Performance data conversion device and performance data conversion program

Abstract

To enable easy conversion of tempo information and sounding time information of performance data.SOLUTION: A performance data conversion device is provided, comprising input means for inputting timing information for each beat of first performance data according to manipulation by an operator, and conversion means for converting the first performance data into second performance data according to the timing information of each beat, where the conversion means derives tempo information of each beat of the second performance data and sounding time information of each musical tone of the second performance data on the basis of the timing information of each beat, tempo information of the first performance data, and sounding time information of each musical tone of the first performance data.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to a performance data conversion device and a performance data conversion program. [Background technology]

[0002] Patent Document 1 describes an automatic performance device that automatically plays music data in response to external events. The music data is divided into predetermined sections. During automatic performance, the automatic performance device automatically plays the sections corresponding to the external events in response to the external events, and sets the tempo of the automatic performance based on the interval between the external events.

[0003] Patent Document 2 describes a MIDI data editing device having a means for inputting an audio signal of a musical piece and a means for inputting MIDI data of the musical piece. The MIDI data editing device further has a means for detecting beat positions from the input audio signal, and a means for generating tempo data of the musical piece from the detected beat positions of the musical piece and adding the tempo data to the input MIDI data. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2003-15647 [Patent Document 2] Japanese Patent Application Publication No. 7-295560 Summary of the Invention [Problem to be solved by the invention]

[0005] When a performer plays a MIDI keyboard live, the MIDI keyboard can record the performance information in real time and generate performance data. For songs with a constant rhythm, such as J-POP, the performer plays and records in time with the metronome sound of the MIDI keyboard. When the MIDI keyboard plays back this performance data, it is played back in sync with the metronome sound.

[0006] In contrast, for classical music and other pieces with free rhythms, performers often play and record without using the metronome sound of a MIDI keyboard. When the MIDI keyboard plays back this performance data, the performance data is not synchronized with the metronome sound. To synchronize the performance data with the metronome sound, performers must manually edit the performance data. This editing process is extremely tedious, time-consuming, and labor-intensive.

[0007] An object of the present invention is to enable easy conversion of tempo information and onset time information of performance data. [Means for solving the problem]

[0008] The performance data conversion device has an input means for inputting timing information for each beat of first performance data based on an operation by an operator, and a conversion means for converting the first performance data into second performance data based on the timing information for each beat, wherein the conversion means calculates tempo information for each beat of the second performance data and onset time information of each musical note of the second performance data based on the timing information for each beat, tempo information of the first performance data, and onset time information of each musical note of the first performance data. [Effects of the Invention]

[0009] According to the present invention, tempo information and onset time information of performance data can be easily converted. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 1 is a block diagram showing an example of the hardware configuration of a performance data conversion device. [Figure 2] FIG. 2 is a block diagram showing an example of the functional configuration of the performance data conversion device. [Figure 3] FIG. 3 is a diagram showing an example of a piano roll display. [Figure 4] FIG. 4 is a diagram showing an example of a display of the timing information window. [Figure 5] FIG. 5 is a diagram showing an example of performance data before conversion. [Figure 6] FIG. 6 is a diagram showing an example of a piano roll display corresponding to performance data before conversion. [Figure 7] FIG. 7 is a diagram showing an example of the display of the piano roll after timing information has been input. [Figure 8] FIG. 8 is a diagram illustrating an example of timing information. [Figure 9] FIG. 9 is a diagram showing an example of performance data after conversion. [Figure 10] FIG. 10 is a diagram showing an example of a piano roll display corresponding to the converted performance data. [Figure 11] FIG. 11 is a diagram showing an example of musical score data corresponding to performance data before conversion. [Figure 12] FIG. 12 is a diagram showing an example of musical score data corresponding to the converted performance data. DETAILED DESCRIPTION OF THE INVENTION

[0011] 1 is a block diagram showing an example of the hardware configuration of a performance data conversion device 100 according to this embodiment. The hardware of the performance data conversion device 100 is, for example, a general-purpose information processing device such as a tablet, a smartphone, or a personal computer.

[0012] The performance data conversion device 100 has a CPU 102, a ROM 103, a RAM 104, a display device 105, a touch panel 107, a sound source unit 108, a communication interface 109, a VRAM 110, a scan circuit 112, a bus 113, a sound system 114, and an external device 115. The display device 105 is, for example, a liquid crystal display, and is connected to the bus 113 via the VRAM 110. The touch panel 107 is provided on the display device 105, and is connected to the bus 113 via the scan circuit 112. Note that a mouse and a keyboard may be provided instead of the touch panel 107.

[0013] A user can give instructions by touching the touch panel 107. The scan circuit 112 detects the position (coordinates) of the touch operation on the touch panel 107, and outputs a detection signal to the CPU 102 via the bus 113. The CPU 102 can detect touch operations, tap operations, double tap operations, etc. on the touch panel 107.

[0014] The external device 115 is, for example, an external storage device, an external computer, a printer, or a MIDI keyboard instrument. The external storage device is, for example, a hard disk, a CD-ROM, an MO disk, a DVD, or a memory card. The communication interface 109 is an interface connected to a communication network such as a USB, a LAN, a wireless communication network, the Internet, or a telephone line, or a MIDI network, and is connected to the external device 115. The performance data conversion device 100 can input performance data from the external device 115 via the communication interface 109 and display the performance data on the display device 105 via the VRAM 110.

[0015] The MIDI keyboard instrument is connected to the bus 113 via, for example, a Bluetooth or USB communication interface 109. The MIDI keyboard instrument outputs key-press information and key-release information in response to key press operations by the operator. The key-press information includes the key number of the pressed key, the time of key press, and the key press strength.

[0016] The CPU 102 loads a program stored on the hard disk of the external device 115 into the RAM 104 and executes the program loaded into the RAM 104, thereby controlling the entire performance data conversion device 100. The hard disk of the external device 115 stores the performance data conversion program and performance data executed by the CPU 102. The RAM 104 temporarily stores information used in processing by the CPU 102.

[0017] The display device 105 is, for example, a liquid crystal display, and displays performance data and the like.

[0018] The sound source unit 108 includes software as a sound source and a DSP for adding effects, and generates sound signals for generating musical tones corresponding to the performance data. The sound source unit 108 outputs sound signals to the sound system 114 based on the performance data. The performance data includes tempo information, beat information, and multiple note data. The note data includes a note number, a step time, a gate time, and a velocity. The note number represents the pitch. The step time indicates the start time of a sound relative to the beginning of the song. The gate time represents the duration of the sound. The end time of a sound is the sum of the step time and the gate time. The velocity represents the strength of the sound. Furthermore, when the metronome mode is set to on, the sound source unit 108 outputs a metronome sound signal based on the tempo information and beat information of the performance data to the sound system 114. The sound system 114 includes a D / A converter, an amplifier, and a speaker, and can generate musical sounds corresponding to the performance data based on the sound signals generated by the sound source unit 108.

[0019] 2 is a block diagram showing an example of the functional configuration of the performance data converting device 100. The performance data converting device 100 has an input unit 201, a conversion unit 202, a playback unit 203, and a display control unit 204. The performance data converting device 100 realizes the functions of the input unit 201, the conversion unit 202, the playback unit 203, and the display control unit 204 by the CPU 102 executing a performance data conversion program.

[0020] When a performer plays a MIDI keyboard instrument live, the performance data conversion device 100 records the performance information of the MIDI keyboard instrument in real time, generates performance data, and stores the performance data in an external storage device. In the case of classical music or other pieces with free rhythms, the performer plays and records without using the metronome sound of the performance data conversion device 100. When the performance data conversion device 100 plays back this performance data, the performance data is played back asynchronously with the metronome sound. The following describes how the performance data conversion device 100 converts performance data that is not synchronized with the metronome sound into performance data that can be played back in synchronization with the metronome sound. The performance data before conversion, which is not synchronized with the metronome sound, is stored in the external storage device.

[0021] The CPU 102 selects a song in response to the operator's operation of the touch panel 107, reads out performance data corresponding to the selected song from an external storage device, and displays figures of each musical note in the performance data on the display device 105 as a piano roll as shown in Figure 3.

[0022] 3 is a diagram showing an example of a piano roll display according to this embodiment. The CPU 102 reads out performance data stored in an external storage device, and controls the display device 105 to display the piano roll shown in FIG. 3 corresponding to the performance data.

[0023] In the piano roll of FIG. 3, the vertical direction of the display screen represents the time axis of the performance data, and the horizontal direction of the display screen represents the pitch of the keyboard instrument. Each musical note in the performance data is represented by a rectangular shape. The bottom side of the rectangular shape of the musical note indicates the sounding start time, and the top side indicates the sounding end time. The playback position 301 of the performance data is the song pointer, indicated by the horizontal line in the center. In response to the operator's operation of the touch panel 107, the CPU 102 advances the elapsed playback time of the performance data, and scrolls the display so that the rectangular shape of each musical note moves from top to bottom. When the bottom side of the rectangular shape of the musical note passes the playback position 301, the musical note begins to be played. When the top side of the rectangular shape of the musical note passes the playback position 301, the musical note ends to be played. The performance data is played by tapping the playback start button 322 in FIG. 3.

[0024] Touch panel 107 is provided on display device 105 that displays the piano roll of Fig. 3. The operator can operate touch panel 107 on the piano roll of Fig. 3. When a swipe operation is performed up or down on touch panel 107, CPU 102 scrolls the piano roll of Fig. 3 up or down. When a pinch operation is performed up or down on touch panel 107, CPU 102 zooms the piano roll of Fig. 3 in the time axis direction.

[0025] 3 is tapped, CPU 102 displays tap area 305 and inputs and displays timing information 302 to 304 based on the tap operation in tap area 305. If tap input mode button 318 in Fig. 3 is not tapped, CPU 102 inputs and displays timing information 302 to 304 based on the key depression operation on a MIDI keyboard instrument. The following explanation takes tap operation in tap area 305 as an example, but the same applies when the key depression operation on a MIDI keyboard instrument is performed instead of operating tap area 305. The operator inputs timing information 302 to 304 at the beginning of each beat or each bar of the performance data, and specifies the timing of each beat or each bar.

[0026] In the real-time input mode, the CPU 102 starts playing back performance data in response to a tap operation in the tap area 305, scrolls the piano roll of Fig. 3 as the playback time elapses, and inputs and displays timing information 302 to 304 at a position based on the playback position 301 in response to a tap operation in the tap area 305. The timing information 302 to 304 is already input information because it is located below the playback position 301.

[0027] In the step input mode, the CPU 102 does not play back the performance data, but instead scrolls the piano roll of FIG. 3 based on the operator's swipe operation, and inputs and displays timing information 302 to 304 at a position based on the playback position 301 in response to a tap operation in the tap area 305.

[0028] The CPU 102 switches between grid on and grid off by tapping the grid mode button 314 in Fig. 3. In the grid off mode, when the tap area 305 is tapped, the CPU 102 inputs and displays timing information at the time of the playback position 301. In the grid on mode, when the tap area 305 is tapped, the CPU 102 inputs and displays timing information at the sounding start time of the rectangular shape of the musical tone closest to the playback position 301.

[0029] If timing information already exists within a predetermined time from the input time, the CPU 102 does not add timing information. The CPU 102 inputs timing information 302 to 304 at the beginning of each beat or measure of the music piece from the beginning to the end of the performance data in response to a tap operation on the tap area 305.

[0030] For music that is not synchronized with the metronome sound, it is easier to align the timing information 302-304 by inputting the timing information 302-304 using real-time input with a slower playback speed or by step input. By real-time input, the timing information 302-304 may be tap-input while the performance data is automatically played back, or by step input, the timing information 302-304 may be tap-input while manually scrolling forward or backward in time. The CPU 102 displays the input timing information as a horizontal line graphic at a position corresponding to the time of playback position 301 or the sounding start time of the musical tone closest to playback position 301.

[0031] The timing information 302 having the time closest to the playback position 301 is selected and displayed in a color different from the other timing information 303 to 304. In the step input mode, the time of the selected timing information 302 can be changed in response to an operation by the operator.

[0032] 3 is tapped, CPU 102 moves selected timing information 302 to the sounding start time of the rectangular shape of the musical tone closest to playback position 301. When grid off, if direct move button 311 in FIG. 3 is tapped, CPU 102 moves selected timing information 302 to the time of playback position 301.

[0033] In grid on mode, when the move forward button 313 in Fig. 3 is tapped, the CPU 102 moves the selected timing information 302 to the sounding start time of the rectangular shape of the musical tone immediately before the time of the selected timing information 302. In grid off mode, when the move forward button 313 in Fig. 3 is tapped, the CPU 102 moves the selected timing information 302 to the previous time by a predetermined time.

[0034] In grid-on mode, when the next move button 312 in Fig. 3 is tapped, the CPU 102 moves the selected timing information 302 to the sounding start time of the rectangular figure of the musical tone immediately following the time of the selected timing information 302. In grid-off mode, when the next move button 312 in Fig. 3 is tapped, the CPU 102 moves the selected timing information 302 to a time a predetermined time later. In either case of the above movement, if timing information already exists within a predetermined time from the destination time, the timing information is not moved. This prevents the timing information from becoming crowded.

[0035] When the delete button 315 in FIG. 3 is tapped, the CPU 102 deletes the timing information 302 in the selected state.

[0036] CPU 102 outlines rectangular figure 306 of the musical tone whose sounding start time is closest to playback position 301. CPU 102 also displays a black circle on the rectangular figure of the musical tone whose sounding start time is the same as the time of selected timing information 302. This allows the operator to easily specify the destination time when the time of selected timing information 302 is inappropriate.

[0037] First, the operator can input timing information at the beginning of each measure of a song in real-time input mode. Then, the operator can issue a command to automatically insert timing information at beat positions within the measure in step input mode. The CPU 102 sets batch division on or batch division off in response to the operation of the setting button 324.

[0038] When the split-in-two button 316 in Fig. 3 is tapped while the batch split is on, the CPU 102 divides the time between all adjacent timing information equally into two and inserts timing information into the two divided times. When the split-in-two button 316 in Fig. 3 is tapped while the batch split is off, the CPU 102 divides the time between the selected timing information 302 and the next timing information equally into two and inserts timing information into the two divided times.

[0039] When the split-by-three button 317 in Fig. 3 is tapped while the batch division is on, the CPU 102 divides the time between all adjacent timing information equally into thirds and inserts timing information into the third divided times. When the split-by-three button 317 in Fig. 3 is tapped while the batch division is off, the CPU 102 divides the time between the selected timing information 302 and the next timing information equally into thirds and inserts timing information into the third divided times.

[0040] The CPU 102 can switch between timing information display on and timing information display off in response to a tap operation on the timing information display button 323 in Fig. 3. When the timing information display is on, the CPU 102 displays the timing information window in Fig. 4. When the timing information display is off, the CPU 102 does not display the timing information window in Fig. 4.

[0041] Fig. 4 is a diagram showing an example of the display of a timing information window. The CPU 102 displays the contents of the timing information 302 in the selected state of Fig. 3 in the timing information window of Fig. 4. Each of the timing information 302 to 304 has a tempo 401, a velocity 402, and a time signature 405. The playback speed 403 and metronome sound volume 404 in Fig. 4 are setting values ​​related to playback that are not related to the timing information, but are conveniently placed in the timing information window so that they can be quickly operated as needed.

[0042] The performance data has a tempo 401, a velocity 402, and a time signature 405. The tempo 401 and the time signature 405 are set, for example, at the beginning of the performance data and when they change. The velocity 402 is set for each note data in the performance data.

[0043] Timing information 302 of the selected information is the timing information that is closest to playback position 301 among timing information 302 to 304. When playback position 301 moves, the timing information of the selected state is switched to the timing information of the new selected information. Then, the display in the timing information window in Fig. 4 is switched to the timing information of the new selected state.

[0044] The timing information window in Fig. 4 displays the tempo 401, velocity 402, and time signature 405 included in the selected timing information 302. If there are multiple velocities of note data between the current timing information and the next timing information, the timing information window in Fig. 4 displays the velocity of the first note data among the multiple note data as the velocity 402. In this case, the timing information window in Fig. 4 may display the average value of the velocities of the multiple note data as the velocity 402.

[0045] The CPU 102 can change the tempo 401, velocity 402, playback speed 403, metronome sound volume 404, and time signature 405 in the timing information window of FIG. 4 in response to an operator's operation on the touch panel 107.

[0046] The tempo 401 is, for example, 125, and can be changed by operating the slider, the + button, or the - button. The velocity 402 is, for example, 69, and can be changed by operating the slider, the + button, or the - button. The playback speed 403 can be changed by operating the slider. The metronome sound volume 404 can be changed by operating the slider. The time signature 405 is, for example, 3 / 4, and the numerator and denominator can be changed by operating the + button or the - button, respectively.

[0047] FIG. 5 shows an example of performance data before conversion. The performance data in FIG. 5 was recorded while playing at a free rhythm, ignoring the metronome. The performance data in FIG. 5 has, for each note data, a musical note pitch (note number) KN, a musical note sounding start time t1, a musical note sounding end time t2, and a tempo T1. The performance data in FIG. 5 is performance data generated, for example, with a tempo T1 of 120, a time base of 480, and a beat of 4 / 4. Here, the time base is a time unit equivalent to the length of a quarter note.

[0048] Fig. 6 is a diagram showing an example of a piano roll display corresponding to the performance data before conversion in Fig. 5. The CPU 102 displays the piano roll in Fig. 6 based on the performance data before conversion in Fig. 5. The piano roll in Fig. 6 includes a playback position 301 and timing information 601. The timing information 601 was automatically generated by the CPU 102 based on the 4 / 4 time signature and the time base of 480 when the performance data in Fig. 5 was read.

[0049] The sounding start time t1 is the step time of the note data, and indicates the bottom side of the rectangular shape of the musical sound in Fig. 6. The sounding end time t2 is the sum of the step time and gate time of the note data, and indicates the top side of the rectangular shape of the musical sound in Fig. 6.

[0050] When the CPU 102 plays back the performance data of Fig. 5, the metronome sound is generated at each time (playback times 0, 480, 960, 1440, ...) of the timing information 601. However, the playback times of the metronome sound are not synchronized with the sound generation start time t1 in Fig. 5. In the case of such performance data that is not synchronized with the metronome sound, the timing information 601 can be reset by tapping the reset button (trash can icon) 319 in Fig. 6. When resetting, all of the timing information 601 except for the first part at time = 0 is deleted.

[0051] 7 is a diagram showing an example of the piano roll display after resetting the timing information 601 of the performance data in Fig. 6 and then inputting new timing information 701 by tapping the tap area 305. The CPU 102 inputs the timing information 701 in response to an operation on the touch panel 107 by the operator, and displays the timing information 701 on the piano roll in Fig. 7.

[0052] Fig. 8 is a diagram showing an example of the timing information 701 in Fig. 7. Here, the time signature 405 in Fig. 4 is set to 3 / 4. The tap index indicates the identification number of the tap operation in the tap area 305 in Fig. 3. The bar index indicates the bar number of the 3 / 4 time signature. The beat index indicates the beat number within each bar of the 3 / 4 time signature.

[0053] First, while playing back the performance data of Fig. 5 through real-time input, the CPU 102 inputs timing information for input time 801 corresponding to the sounding start time of each musical tone in response to tap operations in the tap area 305 with the grid on setting. With the grid on, the input time 801 becomes the same as the sounding start time t1 in Fig. 5. Note that the value of the timing information for a tap index of 0 is fixed, and no tap input is required.

[0054] 5, the musical tone whose sounding start time t1 is "2127" and whose sounding end time t2 is "3063" has a length of two beats, so timing information needs to be added to the position where these two beats are divided in half. Similarly, the musical tone whose sounding start time t1 is "5391" and whose sounding end time t2 is "6745" has a length of two beats, so timing information needs to be added to the position where these two beats are divided in half.

[0055] 3, CPU 102 inputs timing information for insertion time 802 by step input in response to a tap operation on split-by-two button 316. Specifically, CPU 102 moves playback position 301 in response to an operation on touch panel 107, and selects timing information for a musical tone whose sound generation start time t1 is "2127." After that, CPU 102 equally divides the time between the selected timing information and the next timing information into two in response to a tap operation on split-by-two button 316, and inserts timing information for insertion time 802 of "2688" into the divided time.

[0056] Similarly, CPU 102 moves playback position 301 in response to an operation on touch panel 107, and selects timing information for a musical tone whose sound generation start time t1 is "5391." Thereafter, CPU 102 equally divides the time between the selected timing information and the next timing information into two in response to a tap on split button 316, and inserts timing information whose insertion time 802 is "6139" into the divided time. Timing information 701 in Fig. 7 includes timing information for input time 801 and timing information for insertion time 802, and indicates the timing of each beat of the performance data.

[0057] After the timing information of FIG. 8 is input, when the conversion button in button 321 of FIG. 3 is tapped, CPU 102 generates the converted performance data of FIG. 9 based on the pre-conversion performance data of FIG. 5 and the timing information of FIG. 8, and displays the piano roll of FIG. 10.

[0058] Fig. 9 is a diagram showing an example of performance data after conversion. Fig. 10 is a diagram showing an example of a piano roll display corresponding to the performance data after conversion in Fig. 9. The piano roll in Fig. 10 includes a playback position 301 and beat information 1001. The beat information 1001 is displayed as the timing of each beat of the time signature (e.g., 3 / 4 time signature) of the performance data after conversion.

[0059] Time t11 corresponds to input time 801 and insertion time 802 in Figure 8. Conversion time t12 indicates the start time of each beat of the time signature (3 / 4 time) of the changed performance data. The performance data in Figure 9 has, for each beat, a converted tempo T2, a musical tone pitch KN, a musical tone sounding start time t21, and a musical tone sounding end time t22.

[0060] First, the CPU 102 calculates the converted tempo T2 for each beat based on the pre-conversion tempo T1 in Fig. 5, the interval between conversion times t12, and the interval between times t11, as shown in the following equation (1). For example, the following shows how to calculate the converted tempo T2 (=102.7) for a beat with a tap index of "1."

[0061] T2 = T1 × (t12 interval) ÷ ​​(t11 interval) =120×(960-480)÷(1078-517) =102.7 (1)

[0062] As described above, the conversion unit 202 calculates tempo information T2 for each beat of the converted performance data based on the difference between the timing information t11 of two adjacent beats, the beat time information of the converted performance data (the interval between the conversion times t12), and the tempo information T1 for each beat of the performance data before conversion.

[0063] Next, the CPU 102 calculates the converted sound production start time t21 for each beat based on the conversion time t12, time t11, the pre-conversion sound production start time t1 in Fig. 5, the pre-conversion tempo T1 in Fig. 5, and the post-conversion tempo T2, as shown in the following equation (2). For example, the following shows how to calculate the converted sound production start time t21 (=480) for a beat with a tap index of "1."

[0064] t21=t12+(t1-t11)×(T2÷T1) =480+(517-517)×(102.7÷120) =480 (2)

[0065] As described above, the conversion unit 202 calculates sounding start time information t21 of each musical tone in the converted performance data based on the timing information t11 of each beat, the sounding start time t1 of each musical tone in the performance data before conversion, the beat duration information t12 of the converted performance data, the tempo information T1 of each beat in the performance data before conversion, and the tempo information T2 of each beat in the converted performance data.

[0066] Next, the CPU 102 calculates the converted sound production end time t22 for each beat based on the conversion time t12, time t11, the pre-conversion sound production end time t2 in Fig. 5, the pre-conversion tempo T1 in Fig. 5, and the post-conversion tempo T2, as shown in the following equation (3). For example, the following shows a method for calculating the post-conversion sound production end time t22 (=800) for a beat with a tap index of "1".

[0067] t22=t12+(t2-t11)×(T2÷T1) =480+(891-517)×(102.7÷120) =800 (3)

[0068] As described above, the conversion unit 202 calculates the sounding end time information t22 of each musical tone in the converted performance data based on the timing information t11 of each beat, the sounding end time t2 of each musical tone in the performance data before conversion, the beat duration information t12 of the converted performance data, the tempo information T1 of each beat in the performance data before conversion, and the tempo information T2 of each beat in the converted performance data.

[0069] Thereafter, the CPU 102 generates converted performance data based on the converted tempo T2, the converted sounding start time t21, and the converted sounding end time t22. The CPU 102 can then play back the converted performance data. The sounding timing of the converted performance data during playback is exactly the same as the sounding timing of the performance data before conversion during playback. The converted performance data is then played back in perfect synchronization with the metronome sound.

[0070] Fig. 11 is a diagram showing an example of musical score data corresponding to pre-conversion performance data. In response to an operator's operation on the touch panel 107, the CPU 102 can convert the pre-conversion performance data into the pre-conversion musical score data shown in Fig. 11. In the musical score data shown in Fig. 11, the notes are not synchronized with the bars and beats, and do not look good.

[0071] Fig. 12 is a diagram showing an example of musical score data corresponding to the converted performance data. In response to an operator's operation on the touch panel 107, the CPU 102 can convert the converted performance data into the musical score data before conversion shown in Fig. 12. In the musical score data of Fig. 12, the notes are synchronized with the bars and beats, which makes it look better.

[0072] In this way, the performance data converting device 100 converts the performance data so that it is synchronized with the metronome sound, and can easily generate visually appealing musical score data from the converted performance data.

[0073] As described above, the CPU 102 can input timing information corresponding to the beats of a piece of music while playing back performance data that is not synchronized with the metronome sound. The CPU 102 can input timing information in real time in response to operation of the tap area 305 or a MIDI keyboard instrument. The operator plays back the performance data and inputs timing information by operating the tap area 305 or a MIDI keyboard instrument while listening to it. The tap area 305 is the tap area of ​​a tablet, smartphone, or touch panel of a personal computer.

[0074] The timing information contains time information corresponding to the performance data as the timing of taps in the tap area 305. The timing of the taps should be synchronized with the beats or the beginning of the bars of the music. The operator can tap in time with each beat, or just at the beginning of each bar. In this way, the operator inputs timing information from the beginning to the end of the performance data. Input can be done not only in real time, but also in step input.

[0075] 3 and scrolls along the time axis to advance or rewind the time of the performance data. CPU 102 displays rectangular shapes (musical note marks) of musical tones corresponding to the note data on the piano roll. While looking at the musical note marks, the operator can check the sounds being produced as the musical note marks pass through playback position 301 on the piano roll and input timing information.

[0076] The timing information closest to the playback position 301 in the piano roll scroll position is automatically selected. Selected timing information can be deleted or moved. With grid on, the timing information is set to the same timing as the sound start time of the rectangular shape of the musical sound whose sound start time is closest to the playback position 301 among multiple rectangular shapes of musical sounds. With real-time input, there is a high possibility that the timing of tap operations will be off, so grid on is effective.

[0077] The CPU 102 can move timing information in response to a tap operation on the direct move button 311, the next move button 312, or the previous move button 313 in Fig. 3. The CPU 102 can also equally divide the time between adjacent timing information and insert new timing information at the divided time in response to a tap operation on the two-division button 316 or the three-division button 317 in Fig. 3. This allows the operator to easily add beat-by-beat timing information to timing information that is only bar-by-bar.

[0078] The timing information has the beat 405 in Figure 4. The CPU 102 can set the beat at the beginning of the performance data and an irregular beat within the timing information. First, for each piece of timing information, the CPU 102 calculates the post-conversion tempo T2 based on the pre-conversion tempo T1. Next, the CPU 102 calculates the post-conversion sounding start time t21 and the post-conversion sounding end time t22 based on the post-conversion tempo T2. Next, the CPU 102 generates post-conversion performance data based on the post-conversion tempo T2, the sounding start time t21, and the sounding end time t22.

[0079] As described above, the input unit 201 inputs timing information for each beat of the pre-conversion performance data based on the operation of the operator. The conversion unit 202 converts the pre-conversion performance data into post-conversion performance data based on the timing information for each beat. The conversion unit 202 calculates tempo information T2 for each beat of the post-conversion performance data and onset time information t21 and t22 of each musical note of the post-conversion performance data based on the timing information for each beat, tempo information T1 of the pre-conversion performance data, and onset time information t1 and t2 of each musical note of the pre-conversion performance data.

[0080] The conversion unit 202 calculates tempo information T2 for each beat of the converted performance data based on the timing information for each beat and tempo information T1 of the performance data before conversion, as shown in equation (1). Specifically, the conversion unit 202 calculates tempo information T2 for each beat of the converted performance data based on the difference between the timing information t11 of two adjacent beats, the beat time information of the converted performance data (the interval between conversion times t12), and the tempo information T1 for each beat of the performance data before conversion.

[0081] Furthermore, the conversion unit 202 calculates sounding start time information t21 of each musical tone in the converted performance data based on the timing information of each beat and sounding start time information t1 of each musical tone in the performance data before conversion, as in equation (2). Specifically, the conversion unit 202 calculates sounding start time information t21 of each musical tone in the converted performance data based on the timing information t11 of each beat, the sounding start time information t1 of each musical tone in the performance data before conversion, beat time information t12 of the converted performance data, tempo information T1 of each beat in the performance data before conversion, and tempo information T2 of each beat in the converted performance data.

[0082] In addition, the conversion unit 202 calculates the sounding end time information t22 of each musical tone of the converted performance data based on the tempo information T1 of each beat of the performance data before conversion, the tempo information T2 of each beat of the performance data after conversion, and the sounding end time information t2 of each musical tone of the performance data before conversion, as shown in equation (3).

[0083] If the sounding start time information t21 of each beat of the musical tone of the converted performance data in Figure 9 is earlier than the sounding start time information t1 of each beat of the musical tone of the pre-conversion performance data in Figure 5, the tempo information T2 of each beat of the converted performance data in Figure 9 will be slower than the tempo information T1 of each beat of the pre-conversion performance data in Figure 5.

[0084] If the musical tone start time information t21 of each beat of the converted performance data in Figure 9 is later than the musical tone start time information t1 of each beat of the pre-conversion performance data in Figure 5, the tempo information T2 of each beat of the converted performance data in Figure 9 will be faster than the tempo information T1 of each beat of the pre-conversion performance data in Figure 5.

[0085] The playback unit 203 plays back the performance data before or after conversion. The sound generation timing of the performance data before and after conversion played back by the playback unit 203 is the same as that of the performance data after conversion.

[0086] When playback of pre-conversion performance data is instructed with playback of metronome sound set, a playback unit 203 plays back a metronome sound not synchronized with the pre-conversion performance data based on tempo information T1 of the pre-conversion performance data and beat information 405 of the pre-conversion performance data.

[0087] Furthermore, when playback of the converted performance data is instructed while playback of the metronome sound is set, the playback unit 203 plays a metronome sound synchronized with the converted performance data based on the tempo information T2 for each beat of the converted performance data and the beat information 405 of the converted performance data.

[0088] In the real-time input mode, while the playback unit 203 is playing back the performance data before conversion, the input unit 201 inputs timing information based on the time of the playback position 301. In the grid-on mode, while the playback unit 203 is playing back the performance data before conversion, the input unit 201 inputs timing information so that the timing information matches the sounding start time information of the musical tone just before or just after the time of the playback position 301.

[0089] In step input mode, the input unit 201 inputs timing information based on the time specified by the operator's operation while the pre-conversion performance data is not being played back by the playback unit 203. In grid-on mode, the input unit 201 inputs timing information so that the timing information matches the sounding start time information of the musical tone immediately before or immediately after the time specified by the operator's operation while the pre-conversion performance data is not being played back by the playback unit 203.

[0090] The input unit 201 inputs timing information of a portion of the beats of the pre-conversion performance data based on the operator's operation of the tap area 305, and inputs timing information of the remaining beats of the pre-conversion performance data by equally dividing the intervals of the timing information of the portion of the beats of the pre-conversion performance data based on the operator's operation of the two-part button 316.

[0091] The display control unit 204 controls the display so that rectangular shapes indicating the onset times of each musical tone in the performance data before conversion and horizontal line shapes indicating the timing information 302 to 304 are displayed along the time axis. The display control unit 204 also controls the display so that the playback position 301 of the first performance data is displayed.

[0092] The input unit 201 inputs timing information based on the playback position 301 of the displayed pre-conversion performance data. In grid-on mode, the input unit 201 inputs timing information so that it matches the sounding start time information of the musical note immediately before or immediately after the playback position 301 of the displayed pre-conversion performance data. Specifically, the input unit 201 inputs timing information so that it matches the sounding start time information of the musical note closest to the playback position 301 of the displayed pre-conversion performance data. The input unit 201 inputs timing information based on a tap operation on the touch panel 107 or a key depression operation on the keyboard.

[0093] As described above, the performance data conversion device 100 enables anyone to easily and efficiently convert performance data that is not synchronized with the metronome sound into performance data that is synchronized with the metronome sound, while audibly and visually checking the data in real time, minimizing the time and effort required. This has the advantage that the operator no longer needs to worry about synchronizing the performance data with the metronome sound when creating the performance data. Furthermore, the performance data conversion device 100 has the advantage of easily generating visually appealing sheet music data from the converted performance data.

[0094] This embodiment can be realized by a computer executing a program. A computer-readable recording medium on which the above program is recorded and a computer program product such as the above program can also be applied as an embodiment of the present invention. Examples of recording media that can be used include flexible disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, magnetic tapes, non-volatile memory cards, and ROMs.

[0095] It should be noted that the above-described embodiments are merely examples of specific embodiments for carrying out the present invention, and the technical scope of the present invention should not be construed as being limited by these embodiments. In other words, the present invention can be carried out in various forms without departing from its technical concept or main features. [Explanation of symbols]

[0096] 201 Input section 202 Conversion Unit 203 Playback Department 204 Display control unit

Claims

1. an input means for inputting timing information for each beat of the first performance data based on an operation by an operator; a conversion means for converting the first performance data into second performance data based on the timing information of each beat, the conversion means calculates tempo information for each beat of the second performance data and onset time information of each musical tone of the second performance data based on the timing information for each beat, tempo information of the first performance data, and onset time information of each musical tone of the first performance data.

2. The conversion means calculating tempo information for each beat of the second performance data based on the timing information for each beat and tempo information for the first performance data; calculating sounding start time information of each musical tone of the second performance data based on the timing information of each beat and sounding start time information of each musical tone of the first performance data; 2. The performance data conversion device according to claim 1, wherein the sounding end time information of each musical tone of the second performance data is calculated based on tempo information of each beat of the first performance data, tempo information of each beat of the second performance data, and sounding end time information of each musical tone of the first performance data.

3. 3. The performance data conversion device according to claim 2, wherein the conversion means calculates tempo information for each beat of the second performance data based on a difference in timing information between two adjacent beats, beat time information of the second performance data, and tempo information for each beat of the first performance data.

4. 4. The performance data conversion device according to claim 2, wherein the conversion means calculates the sounding start time information of each musical tone of the second performance data based on the timing information of each beat, the sounding start time information of each musical tone of the first performance data, the beat time information of the second performance data, the tempo information of each beat of the first performance data, and the tempo information of each beat of the second performance data.

5. 4. The performance data conversion device according to claim 2, wherein the conversion means calculates the sounding end time information of each musical tone of the second performance data based on the timing information of each beat, the sounding end time information of each musical tone of the first performance data, the beat time information of the second performance data, the tempo information of each beat of the first performance data, and the tempo information of each beat of the second performance data.

6. 6. The performance data conversion device according to claim 1, further comprising a playback means for playing back the first performance data or the second performance data.

7. 7. The performance data conversion device according to claim 6, wherein the sounding timing of the first performance data and the sounding timing of the second performance data reproduced by the reproduction means are the same.

8. 8. The performance data conversion device according to claim 6, wherein the input means inputs the timing information based on the time of a playback position while the first performance data is being played back by the playback means.

9. The performance data conversion device according to any one of claims 6 to 8, characterized in that the input means, while the first performance data is being reproduced by the reproduction means, inputs the timing information so that it coincides with the sounding start time information of the musical tone immediately before or immediately after the time of the reproduction position.

10. 8. The performance data conversion device according to claim 6, wherein the input means inputs the timing information based on a time designated by an operator's operation while the first performance data is not being reproduced by the reproduction means.

11. 8. The performance data conversion device according to claim 6, wherein the input means inputs the timing information so that the timing information coincides with the sounding start time information of a musical tone immediately before or immediately after the time specified by the operation of the operator while the first performance data is not being reproduced by the reproduction means.

12. The performance data conversion device according to any one of claims 1 to 11, characterized in that the input means inputs timing information of a portion of the beats of the first performance data based on an operation by an operator, and inputs timing information of the remaining beats of the first performance data by equally dividing an interval of the timing information of a portion of the beats of the first performance data based on an operation by the operator.

13. The performance data conversion device according to any one of claims 1 to 12, further comprising display control means for controlling the display of a first graphic indicating the onset time of each musical tone of the first performance data and a second graphic indicating the timing information along a time axis.

14. the display control means controls to display the playback position of the first performance data, 14. The performance data conversion device according to claim 13, wherein said input means inputs said timing information based on a playback position of said displayed first performance data.

15. 15. The performance data conversion device according to claim 14, wherein the input means inputs the timing information so that it matches the sounding start time information of the musical note immediately before or immediately after the playback position of the displayed first performance data.

16. 16. The performance data conversion device according to claim 14, wherein the input means inputs the timing information so that it matches the sounding start time information of the musical tone closest to the playback position of the displayed first performance data.

17. 17. The performance data conversion device according to claim 1, wherein the input means inputs the timing information based on a tap operation on a touch panel or a key depression operation on a keyboard.

18. A performance data conversion program for causing a computer to function as the performance data conversion device according to any one of claims 1 to 17.

Images