Information processing system, information processing method, and program

Abstract

This information processing system comprises: a data acquisition unit 510 that acquires a plurality of pieces of performance data each representing performance of a partial section of music; a performance data classification unit 511 that classifies the plurality of pieces of performance data into a plurality of performance data groups corresponding to different sections of the music; and an editing processing unit 514 that replaces a specific section of music data representing the music with performance data selected from a performance data group corresponding to the specific section among the plurality of performance data groups.

Description

Information processing system, information processing method, and program

[0001] The present disclosure relates to techniques for processing data representing music pieces.

[0002] Various techniques for processing performance data representing a musical instrument performance by a performer have been proposed. For example, Patent Document 1 discloses a technique for generating a musical score in response to the operation of an instrument such as a keyboard instrument, and editing the musical score in response to instructions from a user.

[0003] Patent No. 6734186

[0004] In music lessons, for example, the score of a single piece of music may be edited into multiple scores depending on the level of proficiency of each learner. However, the workload of editing a single score to generate multiple scores is extremely heavy. In consideration of the above, one aspect of the present disclosure aims to easily generate multiple score data from a single piece of score data.

[0005] In order to solve the above problems, an information processing system according to one aspect of the present disclosure includes a data acquisition unit that acquires a plurality of performance data representing the performance of a portion of a musical piece, a performance data classification unit that classifies the plurality of performance data into a plurality of performance data groups corresponding to different portions of the musical piece, and an editing processing unit that replaces a specific portion of the musical piece data representing the musical piece with performance data selected from a performance data group corresponding to the specific portion of the plurality of performance data groups.

[0006] An information processing method according to one aspect of the present disclosure acquires a plurality of performance data representing the performance of a portion of a musical piece, classifies the plurality of performance data into a plurality of performance data groups corresponding to different portions of the musical piece, and replaces a specific portion of the musical piece data representing the musical piece with performance data selected from the performance data group corresponding to the specific portion of the plurality of performance data groups.

[0007] A program according to one aspect of the present disclosure causes a computer system to function as a data acquisition unit that acquires multiple performance data representing the performance of a portion of a musical piece, a performance data classification unit that classifies the multiple performance data into multiple performance data groups corresponding to different sections of the musical piece, and an editing processing unit that replaces a specific section of the musical piece data representing the musical piece with performance data selected from a performance data group corresponding to the specific section among the multiple performance data groups.

[0008] 1 is a block diagram illustrating the configuration of an information processing system according to a first embodiment. FIG. 1 is a block diagram illustrating the configuration of a terminal device. FIG. 1 is a block diagram illustrating the configuration of a control system. FIG. 2 is a block diagram illustrating the functional configuration of a control system. FIG. 2 is an explanatory diagram regarding the classification of performance data X. FIG. 3 is a schematic diagram of a performance data list. FIG. 4 is an explanatory diagram of the operation of an edit processing unit editing music data. FIG. 5 is a flowchart of edit processing. FIG. 6 is a block diagram illustrating the functional configuration of a control system according to a second embodiment. FIG. 7 is a block diagram illustrating the functional configuration of a control system according to a third embodiment. FIG. 8 is a flowchart of preprocessing. FIG. 9 is an explanatory diagram of arrangement processing in the third embodiment. FIG. 10 is a schematic diagram of a performance data list in the fourth embodiment. FIG. 11 is a display example in a modified example of the fourth embodiment. FIG. 12 is a block diagram illustrating the configuration of an information processing system according to a fifth embodiment. FIG. 13 is an explanatory diagram of image data. FIG. 14 is a schematic diagram of image data. FIG. 15 is a schematic diagram of an image data list. FIG. 16 is a block diagram illustrating the functional configuration of a control system according to a sixth embodiment. FIG. 17 is an explanatory diagram of the operation of an information setting unit in the sixth embodiment. FIG. 18 is a block diagram illustrating the functional configuration of a control system according to a seventh embodiment. FIG. 19 is an explanatory diagram of the operation of an information setting unit in the seventh embodiment. 13 is a schematic diagram of a performance data list in the eighth embodiment. FIG. 14 is a schematic diagram of an image data list in the eighth embodiment. FIG. 15 is a schematic diagram of image data in the ninth embodiment. FIG. 16 is a display example for logging in when registering multiple instructors.

[0009] A: First Embodiment Fig. 1 is a block diagram illustrating the configuration of an information processing system 100 according to a first embodiment. The information processing system 100 is a computer system for editing a specific piece of music (hereinafter referred to as a "target piece of music"). The information processing system 100 includes a keyboard instrument 10, a terminal device 30, and a control system 50.

[0010] The performer Ua plays the keyboard instrument 10. The performer Ua is, for example, a person who practices playing the keyboard instrument 10. The performer Ua is, for example, a student belonging to a music school. The terminal device 30 is used by the performer Ua or the instructor Ub. The instructor Ub instructs the performer Ua in the music school. In the following description, when there is no need to particularly distinguish between the performer Ua and the instructor Ub, they will simply be referred to as the user U.

[0011] The keyboard instrument 10 is an electronic musical instrument that accepts a performance by a performer Ua. The keyboard instrument 10 is, for example, an electronic musical instrument that conforms to the MIDI (Musical Instrument Digital Interface) standard and has multiple keys corresponding to different pitches. The performer Ua plays a target piece of music by sequentially operating each key. The keyboard instrument 10 not only emits musical tones corresponding to the performance by the performer Ua, but also generates performance data X representing the performance by the performer Ua. Note that the performance data X may also be data representing a performance by an instructor Ub.

[0012] The performance data X is time-series data representing the performance of a section of the target piece of music. The performance data X is, for example, a time-series of event data conforming to the MIDI standard. Specifically, the performance data X specifies the pitch and tone duration for each note of the target piece of music played by the performer Ua. Note that the performance data X representing the keyboard operation and the performance data X representing the pedal operation may be generated separately.

[0013] 2 is a block diagram illustrating an example of the configuration of the terminal device 30. The terminal device 30 is an information device such as a smartphone, a tablet terminal, or a personal computer. The terminal device 30 includes a control device 31, a storage device 32, a communication device 33, a display device 34, and an operation device 35. The terminal device 30 may be realized as a single device or as multiple devices configured separately from each other. Some or all of the functions of the terminal device 30 may be incorporated into the keyboard instrument 10.

[0014] The control device 31 is configured with one or more processors that control each element of the terminal device 30. For example, the control device 31 is configured with one or more types of processors such as a central processing unit (CPU), a graphics processing unit (GPU), a sound processing unit (SPU), a digital signal processor (DSP), a field programmable gate array (FPGA), or an application specific integrated circuit (ASIC).

[0015] The storage device 32 is one or more memories that store programs executed by the control device 31 and various data used by the control device 31. The storage device 32 is configured with a known storage medium such as a magnetic storage medium or a semiconductor storage medium. The storage device 32 may be configured with a combination of multiple types of storage media. Furthermore, a portable storage medium that is detachable from the terminal device 30, or a storage medium (e.g., cloud storage) that the control device 31 can write to or read from via the communication network 200 may be used as the storage device 32.

[0016] The communication device 33 communicates with the keyboard instrument 10 via wireless communication such as Wi-Fi (registered trademark) or Bluetooth (registered trademark). For example, the communication device 33 receives performance data X from the keyboard instrument 10. Note that the communication between the communication device 33 and the keyboard instrument 10 may be wired communication. The communication device 33 also communicates with the control system 50 via a communication network 200 such as the Internet. For example, the communication device 33 transmits the performance data X to the control system 50. Note that the communication path between the communication device 33 and the control system 50 may include a wireless section.

[0017] The display device 34 displays an image under the control of the control device 31. The display device 34 is configured with a display panel such as a liquid crystal panel or an organic EL (Electroluminescence) panel. The operation device 35 is an input device that accepts operations by the user U of the terminal device 30. For example, an operator operated by the user U or a touch panel that detects contact of a touch pen with the display surface is used as the operation device 35. Note that the display device 34 or the operation device 35, which are separate from the terminal device 30, may be connected to the terminal device 30 by wire or wirelessly. Operation data representing instructions from the user U to the operation device 35 is transmitted from the communication device 33 to the control system 50.

[0018] 3 is a block diagram illustrating the configuration of a control system 50. The control system 50 includes a control device 51, a storage device 52, and a communication device 53. The control system 50 may be realized as a single device, or may be realized as a plurality of devices configured separately from each other.

[0019] The control device 51 is composed of one or more processors that control each element of the control system 50. For example, the control device 51 is composed of one or more types of processors such as a CPU, a GPU, an SPU, a DSP, an FPGA, or an ASIC.

[0020] The communication device 53 communicates with the terminal device 30 via the communication network 200. For example, the communication device 53 receives performance data X transmitted from the terminal device 30. When the terminal device 30 logs in to the control system 50, communication between the control system 50 and the terminal device 30 is established. Logging in to the control system 50 requires authentication processing using authentication information such as the user U's identification information Fa (user ID) and a password. The authentication processing may be biometric authentication using the user U's biometric information. Any known technology may be used for the biometric authentication.

[0021] The storage device 52 is one or more memories that store programs executed by the control device 51 and various data used by the control device 51. The storage device 52 is configured with a known storage medium such as a magnetic storage medium or a semiconductor storage medium. The storage device 52 may be configured with a combination of multiple types of storage media. Furthermore, a portable storage medium that is detachable from the control system 50, or a storage medium (e.g., cloud storage) that the control device 51 can write to or read from via the communication network 200 may be used as the storage device 52.

[0022] The storage device 52 of the first embodiment stores music data D1 representing a target piece of music. Specifically, the music data D1 is data specifying a plurality of notes constituting the target piece of music in chronological order. While the performance data X represents a portion of the target piece of music, the music data D1 represents the entire portion of the target piece of music. The music data D1 can also be expressed as data representing the musical score of the target piece of music. For example, data in MusicXML format or MIDI format is exemplified as the music data D1. However, the format of the music data D1 is arbitrary.

[0023] The control system 50 of the first embodiment generates music data D2 by editing music data D1 using performance data X. Note that the terminal device 30 that transmits the performance data X to the control system 50 and the terminal device 30 of the user U to which the edited music data D2 is transmitted are separate devices. Therefore, the user U who performs music using the performance data X may be a different person from the user U to whom the music data D2 is provided. However, the terminal device 30 that transmits the performance data X and the terminal device 30 to which the music data D2 is transmitted may be the same device.

[0024] 4 is a block diagram illustrating an example of the functional configuration of the control system 50. The control device 51 executes a program stored in the storage device 52 to realize multiple functions (a data acquisition unit 510, a performance data classification unit 511, a display control unit 512, a selection acceptance unit 513, an edit processing unit 514, and a data provision unit 515) for generating music data D2 from music data D1.

[0025] The data acquisition unit 510 acquires the performance data X from the terminal device 30. Specifically, the data acquisition unit 510 receives the performance data X transmitted from the terminal device 30 via the communication device 53. Note that the data acquisition unit 510 may also acquire the performance data X directly from the keyboard instrument 10.

[0026] The data acquisition unit 510 repeatedly acquires the performance data X. For example, the data acquisition unit 510 acquires one or more pieces of performance data X from each of the multiple terminal devices 30. Therefore, the data acquisition unit 510 acquires multiple pieces of performance data X. For example, the data acquisition unit 510 acquires multiple pieces of performance data X representing performances by different performers Ua, and multiple pieces of performance data X representing different performances by a single performer Ua. The multiple pieces of performance data X acquired by the data acquisition unit 510 are stored in the storage device 52.

[0027] Each performer Ua independently arranges and performs a section of the target piece of music. Therefore, even if the performance data X corresponds to the performance of a common section of the target piece of music, the note strings (e.g., melodies) represented by the performance data X are different.

[0028] The performance data classification unit 511 classifies the multiple pieces of performance data X acquired by the data acquisition unit 510 into multiple sets (hereinafter referred to as "performance data groups"). The multiple performance data groups correspond to different sections of the target music piece. Of the multiple performance data groups, a performance data group corresponding to a specific section of the target music piece is a set of two or more pieces of performance data X that correspond to that section among the multiple pieces of performance data X.

[0029] 5 is an explanatory diagram of the classification of performance data X by the performance data classification unit 511. The performance data classification unit 511 stores, for each of the multiple performance data X, identification information Fa, music title Fb, time information Fc, performance position Fd, and classification information Fe in the storage device 52.

[0030] The identification information Fa is a code string for identifying the performer Ua (or instructor Ub) who performed the performance represented by the performance data X. The song title Fb is the name of the target song related to the performance represented by the performance data X. The time information Fc is a timestamp indicating the period during which the performance represented by the performance data X was performed (performance period). Specifically, the time information Fc specifies the start time and end time of the performance period. The identification information Fa, song title Fb, and time information Fc are added to the performance data X by, for example, the keyboard instrument 10.

[0031] The performance position Fd is information that specifies a section of the target music piece that corresponds to the performance represented by the performance data X. For example, the performance position Fd specifies a section using a measure number in the target music piece. The performance data classification unit 511 generates the performance position Fd by comparing the performance data X with the music piece data D1. Specifically, the performance position Fd specifies a section of the music piece data D1 that is musically similar to the performance represented by the performance data X. Any known performance analysis technology can be used to estimate the performance position Fd. For example, the technology disclosed in Japanese Patent No. 4399958, Japanese Patent No. 6296221, or Japanese Patent No. 6187132 can be used to estimate the performance position Fd. Note that the performance position Fd may also be expressed, for example, as the elapsed time from the start point of the target music piece.

[0032] The classification information Fe is a code string for identifying each of the multiple performance data groups. Any of the multiple identification information representing different sections of the target song is set as the classification information Fe. For example, a common classification information Fe is assigned to performance data X whose section specified by the performance position Fd overlaps with a specific section of the target song. In other words, two or more performance data X that include a specific section of the target song among the multiple performance data X are classified into a common performance data group.

[0033] 4 causes an image to be displayed on the display device 34 of the terminal device 30. Specifically, the display control unit 512 causes the image to be displayed on the display device 34 of the terminal device 30 by transmitting data representing the image from the communication device 53 to the terminal device 30.

[0034] Specifically, the display control unit 512 displays a performance data list Lx, as shown in FIG. 6, on the display device 34 of the terminal device 30. The performance data list Lx is a list listing multiple performance data X belonging to one performance data group selected from multiple performance data groups. That is, multiple performance data X with common classification information Fe are presented to the user U via the performance data list Lx. Specifically, the display control unit 512 displays multiple performance data X corresponding to a section of the target music piece selected by the user U (hereinafter referred to as the "section to be edited") via the performance data list Lx. That is, multiple performance data X representing performances by different performers Ua are displayed. As described above, the display control unit 512 displays multiple performance data X included in the performance data group on the display device 34. Note that the display control unit 512 may also display multiple performance data X representing performances by a single performer Ua (e.g., the user U himself) on the display device 34.

[0035] Specifically, the performance data list Lx displays time information Fc and a performance position Fd for each of the multiple performance data X belonging to the performance data group. For example, the multiple performance data X are arranged in chronological order of the performance period specified by the time information Fc. In addition, the musical score 60 of the target song is displayed on the display device 34 together with the performance data list Lx.

[0036] The selection receiving unit 513 in Figure 4 receives instructions from the user U of the terminal device 30. Specifically, the selection receiving unit 513 receives operation data transmitted from the terminal device 30 in response to the instructions from the user U via the communication device 53. For example, the user U can select a desired section to be edited for a target song. The selection receiving unit 513 receives the selection of the section to be edited by the user U.

[0037] Furthermore, the user U can select any one of the multiple performance data X displayed in the performance data list Lx by operating the operating device 35 while visually checking the performance data list Lx displayed on the display device 34. The selection accepting unit 513 accepts a selection from the user U of any one of the multiple performance data X displayed in the performance data list Lx. The selection accepting unit 513 may also reproduce the performance sound represented by the performance data X selected by the user U using a sound emitting device (not shown), such as a speaker or earphones. With the above configuration, the user U can visually and audibly confirm the content of the performance data X.

[0038] 7, the edit processing unit 514 replaces the edit target section of the music piece data D1 of the target music piece with performance data X selected from the performance data group corresponding to the edit target section. Specifically, the edit processing unit 514 replaces the edit target section of the music piece data D1 with the performance data X selected by the selection receiving unit 513. By replacing the edit target section with the performance data X, music piece data D2 is generated.

[0039] The data providing unit 515 in FIG. 4 provides the terminal device 30 with the music data D2 processed by the editing processing unit 514. Specifically, the data providing unit 515 transmits the edited music data D2 from the communication device 53 to the terminal device 30 of the user U, on the condition that the user U executes the billing process. The billing process is an electronic settlement process in which the user U pays a predetermined amount of currency to the operator of the control system 50. For example, the billing process is executed by transmitting the user U's payment information to an electronic settlement server. The payment information is, for example, information about the bank account to which the transfer is to be made in the case of a bank transfer, or information about the credit card in the case of a card payment. The user U can use the music data D2 provided by the control system 50, for example, to output (e.g., display or print) the score of the edited target music piece.

[0040] As described above, in the first embodiment, the music data D2 processed by the edit processing unit 514 is provided to the terminal device 30 of the user U who performed the billing process. Therefore, buying and selling of the music data D2 can be effectively promoted.

[0041] If the user U selects performance data X related to his / her own performance, the charge amount in the billing process may be set to free (or a discounted amount). If the user U selects his / her own performance data X, the billing process may be omitted. The fact that the user U has selected his / her own performance data X can be determined, for example, by comparing the identification information Fa used by the user U to log in with the identification information Fa stored in the storage device 52 for the performance data X.

[0042] Furthermore, the display control unit 512 may display information (Fc, Fd) related to the user U's own performance data X and information (Fc, Fd) related to the performance data X of a performer Ua other than the user U in different display modes in the performance data list Lx. For example, the background color of the user U's own performance data X may be different from the background color of the performance data X of the other performer Ua. Note that the display mode refers to the characteristics of an image that can be visually distinguished by the user U. For example, display color, pattern (design), size, or shape are examples of the display mode. The display color is defined by hue (tone), saturation, or brightness (gradation).

[0043] 8 is a flowchart of the process (hereinafter referred to as the "editing process") in which the control device 51 generates music piece data D2 by editing music piece data D1. When the editing process starts, a plurality of pieces of performance data X are stored in the storage device 52 for each of a plurality of sections of the target music piece.

[0044] When the editing process is started, the control device 51 (selection receiving unit 513) receives from the user U a specification of a section to be edited in the target song (Sa1). The control device 51 (display control unit 512) displays, in a performance data list Lx, a plurality of performance data X belonging to one performance data group corresponding to the section to be edited among the plurality of performance data groups (Sa2).

[0045] The control device 51 (selection receiving unit 513) receives a selection from the user U of one of the multiple performance data X in the performance data list Lx (Sa3). The control device 51 (edit processing unit 514) replaces the section to be edited in the music data D1 of the target music piece with the performance data X selected from the group of performance data corresponding to the section to be edited (Sa4).

[0046] The control device 51 determines whether a predetermined termination condition has been met (Sa5). The termination condition may be, for example, an instruction from the user U to end editing of the music piece data D1. If the termination condition has not been met (Sa5: NO), the control device 51 repeats the following steps: accepting the section to be edited (Sa1), displaying the performance data list Lx (Sa2), accepting the selection of the performance data X (Sa3), and editing the music piece data D1 (Sa4). In other words, each of the multiple sections to be edited in the music piece data D1 of the target music piece is replaced with the performance data X.

[0047] On the other hand, if the termination condition is met (Sa5: YES), the control device 51 (data providing unit 515) confirms the edited music data D1 up to this point as music data D2 (Sa6), and transmits the music data D2 from the communication device 53 to the terminal device 30 (Sa7).

[0048] As described above, in the first embodiment, multiple pieces of performance data X representing performances of partial sections of a target song are classified into multiple performance data groups, and a section to be edited in song data D1 of the target song is replaced with performance data X selected from the performance data group corresponding to the section to be edited. This makes it possible to easily generate song data D2 in which different performance data X are applied to each section of song data D1. In particular, in the first embodiment, the user U's desired performance data X is selected from the multiple pieces of performance data X displayed in the performance data list Lx. This makes it possible to generate song data D2 that matches the user U's intentions or preferences.

[0049] B: Second Embodiment A second embodiment will be described. Note that, for elements in the following exemplary aspects that have the same functions as those in the first embodiment, the same reference numerals as those in the first embodiment will be used, and detailed descriptions of each element will be omitted as appropriate.

[0050] 9 is a block diagram illustrating the functional configuration of a control system 50 according to the second embodiment. A control device 51 according to the second embodiment executes a program stored in a storage device 52, thereby functioning as a data converter 516 in addition to the same elements as those in the first embodiment (a data acquisition unit 510, a performance data classification unit 511, a display control unit 512, a selection acceptance unit 513, an edit processing unit 514, and a data provision unit 515).

[0051] The storage device 52 of the second embodiment stores musical score data G1 representing an image of the musical score of a target piece of music. The musical score data G1 is data in any format, such as PDF (Portable Document Format) or JPEG (Joint Photographic Experts Group) format. The data conversion unit 516 converts the musical score data G1 to generate music data D1. The editing processing unit 514 edits the music data D1 converted by the data conversion unit 516 to generate music data D2.

[0052] Any known technique may be used to convert the musical score data G1 into the music data D1. For example, the techniques disclosed in Japanese Patent No. 5770445, Japanese Patent No. 5765848, or Japanese Patent No. 6746892 may be used to convert the musical score data G1.

[0053] The configuration and operation of the second embodiment are the same as those of the first embodiment, except for the data conversion unit 516. Therefore, the second embodiment also achieves the same effects as those of the first embodiment. Furthermore, in the second embodiment, musical score data G1 representing the musical score of the target song is converted into song data D1. Therefore, even in an environment where only musical score data G1 of the target song exists, song data D2 can be easily generated by editing song data D1 to which performance data X has been applied.

[0054] C: Third Embodiment Fig. 10 is a block diagram illustrating an example of the functional configuration of a control system 50 according to the third embodiment. A control device 51 according to the third embodiment executes a program stored in a storage device 52, thereby functioning as a preprocessing unit 517 in addition to the same elements as those in the first embodiment (a data acquisition unit 510, a performance data classification unit 511, a display control unit 512, a selection acceptance unit 513, an edit processing unit 514, and a data provision unit 515).

[0055] The preprocessing unit 517 performs predetermined processing (hereinafter referred to as "preprocessing") on the music data D1. The editing unit 514 applies performance data X to the preprocessed music data D1 to edit the music data D1, thereby generating music data D2.

[0056] 11 is a flowchart of the pre-processing executed by the pre-processing unit 517. The pre-processing unit 517 executes an extraction process Sb1, an adjustment process Sb2, and an arrangement process Sb3. The order in which the extraction process Sb1, the adjustment process Sb2, and the arrangement process Sb3 are executed may be changed as desired. Also, some of the extraction process Sb1, the adjustment process Sb2, and the arrangement process Sb3 may be omitted. Also, other processes may be added to the pre-processing.

[0057] The target piece of music represented by the music data D1 is an ensemble piece composed of multiple performance parts. The extraction process Sb1 is a process for extracting a portion corresponding to a specific performance part from among the multiple performance parts that make up the target piece of music. For example, a performance part selected by the user U by operating the operation device 35, or a performance part corresponding to the main melody of the target piece of music, is extracted from the music data D1. For example, publicly known techniques such as those disclosed in Japanese Patent No. 3801939 or Japanese Patent Laid-Open No. 2021-152618 may be employed for the extraction process Sb1.

[0058] The adjustment process Sb2 is a process for adjusting the difficulty level of the target piece of music represented by the music data D1. The difficulty level refers to the degree of difficulty associated with playing the target piece of music. For example, the adjustment process Sb2 is a process for lowering the difficulty level of the target piece of music. For example, the adjustment process Sb2 may include various processes such as omitting repeat signs included in the target piece of music, assigning fingering numbers to each note, or transposing to a key that is easier to play. The transposition performed as the adjustment process Sb2 may be, for example, a change from a key with many alterations (e.g., sharps or flats) to a key with fewer alterations. The adjustment process Sb2 may employ any known technology, such as those described in International Publication No. 2022 / 190453, Japanese Patent No. 72684, or Japanese Patent No. 4682375.

[0059] A plurality of pieces of music data D1 corresponding to different pieces of music are stored in the storage device 52. The arrangement process Sb3 is a process for musically unifying the pieces of music data D1. Specifically, the arrangement process Sb3 includes a first process and a second process.

[0060] 12 is an explanatory diagram of the arrangement process Sb3. The first process is a process of transposing the keys of the pieces of music represented by each piece of music data D1 into a common key. The second process is a process of adjusting the beats of the pieces of music represented by each piece of music data D1 to a common beat and aligning the pieces of music data D1 in time. The second process is an alignment process that aligns the pieces of music data D1 in time, and includes, for example, adding or deleting notes from each measure and changing the note values ​​of notes.

[0061] The third embodiment also achieves the same effects as the first embodiment. Furthermore, in the third embodiment, editing is performed by the editing processing unit 514 on pre-processed music data D1. Therefore, a variety of music data D2 can be generated from music data D1 that has been commonly subjected to basic pre-processing.

[0062] When arranging or creating any part of a musical piece consisting of multiple parts, a situation may arise in which the tempo or key, for example, differs between the sheet music arranged or created by the user U and the sheet music owned by the user U. However, when integrating the part arranged or created by the user U into a full score, or when the user U performs the part arranged or created by the user U while referring to the full score, it is desirable that the sheet music arranged or created by the user U and the sheet music owned by the user U are musically consistent. The third embodiment can meet the above requirements.

[0063] In the above description, the preprocessing unit 517 performs preprocessing on the music data D1, but the preprocessing unit 517 may also perform preprocessing on each piece of performance data X. The preprocessed pieces of performance data X are used to edit the music data D1.

[0064] D: Fourth Embodiment Fig. 13 is a schematic diagram of a performance data list Lx in a fourth embodiment. The performance data list Lx in the fourth embodiment displays a note sequence image N for each of the multiple performance data X in the performance data group, in addition to time information Fc and performance position Fd similar to those in the first embodiment. The note sequence image N for each performance data X is an image of the note sequence represented by that performance data X. As described above, the display control unit 512 in the fourth embodiment displays a note sequence image N for each of the multiple performance data X.

[0065] The fourth embodiment also achieves the same effects as the first embodiment. Furthermore, in the fourth embodiment, the note sequence image N of each performance data X is displayed on the display device 34, so the user U can easily select desired performance data X from the performance data group by referring to each note sequence image N. Furthermore, as in the first embodiment, when the user U selects performance data X, the performance sound corresponding to the performance data X may be reproduced by a sound emitting device (not shown), such as a speaker or earphones.

[0066] Although the above description illustrates an example in which the display control unit 512 of the control system 50 generates the note sequence image N, the location where the note sequence image N is generated is not limited to the above example. For example, the keyboard instrument 10 or the terminal device 30 may generate the note sequence image N from the performance data X.

[0067] The display method of the performance data list Lx is not limited to the above example. Specifically, the performance data list Lx may be displayed together with the musical score 60 of the target piece of music as a pull-down list 64, as shown in FIG.

[0068] 14 illustrates a state in which a plurality of note sequence images N in the performance data list Lx are displayed in a pull-down list 64. For example, when the user U specifies a desired portion of the musical score 60 and operates the operation device 35, a list 64 of a plurality of note sequence images N corresponding to the section to be edited that includes that portion is displayed. The user U can select one of the plurality of note sequence images N by operating the operation device 35, thereby selecting the performance data X corresponding to that note sequence image N from the plurality of performance data X. According to the above embodiment, the user U can easily check and select the performance data X.

[0069] 14, note sequence images N of some of the performance data X (for example, the top three in the performance history) may be selectively displayed. Also, note sequence images N of the remaining performance data X may be additionally displayed in response to an instruction from the user U. For example, when the user U selects a message such as "Show more" displayed at the bottom of the list 64, the display of note sequence images N is added.

[0070] E: Fifth Embodiment Fig. 15 is a block diagram illustrating the configuration of an information processing system 100 according to a fifth embodiment. In the first embodiment, performance data X is transmitted from a terminal device 30 to a control system 50. In the fifth embodiment, material data Z including performance data X and image data Y is transmitted from the terminal device 30 to the control system 50.

[0071] FIG. 16 is an explanatory diagram of image data Y. During the process in which instructor Ub instructs performer Ua, the score of the target piece of music is displayed on the display device 34. By operating the operation device 35, such as a touch pen, instructor Ub can write instruction comments C on the score displayed on the display device 34. The instruction comments C are messages such as problems with the performer Ua's performance or points to note when performing the target piece of music. As illustrated in FIG. 16, the image data Y is data representing multiple instruction comments C. Note that the image data Y may also include data representing an image of the target piece of music. The image data Y may be composed of multiple layers that are superimposed on each other.

[0072] 17 is a schematic diagram of image data Y. The image data Y includes a plurality of units of data Q (Q1, Q2, ...) representing different instruction comments C created by the instructor Ub. Each unit of data Q represents one instruction comment C. The image data Y also includes identification information Fa, a song title Fb, and a plurality of attribute data H corresponding to the different instruction comments C.

[0073] The identification information Fa is a code string for identifying the instructor Ub who created the instructional comment C. The song title Fb is the name of the target song for the performance represented by the image data Y.

[0074] The attribute data H is data that represents attributes related to the unit data Q. Specifically, the attribute data H includes a number h1, location information h2, and creation date and time h3. The number h1 is a number for identifying the unit data Q. The creation date and time h3 is the date and time when the instructor Ub created the instruction comment C represented by the unit data Q.

[0075] The position information h2 is information that indicates the position of the instruction comment C represented by the unit data Q. Specifically, the position information h2 specifies the position in the score of the target song where the instruction comment C was added. For example, the position information h2 may be a number that specifies one of a plurality of areas (cells) that divide the score of the target song.

[0076] For example, if the score of the target piece of music is A4 size (height:width = 7:5), dividing the score vertically into seven equal parts and horizontally into five equal parts results in a total of 35 regions (cells) arranged in a matrix of 7 rows and 5 columns. Of the 35 regions described above, the five regions in the top row, the first row, are assigned numbers "#1" through "#5" in order as position information h2, from the first column on the left to the fifth column on the right. Consecutive numbers are assigned sequentially as position information h2 to each of the regions in the second through seventh rows using the same rule, resulting in numbers "#1" through "#35" being assigned to each region without overlap.

[0077] The data acquisition unit 510 of the fifth embodiment acquires one or more pieces of material data Z (performance data X and image data Y) from each of the multiple terminal devices 30. That is, the data acquisition unit 510 acquires multiple pieces of performance data X and multiple pieces of image data Y. Therefore, the storage device 52 stores multiple pieces of performance data X and multiple pieces of image data Y.

[0078] The display control unit 512 displays the performance data list Lx exemplified in Fig. 6 or 13 as well as the image data list Ly of Fig. 18 on the display device 34 of the terminal device 30. The image data list Ly is a list listing multiple image data Y acquired by the data acquisition unit 510. Specifically, the performance data list Lx includes, for each of the multiple image data Y, identification information Fa and song title Fb, as well as the number h1 and creation date and time h3 of each unit data Q. The selection receiving unit 513 receives from the user U the selection of one or more image data Y from the multiple image data Y included in the image data list Ly.

[0079] The editing processing unit 514 generates the score data G2 by combining the score data G1 of the target song with the image data Y selected by the user U. Specifically, the editing processing unit 514 generates the score data G2 by superimposing one or more image data Y on the score data G1.

[0080] The data providing unit 515 provides the edited data E to the terminal device 30. The edited data E includes edited music data D2 and edited musical score data G2. Specifically, the data providing unit 515 transmits the edited data E from the communication device 53 to the terminal device 30 of the user U, on the condition that the user U executes the billing process. The user U can use the edited data E provided by the control system 50 to output (e.g., display or print) a musical score image including instruction comments C, for example. Note that if the user U selects image data Y related to his or her own performance, the amount charged in the billing process may be set to free (or a discounted amount). If the user U selects image data Y related to his or her own performance, the billing process may be omitted.

[0081] In the second embodiment, the data conversion unit 516 converts the musical score data G into the music data D, but in the fifth embodiment, the data conversion unit 516 may convert the music data D stored in the storage device 52 into the musical score data G. The editing processing unit 514 generates the musical score data G by editing the musical score data G after conversion by the data conversion unit 516.

[0082] Any known technique may be used to convert the music data D1 into the musical score data G1. For example, the techniques disclosed in Japanese Patent Application Laid-Open No. 2012-047983 or Japanese Patent Application Laid-Open No. 2008-257068 may be used to convert the music data D1.

[0083] F: Sixth Embodiment Fig. 19 is a block diagram illustrating the functional configuration of a control system 50 in a sixth embodiment. A control device 51 in the sixth embodiment executes a program stored in a storage device 52 to function as an information setting unit 518 in addition to the same elements as in the first embodiment (a data acquisition unit 510, a performance data classification unit 511, a display control unit 512, a selection acceptance unit 513, an editing processing unit 514, and a data provision unit 515). In the sixth embodiment, a plurality of performance data X and a plurality of image data Y are stored in the storage device 52, as in the fifth embodiment.

[0084] 20 is an explanatory diagram of the operation of the information setting unit 518. The information setting unit 518 sets viewing permission information Ax (Ax1, Ax2, ...) and editing permission information Bx (Bx1, Bx2, ...) for each of multiple performance data X (X1, X2, ...). The viewing permission information Ax is identification information Fa of a user U who is permitted to view the performance data X. On the other hand, the editing permission information Bx is identification information Fa of a user U who is permitted to edit the performance data X. In other words, the storage device 52 stores the identification information Fa of a user U who is permitted to view the performance data X (viewing permission information Ax) and the identification information Fa of a user U who is permitted to edit the performance data X (editing permission information Bx).

[0085] For example, at the stage when material data Z is transmitted from the terminal device 30 to the control system 50, the user U operates the operation device 35 to specify the identification information Fa of the user U who is permitted to view the performance data X and the identification information Fa of the user U who is permitted to edit the performance data X. Upon receiving the material data Z from the terminal device 30, the information setting unit 518 sets the identification information Fa of the user U who is permitted to view as the viewing permission information Ax for the performance data X in the material data Z. Furthermore, the information setting unit 518 sets the identification information Fa of the user U who is permitted to edit as the editing permission information Bx for the performance data X in the material data Z. In other words, the user U who provides the material data Z can specify the users U who are permitted to view or edit the performance data X that he or she created.

[0086] The information setting unit 518 may automatically set viewing permission information Ax, which indicates permission for viewing, and editing permission information Bx, which indicates permission for editing, for the performance data X of the user U. In other words, the viewing permission information Ax and the editing permission information Bx may be assigned to the performance data X of the user U without requiring the user U to perform any operation on the operation device 35.

[0087] Furthermore, the information setting unit 518 sets viewing permission information Ay (Ay1, Ay2, ...) and editing permission information By (By1, By2, ...) for each of the multiple image data Y (Y1, Y2, ...). The viewing permission information Ay is identification information Fa of a user U who is permitted to view the image data Y. On the other hand, the editing permission information By is identification information Fa of a user U who is permitted to edit the image data Y. In other words, the storage device 52 stores the identification information Fa (viewing permission information Ay) of a user U who is permitted to view the image data Y and the identification information Fa (editing permission information By) of a user U who is permitted to edit the image data Y.

[0088] For example, at the stage when material data Z is transmitted from the terminal device 30 to the control system 50, the user U operates the operation device 35 to specify the identification information Fa of the user U who is permitted to view the image data Y and the identification information Fa of the user U who is permitted to edit the image data Y. Upon receiving the material data Z from the terminal device 30, the information setting unit 518 sets the identification information Fa of the user U who is permitted to view the image data Y in the material data Z as the viewing permission information Ay. Furthermore, the information setting unit 518 sets the identification information Fa of the user U who is permitted to edit the image data Y in the material data Z as the editing permission information By. In other words, the user U who provides the material data Z can specify the users U who are permitted to view or edit the image data Y that he or she created.

[0089] The information setting unit 518 may automatically set viewing permission information Ay indicating permission for viewing and editing permission information By indicating permission for editing for the user U's own image data Y. In other words, the viewing permission information Ay and the editing permission information By may be assigned to the user U's image data Y without the user U needing to operate the operation device 35.

[0090] The display control unit 512 displays the performance data X on the display device 34 of the terminal device 30 of the user U in response to an instruction from the user U who is permitted to view the performance data X. For example, in response to an instruction from the user U via the operation device 35, a viewing request including the user U's identification information Fa is sent from the terminal device 30 to the control system 50. The display control unit 512 determines whether the identification information Fa included in the viewing request is included in the viewing permission information Ax. If the identification information Fa is included in the viewing permission information Ax, the display control unit 512 displays the performance data X on the display device 34 of the terminal device 30. On the other hand, if the identification information Fa is not included in the viewing permission information Ax, the display control unit 512 does not display the performance data X on the display device 34 of the terminal device 30. As described above, according to the sixth embodiment, viewing of the performance data X can be permitted only for specific users U.

[0091] The display control unit 512 displays the image data Y on the display device 34 of the terminal device 30 of the user U in response to an instruction from the user U who is permitted to view the image data Y. For example, in response to an instruction from the user U via the operation device 35, a viewing request including the user U's identification information Fa is sent from the terminal device 30 to the control system 50. The display control unit 512 determines whether the identification information Fa included in the viewing request is included in the viewing permission information Ay. If the identification information Fa is included in the viewing permission information Ay, the display control unit 512 displays the image data Y on the display device 34 of the terminal device 30. On the other hand, if the identification information Fa is not included in the viewing permission information Ay, the display control unit 512 does not display the image data Y on the display device 34 of the terminal device 30. As described above, according to the sixth embodiment, viewing of the image data Y can be permitted only to specific users U.

[0092] The editing processing unit 514 edits the performance data X in response to an instruction from a user U who is permitted to edit the performance data X. For example, in response to an instruction from the user U via the operation device 35, an editing request including the user U's identification information Fa is sent from the terminal device 30 to the control system 50. The editing processing unit 514 determines whether the identification information Fa included in the editing request is included in the editing permission information Bx. If the identification information Fa is included in the editing permission information Bx, the editing processing unit 514 edits the performance data X in response to an instruction from the user U. On the other hand, if the identification information Fa is not included in the editing permission information Bx, the editing processing unit 514 does not edit the performance data X. As described above, according to the sixth embodiment, editing of the performance data X can be permitted only for specific users U.

[0093] The editing processing unit 514 edits the image data Y in response to instructions from a user U who is permitted to edit the image data Y. For example, in response to an instruction from the user U via the operation device 35, an editing request including the identification information Fa of the user U is sent from the terminal device 30 to the control system 50. The editing processing unit 514 determines whether the identification information Fa included in the editing request is included in the editing permission information By. If the identification information Fa is included in the editing permission information By, the editing processing unit 514 edits the image data Y in response to an instruction from the user U. On the other hand, if the identification information Fa is not included in the editing permission information By, the editing processing unit 514 does not edit the image data Y. As described above, according to the sixth embodiment, editing of the image data Y can be permitted only for specific users U.

[0094] G: Seventh Embodiment Fig. 21 is a block diagram illustrating the functional configuration of a control system 50 according to a seventh embodiment. A control device 51 according to the seventh embodiment executes a program stored in a storage device 52 to function as an information setting unit 519 in addition to the same elements as those in the first embodiment (a data acquisition unit 510, a performance data classification unit 511, a display control unit 512, a selection acceptance unit 513, an editing processing unit 514, and a data provision unit 515). In the seventh embodiment, a plurality of performance data X and a plurality of image data Y are stored in the storage device 52, as in the fifth embodiment.

[0095] 22 is an explanatory diagram of the operation of the information setting unit 519. As exemplified in each of the above-mentioned embodiments, the edit processing unit 514 generates music data D2 by editing music data D1 to which performance data X is applied, and generates score data G2 by editing score data G1 to which image data Y is applied. The edit processing unit 514 of the seventh embodiment repeatedly and cumulatively edits music data D and score data G to generate multiple edited data E (E1, E2, ...) corresponding to different versions.

[0096] The nth edition (n is a natural number equal to or greater than 1) of edited data En includes music piece data D2 obtained by editing music piece data D1 included in the immediately preceding edited data En-1, and musical score data G2 obtained by editing musical score data G1 included in edited data En-1. The second edition of edited data E2 includes music piece data D2 obtained by editing initial music piece data D1, and musical score data G2 obtained by editing initial musical score data G1.

[0097] The information setting unit 519 sets copyright information Rn (R1, R2, ...) for each version of edited data En. The copyright information Rn is information related to the copyright of the nth version of edited data En. Specifically, the copyright information Rn includes whether the copyright property rights are valid or invalid, whether the moral rights are valid or invalid, the name and contact information of the editor (author), and the time of editing. Valid copyright property rights or moral rights mean that the rights have not been waived, while invalid copyright property rights or moral rights mean that the rights have been waived (so-called public domain). The editor's contact information is, for example, an address, telephone number, or email address. As described above, according to the seventh embodiment, copyright information Rn can be set for each version of edited data En (music data D and musical score data G).

[0098] The copyright information Rn is set in response to instructions from a user U who edits the material data Z (performance data X, image data Y). On the other hand, if a user U wishes to re-edit edited data En, the user U operates the operation device 35 to specify the desired version of the edited data En. The terminal device 30 transmits an information request specifying the version specified by the user U to the control system 50. The display control unit 512 transmits the copyright information Rn set in the edited data En for the version specified by the user U to the requesting terminal device 30. The display device 34 of the terminal device 30 displays the copyright information Rn. Thus, the user U can check the copyright information Rn for each version of the edited data En. For example, the user U can check whether or not there are copyright property rights and moral rights, as well as the contact information of the author.

[0099] For convenience, Fig. 22 illustrates a case in which one edited data En+1 is generated by editing one edited data En. However, as illustrated in Fig. 23, multiple edited data En+1 may be generated from one edited data En by applying different performance data X or image data Y. Copyright information Rn is also set for each of the multiple edited data En+1 generated from the common edited data En.

[0100] H: Eighth Embodiment The data providing unit 515 of the fifth embodiment transmits edited data E from the communication device 53 to the terminal device 30 of the user U, on the condition that the user U executes a billing process. In other words, the user U can obtain the edited music piece data D and musical score data G in exchange for paying a predetermined amount of currency.

[0101] The data providing unit 515 of the eighth embodiment provides one or more pieces of performance data X from among the plurality of pieces of performance data X stored in the storage device 52 to the terminal device 30 of the user U. Specifically, the data providing unit 515 transmits the performance data X from the communication device 53 to the terminal device 30 of the user U on the condition that the user U executes a billing process.

[0102] Specifically, the display control unit 512 displays the performance data list Lx of Fig. 24 on the display device 34 of the terminal device 30. The performance data list Lx includes, for each of the multiple performance data X, the same information as in the fourth embodiment (Fig. 13) (time information Fc, performance position Fd, and note sequence image N), as well as the price Px of the performance data X. The data providing unit 515 transmits the performance data X selected by the user U from the performance data list Lx to the terminal device 30 of the user U in exchange for a billing process for the price Px.

[0103] According to the eighth embodiment, performance data X representing a performance of a partial section of a target song is provided to the terminal device 30 of the user U who has executed the billing process. This effectively promotes the buying and selling of performance data X. The user U of the terminal device 30 can use the performance data X acquired through the billing process to edit his or her own song data D.

[0104] Furthermore, the data providing unit 515 provides one or more pieces of image data Y from the plurality of image data Y stored in the storage device 52 to the terminal device 30 of the user U. Specifically, the data providing unit 515 transmits the image data Y from the communication device 53 to the terminal device 30 of the user U on the condition that the user U executes the billing process.

[0105] Specifically, the display control unit 512 displays the image data list Ly of Fig. 25 on the display device 34 of the terminal device 30. The image data list Ly includes, for each of a plurality of image data Y, identification information Fa and song title Fb, the creation date and time h3 of each unit data Q, the price Py of the image data Y, and a summary 61 of the image data Y. The summary 61 of the image data Y is a rough outline of the instruction comment C represented by the image data Y. The data providing unit 515 transmits the image data Y selected by the user U from the image data list Ly to the terminal device 30 of the user U in exchange for a charging process for the price Py.

[0106] According to the eighth embodiment, image data Y is provided to the terminal device 30 of the user U who has executed the charging process. This effectively promotes the buying and selling of image data Y. The user U of the terminal device 30 can use the image data Y acquired through the charging process to refer to the instruction comments C or edit the musical score data G.

[0107] The performance data list Lx or the image data list Ly in the eighth embodiment may be displayed, for example, as a pull-down list together with the musical score 60 of the target song, as in the example of Fig. 14. The user U selects the desired performance data X from the performance data list Lx, and the desired image data Y from the image data list Ly.

[0108] I: Ninth Embodiment Fig. 26 is a schematic diagram of image data Y in the ninth embodiment. In the fifth embodiment, as shown in Fig. 17, it is assumed that the identification information Fa of one instructor Ub is registered in the image data Y. However, in reality, it is also assumed that multiple instructors Ub jointly create the image data Y. As shown in Fig. 26, the image data Y in the ninth embodiment has the identification information Fa of each of the multiple instructors Ub who jointly created the image data Y registered in the image data Y.

[0109] 27 shows the transition of screens displayed on the display device 34 in the process of the terminal device 30 logging in to the control system 50. When the user U instructs logging in to the control system 50 by operating the operation device 35, an authentication screen 631 is displayed on the display device 34 of the terminal device 30, allowing the instructor Ub (representative) to input authentication information (e.g., identification information and a password).

[0110] If the authentication process by the instructor Ub is successful, a setting screen 632 prompting the input of the other instructors Ub who jointly created the image data Y is displayed on the display device 34. The instructor Ub operates the operation device 35 to designate the other instructors Ub. Once all of the instructors Ub have been designated, a confirmation screen 633 for confirming the appropriateness of the designation is displayed on the display device 34. Once the confirmation on the confirmation screen 633 is complete, the identification information Fa of each of the multiple instructors Ub is registered in the image data Y, as shown in the example of FIG. 26. The multiple instructors Ub registered as creators can view and edit the image data Y. Note that the identification information Fa of each instructor Ub may also be registered in the viewing permission information Ay or the editing permission information By in the sixth embodiment.

[0111] J: Modifications Specific modifications that can be added to the above-mentioned embodiments are exemplified below. Two or more embodiments arbitrarily selected from the following examples may be combined as appropriate within the scope of not mutually contradicting each other.

[0112] (1) In the above-described embodiments, the user U selects performance data X from the performance data list Lx. However, the method of selecting performance data X to be used in editing the music piece data D1 is not limited to the above examples. For example, a configuration is also conceivable in which performance data X is selected using attribute information of the performance data X. The attribute information is, for example, tag information such as the musical genre (e.g., jazz or rock) of the note sequence associated with the performance data X or the difficulty level of the performance. The user U specifies conditions related to the attributes of the performance data X by operating the operation device 35. The editing processing unit 514 selects performance data X with attribute information that satisfies the conditions specified by the user U.

[0113] Any known technique may be employed to identify the musical genre of the performance data X. For example, techniques disclosed in Japanese Patent Laid-Open No. 2003-298830, Japanese Patent No. 7176113, Japanese Patent No. 4665836, etc. may be used to estimate the musical genre. The user U who provides the performance data X may also specify the musical genre. Any known technique may be employed to identify the difficulty level of the performance data X. For example, techniques disclosed in Japanese Patent Laid-Open No. 2007-241026, Japanese Patent No. 6906358, Japanese Patent No. 6248415, etc. may be used to estimate the difficulty level. The user U who provides the performance data X may also specify the difficulty level.

[0114] (2) In the above-described embodiments, the music data D2 is provided to the user U on the condition that a billing process is executed. When the music data D2 is provided, a portion of the price of the music data D2 may be paid to the user U who created the performance data X to which the music data D2 is edited. Payment to the user U who created the performance data X may be made, for example, by electronic payment.

[0115] In the seventh embodiment, an example has been given in which performance data X is provided to a user U on the condition that a billing process is executed. When the performance data X is provided, a part of the price Px of the performance data X may be returned to the user U who created the performance data X. Payment to the user U who created the performance data X may be made, for example, by electronic payment. Note that when the performance data X is provided, the price Px of the performance data X may be provided to the user U who created the performance data X and to an administrator of the control system 50 (or the information processing system 100).

[0116] Similarly, in the seventh embodiment, an example has been given in which image data Y is provided to user U on the condition that billing processing is executed. When the image data Y is provided, a portion of the price Py of the image data Y may be returned to user U who created the image data Y. Payment to user U who created the image data Y may be made, for example, by electronic payment. Note that when the image data Y is provided, the price Py of the image data Y may be provided to user U who created the image data Y and to the administrator of control system 50 (or information processing system 100).

[0117] (3) In the above-described embodiments, the editing section selected by the user U in the music data D1 of the target music piece is replaced with performance data X. However, the editing processing unit 514 may also replace sections of the music data D1 of the target music piece that have similar note sequences to the editing section (hereinafter referred to as "related sections") with performance data X. That is, one or more related sections of the music data D1 are automatically replaced with performance data X (i.e., without requiring instructions from the user U). A related section is, for example, a section whose note sequence similarity to the editing section exceeds a predetermined threshold. Any known technology may be employed to search for related sections.

[0118] For example, after receiving the designation of the section to be edited and the performance data X from the user U (Sa1, Sa3) and replacing the section to be edited with the performance data X (Sa4), the control device 51 (editing processing unit 514) prompts the user U to select whether or not to edit the related section as well. For example, a confirmation message such as "There are other similar phrases. Do you want to edit those phrases as well?" is displayed on the display device 34. Upon receiving an affirmative response from the user U, the control device 51 (editing processing unit 514) replaces the related section of the music piece data D1 with the performance data X, as described above.

[0119] (4) In the fifth embodiment, material data Z including performance data X and image data Y is transmitted from the terminal device 30 to the control system 50, and edited data E including edited music piece data D2 and edited score data G2 is transmitted from the control system 50 to the terminal device 30. However, transmission of performance data X from the terminal device 30 to the control system 50 or transmission of music piece data D2 from the control system 50 to the terminal device 30 may be omitted. In other words, editing of music piece data D1 using performance data X may be omitted.

[0120] (5) Some or all of the functions of the control system 50 exemplified in each of the above embodiments may be installed in the terminal device 30. In addition, two or more embodiments selected from the above embodiments (first embodiment to ninth embodiment) may be appropriately combined.

[0121] (6) As described above, the functions of the control system 50 illustrated above are realized through cooperation between one or more processors constituting the control device 51 and a program stored in the storage device 52. The program according to the present disclosure may be provided in a form stored on a computer-readable recording medium and installed on a computer. The recording medium may be, for example, a non-transitory recording medium, such as an optical recording medium (optical disk) such as a CD-ROM, but may also include any known type of recording medium, such as a semiconductor recording medium or a magnetic recording medium. Note that a non-transitory recording medium includes any recording medium other than a transient, propagating signal, and does not exclude volatile recording media. Furthermore, in a configuration in which a distribution device distributes a program via a communication network 200, the storage medium that stores the program in the distribution device corresponds to the non-transitory recording medium described above.

[0122] K: Supplementary Note From the above-described exemplary embodiments, the following configurations can be understood, for example.

[0123] An information processing system according to one aspect (aspect 1) of the present disclosure includes a data acquisition unit that acquires a plurality of performance data representing the performance of a portion of a musical piece; a performance data classification unit that classifies the plurality of performance data into a plurality of performance data groups corresponding to different sections of the musical piece; and an editing processing unit that replaces a specific section of the musical piece data representing the musical piece with performance data selected from a performance data group corresponding to the specific section among the plurality of performance data groups.

[0124] In the above-described embodiment, multiple pieces of performance data representing performances of sections of a piece of music are classified into multiple performance data groups, and specific sections of the music data are replaced with performance data selected from the performance data group corresponding to the sections. This makes it possible to easily generate multiple pieces of music data in which different performance data are applied to specific sections of the music data.

[0125] "Performance data" is data in any format that represents a musical performance. For example, "performance data" may be MIDI time-series data representing each note played by a performer, or audio data recording the sound of a musical instrument played by a performer.

[0126] A performance data group corresponding to one section of a piece of music is a collection of two or more pieces of performance data corresponding to that section among the multiple pieces of performance data. Note that the multiple pieces of performance data belonging to one performance data group do not necessarily correspond strictly to a common section in the piece of music. For example, a performance data group corresponding to one section of a piece of music is a collection of two or more pieces of performance data corresponding to positions close to that section among the multiple pieces of performance data.

[0127] The method of selecting the performance data to be used to replace the music piece data from the performance data group may be arbitrary, for example, one of the performance data from the performance data group may be selected by a user, one of the performance data from the performance data group may be selected according to a predetermined rule, or one of the performance data from the performance data group may be selected randomly.

[0128] In a specific example (Aspect 2) of Aspect 1, the music data is data specifying a plurality of notes that make up the music piece in chronological order, and the system further includes a data conversion unit that generates the music data from image data representing the musical score of the music piece. According to this aspect, image data representing an image of the musical score is converted into music data. Therefore, even in an environment where only image data of the music piece exists, editing of music data by applying performance data can be easily achieved.

[0129] A specific example (Aspect 3) of Aspect 1 or Aspect 2 further includes a preprocessing unit that performs preprocessing on the music data, and the editing unit replaces the specific section of the music data after the preprocessing with performance data. According to the above aspect, the editing unit performs editing on the preprocessed music data. Therefore, a variety of music data can be generated from music data that has undergone common basic preprocessing. "Preprocessing" refers to any process for editing music data. Examples of "preprocessing" include editing a musical score to increase or decrease the difficulty of performance, changing the key of a musical piece, and extracting a specific performance part from a musical score that includes multiple performance parts.

[0130] In a specific example (Aspect 4) of any one of Aspects 1 to 3, the system further includes a display control unit that displays two or more performance data included in the performance data group on a display device, and a selection receiving unit that receives a selection of one of the two or more performance data, and the editing processing unit replaces the specific section of the music data with the performance data selected by the selection receiving unit. According to the above aspect, a user can select desired performance data from the two or more performance data displayed as selection candidates. This allows music data to be generated in accordance with the user's intentions or preferences.

[0131] In a specific example (Aspect 5) of Aspect 4, the display control unit displays, for each of the two or more pieces of performance data, an image of the note sequence represented by that performance data. According to the above aspect, since an image of the note sequence for each piece of performance data is displayed, the user can easily select desired performance data from the group of performance data.

[0132] In a specific example (Aspect 6) of any one of Aspects 1 to 5, a storage unit is further provided for storing identification information of users who are permitted to edit the performance data, and the editing processing unit edits the performance data in response to instructions from the users who are permitted to edit the performance data. According to the above aspect, it is possible to restrict users who can edit the performance data.

[0133] In a specific example (Aspect 7) of any of Aspects 1 to 6, the edit processing unit generates multiple pieces of music data corresponding to different versions by repeatedly editing the music data, and further includes an information setting unit that sets copyright information for each version of the music data. According to the above aspect, copyright information can be set for each version of music data generated by editing the music data. The copyright may be one or both of a copyright property right and a moral right. The information setting unit may set one of the copyright property right and the moral right, or may set each of the copyright property right and the moral right separately.

[0134] In a specific example (Aspect 8) of any one of Aspects 1 to 7, the system further includes a data providing unit that provides the music data processed by the editing processing unit to the terminal device of the user who executed the billing process. According to the above aspect, the music data processed by the editing processing unit is provided to the terminal device of the user who executed the billing process. Therefore, buying and selling of music data can be effectively promoted.

[0135] In a specific example (Aspect 9) of any one of Aspects 1 to 8, the system further includes a data providing unit that provides one or more of the plurality of performance data to the terminal device of the user who executed the billing process. According to the above aspect, performance data representing the performance of a portion of a musical piece is provided to the terminal device of the user who executed the billing process. This effectively promotes the buying and selling of performance data. The user of the terminal device can use the performance data obtained through the billing process to generate their own musical piece data.

[0136] An information processing method according to one aspect (aspect 10) of the present disclosure acquires a plurality of performance data representing the performance of a portion of a musical piece, classifies the plurality of performance data into a plurality of performance data groups corresponding to different sections of the musical piece, and replaces a specific section of the musical piece data representing the musical piece with performance data selected from the performance data group corresponding to the specific section among the plurality of performance data groups.

[0137] A program according to one aspect (aspect 11) of the present disclosure causes a computer system to function as a data acquisition unit that acquires multiple performance data representing the performance of a portion of a musical piece, a performance data classification unit that classifies the multiple performance data into multiple performance data groups corresponding to different sections of the musical piece, and an editing processing unit that replaces a specific section of the musical piece data representing the musical piece with performance data selected from a performance data group corresponding to the specific section among the multiple performance data groups.

[0138] 100...information processing system, 200...communication network, 10...keyboard instrument, 30...terminal device, 31...control device, 32...storage device, 33...communication device, 34...display device, 35...operation device, 50...control system, 51...control device, 52...storage device, 53...communication device, 510...data acquisition unit, 511...data classification unit, 512...display control unit, 513...selection reception unit, 514...editing processing unit, 515...data provision unit, 516...data conversion unit, 517...preprocessing unit, 518...information setting unit, 519...information setting unit.

Claims

1. An information processing system comprising: a data acquisition unit that acquires a plurality of performance data representing the performance of a portion of a musical piece; a performance data classification unit that classifies the plurality of performance data into a plurality of performance data groups corresponding to different sections of the musical piece; and an edit processing unit that replaces a specific section of the musical piece data representing the musical piece with performance data selected from a performance data group corresponding to the specific section among the plurality of performance data groups.

2. The information processing system of claim 1, wherein the music data is data that specifies a plurality of notes that make up the music in chronological order, and further comprises a data conversion unit that generates the music data from image data representing the musical score of the music.

3. The information processing system according to claim 1, further comprising a pre-processing unit that performs pre-processing on the music data, wherein the editing unit replaces the specific section of the music data after the pre-processing with performance data.

4. The information processing system of claim 1 further comprises a display control unit that displays two or more pieces of performance data included in the performance data group on a display device, and a selection receiving unit that receives a selection of one of the two or more pieces of performance data, wherein the editing processing unit replaces the specific section of the music data with the performance data selected by the selection receiving unit.

5. The information processing system according to claim 4, wherein the display control unit displays an image of the sequence of notes represented by each of the two or more performance data.

6. The information processing system of claim 1 further comprises a storage unit that stores identification information of users who are authorized to edit the performance data, and the editing processing unit edits the performance data in response to instructions from the users who are authorized to edit the performance data.

7. The information processing system of claim 1, further comprising: an editing processing unit that generates multiple pieces of music data corresponding to different versions by repeatedly editing the music data; and an information setting unit that sets copyright information regarding the copyright for each version of the music data.

8. The information processing system according to claim 1, further comprising a data providing unit that provides the music data processed by said editing processing unit to the terminal device of the user who has executed the billing process.

9. The information processing system according to claim 1, further comprising a data providing unit that provides one or more pieces of performance data from among said plurality of pieces of performance data to the terminal device of the user who has executed the billing process.

10. An information processing method implemented by a computer system, which acquires a plurality of performance data representing the performance of a portion of a musical piece, classifies the plurality of performance data into a plurality of performance data groups corresponding to different sections of the musical piece, and replaces a specific section of the musical piece data representing the musical piece with performance data selected from the performance data group corresponding to the specific section among the plurality of performance data groups.

11. A program that causes a computer system to function as: a data acquisition unit that acquires multiple pieces of performance data representing the performance of a portion of a musical piece; a performance data classification unit that classifies the multiple pieces of performance data into multiple performance data groups corresponding to different sections of the musical piece; and an editing processing unit that replaces a specific section of the musical piece data representing the musical piece with performance data selected from a performance data group corresponding to the specific section among the multiple performance data groups.

Images