Information processing system, information processing method and program

Abstract

To easily generate multiple pieces of musical score data from single piece of musical score data.SOLUTION: An information processing system comprises: a data acquisition unit 510 that acquires multiple pieces of performance data representing performance of a section of a musical piece; a performance data classification unit 511 that classifies the multiple pieces of performance data into multiple groups of performance data corresponding to different sections of the musical piece; and an editing processing unit 514 that replaces a specific section of the musical data representing the musical piece with performance data selected from the group of performance data corresponding to the specific section among the multiple groups of performance data.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present disclosure relates to techniques for processing data representing music pieces. [Background technology]

[0002] Various techniques for processing performance data representing a performer's performance of an instrument have been proposed. For example, Patent Document 1 discloses a technique for generating a musical score in response to the operation of an instrument such as a keyboard instrument, and editing the musical score in response to instructions from a user. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6734186 Summary of the Invention [Problem to be solved by the invention]

[0004] In music lessons, for example, the score of a single piece of music may be edited into multiple scores depending on the level of proficiency of each learner. However, the workload of editing a single score to generate multiple scores is extremely heavy. In consideration of the above, one aspect of the present disclosure aims to easily generate multiple score data from a single piece of score data. [Means for solving the problem]

[0005] In order to solve the above problems, an information processing system according to one aspect of the present disclosure includes a data acquisition unit that acquires a plurality of performance data representing the performance of a portion of a musical piece, a performance data classification unit that classifies the plurality of performance data into a plurality of performance data groups corresponding to different portions of the musical piece, and an editing processing unit that replaces a specific portion of the musical piece data representing the musical piece with performance data selected from a performance data group corresponding to the specific portion of the plurality of performance data groups.

[0006] An information processing method according to one aspect of the present disclosure acquires a plurality of performance data representing the performance of a portion of a musical piece, classifies the plurality of performance data into a plurality of performance data groups corresponding to different portions of the musical piece, and replaces a specific portion of the musical piece data representing the musical piece with performance data selected from the performance data group corresponding to the specific portion of the plurality of performance data groups.

[0007] A program according to one aspect of the present disclosure causes a computer system to function as a data acquisition unit that acquires multiple performance data representing the performance of a portion of a musical piece, a performance data classification unit that classifies the multiple performance data into multiple performance data groups corresponding to different sections of the musical piece, and an editing processing unit that replaces a specific section of the musical piece data representing the musical piece with performance data selected from a performance data group corresponding to the specific section among the multiple performance data groups. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a block diagram illustrating a configuration of an information processing system according to a first embodiment. [Figure 2] FIG. 2 is a block diagram illustrating a configuration of a terminal device. [Figure 3] FIG. 1 is a block diagram illustrating a configuration of a control system. [Figure 4] FIG. 2 is a block diagram illustrating an example of the functional configuration of the control system. [Figure 5] FIG. 10 is an explanatory diagram regarding classification of performance data X. [Figure 6] FIG. 2 is a schematic diagram of a performance data list. [Figure 7] 10A and 10B are explanatory diagrams of an operation in which an edit processing unit edits music data. [Figure 8] 10 is a flowchart of an editing process. [Figure 9] FIG. 10 is a block diagram illustrating the functional configuration of a control system according to a second embodiment. [Figure 10] FIG. 10 is a block diagram illustrating the functional configuration of a control system according to a third embodiment. [Figure 11] 10 is a flowchart of preprocessing. [Figure 12] FIG. 11 is an explanatory diagram of the arrangement process in the third embodiment. [Figure 13] FIG. 13 is a schematic diagram of a performance data list in the fourth embodiment. [Figure 14] 13 is a display example in a modified example of the fourth embodiment. [Figure 15] FIG. 10 is a block diagram illustrating the configuration of an information processing system according to a fifth embodiment. [Figure 16] FIG. 2 is an explanatory diagram of image data. [Figure 17] FIG. 2 is a schematic diagram of image data. [Figure 18] FIG. 2 is a schematic diagram of an image data list. [Figure 19] FIG. 13 is a block diagram illustrating the functional configuration of a control system according to a sixth embodiment. [Figure 20] FIG. 20 is an explanatory diagram of the operation of an information setting unit in the sixth embodiment. [Figure 21] FIG. 13 is a block diagram illustrating the functional configuration of a control system according to a seventh embodiment. [Figure 22] FIG. 20 is an explanatory diagram of the operation of an information setting unit in the seventh embodiment. [Figure 23] FIG. 20 is an explanatory diagram of the operation of an information setting unit in the seventh embodiment. [Figure 24] FIG. 20 is a schematic diagram of a performance data list in the eighth embodiment. [Figure 25] FIG. 20 is a schematic diagram of an image data list in the eighth embodiment. [Figure 26] FIG. 13 is a schematic diagram of image data in the ninth embodiment. [Figure 27] 10 is an example of a login screen when multiple instructors are registered. DETAILED DESCRIPTION OF THE INVENTION

[0009] A: First embodiment 1 is a block diagram illustrating the configuration of an information processing system 100 according to a first embodiment. The information processing system 100 is a computer system for editing a specific piece of music (hereinafter referred to as a "target piece of music"). The information processing system 100 includes a keyboard instrument 10, a terminal device 30, and a control system 50.

[0010] The performer Ua plays the keyboard instrument 10. The performer Ua is, for example, a person who practices playing the keyboard instrument 10. The performer Ua is, for example, a student belonging to a music school. The terminal device 30 is used by the performer Ua or the instructor Ub. The instructor Ub teaches the performer Ua in the music school. In the following description, when there is no need to particularly distinguish between the performer Ua and the instructor Ub, they will simply be referred to as the user U.

[0011] The keyboard instrument 10 is an electronic musical instrument that accepts a performance by a performer Ua. The keyboard instrument 10 is, for example, an electronic musical instrument that conforms to the MIDI (Musical Instrument Digital Interface) standard and has a plurality of keys corresponding to different pitches. The performer Ua performs a target piece of music by operating each key in sequence. The keyboard instrument 10 not only emits musical tones corresponding to the performance by the performer Ua, but also generates performance data X that represents the performance by the performer Ua. Note that the performance data X may also be data that represents a performance by an instructor Ub.

[0012] The performance data X is time-series data representing the performance of a section of the target piece of music. The performance data X is, for example, a time-series of event data conforming to the MIDI standard. Specifically, the performance data X specifies the pitch and tone duration for each note of the target piece of music played by the performer Ua. Note that the performance data X representing the keyboard operation and the performance data X representing the pedal operation may be generated separately.

[0013] 2 is a block diagram illustrating the configuration of the terminal device 30. The terminal device 30 is an information device such as a smartphone, a tablet terminal, or a personal computer. The terminal device 30 includes a control device 31, a storage device 32, a communication device 33, a display device 34, and an operation device 35. The terminal device 30 may be realized as a single device, or may be realized as multiple devices configured separately from each other. Some or all of the functions of the terminal device 30 may be incorporated into the keyboard instrument 10.

[0014] The control device 31 is composed of one or more processors that control each element of the terminal device 30. For example, the control device 31 is composed of one or more types of processors such as a central processing unit (CPU), a graphics processing unit (GPU), a sound processing unit (SPU), a digital signal processor (DSP), a field programmable gate array (FPGA), or an application specific integrated circuit (ASIC).

[0015] The storage device 32 is one or more memories that store programs executed by the control device 31 and various data used by the control device 31. The storage device 32 is configured with a known storage medium such as a magnetic storage medium or a semiconductor storage medium. The storage device 32 may be configured with a combination of multiple types of storage media. Furthermore, a portable storage medium that is detachable from the terminal device 30, or a storage medium (e.g., cloud storage) that the control device 31 can write to or read from via the communication network 200 may be used as the storage device 32.

[0016] The communication device 33 communicates with the keyboard instrument 10 via wireless communication such as Wi-Fi (registered trademark) or Bluetooth (registered trademark). For example, the communication device 33 receives performance data X from the keyboard instrument 10. Note that the communication between the communication device 33 and the keyboard instrument 10 may be wired communication. The communication device 33 also communicates with the control system 50 via a communication network 200 such as the Internet. For example, the communication device 33 transmits the performance data X to the control system 50. Note that the communication path between the communication device 33 and the control system 50 may include a wireless section.

[0017] The display device 34 displays an image under the control of the control device 31. The display device 34 is configured with a display panel such as a liquid crystal panel or an organic EL (Electroluminescence) panel. The operation device 35 is an input device that accepts operations by the user U of the terminal device 30. For example, an operator operated by the user U or a touch panel that detects contact of a touch pen with the display surface is used as the operation device 35. Note that the display device 34 or the operation device 35, which are separate from the terminal device 30, may be connected to the terminal device 30 by wire or wirelessly. Operation data representing instructions from the user U to the operation device 35 is transmitted from the communication device 33 to the control system 50.

[0018] 3 is a block diagram illustrating the configuration of a control system 50. The control system 50 includes a control device 51, a storage device 52, and a communication device 53. The control system 50 may be realized as a single device, or may be realized as multiple devices configured separately from each other.

[0019] The control device 51 is composed of one or more processors that control each element of the control system 50. For example, the control device 51 is composed of one or more types of processors such as a CPU, a GPU, an SPU, a DSP, an FPGA, or an ASIC.

[0020] The communication device 53 communicates with the terminal device 30 via the communication network 200. For example, the communication device 53 receives performance data X transmitted from the terminal device 30. When the terminal device 30 logs in to the control system 50, communication between the control system 50 and the terminal device 30 is established. Logging in to the control system 50 requires authentication processing using authentication information such as the user U's identification information Fa (user ID) and password. The authentication processing may be biometric authentication using the user U's biometric information. Any known technology may be used for the biometric authentication.

[0021] The storage device 52 is one or more memories that store programs executed by the control device 51 and various data used by the control device 51. The storage device 52 is configured with a known storage medium such as a magnetic storage medium or a semiconductor storage medium. The storage device 52 may be configured with a combination of multiple types of storage media. Furthermore, a portable storage medium that is detachable from the control system 50, or a storage medium to which the control device 51 can write or read via the communication network 200 (for example, cloud storage) may be used as the storage device 52.

[0022] The storage device 52 of the first embodiment stores music data D1 representing a target piece of music. Specifically, the music data D1 is data that specifies a plurality of notes that constitute the target piece of music in chronological order. While the performance data X represents a portion of a section of the target piece of music, the music data D1 represents the entire section of the target piece of music. The music data D1 can also be expressed as data representing the musical score of the target piece of music. For example, data in MusicXML format or MIDI format is exemplified as the music data D1. However, the format of the music data D1 is arbitrary.

[0023] The control system 50 of the first embodiment generates music data D2 by editing music data D1 using performance data X. Note that the terminal device 30 that transmits the music data X to the control system 50 and the terminal device 30 of the user U to which the edited music data D2 is transmitted are separate devices. Therefore, the user U who performs music using the performance data X may be a different person from the user U to whom the music data D2 is provided. However, the terminal device 30 that transmits the performance data X and the terminal device 30 to which the music data D2 is transmitted may be the same device.

[0024] 4 is a block diagram illustrating an example of the functional configuration of control system 50. Control device 51 executes a program stored in storage device 52 to realize multiple functions (data acquisition unit 510, performance data classification unit 511, display control unit 512, selection acceptance unit 513, edit processing unit 514, and data provision unit 515) for generating music data D2 from music data D1.

[0025] The data acquisition unit 510 acquires the performance data X from the terminal device 30. Specifically, the data acquisition unit 510 receives the performance data X transmitted from the terminal device 30 via the communication device 53. Note that the data acquisition unit 510 may also acquire the performance data X directly from the keyboard instrument 10.

[0026] The data acquisition unit 510 repeatedly acquires the performance data X. For example, the data acquisition unit 510 acquires one or more pieces of performance data X from each of the multiple terminal devices 30. Therefore, the data acquisition unit 510 acquires multiple pieces of performance data X. For example, the data acquisition unit 510 acquires multiple pieces of performance data X representing performances by different performers Ua, and multiple pieces of performance data X representing different performances by a single performer Ua. The multiple pieces of performance data X acquired by the data acquisition unit 510 are stored in the storage device 52.

[0027] Each performer Ua arranges and performs a section of the target music piece in their own way. Therefore, even if the performance data X corresponds to the performance of a common section of the target music piece, the note strings (e.g., melodies) represented by the performance data X are different.

[0028] The performance data classification unit 511 classifies the multiple pieces of performance data X acquired by the data acquisition unit 510 into multiple sets (hereinafter referred to as "performance data groups"). The multiple performance data groups correspond to different sections of the target music piece. Of the multiple performance data groups, a performance data group corresponding to a specific section of the target music piece is a set of two or more pieces of performance data X that correspond to that section among the multiple pieces of performance data X.

[0029] 5 is an explanatory diagram of the classification of performance data X by the performance data classification unit 511. For each of the multiple performance data X, the performance data classification unit 511 stores identification information Fa, music title Fb, time information Fc, performance position Fd, and classification information Fe in the storage device 52.

[0030] The identification information Fa is a code string for identifying the performer Ua (or instructor Ub) who performed the performance represented by the performance data X. The song title Fb is the name of the target song related to the performance represented by the performance data X. The time information Fc is a timestamp indicating the period (performance period) during which the performance represented by the performance data X was performed. Specifically, the time information Fc specifies the start time and end time of the performance period. The identification information Fa, song title Fb, and time information Fc are added to the performance data X by, for example, the keyboard instrument 10.

[0031] The performance position Fd is information that specifies a section of the target music piece that corresponds to the performance represented by the performance data X. For example, the performance position Fd specifies a section using a measure number in the target music piece. The performance data classification unit 511 generates the performance position Fd by comparing the performance data X with the music piece data D1. Specifically, the performance position Fd specifies a section of the music piece data D1 that is musically similar to the performance represented by the performance data X. Any known performance analysis technology can be used to estimate the performance position Fd. For example, the technology disclosed in Japanese Patent No. 4399958, Japanese Patent No. 6296221, or Japanese Patent No. 6187132 can be used to estimate the performance position Fd. Note that the performance position Fd may also be expressed, for example, as the elapsed time from the start of the target music piece.

[0032] The classification information Fe is a code string for identifying each of the multiple performance data groups. One of the multiple identification information representing different sections of the target song is set as the classification information Fe. For example, common classification information Fe is assigned to performance data X whose section specified by the performance position Fd overlaps with a specific section of the target song. In other words, two or more performance data X that include a specific section of the target song among the multiple performance data X are classified into a common performance data group.

[0033] 4 causes an image to be displayed on the display device 34 of the terminal device 30. Specifically, the display control unit 512 causes the display device 34 of the terminal device 30 to display the image by transmitting data representing the image from the communication device 53 to the terminal device 30.

[0034] Specifically, the display control unit 512 displays a performance data list Lx, as shown in FIG. 6, on the display device 34 of the terminal device 30. The performance data list Lx is a list listing multiple performance data X belonging to one performance data group selected from multiple performance data groups. In other words, multiple performance data X with common classification information Fe are presented to the user U in the performance data list Lx. Specifically, the display control unit 512 displays multiple performance data X corresponding to a section of the target music piece selected by the user U (hereinafter referred to as the "section to be edited") in the performance data list Lx. In other words, multiple performance data X representing performances by different performers Ua are displayed. As described above, the display control unit 512 displays multiple performance data X included in the performance data group on the display device 34. Note that the display control unit 512 may also display multiple performance data X representing performances by a single performer Ua (e.g., the user U himself) on the display device 34.

[0035] Specifically, the performance data list Lx displays time information Fc and a performance position Fd for each of the multiple performance data X belonging to the performance data group. For example, the multiple performance data X are arranged in chronological order of the performance period specified by the time information Fc. In addition, the musical score 60 of the target song is displayed on the display device 34 together with the performance data list Lx.

[0036] The selection receiving unit 513 in Figure 4 receives instructions from the user U of the terminal device 30. Specifically, the selection receiving unit 513 receives operation data transmitted from the terminal device 30 in response to the instructions from the user U via the communication device 53. For example, the user U can select a desired section to be edited for a target song. The selection receiving unit 513 receives the selection of the section to be edited by the user U.

[0037] Furthermore, the user U can select any one of the multiple performance data X displayed in the performance data list Lx by operating the operating device 35 while visually checking the performance data list Lx displayed on the display device 34. The selection receiving unit 513 receives a selection of any one of the multiple performance data X displayed in the performance data list Lx from the user U. The selection receiving unit 513 may also reproduce the performance sound represented by the performance data X selected by the user U using a sound emitting device (not shown), such as a speaker or earphones. With the above configuration, the user U can visually and audibly confirm the content of the performance data X.

[0038] 7, the edit processing unit 514 replaces the edit target section of the music piece data D1 of the target music piece with performance data X selected from the performance data group corresponding to the edit target section. Specifically, the edit processing unit 514 replaces the edit target section of the music piece data D1 with the performance data X selected by the selection receiving unit 513. By replacing the edit target section with the performance data X, music piece data D2 is generated.

[0039] The data providing unit 515 in FIG. 4 provides the terminal device 30 with the music data D2 processed by the edit processing unit 514. Specifically, the data providing unit 515 transmits the edited music data D2 from the communication device 53 to the terminal device 30 of the user U, on the condition that the user U executes the billing process. The billing process is an electronic payment process in which the user U pays a predetermined amount of currency to the operator of the control system 50. For example, the billing process is executed by sending the user U's payment information to an electronic payment server. The payment information is, for example, information about the bank account to which the transfer is to be made in the case of a bank transfer, or information about the credit card in the case of a card payment. The user U can use the music data D2 provided by the control system 50, for example, to output (e.g., display or print) the musical score of the edited target music piece.

[0040] As described above, in the first embodiment, the music data D2 processed by the edit processing unit 514 is provided to the terminal device 30 of the user U who performed the billing process. Therefore, buying and selling of the music data D2 can be effectively promoted.

[0041] If the user U selects the performance data X related to his / her own performance, the charge amount in the billing process may be set to free (or a discounted amount). If the user U selects his / her own performance data X, the billing process may be omitted. The fact that the user U has selected his / her own performance data X can be determined, for example, by comparing the identification information Fa used by the user U to log in with the identification information Fa stored in the storage device 52 for the performance data X.

[0042] Furthermore, the display control unit 512 may display information (Fc, Fd) relating to the user U's own performance data X and information (Fc, Fd) relating to the performance data X of a performer Ua other than the user U in different display modes in the performance data list Lx. For example, the background color of the user U's own performance data X may be different from the background color of the performance data X of the other performer Ua. Note that the display mode refers to the characteristics of an image that the user U can visually distinguish. Examples of the display mode include display color, pattern (design), size, and shape. The display color is defined by hue (tone), saturation, or brightness (gradation).

[0043] 8 is a flowchart of the process (hereinafter referred to as the "editing process") in which the control device 51 generates music piece data D2 by editing music piece data D1. When the editing process starts, a plurality of pieces of performance data X are stored in the storage device 52 for each of a plurality of sections of the target music piece.

[0044] When the editing process starts, the control device 51 (selection receiving unit 513) receives from the user U a specification of a section to be edited in the target song (Sa1). The control device 51 (display control unit 512) displays, in a performance data list Lx, a plurality of performance data X belonging to one performance data group corresponding to the section to be edited among the plurality of performance data groups (Sa2).

[0045] The control device 51 (selection receiving unit 513) receives a selection of one of the multiple performance data X in the performance data list Lx from the user U (Sa3). The control device 51 (edit processing unit 514) replaces the section to be edited in the music data D1 of the target music piece with the performance data X selected from the group of performance data corresponding to the section to be edited (Sa4).

[0046] The control device 51 determines whether a predetermined termination condition is met (Sa5). The termination condition may be, for example, an instruction from the user U to end editing of the music data D1. If the termination condition is not met (Sa5: NO), the control device 51 repeats the steps of accepting the section to be edited (Sa1), displaying the performance data list Lx (Sa2), accepting the selection of the performance data X (Sa3), and editing the music data D1 (Sa4). In other words, each of the multiple sections to be edited in the music data D1 of the target music piece is replaced with the performance data X.

[0047] On the other hand, if the termination condition is met (Sa5: YES), the control device 51 (data providing unit 515) confirms the edited music data D1 up to the current point in time as music data D2 (Sa6), and transmits the music data D2 from the communication device 53 to the terminal device 30 (Sa7).

[0048] As described above, in the first embodiment, multiple pieces of performance data X representing performances of sections of a target song are classified into multiple performance data groups, and a section to be edited in song data D1 of the target song is replaced with performance data X selected from the performance data group corresponding to the section to be edited. This makes it possible to easily generate song data D2 in which different performance data X are applied to each section of song data D1. In particular, in the first embodiment, the performance data X desired by user U is selected from the multiple pieces of performance data X displayed in the performance data list Lx. This makes it possible to generate song data D2 that matches the intentions or preferences of user U.

[0049] B: Second embodiment A second embodiment will be described. Note that, for elements in the following exemplary aspects that have the same functions as those in the first embodiment, the same reference numerals as those in the first embodiment will be used, and detailed descriptions of each will be omitted as appropriate.

[0050] 9 is a block diagram illustrating the functional configuration of a control system 50 according to the second embodiment. A control device 51 according to the second embodiment executes a program stored in a storage device 52, thereby functioning as a data converter 516 in addition to the same elements as those in the first embodiment (a data acquisition unit 510, a performance data classification unit 511, a display control unit 512, a selection acceptance unit 513, an edit processing unit 514, and a data provision unit 515).

[0051] The storage device 52 of the second embodiment stores musical score data G1 representing an image of the musical score of a target piece of music. The musical score data G1 is data in any format, such as PDF (Portable Document Format) or JPEG (Joint Photographic Experts Group) format. A data conversion unit 516 converts the musical score data G1 to generate music data D1. An editing processing unit 514 edits the music data D1 converted by the data conversion unit 516 to generate music data D2.

[0052] Any known technology may be used to convert the musical score data G1 into the music data D1. For example, the technology disclosed in Japanese Patent No. 5770445, Japanese Patent No. 5765848, or Japanese Patent No. 6746892 may be used to convert the musical score data G1.

[0053] The configuration and operation of the second embodiment are the same as those of the first embodiment, except for the data conversion unit 516. Therefore, the second embodiment also achieves the same effects as the first embodiment. Furthermore, in the second embodiment, musical score data G1 representing the musical score of the target song is converted into song data D1. Therefore, even in an environment where only musical score data G1 of the target song exists, song data D2 can be easily generated by editing song data D1 to which performance data X has been applied.

[0054] C: Third embodiment 10 is a block diagram illustrating the functional configuration of a control system 50 according to the third embodiment. A control device 51 according to the third embodiment executes a program stored in a storage device 52, thereby functioning as a preprocessing unit 517 in addition to the same elements as those in the first embodiment (a data acquisition unit 510, a performance data classification unit 511, a display control unit 512, a selection acceptance unit 513, an edit processing unit 514, and a data providing unit 515).

[0055] Pre-processing unit 517 performs predetermined processing (hereinafter referred to as "pre-processing") on music piece data D1. Editing unit 514 applies performance data X to pre-processed music piece data D1 to perform editing, thereby generating music piece data D2.

[0056] 11 is a flowchart of the pre-processing executed by the pre-processing unit 517. The pre-processing unit 517 executes an extraction process Sb1, an adjustment process Sb2, and an arrangement process Sb3. The order in which the extraction process Sb1, the adjustment process Sb2, and the arrangement process Sb3 are executed may be changed as desired. Also, some of the extraction process Sb1, the adjustment process Sb2, and the arrangement process Sb3 may be omitted. Also, other processes may be added to the pre-processing.

[0057] The target piece of music represented by the music data D1 is an ensemble piece composed of multiple performance parts. The extraction process Sb1 is a process for extracting a portion corresponding to a specific performance part from among the multiple performance parts that make up the target piece of music. For example, a performance part selected by the user U by operating the operation device 35, or a performance part corresponding to the main melody of the target piece of music, is extracted from the music data D1. For example, publicly known techniques such as those disclosed in Japanese Patent No. 3801939 or Japanese Patent Laid-Open No. 2021-152618 may be employed for the extraction process Sb1.

[0058] The adjustment process Sb2 is a process for adjusting the difficulty level of the target piece of music represented by the music data D1. Difficulty level refers to the degree of difficulty associated with playing the target piece of music. For example, the adjustment process Sb2 is a process for lowering the difficulty level of the target piece of music. For example, the adjustment process Sb2 includes various processes such as omitting repeat signs included in the target piece of music, assigning fingering numbers to each note, or transposing to a key that is easier to play. The transposition performed as the adjustment process Sb2 is, for example, changing from a key with many alterations (e.g., sharps or flats) to a key with fewer alterations. The adjustment process Sb2 may employ any known technology, such as those described in International Publication No. 2022 / 190453, Japanese Patent No. 72684, or Japanese Patent No. 4682375.

[0059] A plurality of pieces of music data D1 corresponding to different pieces of music are stored in the storage device 52. The arrangement process Sb3 is a process for musically unifying the pieces of music data D1. Specifically, the arrangement process Sb3 includes a first process and a second process.

[0060] 12 is an explanatory diagram of the arrangement process Sb3. The first process is a process of transposing the keys of the pieces of music represented by each piece of music data D1 into a common key. The second process is a process of adjusting the beats of the pieces of music represented by each piece of music data D1 to a common beat and aligning the pieces of music data D1 in time. The second process is an alignment process that aligns the pieces of music data D1 in time, and includes, for example, adding or deleting notes from each measure and changing the note values of notes.

[0061] The third embodiment also achieves the same effects as the first embodiment. Furthermore, in the third embodiment, editing is performed by the editing processing unit 514 on pre-processed music data D1. Therefore, a variety of music data D2 can be generated from music data D1 that has been commonly subjected to basic pre-processing.

[0062] When arranging or creating any part of a musical piece consisting of multiple parts, a situation may arise in which the tempo or key, for example, differs between the musical score arranged or created by user U and the musical score owned by user U. However, when integrating the part arranged or created by user U into a full score, or when user U plays the part arranged or created by user U while referring to the full score, it is desirable that the musical score arranged or created by user U and the musical score owned by user U are musically consistent. The third embodiment can meet the above requirements.

[0063] In the above description, the preprocessing unit 517 performs preprocessing on the music data D1, but the preprocessing unit 517 may also perform preprocessing on each piece of performance data X. Each piece of performance data X after preprocessing is applied to editing of the music data D1.

[0064] D: Fourth embodiment 13 is a schematic diagram of a performance data list Lx in the fourth embodiment. The performance data list Lx in the fourth embodiment displays a note sequence image N for each of the multiple performance data X in the performance data group, in addition to time information Fc and performance position Fd similar to those in the first embodiment. The note sequence image N for each performance data X is an image of the note sequence represented by that performance data X. As described above, the display control unit 512 in the fourth embodiment displays a note sequence image N for each of the multiple performance data X.

[0065] The fourth embodiment also achieves the same effects as the first embodiment. Furthermore, in the fourth embodiment, the note sequence image N of each performance data X is displayed on the display device 34, so the user U can easily select desired performance data X from the performance data group by referring to each note sequence image N. Furthermore, as in the first embodiment, when the user U selects performance data X, the performance sound corresponding to the performance data X may be reproduced by a sound emitting device (not shown), such as a speaker or earphones.

[0066] In the above description, the display control unit 512 of the control system 50 generates the note sequence image N, but the location where the note sequence image N is generated is not limited to the above example. For example, the keyboard instrument 10 or the terminal device 30 may generate the note sequence image N from the performance data X.

[0067] The display method of the performance data list Lx is not limited to the above example. Specifically, the performance data list Lx may be displayed as a pull-down list 64 together with the musical score 60 of the target piece of music, as shown in FIG.

[0068] 14 illustrates a state in which a plurality of note sequence images N in the performance data list Lx are displayed in a pull-down list 64. For example, when the user U specifies a desired portion of the musical score 60 and operates the operation device 35, a list 64 of a plurality of note sequence images N corresponding to the section to be edited that includes that portion is displayed. The user U can select one of the plurality of note sequence images N by operating the operation device 35, thereby selecting the performance data X corresponding to that note sequence image N from the plurality of performance data X. According to the above embodiment, the user U can easily check and select the performance data X.

[0069] 14, note sequence images N of some of the performance data X (for example, the top three in the performance history) may be selectively displayed. Also, note sequence images N of the remaining performance data X may be additionally displayed in response to an instruction from the user U. For example, when the user U selects a message such as "Show more" displayed at the bottom of the list 64, the note sequence images N are additionally displayed.

[0070] E: Fifth embodiment 15 is a block diagram illustrating the configuration of an information processing system 100 according to the fifth embodiment. In the first embodiment, performance data X is transmitted from a terminal device 30 to a control system 50. In the fifth embodiment, material data Z including performance data X and image data Y is transmitted from the terminal device 30 to the control system 50.

[0071] FIG. 16 is an explanatory diagram of image data Y. During the process in which instructor Ub instructs performer Ua, the score of the target piece of music is displayed on display device 34. By operating operating device 35, such as a touch pen, instructor Ub can write instruction comments C on the score displayed on display device 34. Instruction comments C are messages such as problems with the performer Ua's performance or points to note when performing the target piece of music. As illustrated in FIG. 16, image data Y is data representing multiple instruction comments C. Note that image data Y may also include data representing an image of the target piece of music. Image data Y may be composed of multiple layers that are superimposed on each other.

[0072] 17 is a schematic diagram of image data Y. The image data Y includes a plurality of units of data Q (Q1, Q2, ...) that represent different instruction comments C created by an instructor Ub. Each unit of data Q represents one instruction comment C. The image data Y also includes identification information Fa, a song title Fb, and a plurality of attribute data H that correspond to the different instruction comments C.

[0073] The identification information Fa is a code string for identifying the instructor Ub who created the instructional comment C. The song title Fb is the name of the target song for the performance represented by the image data Y.

[0074] The attribute data H is data that represents attributes related to the unit data Q. Specifically, the attribute data H includes a number h1, location information h2, and creation date and time h3. The number h1 is a number for identifying the unit data Q. The creation date and time h3 is the date and time when the instructor Ub created the teaching comment C represented by the unit data Q.

[0075] The position information h2 is information that indicates the position of the instruction comment C represented by the unit data Q. Specifically, the position information h2 specifies the position in the score of the target song where the instruction comment C was added. For example, the position information h2 is exemplified by a number that specifies one of a plurality of areas (cells) that divide the score of the target song.

[0076] For example, if the score of the target piece of music is A4 size (height:width = 7:5), dividing the score vertically into seven equal parts and horizontally into five equal parts results in a total of 35 regions (cells) arranged in a matrix of 7 rows and 5 columns. Of the 35 regions described above, the five regions in the top row, the first row, are assigned numbers "#1" through "#5" in order as position information h2, from the first column on the left to the fifth column on the right. Consecutive numbers are assigned sequentially as position information h2 to each region in the second through seventh rows using the same rule, resulting in numbers "#1" through "#35" being assigned to each region without overlapping.

[0077] The data acquisition unit 510 of the fifth embodiment acquires one or more pieces of material data Z (music performance data X and image data Y) from each of the multiple terminal devices 30. That is, the data acquisition unit 510 acquires multiple pieces of music performance data X and multiple pieces of image data Y. Therefore, the storage device 52 stores multiple pieces of music performance data X and multiple pieces of image data Y.

[0078] The display control unit 512 displays the performance data list Lx exemplified in FIG. 6 or FIG. 13 as well as the image data list Ly of FIG. 18 on the display device 34 of the terminal device 30. The image data list Ly is a list listing multiple image data Y acquired by the data acquisition unit 510. Specifically, the performance data list Lx includes, for each of the multiple image data Y, identification information Fa and song title Fb, as well as the number h1 and creation date and time h3 of each unit data Q. The selection receiving unit 513 receives from the user U the selection of one or more image data Y from the multiple image data Y included in the image data list Ly.

[0079] The editing processor 514 generates the score data G2 by combining the score data G1 of the target song with image data Y selected by the user U. Specifically, the editing processor 514 generates the score data G2 by superimposing one or more image data Y on the score data G1.

[0080] The data providing unit 515 provides the edited data E to the terminal device 30. The edited data E includes edited music data D2 and edited musical score data G2. Specifically, the data providing unit 515 transmits the edited data E from the communication device 53 to the terminal device 30 of the user U, on the condition that the user U executes the billing process. The user U can use the edited data E provided by the control system 50 to output (e.g., display or print) a musical score image including instruction comments C, for example. Note that if the user U selects image data Y related to his or her own performance, the amount charged in the billing process may be set to free (or a discounted amount). If the user U selects image data Y related to his or her own performance, the billing process may be omitted.

[0081] In the second embodiment, the data conversion unit 516 converts the musical score data G1 into the music data D1. However, in the fifth embodiment, the data conversion unit 516 may convert the music data D1 stored in the storage device 52 into the musical score data G1. The editing processing unit 514 generates the musical score data G2 by editing the musical score data G1 after conversion by the data conversion unit 516.

[0082] Any known technique may be used to convert the music data D1 into the musical score data G1. For example, the techniques disclosed in Japanese Patent Application Laid-Open No. 2012-047983 or Japanese Patent Application Laid-Open No. 2008-257068 may be used to convert the music data D1.

[0083] F: Sixth embodiment 19 is a block diagram illustrating the functional configuration of a control system 50 according to the sixth embodiment. A control device 51 according to the sixth embodiment executes a program stored in a storage device 52, thereby functioning as an information setting unit 518 in addition to the same elements as those in the first embodiment (a data acquisition unit 510, a performance data classification unit 511, a display control unit 512, a selection acceptance unit 513, an edit processing unit 514, and a data provision unit 515). In the sixth embodiment, a plurality of pieces of performance data X and a plurality of pieces of image data Y are stored in the storage device 52, as in the fifth embodiment.

[0084] 20 is an explanatory diagram of the operation of the information setting unit 518. The information setting unit 518 sets viewing permission information Ax (Ax1, Ax2, ...) and editing permission information Bx (Bx1, Bx2, ...) for each of multiple performance data X (X1, X2, ...). The viewing permission information Ax is identification information Fa of a user U who is permitted to view the performance data X. On the other hand, the editing permission information Bx is identification information Fa of a user U who is permitted to edit the performance data X. In other words, the storage device 52 stores the identification information Fa (viewing permission information Ax) of a user U who is permitted to view the performance data X and the identification information Fa (editing permission information Bx) of a user U who is permitted to edit the performance data X.

[0085] For example, at the stage when material data Z is transmitted from terminal device 30 to control system 50, user U operates operation device 35 to specify identification information Fa of user U permitted to view performance data X and identification information Fa of user U permitted to edit performance data X. Upon receiving material data Z from terminal device 30, information setting unit 518 sets identification information Fa of user U permitted to view as viewing permission information Ax for performance data X in material data Z. Furthermore, information setting unit 518 sets identification information Fa of user U permitted to edit as editing permission information Bx for performance data X in material data Z. In other words, user U providing material data Z can specify users U permitted to view or edit performance data X created by user U.

[0086] The information setting unit 518 may automatically set viewing permission information Ax, which indicates permission for viewing, and editing permission information Bx, which indicates permission for editing, for the performance data X of the user U. That is, the viewing permission information Ax and the editing permission information Bx may be assigned to the performance data X of the user U without requiring the user U to perform any operation on the operation device 35.

[0087] Furthermore, the information setting unit 518 sets viewing permission information Ay (Ay1, Ay2, ...) and editing permission information By (By1, By2, ...) for each of the multiple image data Y (Y1, Y2, ...). The viewing permission information Ay is identification information Fa of a user U who is permitted to view the image data Y. On the other hand, the editing permission information By is identification information Fa of a user U who is permitted to edit the image data Y. That is, the storage device 52 stores the identification information Fa (viewing permission information Ay) of a user U who is permitted to view the image data Y and the identification information Fa (editing permission information By) of a user U who is permitted to edit the image data Y.

[0088] For example, at the stage when material data Z is transmitted from terminal device 30 to control system 50, user U operates operation device 35 to specify identification information Fa of user U permitted to view image data Y and identification information Fa of user U permitted to edit image data Y. Upon receiving material data Z from terminal device 30, information setting unit 518 sets identification information Fa of user U permitted to view as viewing permission information Ay for image data Y in material data Z. Furthermore, information setting unit 518 sets identification information Fa of user U permitted to edit as editing permission information By for image data Y in material data Z. In other words, user U providing material data Z can specify users U who can view or edit image data Y that he or she created.

[0089] The information setting unit 518 may automatically set viewing permission information Ay indicating permission for viewing and editing permission information By indicating permission for editing for the image data Y of the user U. That is, the viewing permission information Ay and the editing permission information By may be assigned to the image data Y of the user U without requiring the user U to perform any operation on the operation device 35.

[0090] The display control unit 512 displays the performance data X on the display device 34 of the terminal device 30 of the user U in response to an instruction from the user U who is permitted to view the performance data X. For example, in response to an instruction from the user U via the operation device 35, a viewing request including the identification information Fa of the user U is sent from the terminal device 30 to the control system 50. The display control unit 512 determines whether the identification information Fa included in the viewing request is included in the viewing permission information Ax. If the identification information Fa is included in the viewing permission information Ax, the display control unit 512 displays the performance data X on the display device 34 of the terminal device 30. On the other hand, if the identification information Fa is not included in the viewing permission information Ax, the display control unit 512 does not display the performance data X on the display device 34 of the terminal device 30. As described above, according to the sixth embodiment, viewing of the performance data X can be permitted only to specific users U.

[0091] The display control unit 512 displays the image data Y on the display device 34 of the terminal device 30 of the user U in response to an instruction from the user U who is permitted to view the image data Y. For example, in response to an instruction from the user U via the operation device 35, a viewing request including the identification information Fa of the user U is sent from the terminal device 30 to the control system 50. The display control unit 512 determines whether the identification information Fa included in the viewing request is included in the viewing permission information Ay. If the identification information Fa is included in the viewing permission information Ay, the display control unit 512 displays the image data Y on the display device 34 of the terminal device 30. On the other hand, if the identification information Fa is not included in the viewing permission information Ay, the display control unit 512 does not display the image data Y on the display device 34 of the terminal device 30. As described above, according to the sixth embodiment, viewing of the image data Y can be permitted only to a specific user U.

[0092] The edit processing unit 514 edits the performance data X in response to an instruction from a user U who is permitted to edit the performance data X. For example, in response to an instruction from the user U via the operation device 35, an edit request including the identification information Fa of the user U is sent from the terminal device 30 to the control system 50. The edit processing unit 514 determines whether the identification information Fa included in the edit request is included in the edit permission information Bx. If the identification information Fa is included in the edit permission information Bx, the edit processing unit 514 edits the performance data X in response to the instruction from the user U. On the other hand, if the identification information Fa is not included in the edit permission information Bx, the edit processing unit 514 does not edit the performance data X. As described above, according to the sixth embodiment, editing of the performance data X can be permitted only for specific users U.

[0093] The editing processing unit 514 edits the image data Y in response to an instruction from a user U who is permitted to edit the image data Y. For example, in response to an instruction from the user U to the operation device 35, an editing request including the identification information Fa of the user U is sent from the terminal device 30 to the control system 50. The editing processing unit 514 determines whether the identification information Fa included in the editing request is included in the editing permission information By. If the identification information Fa is included in the editing permission information By, the editing processing unit 514 edits the image data Y in response to an instruction from the user U. On the other hand, if the identification information Fa is not included in the editing permission information By, the editing processing unit 514 does not edit the image data Y. As described above, according to the sixth embodiment, editing of the image data Y can be permitted only to specific users U.

[0094] G: Seventh embodiment 21 is a block diagram illustrating the functional configuration of a control system 50 according to the seventh embodiment. A control device 51 according to the seventh embodiment executes a program stored in a storage device 52, thereby functioning as an information setting unit 519 in addition to the same elements as those in the first embodiment (a data acquisition unit 510, a performance data classification unit 511, a display control unit 512, a selection acceptance unit 513, an edit processing unit 514, and a data provision unit 515). In the seventh embodiment, a plurality of pieces of performance data X and a plurality of pieces of image data Y are stored in the storage device 52, as in the fifth embodiment.

[0095] 22 is an explanatory diagram of the operation of the information setting unit 519. As exemplified in each of the above-mentioned embodiments, the edit processing unit 514 generates music data D2 by editing music data D1 to which performance data X is applied, and generates score data G2 by editing score data G1 to which image data Y is applied. The edit processing unit 514 of the seventh embodiment repeatedly and cumulatively edits music data D and score data G to generate multiple edited data E (E1, E2, ...) corresponding to different versions.

[0096] The nth edition (n is a natural number equal to or greater than 1) of edited data En includes music data D2, which is an edited version of music data D1 included in the immediately preceding edited data En-1, and musical score data G2, which is an edited version of musical score data G1 included in edited data En-1. The second edition of edited data E2 includes music data D2, which is an edited version of initial music data D1, and musical score data G2, which is an edited version of initial musical score data G1.

[0097] The information setting unit 519 sets copyright information Rn (R1, R2, ...) for each version of edited data En. The copyright information Rn is information related to the copyright of the nth version of edited data En. Specifically, the copyright information Rn includes whether the copyright property rights are valid or invalid, whether the moral rights are valid or invalid, the name and contact information of the editor (author), and the time of editing. Valid copyright property rights or moral rights mean that the rights have not been waived, while invalid copyright property rights or moral rights mean that the rights have been waived (so-called public domain). The editor's contact information is, for example, an address, telephone number, or email address. As described above, according to the seventh embodiment, copyright information Rn can be set for each version of edited data En (music data D and musical score data G).

[0098] The copyright information Rn is set in response to instructions from a user U who edits the material data Z (performance data X, image data Y). On the other hand, a user U who wishes to re-edit edited data En that has already been edited operates the operation device 35 to specify the desired version of the edited data En. The terminal device 30 transmits an information request specifying the version specified by the user U to the control system 50. The display control unit 512 transmits the copyright information Rn set in the edited data En for the version specified by the user U to the terminal device 30 that made the request. The display device 34 of the terminal device 30 displays the copyright information Rn. Thus, the user U can check the copyright information Rn for each version of the edited data En. For example, the user U can check whether or not there is a copyright right and a moral right, as well as the contact information of the author.

[0099] For convenience, Fig. 22 illustrates a case where one edited data En+1 is generated by editing one edited data En. However, as illustrated in Fig. 23, multiple edited data En+1 may be generated from one edited data En by applying different performance data X or image data Y. Copyright information Rn is also set for each of the multiple edited data En+1 generated from the common edited data En.

[0100] H: Eighth embodiment The data providing unit 515 of the fifth embodiment transmits edited data E from the communication device 53 to the terminal device 30 of the user U, on the condition that the user U executes a billing process. In other words, the user U can obtain the edited music piece data D and musical score data G in exchange for paying a predetermined amount of currency.

[0101] The data providing unit 515 of the eighth embodiment provides one or more pieces of performance data X from among the plurality of pieces of performance data X stored in the storage device 52 to the terminal device 30 of the user U. Specifically, the data providing unit 515 transmits the performance data X from the communication device 53 to the terminal device 30 of the user U on the condition that the user U executes a billing process.

[0102] Specifically, the display control unit 512 displays the performance data list Lx of Fig. 24 on the display device 34 of the terminal device 30. The performance data list Lx includes, for each of the multiple performance data X, the same information as in the fourth embodiment (Fig. 13) (time information Fc, performance position Fd, and note sequence image N), and the price Px of the performance data X. The data providing unit 515 transmits the performance data X selected by the user U from the performance data list Lx to the terminal device 30 of the user U in exchange for a billing process for the price Px.

[0103] According to the eighth embodiment, performance data X representing a performance of a partial section of a target song is provided to the terminal device 30 of the user U who has executed the billing process. This effectively promotes the buying and selling of performance data X. The user U of the terminal device 30 can use the performance data X acquired through the billing process to edit his or her own song data D.

[0104] Furthermore, the data providing unit 515 provides one or more pieces of image data Y from the plurality of image data Y stored in the storage device 52 to the terminal device 30 of the user U. Specifically, the data providing unit 515 transmits the image data Y from the communication device 53 to the terminal device 30 of the user U on the condition that the user U executes the billing process.

[0105] 25 on the display device 34 of the terminal device 30. The image data list Ly includes, for each of a plurality of image data Y, identification information Fa and song title Fb, creation date and time h3 of each unit data Q, price Py of the image data Y, and a summary 61 of the image data Y. The summary 61 of the image data Y is a general outline of the instruction comment C represented by the image data Y. The data providing unit 515 transmits the image data Y selected by the user U from the image data list Ly to the terminal device 30 of the user U in exchange for a charging process for the price Py.

[0106] According to the eighth embodiment, image data Y is provided to the terminal device 30 of the user U who has executed the billing process. This effectively promotes the buying and selling of image data Y. The user U of the terminal device 30 can use the image data Y acquired through the billing process to refer to the instruction comments C or edit the musical score data G.

[0107] The performance data list Lx or the image data list Ly in the eighth embodiment may be displayed, for example, as a pull-down list together with the musical score 60 of the target song, as in the example of Fig. 14. The user U selects the desired performance data X from the performance data list Lx, and the desired image data Y from the image data list Ly.

[0108] I: Ninth embodiment FIG. 26 is a schematic diagram of image data Y in the ninth embodiment. In the fifth embodiment, as shown in the example of FIG. 17, it was assumed that the identification information Fa of one instructor Ub was registered in the image data Y. However, in reality, it is also assumed that multiple instructors Ub jointly create the image data Y. As shown in the example of FIG. 26, the image data Y in the ninth embodiment has the identification information Fa of each of the multiple instructors Ub who jointly created the image data Y registered in the image data Y.

[0109] 27 shows the transition of screens displayed on the display device 34 in the process of the terminal device 30 logging in to the control system 50. When the user U instructs logging in to the control system 50 by operating the operation device 35, an authentication screen 631 is displayed on the display device 34 of the terminal device 30, allowing the instructor Ub (representative) to input authentication information (e.g., identification information and a password).

[0110] If the authentication process by the instructor Ub is successful, a setting screen 632 prompting the input of the other instructors Ub who jointly created the image data Y is displayed on the display device 34. The instructor Ub operates the operation device 35 to specify the other instructors Ub. Once all of the instructors Ub have been specified, a confirmation screen 633 for confirming whether the specified contents are appropriate is displayed on the display device 34. Once the confirmation on the confirmation screen 633 is complete, as shown in the example of FIG. 26, the identification information Fa of each of the multiple instructors Ub is registered in the image data Y. The multiple instructors Ub registered as creators can view and edit the image data Y. Note that the identification information Fa of each instructor Ub may be registered in the viewing permission information Ay or the editing permission information By in the sixth embodiment.

[0111] J: Variation Specific modified embodiments that can be added to each of the embodiments exemplified above are exemplified below. Two or more embodiments arbitrarily selected from the following examples may be appropriately combined within the scope of not being mutually contradictory.

[0112] (1) In the above-described embodiments, the user U selects performance data X from the performance data list Lx. However, the method of selecting performance data X to be applied to editing the music data D1 is not limited to the above examples. For example, a configuration is also conceivable in which performance data X is selected using attribute information of the performance data X. The attribute information is, for example, tag information such as the musical genre (e.g., jazz, rock) of the note sequence related to the performance data X or the difficulty level of the performance. The user U specifies conditions related to the attributes of the performance data X by operating the operation device 35. The editing processing unit 514 selects performance data X with attribute information that satisfies the conditions specified by the user U.

[0113] Any known technology may be employed to identify the musical genre of the performance data X. For example, the technology disclosed in Japanese Patent Laid-Open No. 2003-298830, Japanese Patent No. 7176113, or Japanese Patent No. 4665836 may be used to estimate the musical genre. The user U who provides the performance data X may also specify the musical genre. Any known technology may be employed to identify the difficulty level of the performance data X. For example, the technology disclosed in Japanese Patent Laid-Open No. 2007-241026, Japanese Patent No. 6906358, or Japanese Patent No. 6248415 may be used to estimate the difficulty level. The user U who provides the performance data X may also specify the difficulty level.

[0114] (2) In the above-described embodiments, the music data D2 is provided to the user U on the condition that the billing process is executed. When the music data D2 is provided, a portion of the price of the music data D2 may be paid to the user U who created the performance data X to which the music data D2 is edited. Payment to the user U who created the performance data X may be made, for example, by electronic payment.

[0115] In the seventh embodiment, an example has been given in which performance data X is provided to user U on the condition that billing processing is executed. When the performance data X is provided, a part of the price Px of the performance data X may be returned to user U who created the performance data X. Payment to user U who created the performance data X may be made, for example, by electronic payment. Note that when the performance data X is provided, the price Px of the performance data X may be provided to user U who created the performance data X and to an administrator of control system 50 (or information processing system 100).

[0116] Similarly, in the seventh embodiment, an example has been given in which image data Y is provided to user U on the condition that billing processing is executed. When image data Y is provided, a portion of the price Py of the image data Y may be returned to user U who created the image data Y. Payment to user U who created the image data Y may be made, for example, by electronic payment. Note that when image data Y is provided, the price Py of the image data Y may be provided to user U who created the image data Y and to the administrator of control system 50 (or information processing system 100).

[0117] (3) In the above-described embodiments, the editing section selected by the user U in the music data D1 of the target music piece is replaced with the performance data X. However, the editing processing unit 514 may also replace sections of the music data D1 of the target music piece that have similar note sequences to the editing section (hereinafter referred to as "related sections") with the performance data X. That is, one or more related sections in the music data D1 are automatically replaced with the performance data X (i.e., without requiring any instruction from the user U). A related section is, for example, a section whose note sequence similarity to the editing section exceeds a predetermined threshold. Any known technique may be employed to search for related sections.

[0118] For example, after receiving the specification of the section to be edited and the performance data X from the user U (Sa1, Sa3) and replacing the section to be edited with the performance data X (Sa4), the control device 51 (edit processing unit 514) prompts the user U to select whether or not to edit the related section as well. For example, a confirmation message such as "There are other similar phrases. Do you want to edit those phrases as well?" is displayed on the display device 34. Upon receiving an affirmative response from the user U, the control device 51 (edit processing unit 514) replaces the related section of the music piece data D1 with the performance data X, as described above.

[0119] (4) In the fifth embodiment, material data Z including performance data X and image data Y is transmitted from the terminal device 30 to the control system 50, and edited data E including edited music piece data D2 and edited score data G2 is transmitted from the control system 50 to the terminal device 30. However, transmission of performance data X from the terminal device 30 to the control system 50 or transmission of music piece data D2 from the control system 50 to the terminal device 30 may be omitted. In other words, editing of music piece data D1 using performance data X may be omitted.

[0120] (5) Some or all of the functions of the control system 50 exemplified in each of the above embodiments may be installed in the terminal device 30. In addition, two or more embodiments selected from the above embodiments (first embodiment to ninth embodiment) may be appropriately combined.

[0121] (6) As mentioned above, the functions of the control system 50 illustrated above are realized by cooperation between one or more processors constituting the control device 51 and a program stored in the storage device 52. The program according to the present disclosure may be provided in a form stored on a computer-readable recording medium and installed on a computer. The recording medium may be, for example, a non-transitory recording medium, such as an optical recording medium (optical disk) such as a CD-ROM, but may also include any known type of recording medium, such as a semiconductor recording medium or a magnetic recording medium. Note that a non-transitory recording medium includes any recording medium other than a transitory, propagating signal, and does not exclude volatile recording media. Furthermore, in a configuration in which a distribution device distributes a program via the communication network 200, the storage medium that stores the program in the distribution device corresponds to the non-transitory recording medium described above.

[0122] K:Additional notes From the above-described exemplary embodiments, the following configurations can be understood, for example.

[0123] An information processing system according to one aspect (aspect 1) of the present disclosure includes a data acquisition unit that acquires a plurality of performance data representing the performance of a portion of a musical piece, a performance data classification unit that classifies the plurality of performance data into a plurality of performance data groups corresponding to different sections of the musical piece, and an editing processing unit that replaces a specific section of the musical piece data representing the musical piece with performance data selected from a performance data group corresponding to the specific section among the plurality of performance data groups.

[0124] In the above-described embodiment, multiple pieces of performance data representing performances of sections of a piece of music are classified into multiple performance data groups, and specific sections of the music data are replaced with performance data selected from the performance data group corresponding to the sections. This makes it possible to easily generate multiple pieces of music data in which different performance data are applied to specific sections of the music data.

[0125] "Performance data" is data in any format that represents a musical piece being performed. For example, MIDI time-series data representing each note played by a performer, or audio data recording the sound of a performer playing an instrument, are examples of "performance data."

[0126] A performance data group corresponding to one section of a piece of music is a collection of two or more pieces of performance data that correspond to that section among the multiple pieces of performance data. Note that the multiple pieces of performance data that belong to one performance data group do not necessarily correspond strictly to a common section in the piece of music. For example, a performance data group corresponding to one section of a piece of music is a collection of two or more pieces of performance data that correspond to positions close to that section among the multiple pieces of performance data.

[0127] The method of selecting the performance data to be used to replace the music piece data from the performance data group may be arbitrary, for example, one of the performance data from the performance data group may be selected by a user, one of the performance data from the performance data group may be selected according to a predetermined rule, or one of the performance data from the performance data group may be selected randomly.

[0128] In a specific example (Aspect 2) of Aspect 1, the music data is data specifying a plurality of notes that make up the music piece in chronological order, and the system further includes a data conversion unit that generates the music data from image data representing the musical score of the music piece. According to the above aspect, image data representing an image of the musical score is converted into music data. Therefore, even in an environment where only image data of the music piece exists, editing of music data by applying performance data can be easily realized.

[0129] In a specific example (Aspect 3) of Aspect 1 or Aspect 2, the system further includes a pre-processing unit that performs pre-processing on the music data, and the edit processing unit replaces the specific section of the music data after the pre-processing with performance data. According to the above aspect, the edit processing unit performs editing on the pre-processed music data. Therefore, a variety of music data can be generated from music data that has undergone common basic pre-processing. "Preprocessing" refers to any process that edits music data. Examples of "preprocessing" include editing a score to increase or decrease the difficulty of playing the music, changing the key of a piece of music, and extracting a specific performance part from a score that includes multiple performance parts.

[0130] In a specific example (Aspect 4) of any one of Aspects 1 to 3, the system further includes a display control unit that displays two or more performance data included in the performance data group on a display device, and a selection receiving unit that receives a selection of one of the two or more performance data, and the editing processing unit replaces the specific section of the music data with the performance data selected by the selection receiving unit. According to the above aspect, a user can select desired performance data from the two or more performance data displayed as selection candidates. This allows music data to be generated in accordance with the user's intentions or preferences.

[0131] In a specific example of Aspect 4 (Aspect 5), the display control unit displays, for each of the two or more pieces of performance data, an image of the note sequence represented by that performance data. According to the above aspect, since an image of the note sequence for each piece of performance data is displayed, the user can easily select desired performance data from the group of performance data.

[0132] In a specific example (Aspect 6) of any of Aspects 1 to 5, a storage unit is further provided for storing identification information of users who are permitted to edit the performance data, and the editing processing unit edits the performance data in response to instructions from the users who are permitted to edit the performance data. According to the above aspects, it is possible to restrict the users who can edit the performance data.

[0133] In a specific example (Aspect 7) of any of Aspects 1 to 6, the edit processing unit generates multiple pieces of music data corresponding to different versions by repeatedly editing the music data, and further includes an information setting unit that sets copyright information related to the copyright for each version of the music data. According to the above aspect, copyright information can be set for each version of the music data generated by editing the music data. The copyright may be either or both of the property right and the moral right. The information setting unit may set either the property right or the moral right, or may set each of the property right and the moral right separately.

[0134] In a specific example (Aspect 8) of any one of Aspects 1 to 7, a data providing unit is further provided that provides the music data processed by the editing processing unit to the terminal device of the user who executed the billing process. According to the above aspect, the music data processed by the editing processing unit is provided to the terminal device of the user who executed the billing process. Therefore, buying and selling of music data can be effectively promoted.

[0135] In a specific example (Aspect 9) of any one of Aspects 1 to 8, the system further includes a data providing unit that provides one or more of the plurality of performance data to the terminal device of the user who executed the billing process. According to the above aspect, performance data representing the performance of a portion of a musical piece is provided to the terminal device of the user who executed the billing process. Therefore, buying and selling of performance data can be effectively promoted. The user of the terminal device can use the performance data obtained through the billing process to generate their own musical piece data.

[0136] An information processing method according to one aspect (aspect 10) of the present disclosure acquires a plurality of performance data representing the performance of a portion of a musical piece, classifies the plurality of performance data into a plurality of performance data groups corresponding to different sections of the musical piece, and replaces a specific section of the musical piece data representing the musical piece with performance data selected from the performance data group corresponding to the specific section among the plurality of performance data groups.

[0137] A program according to one aspect (aspect 11) of the present disclosure causes a computer system to function as a data acquisition unit that acquires multiple performance data representing the performance of a portion of a musical piece, a performance data classification unit that classifies the multiple performance data into multiple performance data groups corresponding to different sections of the musical piece, and an editing processing unit that replaces a specific section of the musical piece data representing the musical piece with performance data selected from a performance data group corresponding to the specific section among the multiple performance data groups. [Explanation of symbols]

[0138] 100...information processing system, 200...communication network, 10...keyboard instrument, 30...terminal device, 31...control device, 32...storage device, 33...communication device, 34...display device, 35...operation device, 50...control system, 51...control device, 52...storage device, 53...communication device, 510...data acquisition unit, 511...data classification unit, 512...display control unit, 513...selection reception unit, 514...editing processing unit, 515...data provision unit, 516...data conversion unit, 517...preprocessing unit, 518...information setting unit, 519...information setting unit.

Claims

1. a data acquisition unit that acquires a plurality of performance data representing the performance of a portion of a piece of music; a performance data classification unit that classifies the plurality of performance data into a plurality of performance data groups corresponding to different sections of the music piece; an edit processing unit that replaces a specific section of the music piece data representing the music piece with performance data selected from a performance data group corresponding to the specific section among the plurality of performance data groups; An information processing system comprising:

2. the music data is data specifying a plurality of notes constituting the music piece in time series, The apparatus further includes a data conversion unit that generates the music data from image data representing the musical score of the music. The information processing system of claim 1.

3. a pre-processing unit that performs pre-processing on the music data; The editing processing unit replaces the specific section of the music data after the pre-processing with performance data. The information processing system of claim 1.

4. a display control unit for displaying two or more pieces of performance data included in the performance data group on a display device; a selection receiving unit that receives a selection of one of the two or more performance data; Further comprising: The editing processing unit replaces the specific section of the music data with performance data selected by the selection receiving unit. The information processing system of claim 1.

5. The display control unit displays an image of a sequence of notes represented by each of the two or more performance data.

5. The information processing system of claim 4.

6. a storage unit for storing identification information of users who are permitted to edit the performance data; The editing processing unit edits the performance data in response to an instruction from a user who is permitted to edit the performance data. The information processing system of claim 1.

7. the editing processing unit generates a plurality of pieces of music data corresponding to different versions by repeatedly editing the music data; an information setting section for setting copyright information regarding the copyright of each version of the music data; The information processing system of claim 1 further comprising:

8. a data providing section that provides the music data processed by the editing processing section to the terminal device of the user who has executed the billing process; The information processing system of claim 1 further comprising:

9. a data providing section that provides one or more pieces of performance data from among the plurality of pieces of performance data to a terminal device of a user who has executed a billing process; The information processing system of claim 1 further comprising:

10. acquiring a plurality of pieces of performance data representing performances of a portion of a piece of music; classifying the plurality of performance data into a plurality of performance data groups corresponding to different sections of the musical piece; A specific section of the music piece data representing the music piece is replaced with performance data selected from a performance data group corresponding to the specific section among the plurality of performance data groups. An information processing method implemented by a computer system.

11. a data acquisition unit that acquires a plurality of performance data representing the performance of a portion of a musical piece; a performance data classification unit that classifies the plurality of performance data into a plurality of performance data groups corresponding to different sections of the music piece; an edit processing unit that replaces a specific section of the music piece data representing the music piece with performance data selected from a performance data group corresponding to the specific section among the plurality of performance data groups; A program that makes a computer system function as a

Images