Information processing apparatus, information processing method, and information processing program

Abstract

An information processing apparatus according to the present disclosure has a storage unit configured to store therein a plurality of pieces of musical composition feature information used as learning data in a musical composition process using machine learning, and in which a predetermined identification information item is associated with a plurality of types of feature amounts extracted from musical composition information; a reception unit configured to receive instruction information transmitted from a terminal apparatus; an extraction unit configured to extract, from the storage unit, a piece of musical composition feature information in accordance with the instruction information; and an output unit configured to output presentation information about the piece of musical composition feature information extracted by the extraction unit.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to an information processing apparatus, an information processing method, and an information processing program. BACKGROUND

[0002] With the progress of artificial intelligence (AI), the application of computers in the field of art has made progress. For example, a technique is known in which machine learning is performed on an existing musical piece as learning data to generate a model for musical piece generation, and a computer composes a new musical piece (for example, Patent Literature 1). In such a technique, it is possible to imitate the characteristics of an existing musical piece or produce a more natural melody by using a Markov model.

[0003] PRIOR ART DOCUMENTS

[0004] PATENT LITERATURE

[0005] Patent Literature 1: U.S. Patent No. 9110817 SUMMARY

[0006] PROBLEMS TO BE SOLVED BY THE INVENTION

[0007] According to the conventional technique, since musical piece information proposed (generated) by AI is available in composition, a user can perform composition based on a wider variety of perspectives.

[0008] The automatic composition function of AI is set for a general user, and the general user can only receive automatically created musical piece information by setting an image such as bright and dark. On the other hand, since a maker who produces a musical piece often specifically sets characteristics of a musical piece, such as a chord progression and a bass progression, in the process of producing a musical piece, the maker desires to receive a provision of musical piece information that matches the characteristics of the musical piece, rather than an image.

[0009] Therefore, the present disclosure proposes an information processing apparatus, an information processing method, and an information processing program capable of improving the convenience of a musical piece creation function of a user.

[0010] SOLUTION TO THE PROBLEM

[0011] To solve the above problem, the information processing apparatus according to the present disclosure includes a storage unit that stores a plurality of pieces of musical piece characteristic information in which a plurality of types of characteristic amounts extracted from musical piece information are associated with predetermined identification information, the musical piece characteristic information being used as learning data in a composition process using machine learning; a reception unit that receives instruction information transmitted from a terminal apparatus; an extraction unit that extracts the musical piece characteristic information from the storage unit according to the instruction information; and an output unit that outputs presentation information of the musical piece characteristic information extracted by the extraction unit. BRIEF DESCRIPTION OF DRAWINGS

[0012] Figure 1 is a conceptual diagram showing a flow of information processing according to the first embodiment.

[0013] Figure 2 is a diagram showing an example of data configuration of style information according to the first embodiment.

[0014] Figure 3 is a diagram showing an example of a display screen of a user terminal according to the first embodiment.

[0015] Figure 4 is a diagram showing an example of a display screen of a user terminal according to the first embodiment.

[0016] Figure 5 is a diagram showing an example of a display screen of a user terminal according to the first embodiment.

[0017] Figure 6 is a diagram showing an example of an information processing system according to the first embodiment.

[0018] Figure 7 is a diagram showing a configuration example of an information processing apparatus according to the first embodiment.

[0019] Figure 8 is a diagram showing an example of a user information storage unit according to the first embodiment.

[0020] Figure 9 is a diagram showing an example of a style information storage unit according to the first embodiment.

[0021] Figure 10 is a diagram showing an example of a possession information storage unit according to the first embodiment.

[0022] Figure 11 is a diagram showing an example of a production information storage unit according to the first embodiment.

[0023] Figure 12 is a diagram showing an example of an operation history information storage unit according to the first embodiment.

[0024] Figure 13 is a diagram showing a configuration example of a producer terminal according to the first embodiment.

[0025] Figure 14 is a sequence diagram showing a process of information processing according to the first embodiment.

[0026] Figure 15 is a diagram showing an example of a display screen of a producer terminal according to the first embodiment.

[0027] Figure 16 is a diagram showing an example of a display screen of a producer terminal according to a modification of the first embodiment.

[0028] Figure 17 is a diagram showing an example of a display screen of a producer terminal according to a modification of the first embodiment.

[0029] Figure 18 is a diagram showing an example of a display screen of a producer terminal according to a modification of the first embodiment.

[0030] Figure 19 is a flowchart showing an information processing procedure according to a modification of the first embodiment.

[0031] Figure 20 is a conceptual diagram showing a flow of information processing according to the second embodiment.

[0032] Figure 21 is a diagram showing an example of an information processing system according to the second embodiment.

[0033] Figure 22 is a diagram showing a configuration example of an information processing apparatus according to the second embodiment.

[0034] Figure 23 is a diagram showing an example of a user history information storage unit according to the second embodiment.

[0035] Figure 24 is a diagram showing a configuration example of a general user terminal according to the second embodiment.

[0036] Figure 25 is a sequence diagram showing a procedure of information processing according to the second embodiment.

[0037] Figure 26 is a sequence diagram showing a procedure of information processing according to the second embodiment.

[0038] Figure 27 is a sequence diagram showing a procedure of information processing according to the second embodiment.

[0039] Figure 28 is a conceptual diagram showing a flow of information processing according to the third embodiment.

[0040] Figure 29 is a diagram showing an example of an information processing system according to the third embodiment.

[0041] Figure 30 is a diagram showing a configuration example of an information processing apparatus according to the third embodiment.

[0042] Figure 31 is a diagram illustrating an example of a user action history information storage unit according to the third embodiment.

[0043] Figure 32 is a diagram illustrating an example of a position pattern information storage unit according to the third embodiment.

[0044] Figure 33 is a diagram illustrating an example of a configuration of a general user terminal according to the third embodiment.

[0045] Figure 34 is a sequence diagram illustrating a process of information processing according to the third embodiment.

[0046] Figure 35 is a sequence diagram illustrating a process of information processing according to the third embodiment.

[0047] Figure 36 is a sequence diagram illustrating a process of information processing according to the third embodiment.

[0048] Figure 37 is a diagram illustrating an example of a conceptual diagram of a configuration of an information processing system.

[0049] Figure 38 is a diagram illustrating an example of a user interface according to the present embodiment.

[0050] Figure 39 is a diagram illustrating an example of a user interface according to the present embodiment.

[0051] Figure 40 is a hardware configuration diagram illustrating an example of a computer that realizes the functions of the information processing apparatus and the general user terminal. DETAILED DESCRIPTION

[0052] Embodiments of the present disclosure will be described in detail below based on the drawings. Note that the information processing apparatus, the information processing method, and the information processing program according to the present embodiment are not limited by the embodiments. Furthermore, in each of the embodiments described below, the same portions are denoted by the same reference numerals, and repetitive description will be omitted.

[0053] The present disclosure will be described in the order of items described below.

[0054] 1. First Embodiment

[0055] 1-1. Example of information processing according to the first embodiment

[0056] 1-2. Configuration of information processing system according to the first embodiment

[0057] 1-3. Configuration of the information processing device according to the first embodiment

[0058] 1-4. Configuration of the producer terminal according to the first embodiment

[0059] 1-5. Process of the information processing according to the first embodiment

[0060] 1-6. Effects of the first embodiment

[0061] 2. Modification of the first embodiment

[0062] 2-1. Example of the information processing according to the modification of the first embodiment

[0063] 2-2. Process of the information processing according to the modification of the first embodiment

[0064] 2-3. Effects according to the modification of the first embodiment

[0065] 3. Second embodiment

[0066] 3-1. Example of the information processing according to the second embodiment

[0067] 3-2. Configuration of the information processing system according to the second embodiment

[0068] 3-3. Configuration of the information processing device according to the second embodiment

[0069] 3-4. Configuration of the general user terminal according to the second embodiment

[0070] 3-5. Process of the information processing according to the second embodiment

[0071] 3-5-1. Process of presenting style information

[0072] 3-5-2. Process of providing a play list

[0073] 3-5-3. Process of providing music information after reworking or arranging

[0074] 3-6. Effects according to the second embodiment

[0075] 4. Third embodiment

[0076] 4-1. Example of the information processing according to the third embodiment

[0077] 4-2. Configuration of the information processing system according to the third embodiment

[0078] 4-3. Configuration of the information processing device according to the third embodiment

[0079] 4-4. Configuration of general user terminal according to third embodiment

[0080] 4-5. Process of information processing according to fourth embodiment

[0081] 4-5-1. Process of presenting style information

[0082] 4-5-2. Process of providing play list

[0083] 4-5-3. Process of providing music information after reworking or arranging

[0084] 4-6. Effects according to third embodiment

[0085] 5. Conceptual diagram of configuration of information processing system

[0086] 5-1. Regarding overall configuration

[0087] 5-2. Regarding server apparatus

[0088] 5-3. Regarding music maker application program unit

[0089] 5-4. Regarding general user application program

[0090] 5-5. User interface (UI)

[0091] 6. Other embodiments

[0092] 6-1. Other configuration examples

[0093] 6-2. Others

[0094] 7. Hardware configuration

[0095] [1. First embodiment]

[0096] [1-1. Example of information processing according to first embodiment]

[0097] First, an example of information processing according to the first embodiment will be described with reference to Figure 1 Figure 1 is a conceptual diagram showing a flow of information processing according to the first embodiment. The information processing according to the first embodiment is executed by the information processing apparatus 100 and the maker terminal 200.

[0098] ​In the present first embodiment, a case where the information processing apparatus 100 is an information processing apparatus that provides a service (also simply referred to as "service") related to creation of content that is a copyrighted work will be described as an example. Note that, hereinafter, a musical piece (musical piece content) will be described as an example of content, but the content is not limited to a musical piece, and can be various types of content such as video content of a movie or text content such as a book (novel, etc.). Further, the musical piece referred to herein is not limited to one complete musical piece (whole), but includes the concept of a partial sound source that constitutes a song (musical piece) and various musical piece information such as a short tone for sampling.

[0099] The information processing apparatus 100 communicates with the producer terminal 200 of a user who uses the service provided by the information processing apparatus 100 by using a network N (see Figure 6 ) such as the Internet. Note that the number of producer terminals 200 is not limited to the number shown in Figure 1 .

[0100] The producer terminal 200 is an information processing terminal such as a personal computer (PC) or a tablet terminal. Various program applications are installed in the producer terminal 200. A musical piece creation-related application is installed in the producer terminal 200. For example, the producer terminal 200 has an automatic composition function of AI added to an application program (such as a DAW) that realizes a comprehensive musical piece production environment through a plug-in (extension application). For example, the plug-in can take the form of Virtual Studio Technology (VST) (registered trademark) of Steinberg, AudioUnits, Avid Audio eXtension (AAX), or the like. Further, the producer terminal 200 is not limited to a DAW, and for example, a mobile application program such as iOS can be used.

[0101] The producer terminal 200 activates and executes the DAW and the automatic composition function of AI, communicates with the information processing apparatus 100, and receives provision of musical piece information created by the information processing apparatus 100. Further, when the automatic composition function is activated, the producer terminal 200 transmits operation history information that indicates a history of operations performed on the producer terminal 200 to the information processing apparatus 100.

[0102] The user of the producer terminal 200 is any one of a manager who operates and manages the entire system, a composer who creates a musical piece, an arranger, a producer such as a studio engineer, and a general user who receives provision of musical piece information via the automatic composition function. In the present first embodiment, it is assumed that the producer terminal 200 is used by a producer Cl.

[0103] The information processing apparatus 100 is a server apparatus that performs information processing related to the automatic composition function of AI of the producer terminal 200. For example, the information processing apparatus 100 is a so-called cloud server that performs automatic composition by AI according to an instruction from the producer terminal 200 via the network N and provides the generated musical piece information to the producer terminal 200.

[0104] The information processing apparatus 100 performs machine learning to generate a composition model for musical piece generation. For example, the information processing apparatus 100 provides musical piece information automatically created using a Markov model or the like to the producer terminal 200.

[0105] The information processing apparatus 100 uses style information (musical piece feature information) as learning data for a composition model. The style information is information in which a plurality of types of feature amounts such as a chord progression, a melody, and a bass line progression extracted from musical piece information are associated with predetermined identification information and used in a composition process using machine learning. The information processing apparatus 100 obtains a plurality of types of feature amounts from copyright musical piece information or musical piece information created by a producer, compiles the feature amounts, and assigns a style information ID (predetermined identification information) to each piece of musical piece information to generate a plurality of pieces of style information and create a database.

[0106] Figure 2 is a diagram showing an example of a data configuration of style information according to the first embodiment. The style information includes a style information ID 710, which is identification information of the style information, style palette sequence information 720 (musical piece order information), style palette information 730 (musical piece format information), score information 740, and lyric information 750.

[0107] The score information 740 includes a plurality of types of feature amounts extracted from a musical piece. The score information 740 includes a score ID, melody information, chord progression information, bass information, and drum information. The score ID is identification information of the score information. The melody information is information indicating a melody in a measure having a predetermined length. The chord progression information is information indicating a chord progression in a measure having a predetermined length. The bass information is information indicating a bass sound progression in a measure having a predetermined length. The drum information is information indicating a drum sound progression (pattern or rhythm of drums) in a measure having a predetermined length.

[0108] The lyric information 750 includes a lyric ID and lyric information. The lyric ID is identification information of the lyric information. The lyric information is information indicating a lyric in a measure having a predetermined length. The lyric information is, for example, a phrase or a character keyword as a source of a lyric, and automatic lyric writing using a plurality of pieces of lyric information is also possible.

[0109] The style palette information 730 is information in which the score ID of the score information 740 and the lyric ID of the lyric information 750 for the same measure are registered in association with the style palette ID as identification information of the style palette information.

[0110] For the style palette information 730, similar chord progressions of the chord information from the plurality of pieces of score information 740 and lyric information 750 can be bundled. The similar chord progressions are, for example, the same chord progression. Alternatively, the similar chord progressions can be such that each chord is classified into a tonic (T), a subdominant (S), and a dominant (D), and the sequence of T, S, and D is the same. Note that, in the case of C major and A minor, T is C / Em / Am, S is F and Dm, and D is G and Dm7-5. Then, since the chord progressions C-D-G-C and Em-Dm-Bm7-5-Am are both T-S-D-T, they can be considered to be the same chord progression. Further, with respect to the similar chord progressions, the similar chord progressions can be classified, for example, based on machine learning or deep learning, rather than using music theory.

[0111] The style palette sequence information 720 is information indicating the order of the style palette information 730. The style palette sequence information 720 includes a plurality of sets each including a style palette ID uniquely indicating the style palette information 730 and a measure index, so as to serve as information for managing the order of the style palette information 730 in the musical piece. For example, in the case of the example shown in Figure 2 the first to fourth measures of the musical piece correspond to the style palette ID 731a, the fifth to eighth measures correspond to the style palette ID 731b, and the xth to yth measures correspond to the style palette ID 731z.

[0112] The information processing apparatus 100 performs machine learning using the style information 700 as learning data and performs the composition processing. Therefore, the information processing apparatus 100 does not learn the musical piece information itself, but learns the style information including various types of feature amounts such as the chord progression, the melody, the bass progression, and the like extracted from the musical piece information. That is, because the information processing apparatus 100 learns a plurality of feature amounts extracted in advance from the musical piece information, the load of the information processing is smaller compared to twice the learning of the musical piece information itself, and the musical piece information can be effectively provided to the user.

[0113] Further, the information processing apparatus 100 presents the style information as a candidate for learning data to the producer terminal 200 at the time when the producer composes. The producer can select the style information having a desired characteristic from the presented style information, and the information processing apparatus 100 can provide the producer with the musical composition information configured based on the style information selected by the producer. Thereby, the producer can obtain the musical composition information matching the characteristic of the musical composition selected by the producer.

[0114] Specifically, the musical composition creation process by the producer will be described. Figures 3 to 5 is a diagram showing an example of a display screen of the producer terminal 200 according to the first embodiment. When the producer activates the automatic composition function on the producer terminal 200, the window 270 shown in Figure 3 is displayed on the producer terminal 200.

[0115] Note that the window 270 includes a composition parameter setting unit 271, a style information display unit 272, a composition control unit 273, and a production musical composition display / edit unit 274. The composition parameter setting unit 271 is a region in which parameters such as note duration and complexity can be set. The style information display unit 272 is a region in which the style information to be used for composition can be selected by keyword input or drop-down selection. The composition control unit 273 is a region in which a composition instruction can be issued by selecting a composition execution instruction button. The production musical composition display / edit unit 274 is a region in which a plurality of piano roll screens on which a melody and lyrics are displayed.

[0116] Then, as shown in Figure 4 , when the style palette selection drop-down 272a is selected, the chord progression of each style information included in the information processing apparatus 100 is displayed as a candidate in a list.

[0117] The chord progression candidates can be displayed in any order, such as alphabetical order, order of the number of uses by the producer, order of the number of uses by all users, and order of generation of the style information. With respect to the chord progression, all of the style information included in the information processing apparatus 100 can be displayed. Further, with respect to the chord progression, only a part of the style information included in the information processing apparatus 100 can be displayed. In this case, with respect to the chord progression, among the style information sorted using a predetermined rule, the chord progression of the style information of the predetermined sort is displayed in the style palette selection drop-down 272a in rank order.

[0118] Then, when there are many chord progression candidates, a page scheduler can be used to select a display area. Furthermore, the producer can also input a desired chord progression in the search keyword input field. In this case, the information processing apparatus 100 sorts the style information having the input chord progression as the feature quantity using a predetermined rule, and extracts style information of a predetermined rank. For example, the rank is set in correspondence with the number of pieces of chord progression information that can be displayed as a list in the style palette selection drop-down 272a of the producer terminal 200. Then, the information processing apparatus 100 can display a list of the extracted pieces of chord progression information of the style information in the style palette selection drop-down 272a of the producer terminal 200 in descending order of the rank.

[0119] The producer selects a desired chord progression from among the chord progressions presented in the style palette selection drop-down 272a, and selects the composition execution instruction button. For example, the producer selects the chord progression "C-Am-F-C".

[0120] Accordingly, the information processing apparatus 100 extracts style information having the selected chord progression "C-Am-F-C", executes machine learning using the extracted style information 700 as learning data, and executes the composition process. Then, the information processing apparatus 100 provides the musical piece information to the producer terminal 200.

[0121] In response thereto, on the screen of the producer terminal 200, the melody of the musical piece information provided from the information processing apparatus 100 is displayed on the melody display piano roll 274a. Figure 5 Accordingly, the producer can receive the provision of the musical piece information generated according to the chord progression by simply selecting a desired chord progression from among the chord progressions presented in the style palette selection drop-down 272a.

[0122] As described above, the information processing apparatus 100 creates a database of style information including various types of feature quantities of musical piece information, and presents the style information to the producer. Then, the information processing apparatus 100 causes the composition model to learn the style information selected by the producer as learning data. Thereby, the information processing apparatus 100 provides the producer with musical piece information constituted according to the features of the musical piece selected by the producer.

[0123] In addition, when presenting style information to the producer, the information processing device 100 presents a predetermined ranking of style information among the style information sorted using a predetermined rule. For example, the information processing device 100 receives operation information from the producer terminal 200 as instruction information and extracts style information based on the instruction information. When the application (DAW or automatic composition function) is activated, the information processing device 100 obtains operation history information from the producer terminal 200, which indicates the history of operations performed by the producer who created the music relative to the producer terminal 200. Then, the information processing device 100 sorts the style information used to create the music information based on the operation history information in descending order of the number of predetermined operations relative to the music information.

[0124] Predetermined operations include, for example, selecting a button to perform a composition, reproducing, editing, or the like. Musical piece information that has been reproduced multiple times or edited multiple times is considered to match the producer's preferences. Therefore, the information processing device 100 obtains, from the operation history information, musical piece information that has been reproduced and arranged more than a predetermined number of times, and sorts the style information used to create the musical piece information in descending order of the number of reproductions and edits. Alternatively, the information processing device 100 can register this style information as a favorite style learning, presenting the favorite style information again, or presenting style information similar to the favorite style information.

[0125] Furthermore, music information that has been partially reproduced but immediately subjected to automatic composition processing is considered to be inconsistent with the producer's preferences. Therefore, the information processing apparatus 100 lowers the ranking of the style information associated with the music information. Alternatively, the information processing apparatus 100 may register the style information as disliked and may not present the disliked style information again.

[0126] The information processing device 100 presents the preset ranked style information among the style information sorted by this rule to the producer in the order of ranking. Therefore, since the style information that matches the producer's preference is presented to the producer terminal 200, the producer can receive the provision of music information close to his own style by selecting the style information that matches the producer's preference. Figure 1 The flow of style information presentation processing in information processing according to the present embodiment will be described.

[0127] When receiving presentation information of style information from the information processing device 100 while creating a piece of music, the producer terminal 200 presents, for example, the chord progression of the style information in the style palette selection drop-down 272a. When the producer selects a desired chord progression from the presented chord progressions, the information processing device 100 composes a piece of music based on the style information having the selected chord progression, and provides the piece of music to the producer terminal 200.

[0128] Then, the information processing apparatus 100 acquires operation history information from the producer terminal 200, the operation history information indicating a history of operations performed by the producer for the general user terminal 300 when the application is activated (step Sll). The information processing apparatus 100 sorts the style information used in the musical composition information in descending order with respect to the number of times of reproduction and editing of the musical composition information, and extracts the style information of a predetermined rank (step S12). Then, the information processing apparatus 100 outputs presentation information of the extracted style information to the producer terminal apparatus (step S13).

[0129] As described above, in the information processing according to the first embodiment, the operation history information of the producer with respect to the producer terminal 200 is analyzed, and the style information matching the preference of the producer is presented to the producer terminal 200, so that the convenience of the musical composition creation function of the producer is improved.

[0130] The outline of the overall flow of the information processing according to the present embodiment has been described above. In Figure 6 In the following drawings, the configuration of the information processing system 1 including the information processing apparatus 100 and the producer terminal 200 will be described, and the details of various processes will be described in order.

[0131] [1-2. Configuration of information processing system according to first embodiment]

[0132] Figure 6 is a diagram showing an example of the information processing system 1 according to the first embodiment. As Figure 6 indicated, the information processing system 1 includes the producer terminals 200-1 to 200-3 and the information processing apparatus 100. The information processing system 1 functions as an automatic composition function management system. In Figure 6 the example, three producer terminals 200-1 to 200-3 are shown, but are referred to as the producer terminal 200 when not specifically distinguished.

[0133] The information processing apparatus 100 and the producer terminal 200 are communicably connected to each other via the network N by wire or wirelessly.

[0134] When the automatic composition function is activated, the producer terminal 200 transmits the instruction information of the producer and the operation history information of the producer with respect to the producer terminal 200 to the information processing apparatus 100. When the automatic composition function is activated, the producer terminal 200 receives the provision of the musical composition information composed by the information processing apparatus 100.

[0135] The information processing apparatus 100 includes the plurality of pieces of style information generated from the musical composition information as learning data for machine learning. Then, the information processing apparatus 100 performs machine learning using the style information to generate a composition model, and provides the created musical composition information to the producer terminal 200. At this time, the information processing apparatus 100 extracts the style information in accordance with the instruction information transmitted from the producer terminal 200, outputs the presentation information of the extracted style information to the producer terminal 200, and supports the producer to create a musical composition.

[0136] [1-3. Configuration of information processing apparatus 100 according to first embodiment]

[0137] Next, the configuration of the information processing apparatus 100 shown in Figure 7 will be described. Figure 6 Figure 7 is a diagram showing an example of the configuration of the information processing apparatus 100 according to the first embodiment. As shown in Figure 7 , the information processing apparatus 100 includes a communication unit 110, a storage unit 120, and a control unit 130.

[0138] The communication unit 110 is realized by, for example, a network interface card (NIC) or the like. The communication unit 110 is connected to a network N by wire or wirelessly, and transmits and receives information to and from the producer terminal 200 via the network N.

[0139] The storage unit 120 is realized by, for example, a semiconductor storage element such as a random access memory (RAM) or a flash memory, or a storage device such as a hard disk or an optical disk. The storage unit 120 stores various data for information processing. The storage unit 120 includes a user information storage unit 121, a style information storage unit 122, a possession information storage unit 123, a production information storage unit 124, and an operation history information storage unit 125.

[0140] The user information storage unit 121 stores various information about users (user information). Figure 8 is a diagram showing an example of the user information storage unit 121 according to the first embodiment.

[0141] The user information storage unit 121 stores user information including a user ID, user meta information, and authority information. The user information storage unit 121 stores the user meta information or the authority information corresponding to each user ID in association with each user ID.

[0142] ​The user ID represents identification information for uniquely specifying a user. For example, the user ID represents identification information for uniquely specifying a user such as a producer, a general user, a system administrator, and the like. The user meta information is, for example, additional information of the user such as the name and address of the user. As the authority information, for example, a value for identifying an authority such as system administrator authority information, producer authority information, and general user authority information is stored. Note that the user information storage unit 121 is not limited to the above and can store various types of information according to the purpose. Various information on the user can be stored in the user meta information. For example, in the case where the user is a natural person, demographic attribute information, psychological attribute information such as the gender and age of the user, and the like can be stored in the user meta information.

[0143] The style information storage unit 122 stores information on the composition model. Figure 9 is a diagram showing an example of the style information storage unit 122 according to the first embodiment.

[0144] The style information storage unit 122 stores the learning model information including the model information ID, the creator ID, the model information meta information, the style information 700, the copyrighted work ID, and the sharing availability information. The style information storage unit 122 stores the creator ID, the model information meta information, the style information, the copyrighted work ID, and the sharing availability information corresponding to each model information ID in association with each model information ID.

[0145] The model information ID represents identification information for uniquely specifying the composition model information. The creator ID represents identification information for uniquely specifying the creator of the corresponding composition model information. For example, the creator ID represents identification information for uniquely specifying a user such as a system administrator, a producer, a general user, and the like.

[0146] The model information meta information is, for example, information representing the characteristics of the copyrighted work to be learned. The learning model information meta information is information such as the tempo of a musical piece, the style, the atmosphere such as light and dark, the structure of a musical piece such as the first verse solo, the second verse solo, and the chorus, the chord progression, the scale, and the church mode.

[0147] The style information 700 is learning data of the composition model included in the information processing apparatus 100. As shown in Figure 2 The style information 700 is information in which various types of feature amounts such as the chord progression, the melody, and the bass progression extracted from the musical piece information are associated with predetermined identification information, for example.

[0148] The sharing availability information indicates, for example, whether or not the corresponding learning model can be shared. As the sharing availability information, for example, a value for specifying and identifying whether or not the corresponding learning model can be shared is stored.

[0149] Note that the style information storage unit 122 is not limited to the above, and can store various types of information according to the purpose. For example, the composition model information meta information can store various types of additional information related to the composition model, such as information related to the date and time when the composition model was created.

[0150] The possession information storage unit 123 stores various information related to the style information selected by the creator of the musical piece at the time of creation of the musical piece. Figure 10 is a diagram illustrating an example of the possession information storage unit 123 according to the first embodiment. The possession information storage unit 123 stores the user ID of the creator of the musical piece and the style information ID selected by the creator in association with each other.

[0151] The production information storage unit 124 stores various information about the produced musical pieces. Figure 11 is a diagram illustrating an example of the production information storage unit 124 according to the first embodiment. As Figure 11 indicated, the production information storage unit 124 stores the user ID of the creator of the musical piece and the score ID produced by the creator in association with each other.

[0152] The operation history information storage unit 125 stores operation history information of the creator with respect to the creator terminal 200. Figure 12 is a diagram illustrating an example of the operation history information storage unit 125 according to the first embodiment.

[0153] As Figure 12 indicated, the operation history information storage unit 125 stores operation history information of the creator with respect to the creator terminal 200. For example, each piece of operation history information is associated with the user ID of each creator. The operation history information is information indicating the history of operations performed by the creator with respect to the creator terminal 200 when the automatic composition function is activated. For example, the operation history information can include various information about the operations of the creator, such as the content of the operations performed by the creator, the date and time of performing the operations, and the like. Examples of the operations include selection of the style information presented from the information processing apparatus 100, selection of the composition execution instruction button, and reproduction and editing of the musical piece information received from the information processing apparatus 100.

[0154] Referring back to Figure 7The description will be continued. The control unit 130 is realized by executing a program stored in the producer terminal 200 using a random access memory (RAM) or the like as a work area, by, for example, a central processing unit (CPU), a micro processing unit (MPU), or the like. Further, the control unit 130 is a controller, and can be realized by, for example, an integrated circuit such as an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA).

[0155] The control unit 130 includes a reception unit 131, an extraction unit 132, a transmission unit 133, a composition unit 134, a registration unit 135, a history acquisition unit 136, and an analysis unit 137, and realizes or executes functions or operations of information processing described below.

[0156] The reception unit 131 communicates with the producer terminal 200 and receives various information. The reception unit 131 receives instruction information related to output of presentation information of style information from the producer terminal 200. The instruction information is operation information related to the terminal device.

[0157] Specifically, the instruction information is composition start information associated with activation of the automatic composition function or information giving an instruction on automatic composition. Further, the instruction information is information for selecting one piece of score information. Specifically, the instruction information is information related to a feature amount of the musical piece information such as chord progression information input by the producer as a feature amount of the musical piece, lyric information indicating a lyric to be searched, and the like. Further, the instruction information is selection information for selecting one piece of style information presented by the information processing device 100, and the like. In addition, the instruction information is operation history information of the producer to the producer terminal 200.

[0158] The extraction unit 132 extracts style information from the style information storage unit 122 according to the instruction information received by the reception unit 131. In a case where the instruction information is information related to a feature amount of the musical piece information such as the chord progression information, the extraction unit 132 sorts a plurality of pieces of style information using a predetermined rule based on the feature amount indicated by the instruction information, and extracts style information of a predetermined rank.

[0159] For example, the extraction unit 132 obtains musical piece information in which the number of times of a predetermined operation exceeds a threshold value based on the operation history information of the producer stored in the operation history information storage unit 125. Then, the extraction unit 132 sorts style information for the obtained musical piece information in descending order of the number of times of the predetermined operation, and extracts style information of a predetermined rank. The predetermined operation is reproduction or editing. The extraction unit 132 obtains musical piece information in which the number of times of reproduction and correction is greater than a predetermined number of times from the operation history information, and sorts style information for the musical piece information in descending order of the number of times of reproduction and correction.

[0160] The transmission unit 133 transmits various information to the external device. For example, the presentation information of the style information extracted by the extraction unit 132 is output. At this time, the transmission unit 133 transmits the presentation information of the style information extracted by the extraction unit 132 to the producer terminal 200 together with the ranking information indicating the ranking of the style information.

[0161] Thus, in the producer terminal 200, the list of the chord progressions of the style information is displayed in a selectable manner in descending order of the ranking in the style palette selection drop-down. By selecting the desired chord progression from the chord progressions indicated in the style palette selection drop-down, the producer can receive the provision of the musical composition information constituted using the style information having the chord progression. Further, the transmission unit 133 transmits the musical composition information composed by the composition unit 134 (described below) to the producer terminal 200.

[0162] The composition unit 134 composes the musical composition information using machine learning based on the style information. When receiving the selection information giving an instruction to select any one of the presented style information from the producer terminal 200, the composition unit 134 acquires the selected style information from the style information storage unit 122. Then, the composition unit 134 composes the musical composition information using machine learning based on the acquired style information. The composition unit 134 can compose using various existing musical composition algorithms.

[0163] For example, the composition unit 134 can use a musical composition algorithm using a Markov chain, or can use a musical composition algorithm using deep learning. Further, the composition unit 134 can generate a plurality of pieces of musical composition information for the instruction information transmitted from the producer terminal 200. Thus, the producer can receive a plurality of suggestions from the composition unit 134, and thus can compose using more various information.

[0164] The registration unit 135 extracts a feature amount from the performance information and the like transmitted from the producer terminal 200, and registers the extracted feature amount as the score information. For example, in the producer terminal 200, the editing of the musical composition and the production of the musical composition by performance are performed based on the musical composition information transmitted by the composition unit 134. When receiving the editing result or the generation result from the producer terminal 200, the registration unit 135 extracts the feature amount and registers the feature amount as the score information. The registration unit 135 generates the score information and registers the score information in the storage unit 120 until the producer completes the musical composition.

[0165] The history acquisition unit 136 acquires operation history information that indicates a history of operations performed by the producer with respect to the producer terminal 200 during music production. The history acquisition unit 136 can acquire target operation history information from the operation history information stored in the operation history information storage unit 125. Further, the history acquisition unit 136 can acquire the operation history information by requesting transmission of operation history information during music production from the music producer terminal 200.

[0166] The analysis unit 137 analyzes the operation history information to obtain the number of times of each operation. The predetermined operation is, for example, reproduction or editing. Alternatively, the predetermined operation is an operation in which automatic composition processing is immediately performed despite partial reproduction being performed. Music information that has been reproduced a plurality of times and music information that has been edited a plurality of times are considered to match the preference of the producer. Further, music information that has been partially reproduced but has immediately undergone automatic composition processing is considered to not match the preference of the producer. Thus, the analysis unit 137 obtains the number of times of each operation to analyze music information that matches the preference of the producer or music information that does not match the preference of the producer.

[0167] Then, the extraction unit 132 sorts the style information in descending order of the number of times of the predetermined operation based on the analysis result of the analysis unit, and extracts style information of a predetermined rank. The extraction unit 132 sorts the style information for music information in descending order of the number of times of reproduction and editing of the music information, and extracts style information of a predetermined rank. This is because music information that has been reproduced a plurality of times and music information that has been edited a plurality of times are considered to match the preference of the producer. Further, since music information that has been partially reproduced but has immediately undergone automatic composition processing is considered to not match the preference of the producer, the extraction unit 132 can lower the rank of the style information for the music information.

[0168] In this way, presentation information of the style information extracted by the extraction unit 132 based on the analysis result of the operation history information is transmitted by the transmission unit 133 to the producer terminal 200. Thus, since style information that matches the preference of the producer is presented to the producer terminal 200, the producer can receive provision of music information close to his or her own style by selecting style information that matches the preference of the producer.

[0169] [1-4. Configuration of the Producer Terminal 200 According to the First Embodiment]

[0170] Next, the configuration of the producer terminal 200 shown in Figure 13 will be described. Figure 6 Figure 13 is a diagram showing a configuration example of the producer terminal 200 according to the first embodiment. As Figure 13 ​As shown, the producer terminal 200 includes a communication unit 210 , an input unit 220 , an output unit 230 , a storage unit 240 , a control unit 250 , and a display unit 260 .

[0171] The communication unit 210 is implemented by, for example, a NIC, a communication circuit, etc. The communication unit 210 is connected to the network N by wire or wirelessly, and transmits information to another device or the like (such as the information processing device 100, another terminal device, etc.) and receives information from another device or the like (such as the information processing device 100, another terminal device, etc.) via the network N.

[0172] Various operations are input from the user to the input unit 220. The input unit 220 includes a keyboard and a mouse connected to the producer terminal 2000. The input unit 220 receives input from the user. The input unit 220 receives user input using a keyboard or a mouse. The input unit 220 may have a function of detecting voice. In this case, the input unit 220 may include a microphone for detecting voice.

[0173] Various information can be input to the input unit 220 via the display unit 260. In this case, the input unit 220 may have a touch panel capable of realizing functions equivalent to those of a keyboard and a mouse. In this case, the input unit 220 receives various operations from the user via the display screen through the functions of the touch panel realized by various sensors. It should be noted that as a method for detecting user operations through the input unit 220, a capacitance method is mainly adopted in tablet terminals, but any method may be adopted as long as user operations can be detected and the functions of the touch panel can be realized, such as a resistive film method, a surface acoustic wave method, an infrared method, and an electromagnetic induction method, which are other detection methods. In addition, the producer terminal 200 may include an input unit that also receives operations through buttons, etc.

[0174] The output unit 230 outputs various information and includes a speaker that outputs sound.

[0175] The storage unit 240 is implemented by, for example, a semiconductor memory element (such as RAM or flash memory) or a storage device (such as a hard disk or optical disk). The storage unit 240 stores various information for display information. The storage unit 240 stores operation history information 241.

[0176] The operation history information 241 is information indicating a history of operations performed by the producer on the producer terminal 200 at the time when the application is activated to create a piece. For example, the operation history information can include various information about the operations of the producer, such as contents of operations performed by the producer, date and time of performing operations, and the like. The operations include selection of style information presented from the information processing apparatus 100, selection of combination execution instruction buttons, and reproduction, editing, and production of piece information received from the information processing apparatus 100.

[0177] The control unit 250 is realized by, for example, a CPU, an MPU, or the like that executes a program stored in the producer terminal 200 by using a RAM or the like as a work area. Further, the control unit 250 is a controller, and can be realized by, for example, an integrated circuit such as an ASIC or an FPGA. The control unit 250 includes a display control unit 251, a transmission / reception unit 252, a selection unit 253, and a reproduction unit 254.

[0178] The display control unit 251 controls various displays with respect to the display unit 260. The display control unit 251 controls the display of the display unit 260. The display control unit 251 controls the display of the display unit 260 on the basis of information received from the information processing apparatus 100. The display control unit 251 controls the display of the display unit 260 on the basis of information generated by processing of each component of the control unit 250. The display control unit 251 can control the display of the display unit 260 with an application that displays an image.

[0179] The display control unit 251 causes the display unit 260 to display a window 270 (see Figures 3 to 5 ) and the like by an application that uses an automatic composition function of the DAW and the AI. Further, when presentation information of a style palette is received from the information processing apparatus 100, the display control unit 251 displays chords and lyrics of the presented style palette in a style palette selection drop-down 272a (see Figure 4 ) of the window 270.

[0180] The transmission / reception unit 252 communicates with the information processing apparatus 100, and transmits and receives various information. When the automatic composition function is activated, the transmission / reception unit 252 receives presentation information of style information transmitted from the information processing apparatus 100. The transmission / reception unit 252 transmits instruction information for selecting style information to the information processing apparatus 100. Then, the transmission / reception unit 252 receives piece information generated by the information processing apparatus 100. Further, the transmission / reception unit 252 transmits piece information such as a melody composed and generated by the producer to the information processing apparatus 100.

[0181] The selection unit 253 selects any of the style information presented from the information processing apparatus 100. For example, by the user's operation to the input unit 220, any of the chord progressions displayed in the style palette selection drop-down 272a (see Figure 4 ) of the window 270 is selected. Thereby, the selection unit 253 sends the instruction information for selecting the style information corresponding to the selected chord progression to the information processing apparatus 100 from the transmission / reception unit 252.

[0182] The reproduction unit 254 reproduces the musical piece information generated by the information processing apparatus 100. Specifically, the reproduction unit 254 sets arbitrary instrument information to each of the melody, the chord, and the bass included in the musical piece data and reproduces each piece of data. Further, the reproduction unit 254 can also reproduce a combination of each of the melody, the chord, and the bass.

[0183] Further, when the producer performs the performance along with the composition provided by the automatic composition function, the control unit 250 receives the performance by the producer. Further, the control unit 250 also receives the processing relating to the arrangement of the composition provided by the automatic composition function and the production of the musical piece by the producer.

[0184] The display unit 260 displays various information. The display unit 260 is realized by, for example, a liquid crystal display, an organic electroluminescence (EL) display, or the like. The display unit 260 displays various information according to the control by the display control unit 251. The display unit 260 can also display information such as an image provided from the information processing apparatus 100.

[0185] [1-5. Process of information processing according to the first embodiment]

[0186] Next, the process of various information processing according to the first embodiment will be described with reference to Figure 14 Figure 14 is a sequence diagram illustrating the process of information processing according to the first embodiment.

[0187] Upon receiving the composition start information (step S102) according to the activation of the automatic composition function on the producer terminal 200 (step S101), the information processing apparatus 100 extracts the style information (step S103) and sends the presentation information of the extracted style information to the producer terminal 200 (step S104). For example, the information processing apparatus 100 extracts all of the style information, the style information of which the number of uses by the producer exceeds a predetermined number, or the style information of which the number of uses by all of the users exceeds a predetermined number from the style information storage unit 222, and sends the presentation information of the extracted style information.

[0188] ​Then, the producer terminal 200 displays a list of the presentation information display style information based on the list (step S105). For example, the producer terminal 200 displays a list of the style information of the chord progression as candidates. Then, when the producer selects the style information in the producer terminal 200 (step S106), selection information indicating the selected style information is transmitted to the information processing apparatus 100 (step S107).

[0189] The information processing apparatus 100 extracts the selected style information, performs machine learning using the extracted style information as learning data, and performs the composition processing (step S108), and provides the musical piece information to the producer terminal 200 (step S109). Note that the information processing apparatus 100 extracts a plurality of types of feature amounts from the composed musical piece information, stores new score information including the feature amounts in the storage unit 120, and registers the new score information in the possession information storage unit 123.

[0190] When the provided musical piece is reproduced (step S110), the producer terminal 200 receives an operation for editing and production processing of the musical piece information by the producer (step S111). In the case where the producer performs a performance using a MIDI keyboard or the like, MIDI information is received. Then, the producer terminal 200 transmits the musical piece information generated by the editing processing or the production processing by the producer to the information processing apparatus 100 (step S112).

[0191] When the composed or produced musical piece information is received, the information processing apparatus 100 extracts a feature amount from the musical piece information and registers score information generated based on the extracted feature amount (step S113). The information processing apparatus 100 can add the score information based on the musical piece information composed and produced by the producer to the style information selected by the producer, and make the style information closer to the style of the producer.

[0192] When the automatic composition function is activated, the producer terminal 200 transmits operation history information to the information processing apparatus 100 (steps S114 and S115). The information processing apparatus 100 analyzes the operation history information to obtain the number of times of each operation (step S116). Then, in order to extract the style information matching the preference of the producer, the information processing apparatus 100 sorts the style information in descending order of the number of times of the predetermined operation based on the analysis result, and extracts the style information of a predetermined rank (step S117). The information processing apparatus 100 transmits the presentation information of the extracted style information to the producer terminal 200 (step S118).

[0193] Then, the producer terminal 200 displays a list of the style information extracted based on the operation history information (step S119). Then, in a case where the composition is not finished (step S120: No), the producer terminal 200 returns to step S106 and continues the process of producing a musical piece by the producer. Further, when the composition by the producer is finished (step S120: Yes), the producer can operate the general user terminal 300 to perform, for example, an arrangement process (step S121), and a mix and mastering process (step S122).

[0194] [1-6. Effects according to the first embodiment]

[0195] As described above, the information processing apparatus according to the first embodiment (the information processing apparatus 100 in the embodiment) includes a storage unit (the storage unit 120 in the embodiment) that stores musical piece characteristic information (the style information 700 in the embodiment) in which a plurality of types of characteristic amounts extracted from musical piece information are associated with predetermined identification information, the musical piece characteristic information being used as learning data in a composition process using machine learning, a reception unit (131) that receives instruction information transmitted from a terminal apparatus (the producer terminal 200 in the embodiment), an extraction unit (the extraction unit 132 in the embodiment) that extracts the musical piece characteristic information from the storage unit according to the instruction information, and an output unit (the transmission unit 133 in the embodiment) that outputs presentation information of the musical piece characteristic information extracted by the extraction unit.

[0196] As described above, in the information processing apparatus according to the first embodiment, the style information having the plurality of types of characteristic amounts of the musical piece information is held, and the presentation information of the extracted musical piece characteristic information is output according to the instruction information. That is, the information processing apparatus according to the first embodiment presents the musical piece characteristic information corresponding to the instruction information to the terminal apparatus, so that the producer can select desired musical piece characteristic information from the musical piece characteristic information. Then, the information processing apparatus can provide musical piece information constituted based on the musical piece characteristic information desired by the producer. Therefore, the information processing apparatus according to the present embodiment can improve the convenience of the musical piece creation function of the user.

[0197] Further, the instruction information includes information on the characteristic amount. The extraction unit sorts the plurality of pieces of musical piece characteristic information using a predetermined rule based on the information on the characteristic amount, and extracts the musical piece characteristic information of a predetermined rank. The output unit outputs the presentation information of the musical piece characteristic information extracted by the extraction unit to the external apparatus together with rank information indicating the rank of the musical piece characteristic information. Therefore, the information processing apparatus presents the musical piece characteristic information having a high rank together with the rank information based on the characteristic amount of the musical piece given by the instruction by the producer, so that the producer can quickly select the musical piece characteristic information matching the needs of the producer by checking only the list of the musical piece characteristic information.

[0198] In addition, the instruction information is operation information of the terminal device. Therefore, the information processing device can receive the operation information as the instruction information and extract appropriate style information according to the operation information.

[0199] The musical piece characteristic information includes score information including chord progression information indicating a chord progression in a measure having a prescribed length, melody information indicating a melody, and bass information indicating a bass line. Thereby, the information processing device can perform composition based on the musical piece characteristic information including the chord progression, melody, and bass information. Then, at the time of composition, the information processing device learns a feature amount such as the chord progression information, melody information, and bass information, rather than the musical piece information itself, and thereby can efficiently provide the musical piece information to the user.

[0200] The score information further includes drum progression information indicating a drum progression in a measure having a prescribed length. Thereby, the information processing device can perform composition based on the musical piece characteristic information including the chord progression, melody, bass information, and drum progression information.

[0201] The musical piece characteristic information includes musical piece format information in which identification information of score information and identification information of lyric information for the same measure are registered in association with each other, and musical piece order information indicating an order of the musical piece format information. The information processing device can further provide musical piece information desired by the user, because the musical piece format information and the order thereof can be learned.

[0202] The receiving unit receives instruction information for selecting one piece of score information. The extracting unit sorts musical piece characteristic information including the score information selected by the instruction information using a predetermined rule, and extracts musical piece characteristic information of a predetermined rank. Therefore, the information processing device presents musical piece characteristic information having a high rank, for example, based on a feature amount of score information given by the composer, so that the composer can quickly select musical piece characteristic information matching the needs of the composer by checking a list of the musical piece characteristic information.

[0203] Further, the terminal device is a composer terminal device in which a musical piece creation-related application is installed. The instruction information is operation history information indicating a history of an operation performed by the composer on the composer terminal device when the application is activated. The extracting unit sorts the musical piece characteristic information in descending order of a number of predetermined operations based on the operation history information, and extracts musical piece characteristic information of a predetermined rank. The output unit outputs presentation information of the musical piece characteristic information extracted by the extracting unit to the composer terminal device. Therefore, the information processing device analyzes the operation history information and presents musical piece information matching the preference of the composer to the composer, so that the composer can quickly select musical piece characteristic information matching the preference of the composer.

[0204] [2. Modification of the first embodiment]

[0205] [2-1. Information processing example according to the modification of the first embodiment]

[0206] Next, information processing according to the modification of the first embodiment will be described. The style information 700 (see Figure 2 ) includes, as a feature quantity, lyric information. Therefore, by inputting a desired lyric to the producer terminal 200, the producer can receive presentation of style information matching the lyric. Figures 15 to 18 is a diagram showing an example of a display screen of the producer terminal 200 according to the modification of the first embodiment.

[0207] Specifically, as shown in Figure 15 , in a case where the producer inputs a desired lyric (for example, "happy") in the search keyword input field 272b of the window 270, the information processing apparatus 100 receives instruction information for searching for the lyric "happy".

[0208] Then, the information processing apparatus 100 sorts the style information including, as a feature quantity, lyric information including a lyric or a lyric similar to the lyric, using a predetermined rule and extracts style information of a predetermined rank. Then, when the information processing apparatus 100 transmits presentation information of each piece of the extracted style information to the producer terminal 200, the lyric information is displayed as a list in the style palette selection drop-down 272a in the producer terminal 200. For example, in the style palette selection drop-down 272a, lyric information including "happy" such as "Happy future is" "That country is happy..." and "Spending happy time with friends..." is displayed.

[0209] The producer selects desired lyric information from the lyric information presented in the style palette selection drop-down 272a and selects the composition execution instruction button. In the example of Figure 16 , "Spending happy time with friends..." is selected. Thereby, the information processing apparatus 100 extracts style information having the selected lyric information, executes machine learning using the extracted style information 700 as learning data, executes composition processing, and provides musical piece information to the producer terminal 200.

[0210] At this time, the information processing apparatus 100 can automatically generate a lyric according to the generated musical piece and provide musical piece information in which a melody is associated with the lyric to the producer terminal 200. In this case, on the screen of the producer terminal 200, on the melody display piano roll 274a of Figure 16 , the melody and the lyric corresponding to the melody are displayed.

[0211] Thus, the producer can receive the provision of the musical composition information generated in accordance with the selected lyric information by selecting the desired lyric information from the lyric information presented in the style palette selection drop-down 272a after inputting the searched lyrics.

[0212] Further, as Figure 17 indicated, in a case where the user inputs lyrics, the producer terminal 200 can display a list of candidates of chord progressions of the style information presented from the information processing apparatus 100 and support the musical composition creation of the producer. In this case, on the screen of the producer terminal 200, the melody display piano curtain 274a on which the melody and the lyrics corresponding to the melody are displayed. Figure 18

[0213] As described above, in the information processing apparatus 100, the reception unit 131 receives the instruction information giving the instruction to search lyrics. Then, the extraction unit 132 sorts the style information including the lyric information including the lyrics or the lyrics similar to the lyrics for which the instruction information gives the search instruction by using a predetermined rule and extracts the style information of a predetermined rank. For example, the information processing apparatus 100 can extract and present the style information having the lyric information (character keyword) whose lyrics match the search target lyrics, and can pre-classify the lyric information and present the style information belonging to the classification including the search target lyrics by machine learning or deep learning. Further, the composition unit 134 also automatically generates lyrics in accordance with the generated musical composition.

[0214] [2-2. Information processing procedure according to the modification of the first embodiment]

[0215] Next, various information processing procedures according to the modification of the first embodiment will be described with reference to Figure 19 Figure 19 is a flowchart illustrating the information processing procedure according to the modification of the first embodiment.

[0216] Figure 19 Step S131 illustrated in FIG. 13 is the same processing as step S101 illustrated in FIG. 11. When the search of the lyrics is received (step S132), the producer terminal 200 transmits the instruction information giving the instruction to search the lyrics to the information processing apparatus 100 (step S133). Figure 14

[0217] The information processing apparatus 100 sorts the style information including the lyric information as a feature quantity including the lyrics or the lyrics similar to the lyrics by using a predetermined rule and extracts the style information of a predetermined rank (step S134).

[0218] ​​​Then, when the information processing apparatus 100 transmits presentation information including the extracted lyric information of each piece of style information to the producer terminal 200 (step S135), the lyric information or chord progression is displayed as a list on the producer terminal 200 (step S136). Figure 19 Steps S137 to S139 shown in FIG. Figure 14 The same processing as steps S106 to S108 shown in FIG. The information processing device 100 automatically generates lyrics (step S140) and provides the composed music information and the generated lyrics information to the producer terminal 200 (step S141). Note that the information processing device 100 extracts various types of feature quantities including lyrics from the composed music information, stores new music score information including the feature quantities in the storage unit 120, and registers the new music score information in the owned information storage unit 123.

[0219] When the provided music with lyrics is reproduced (step S142), the producer terminal 200 receives an operation for editing and producing the producer's music information and lyrics information (step S143). The producer terminal 200 transmits the music information and lyrics information produced by the producer's editing and production processing to the information processing device 100 (step S144).

[0220] Upon receiving the arranged or produced music information, the information processing apparatus 100 extracts feature quantities including lyric information from the music information and registers the score information and lyric information generated based on the extracted feature quantities (step S145). The information processing apparatus 100 can add the score information and lyric information based on the music information arranged and produced by the producer to the style information selected by the producer, thereby making the style information closer to the producer's style.

[0221] Figure 19 Steps S146 to S149 shown in FIG. Figure 14 The information processing apparatus 100 transmits the presentation information including the lyrics information of the extracted style information to the producer terminal 200 (step S150). Figure 19 Steps S151 to S154 shown in FIG. Figure 14 The same processing as steps S119 to S122 shown in FIG.

[0222] [2-3. Effects of Modification Example of First Embodiment]

[0223] As described above, in a variation of the first embodiment, in an information processing device, a receiving unit receives instruction information that instructs a search for lyrics. An extraction unit sorts the music feature information, including the lyrics information, using predetermined rules and extracts a preset ranking of the music feature information, the lyrics information containing the lyrics for which the instruction information was given. This allows the creator to simply input the lyrics they are searching for and select the desired music feature information from the presented music feature information, and receive music information generated based on the selected lyrics. Therefore, the information processing device according to this embodiment can improve the convenience of the user's music creation function.

[0224] [3. Second embodiment]

[0225] [3-1. Example of Information Processing According to Second Embodiment]

[0226] Next, refer to Figure 20 , describing an example of information processing according to the second embodiment. Figure 20 2 is a conceptual diagram showing the flow of information processing according to the second embodiment. The information processing according to the second embodiment is executed by the information processing apparatus 2100 , the producer terminal 200 , and the general user terminal 300 .

[0227] The general user terminal 300 is an information processing terminal such as a tablet terminal. Various program applications are installed in the general user terminal 300. A music viewing application is installed in the general user terminal 300. The general user terminal 300 communicates with the information processing device 100 to receive music information. The user of the general user terminal 300 is a general user who receives the music information.

[0228] When the music viewing application is activated, the general user terminal 300 transmits operation history information indicating the history of operations performed by the user on the general user terminal 300 to the information processing device 2100. In addition, the general user terminal 300 can also activate the automatic composition function using DAW and AI. The general user terminal 300 is not limited to DAW and can use, for example, mobile applications such as iOS.

[0229] Similar to the information processing apparatus 100, the information processing apparatus 2100 provides the presentation information of the style information or the music information to the producer terminal 200. Then, based on the operation history information of the general user terminal 300, the information processing apparatus 2100 presents the style information to the producer terminal 200, provides a playlist of the music information provided to the general user terminal 300, or recreates or arranges the music information provided to the general user terminal 300.

[0230] Will refer to Figure 20 The information processing flow according to the second embodiment is described in detail.Figure 20 The information processing apparatus 2100 acquires operation history information in the general user terminal 300, as shown (step S31). Then, the information processing apparatus 2100 analyzes the operation history information to obtain the number of times of each operation by the user.

[0231] The predetermined operation is, for example, an operation such as reproduction, skip, or repeat performed when the user views the music information. For example, the information processing apparatus 2100 classifies, among the produced music registered in the possession information storage unit 123, music whose reproduction number is greater than a threshold value as music that the user likes. Further, the information processing apparatus 2100 classifies music whose reproduction number is less than the threshold value as music that the user dislikes. Further, the information processing apparatus 2100 classifies skipped music as music that the user dislikes.

[0232] Then, the information processing apparatus 2100 sorts the style information used for creating the music information in descending order of the number of predetermined operations on the music information, and extracts style information of a predetermined rank (step S32), and outputs the style information to the producer terminal 200 (step S33).

[0233] As described above, in the information processing according to the second embodiment, the operation history information of the user with respect to the general user terminal 300 is analyzed, and style information of music information that the user likes is presented to the producer terminal 200. Thereby, the producer can produce a new music requested by the user substantially in real time by using style information for currently popular music.

[0234] Further, the information processing apparatus 2100 analyzes the operation history information, obtains music information in which the number of predetermined operations by the user exceeds a threshold value, generates a play list based on the obtained music information (step S34), and outputs the play list to the general user terminal 300 (step S35).

[0235] As described above, in the information processing according to the second embodiment, the operation history information of the user with respect to the general user terminal 300 is analyzed, a play list that matches the user's preference is generated, and the play list customized for each user is distributed and provided.

[0236] Then, the information processing apparatus 2100 analyzes the operation history information to obtain music information in which the number of predetermined operations by the user exceeds a threshold value. Then, the information processing apparatus 2100 sorts style information for the obtained music information in descending order of the number of predetermined operations, and extracts style information of a predetermined rank. The information processing apparatus 2100 reworks or arranges the music information based on the extracted style information (step S34), and outputs the reworked or arranged music information to the general user terminal 300 (step S35).

[0237] As described above, in the information processing according to the second embodiment, a remade or arranged musical piece reproduced using the style information for making a musical piece preferred by the user can be further remade or arranged, and the remade or arranged musical piece can be provided to the user. The remaking and the arranging can be actively performed by the user who transmits the instruction information from the general user terminal 300, or can be automatically performed by the information processing apparatus 2100 based on the operation history information. Next, the configuration of the information processing system 201 including the information processing apparatus 2100, the maker terminal 200, and the general user terminal 300 will be described, and the details of various processes will be described in order.

[0238] [3-2. Configuration of information processing system according to second embodiment]

[0239] Figure 21 is a diagram illustrating an example of the information processing system 201 according to the second embodiment. As Figure 21 indicated, the information processing system 201 includes the maker terminals 200-1 to 200-3, the general user terminals 300-1 to 300-3, and the information processing apparatus 2100. The information processing system 201 functions as an automatic composition function management system and a musical piece viewing supply system. In the example of Figure 21 , three maker terminals 200-1 to 200-3 are illustrated, but are referred to as the maker terminal 200 when described without specific distinction. Further, in the example of Figure 21 , three general user terminals 300-1 to 300-3 are illustrated, but are referred to as the general user terminal 300 when described without specific distinction.

[0240] The information processing apparatus 2100 and the maker terminal 200 are communicably connected to each other via the network N in a wired or wireless manner. The information processing apparatus 2100 and the general user terminal 300 are communicably connected to each other via the network N by wire or wirelessly.

[0241] The general user terminal 300 transmits operation history information to the information processing apparatus 2100. The operation history information is information indicating a history of operations performed by the user with respect to the general user terminal 300 when the musical piece viewing application is activated. Further, the general user terminal 300 receives provision of the playlist and the remade or arranged musical piece information generated by the information processing apparatus 2100 at the time of viewing a musical piece.

[0242] Similar to the information processing apparatus 100, the information processing apparatus 2100 includes pieces of style information as learning data for machine learning. The information processing apparatus 2100 analyzes operation history information received from the general user terminal 300. The information processing apparatus 2100 outputs presentation information of style information extracted based on a result of the analysis of the operation history information to the producer terminal 200 to support the producer in creating a musical piece. Further, the information processing apparatus 2100 generates a playlist customized for a viewer based on a result of the analysis of the operation history information, and provides the playlist to the general user terminal 300. Further, the information processing apparatus 2100 further reworks or arranges a musical piece being reproduced using style information for making a musical piece preferred by the user based on a result of the analysis of the operation history information, and provides the reworked or arranged musical piece to the user.

[0243] [3-3. Configuration of information processing apparatus 100 according to second embodiment]

[0244] Next, the configuration of the information processing apparatus 2100 shown in Figure 22 will be described with reference to Figure 21 . Figure 22 is a diagram showing an example of the configuration of the information processing apparatus 2100 according to the second embodiment. As shown in Figure 22 , in the information processing apparatus 2100, the storage unit 120 includes a user operation history information storage unit 2125. Then, the information processing apparatus 2100 includes a control unit 2130 instead of the control unit 130.

[0245] The user operation history information storage unit 2125 stores operation history information of users with respect to the general user terminal 300. Figure 23 is a diagram showing an example of the user history information storage unit 2125 according to the second embodiment.

[0246] As shown in Figure 23 , the user operation history information storage unit 2125 stores operation history information of users with respect to the general user terminal 300. For example, each piece of operation history information is associated with a user ID of each user. For example, the operation history information of a user can include various information about operations of the user, such as contents of operations performed by the user, dates and times of performing the operations, and the like. Examples of operations include reproduction, skipping, and repeating of musical piece information.

[0247] In comparison with the control unit 130 shown in Figure 7 , the control unit 2130 includes an extraction unit 2132, a history acquisition unit 2136, an analysis unit 2137, and a generation unit 2138.

[0248] The history acquisition unit 2136 acquires the operation history information of the user. The history acquisition unit 2136 can acquire the target operation history information of the user from the operation history information stored in the user operation history information storage unit 2125. Further, the history acquisition unit 2136 can acquire the operation history information by requesting the general user terminal 300 to transmit the operation history information of the user during the music viewing.

[0249] The analysis unit 2137 analyzes the operation history information of the user to obtain the number of times of each operation. Examples of the predetermined operation include operations such as reproduction, skip, and repeat of the music. For example, the analysis unit 2137 classifies the music whose reproduction number is greater than a threshold value as music that the user likes. Further, the analysis unit 2137 classifies the music whose reproduction number is less than the threshold value as music that the user dislikes. Further, the analysis unit 2137 classifies the skipped music as music that the user dislikes. Thus, the analysis unit 2137 obtains the number of times of each operation to analyze music information that matches the user's preference or music information that does not match the user's preference.

[0250] The generation unit 2138 obtains music information whose number of predetermined operations exceeds a threshold value based on the analysis result of the analysis unit 2137, and generates a playlist based on the obtained music information. The transmission unit 133 outputs the playlist to the general user terminal 300.

[0251] The extraction unit 2132 obtains music information whose number of predetermined operations exceeds a threshold value based on the analysis result of the analysis unit 2137. Then, the extraction unit 2132 sorts the style information for the obtained music information in descending order of the number of predetermined operations, and extracts style information of a predetermined rank. The transmission unit 133 transmits presentation information of the style information extracted by the extraction unit 2132 to the producer terminal 200.

[0252] Then, the combination unit 134 reworks or arranges the music information according to the style information extracted by the extraction unit 2132. The transmission unit 133 transmits the reworked or arranged music information to the general user terminal 300.

[0253] [3-4. Configuration of the general user terminal 300 according to the second embodiment]

[0254] Next, the configuration of the general user terminal 300 shown in Figure 24 will be described with reference to Figure 21 . Figure 24 is a diagram showing a configuration example of the general user terminal 300 according to the second embodiment. As shown in Figure 24 , the general user terminal 300 includes a communication unit 310, an input unit 320, an output unit 330, a storage unit 340, a control unit 350, and a display unit 360.

[0255] The communication unit 310 has a function similar to that of the communication unit 210 illustrated in FIG. 2. The input unit 120 can have a touch panel similar to the input unit 220 illustrated in FIG. 2. Further, the input unit 320 can include a microphone that detects voice. The output unit 330 has a function similar to that of the output unit 230 illustrated in FIG. 2. Figure 13 Figure 13 Figure 13

[0256] The storage unit 340 has a function similar to that of the storage unit 240 illustrated in FIG. 2. The storage unit 340 stores operation history information 341. The operation history information 341 is information indicating a history of operations performed by a user who watches music on the general user terminal 300 when an application is activated. For example, the operation history information can include various information about operations of the producer, such as contents of operations performed by the user, a date and time when the operations are performed, and the like. The operations include operations such as reproduction, skip, and repeat of music, and the like. Figure 13

[0257] The control unit 350 has a function similar to that of the control unit 250 illustrated in FIG. 2. The control unit 350 includes a display control unit 351, a transmission / reception unit 352, a selection unit 353, and a reproduction unit 354. Figure 13

[0258] The display control unit 351 has a function similar to that of the display control unit 251 illustrated in FIG. 2. The display control unit 351 displays a watch list, information about music being watched, and icons through which operations such as reproduction, skip, and repeat can be selected by the music watching application. Figure 13

[0259] The transmission / reception unit 352 has a function similar to that of the transmission / reception unit 252 illustrated in FIG. 2. The transmission / reception unit 352 receives music information and a playlist transmitted from the information processing apparatus 2100. The transmission / reception unit 352 transmits operation history information 341 of the user to the information processing apparatus 2100. Figure 13

[0260] The selection unit 353 selects music information or a playlist, and selects operations such as reproduction, skip, and repeat. The reproduction unit 354 reproduces music information or a playlist received from the information processing apparatus 2100. The display unit 360 has a function similar to that of the display unit 260 illustrated in FIG. 2. Figure 13

[0261] [3-5. Information processing procedure according to the second embodiment]

[0262] [3-5-1. Processing of presentation style information] ​​​​​​​​

[0263] Next, with reference to Figure 25 , the process of various information processing according to the second embodiment will be described. Figure 25 is a sequence chart showing the process of information processing according to the second embodiment. In Figure 25 , the process of presenting style information to the producer will be described.

[0264] When the viewing music instruction information is sent from the general user terminal 300 by the viewer selecting to view the music (step S161), the information processing apparatus 2100 sends the instructed music to the general user terminal 300 and provides the music (steps S163 and S164).

[0265] Then, the general user terminal 300 sends the user's operation history information to the information processing apparatus 2100 (steps S165 and S166). The information processing apparatus 2100 analyzes the user's operation history information to obtain the number of times of each operation (step S167). Then, in order to extract the style information preferred by the user, the information processing apparatus 2100 sorts the style information in descending order of the predetermined number of operations on the basis of the analysis result, and extracts the style information of a predetermined rank (step S168).

[0266] The information processing apparatus 2100 sends the presentation information of the extracted style information to the producer terminal 200 (step S169). Figure 25 The steps S170 to S178 shown in Figure 14 are the same process as the steps S105 to S113 shown in Figure 25 The steps S179 to S181 shown in Figure 14 are the same process as the steps S120 to S122 shown in

[0267] [3-5-2. Process of providing a playlist]

[0268] Next, with reference to Figure 26 , the process of various information processing according to the second embodiment will be described. Figure 26 is a sequence chart showing the process of information processing according to the second embodiment. In Figure 26 , the process of providing a playlist to the user will be described.

[0269] Figure 26 The steps S191 to S197 shown in Figure 25The steps S201 to S207 shown in FIG. 18 are the same processing as the steps S161 to S167 shown in FIG. 16. When the reproduction instruction information giving an instruction about reproduction is received from the general user terminal 300 (step S198), the information processing apparatus 2100 generates a playlist (step S199). In step S199, the information processing apparatus 2100 obtains musical piece information for which the number of predetermined operations exceeds a threshold value on the basis of the analysis result of the operation history information for the user, and generates a playlist on the basis of the obtained musical piece information. Then, the information processing apparatus 2100 transmits the generated playlist to the general user terminal 300 (step S200).

[0270] [3-5-3. Processing of providing musical piece information after reworking or arranging]

[0271] Next, the process of various information processing according to the second embodiment will be described with reference to Figure 27 , which is a sequence diagram showing the process of information processing according to the second embodiment. In Figure 27 , the process of providing a playlist to a user will be described. Figure 27

[0272] Figure 27 The steps S201 to S207 shown in FIG. 18 are the same processing as the steps S161 to S167 shown in FIG. 16. When the reproduction instruction information giving an instruction about reproduction is received from the general user terminal 300 (step S198), the information processing apparatus 2100 generates a playlist (step S199). In step S199, the information processing apparatus 2100 obtains musical piece information for which the number of predetermined operations exceeds a threshold value on the basis of the analysis result of the operation history information for the user, and generates a playlist on the basis of the obtained musical piece information. Then, the information processing apparatus 2100 transmits the generated playlist to the general user terminal 300 (step S200). Figure 25

[0273] The information processing apparatus 2100 reworks or arranges the musical piece information on the basis of the style information extracted in step S209 (step S210). Then, the information processing apparatus 2100 transmits the musical piece information after reworking or arranging to the general user terminal 300 (step S211).

[0274] [3-6. Effects according to the second embodiment]

[0275] As described above, in the second embodiment, the instruction information is operation history information indicating a history of operations performed by a user who watches a musical piece with the application activated for the user terminal apparatus. The information processing apparatus (the information processing apparatus 2100 in the embodiment) further includes an analysis unit (the analysis unit 2137 in the embodiment) that analyzes the operation history information and obtains the number of each operation of the user. Thus, the information processing apparatus can analyze the user's preference for musical piece information. ​​

[0276] Further, the extraction unit (extraction unit 2132 in the embodiment) sorts the piece characteristic information in descending order of the number of predetermined operations based on the analysis result of the analysis unit, and extracts piece characteristic information of a predetermined rank. The output unit (transmission unit 133 in the present embodiment) outputs presentation information of the piece characteristic information extracted by the extraction unit to the producer terminal device on which the piece creation related application is installed. Thereby, the information processing apparatus can present the style information of the piece information preferred by the user to the producer terminal. As a result, the producer can basically make a new piece requested by the user in real time by using the piece characteristic information for the currently popular piece.

[0277] Further, the information processing apparatus further includes a generation unit (transmission unit 2138 in the embodiment) that obtains piece information of which the number of predetermined operations exceeds a threshold value based on the analysis result of the analysis unit, and generates a playlist based on the obtained piece information. The output unit outputs the playlist to the user terminal device. Thus, the information processing apparatus can generate a playlist that matches the user's preference and distribute and provide a playlist customized for each user.

[0278] Further, the extraction unit obtains piece information of which the number of predetermined operations exceeds a threshold value based on the analysis result of the analysis unit, sorts piece characteristic information used in the obtained piece information in descending order of the number of predetermined operations, and extracts piece characteristic information of a predetermined rank. The composition unit reworks or arranges the piece information according to the style information extracted by the extraction unit. The output unit outputs the reworked or arranged piece information to the user terminal device. Thus, the information processing apparatus can further rework or arrange the piece being reproduced using the style information for making a piece preferred by the user, and provide the reworked or arranged piece to the user.

[0279] As described above, according to the second embodiment, it is possible to improve the convenience of the piece creation function of the producer, and it is also possible to improve the convenience of the piece viewing function of the user.

[0280] [4. Third Embodiment]

[0281] [4-1. Example of Information Processing According to the Third Embodiment]

[0282] Next, an example of information processing according to the third embodiment will be described with reference to Figure 28 An example of information processing according to the third embodiment will be described. Figure 28 is a conceptual diagram showing the flow of information processing according to the third embodiment. The information processing according to the third embodiment is performed by the information processing apparatus 3100, the producer terminal 200, and the user terminal 3300.

[0283] Like the general user terminal 300, the general user terminal 3300 is a tablet terminal or the like, and a music viewing application is installed. The general user terminal 3300 transmits action history information indicating a movement history of the general user terminal 3300 to the information processing apparatus 3100.

[0284] Like the information processing apparatus 2100, the information processing apparatus 3100 provides presentation information of the style information or the music information to the producer terminal 200. Further, based on the action history information of the general user terminal 3300, the information processing apparatus 3100 presents the style information to the producer terminal 200, provides a play list of the music information provided to the general user terminal 3300, or reworks or arranges the music information provided to the general user terminal 3300.

[0285] The information processing flow according to the third embodiment will be described with reference to Figure 28 As shown in FIG. 14, the information processing apparatus 3100 acquires action history information in the general user terminal 3300 (step S41). Then, the information processing apparatus 3100 obtains music information viewed on the general user terminal 3300 and analyzes the action history information to obtain a position of the user. Figure 28

[0286] Then, the information processing apparatus 3100 sorts the style information used in the music information viewed more than a threshold value at a predetermined place, extracts style information of a predetermined rank (step S42), and outputs the style information to the producer terminal 200 (step S43). For example, the information processing apparatus 3100 classifies the position at which the produced music registered in the information storage unit 123 is viewed. The predetermined place is, for example, a prefecture where the user is located, an event place where the user is located, or the like.

[0287] As described above, in the information processing according to the third embodiment, the action history information on the general user terminal 3300 is analyzed, and the style information of the music information frequently viewed by the general user at a predetermined place is presented to the producer terminal 200. Thereby, the producer can produce a new music preferred at a specific place using, for example, the style information of the music information preferred at the specific place, substantially in real time.

[0288] Further, the information processing apparatus 3100 analyzes the action history information, obtains music information in which the number of predetermined operations at a predetermined place exceeds a threshold value, generates a play list based on the obtained music information (step S44), and outputs the play list to the general user terminal 3300 (step S45).

[0289] ​As described above, in the information processing according to the third embodiment, the action history information of the general user terminal 3300 is analyzed, a playlist matching the user's preferences is generated, and a playlist specifically tailored to the user's location is distributed and provided. For example, the information processing device 3100 can distribute and provide different regional click playlists to users in Tokyo and users in Yokohama. Furthermore, for example, the information processing device 3100 can dynamically create playlists while also distributing and providing event-specific playlists.

[0290] The information processing device 3100 then analyzes the action history information, sorts the style information used in the music information for which the number of predetermined operations at the predetermined location exceeds a threshold in descending order of the predetermined number of operations, and extracts the style information ranked in a predetermined order. The information processing device 3100 recreates or arranges the music information based on the extracted style information (step S44), and outputs the recreated or arranged music information to the general user terminal 3300 (step S45).

[0291] As described above, in the information processing according to the third embodiment, the produced music reproduced using the style information for producing the music that is preferred at the location where the user is located can be further remade or arranged, and the remade or arranged music can be provided to the user. Therefore, for example, the general user can reproduce the produced music being reproduced in the form arranged at that location. The remaking and arrangement can be actively performed by the user who sends the instruction information from the general user terminal 3300, or can be automatically performed by the information processing device 3100 based on the action history information. Next, the configuration of the information processing system 301 including the information processing device 3100, the producer terminal 200 and the general user terminal 3300 will be described, and the details of the various processes will be described in order.

[0292] [4-2. Configuration of Information Processing System According to Third Embodiment]

[0293] Figure 29 3 is a diagram showing an example of an information processing system 301 according to the third embodiment. Figure 29 As shown in FIG, the information processing system 301 includes producer terminals 200-1 to 200-3, general user terminals 3300-1 to 3300-3, and an information processing device 3100. The information processing system 301 functions as an automatic composition function management system and a viewing music supply system. Figure 29 In the example of , three producer terminals 200-1 to 200-3 are shown, but are referred to as producer terminals 200 when described without particular distinction. Figure 29 In the example of FIG, three general user terminals 3300 - 1 to 3300 - 3 are shown, but are referred to as general user terminals 3300 when not specifically distinguished.

[0294] The information processing apparatus 3100 and the producer terminal 200 are communicably connected to each other via the network N by wire or wirelessly. The information processing apparatus 3100 and the general user terminal 3300 are communicably connected to each other via the network N by wire or wirelessly.

[0295] The general user terminal 3300 transmits action history information indicating a history of movement of the general user terminal 3300 to the information processing apparatus 3100. The general user terminal 3300 receives provision of a playlist and music information that are remade or arranged by the information processing apparatus 3100 while the music is watched.

[0296] Similar to the information processing apparatus 100, the information processing apparatus 3100 includes pieces of style information as learning data of machine learning. The information processing apparatus 3100 analyzes the action history information received from the general user terminal 3300. The information processing apparatus 3100 outputs presentation information of style information extracted based on a result of analysis of the action history information to the producer terminal 200 to support a producer to create music. Further, the information processing apparatus 3100 generates a playlist customized according to a position of a viewer based on a result of analysis of the action history information, and provides the playlist to the general user terminal 3300. Further, the information processing apparatus 3100 further remakes or arranges a production music that is being reproduced using style information for making the production music that is preferred at a place where a user is located based on a result of analysis of the action history information, and provides the remade or arranged music to the user.

[0297] [4-3. Configuration of information processing apparatus 3100 according to third embodiment]

[0298] Next, a configuration of the information processing apparatus 3100 shown in Figure 30 will be described. Figure 29 Figure 30 is a diagram illustrating a configuration example of the information processing apparatus 3100 according to the third embodiment. As Figure 30 indicated, in the information processing apparatus 3100, the storage unit 120 includes a user action history information storage unit 3125 and a position style information storage unit 3126. Then, the information processing apparatus 3100 includes a control unit 3130 instead of the control unit 130.

[0299] The user action history information storage unit 3125 stores a history of a position of the general user terminal 3300. Figure 31 is a diagram illustrating an example of the user action history information storage unit 3125 according to the third embodiment.

[0300] As Figure 31 ​As shown, the user action history information storage unit 3125 stores action history information of a general user terminal 3300. For example, each action history information is associated with a user ID of each user. The user action history information is information indicating the history of the location of the general user terminal 300. For example, the user's location history information may include the user's location (such as the date and time relative to each location) and each location information of the user terminal 3300.

[0301] The position style information storage unit 3126 stores style information corresponding to a predetermined place. Figure 32 : is a diagram showing an example of the position pattern information storage unit 3126 according to the third embodiment.

[0302] like Figure 31 As shown, position style information storage unit 3126 stores position style information ID, position style information, and style information ID. Position style information ID is identification information for uniquely specifying position style information. Position style information is information indicating a position. Style information ID is identification information for uniquely specifying style information. As described above, position style information is information indicating style information used for music information that is preferably viewed at the position indicated by the position style information.

[0303] and Figure 7 Compared to the control unit 130 shown in , the control unit 3130 includes an extracting unit 3132 , a history acquiring unit 3136 , an analyzing unit 3137 , and a generating unit 3138 .

[0304] The history acquisition unit 3136 acquires action history information from the general user terminal 3300. The history acquisition unit 3136 can acquire the user's target action history information from the action history information stored in the user action history information storage unit 3125. In addition, the history acquisition unit 3136 can acquire the action history information by requesting the general user terminal 3300 to transmit the action history information.

[0305] The analysis unit 3137 obtains music information viewed on the general user terminal 3300 and analyzes the action history information to determine the user's location. Furthermore, the analysis unit 3137 can obtain the number of times each action has been performed to analyze music information that matches or does not match the user's preferences. For example, the analysis unit 3137 classifies music that has been played more than a threshold as being liked by the user. Furthermore, the analysis unit 3137 classifies music that has been played less than a threshold as being disliked by the user. Furthermore, the analysis unit 3137 classifies skipped music as being disliked.

[0306] The generation unit 2138 obtains musical piece information in which the number of times of operation at a predetermined place exceeds a threshold value for a predetermined number of times, and generates a play list based on the obtained musical piece information. The predetermined operation is reproduction, repeat, registration of favorite, or the like.

[0307] The extraction unit 3132 sorts the style information used in the musical piece information in which the number of times of viewing at a predetermined place exceeds a threshold value, based on the analysis result of the analysis unit 3137 using a predetermined rule, and extracts the style information of a predetermined rank. The transmission unit 133 transmits presentation information of the style information extracted by the extraction unit 3132 to the producer terminal 200.

[0308] Then, the composition unit 134 reworks or arranges the musical piece information according to the style information extracted by the extraction unit 3132. The transmission unit 133 transmits the reworked or arranged musical piece information to the general user terminal 3300.

[0309] [4-4. Configuration of general user terminal 3300 according to third embodiment]

[0310] Next, the configuration of the general user terminal 3300 shown in Figure 33 will be described. Figure 29 Figure 33 is a diagram showing a configuration example of the general user terminal 3300 according to the third embodiment. As shown in Figure 33 , the general user terminal 3300 includes a control unit 3350 instead of the control unit 350 shown in Figure 24 . Further, the storage unit 340 of the general user terminal 3300 stores action history information 3341 indicating the movement history of the general user terminal 3300. The action history information 3341 is generated using a GPS function or the like of the general user terminal 3300.

[0311] The control unit 3350 has a function similar to that of the control unit 350 shown in Figure 24 . The control unit 3350 includes a transmission / reception unit 3352 that performs transmission / reception having a function similar to that of the transmission / reception unit 352 shown in Figure 24 , and transmits the action history information 3341.

[0312] [4-5. Process of information processing according to fourth embodiment]

[0313] [4-5-1. Process of presenting style information]

[0314] Next, the process of various information processing according to the third embodiment will be described with reference to Figure 34 Figure 34 is a sequence diagram showing the process of information processing according to the third embodiment. In Figure 34 ​​In the process of presenting style information to the producer, the process will be described.

[0315] Figure 34 Steps S221 to S224 shown in the process of presenting style information to the producer are the same process as Figure 25

[0316] The information processing apparatus 3100 obtains the music information viewed on the general user terminal 3300 and analyzes the action history information to obtain the user's location (step S227). Then, the information processing apparatus 3100 sorts the style information used in the music information viewed more than a threshold number of times at a predetermined place using a predetermined rule based on the analysis result, and extracts the style information of a predetermined rank (step S228). Thereby, the information processing apparatus 3100 extracts the style information of the music information preferred at the place where the user is located.

[0317] The information processing apparatus 3100 transmits presentation information of the extracted style information to the producer terminal 200 (step S229). Figure 34 Steps S230 to S241 shown in the process of presenting style information to the producer are the same process as Figure 25 Steps S169 to S181 shown in the process of presenting style information to the producer are the same process as

[0318] [4-5-2. Process of providing a playlist]

[0319] Next, the process of providing a playlist to the user will be described with reference to Figure 35 The process of various information processing according to the third embodiment will be described. Figure 35 is a sequence diagram showing the process of information processing according to the third embodiment. In Figure 35 In the process of presenting style information to the producer, the process will be described.

[0320] Figure 35 Steps S251 to S257 shown in the process of providing a playlist to the user are the same process as Figure 34 Steps S2211 to S227 shown in the process of providing a playlist to the user are the same process as when the reproduction instruction information giving an instruction on reproduction is received from the general user terminal 3300 (step S258), the information processing apparatus 3100 generates a playlist (step S259). In step S259, the information processing apparatus 3100 obtains music information in which the number of times of a predetermined operation at a predetermined place exceeds a threshold value based on the analysis result, and generates a playlist based on the obtained music information. Then, the information processing apparatus 3100 transmits the generated playlist to the general user terminal 300 (step S260).

[0321] [4-5-3. Process of providing music information after reworking or arranging]​

[0322] Next, the process of various information processing according to the third embodiment will be described with reference to Figure 36 Figure 36 is a sequence diagram illustrating the process of information processing according to the third embodiment. In Figure 36 In the third embodiment, the process of providing the musical piece information to the user after the reworking or the arrangement will be described.

[0323] Figure 36 Steps S261 to S267 illustrated in the third embodiment are the same process as steps S221 to S227 illustrated in the second embodiment. The information processing apparatus 3100 receives the instruction information giving the instruction on the reworking or the editing from the general user terminal 300 (step S268). The information processing apparatus 3100 sorts the style information used in the musical piece information in which the number of times of watching at the predetermined place exceeds the threshold value using a predetermined rule based on the analysis result, and extracts the style information of the predetermined rank (step S269). Figure 34

[0324] The information processing apparatus 3100 reworks or arranges the musical piece information based on the style information extracted in step S269 (step S370). Then, the information processing apparatus 3100 transmits the reworked or arranged musical piece information to the general user terminal 300 (step S371).

[0325] [4-6. Effects according to the third embodiment]

[0326] As described above, in the third embodiment, the instruction information is the action history information indicating the movement history of the user terminal apparatus (the general user terminal 3300 in the embodiment). The information processing apparatus (the information processing apparatus 3100 in the embodiment) further includes an analysis unit (the analysis unit 3137 in the embodiment) that obtains the musical piece information watched on the user terminal apparatus and analyzes the action history information to obtain the position of the user. Therefore, the information processing apparatus can analyze the musical piece information that is preferably watched at the place where the user is located.

[0327] ​​Further, the extraction unit (extraction unit 3132 in the present embodiment) sorts the musical piece feature information used in the musical piece information viewed more than a threshold number of times at a predetermined place using a predetermined rule based on the analysis result of the analysis unit, and extracts the musical piece feature information of a predetermined rank. The output unit (transmission unit 133 in the present embodiment) outputs the presentation information of the musical piece feature information extracted by the extraction unit to the producer terminal device on which the musical piece creation related application is installed. In this way, the information processing apparatus can present the musical piece feature information of the musical piece information frequently viewed by general users at a predetermined place to the producer terminal. Thereby, the producer can produce a new musical piece preferred at a specific place using the musical piece feature information of the musical piece information preferred at the specific place, substantially in real time.

[0328] Further, the information processing apparatus further includes a generation unit (transmission unit 3138 in the present embodiment) that obtains the musical piece information in which the number of predetermined operations at a predetermined place exceeds a threshold value from the analysis result of the analysis unit, and generates a playlist based on the obtained musical piece information. The output unit outputs the playlist to the user terminal device located at the predetermined place. Thus, the information processing apparatus generates a playlist matching the preference of the user and distributes and provides a playlist tailored to the place where the user is located.

[0329] Further, the extraction unit sorts the musical piece feature information used in the musical piece information in which the number of predetermined operations at a predetermined place exceeds a threshold value in order from high to low according to the analysis result of the analysis unit, and extracts the musical piece feature information of a predetermined rank. The composition unit reworks or arranges the musical piece information based on the musical piece feature information extracted by the extraction unit. The output unit outputs the reworked or arranged musical piece information to the user terminal device located at the predetermined place. Thus, the information processing apparatus can further rework or arrange a production musical piece reproduced using the musical piece feature information for producing a musical piece preferred at the place where the user is located, and provide the reworked or arranged musical piece to the user.

[0330] As described above, according to the third embodiment, it is possible to improve the convenience of the musical piece creation function of the producer, and it is also possible to improve the convenience of the musical piece viewing function of the user according to the place where the user is located.

[0331] [5. Conceptual diagram of the configuration of the information processing system]

[0332] Here, each function, hardware configuration, and data in the information processing system will be conceptually described with reference to the drawings. Figure 37 To show one example of a conceptual diagram of the configuration of the information processing system; specifically, Figure 37 is a diagram showing a functional outline of a system as an example of the application information processing system 1, 201, and 301.

[0333] [5-1. About overall configuration]

[0334] Figure 37 The server apparatus shown in corresponds to the information processing apparatuses 100, 2100, and 3100 in the information processing systems 1, 201, and 301. Figure 37 The system manager application unit shown in corresponds to an application installed in the terminal used by the system manager. Figure 37 The producer application unit shown in corresponds to the producer terminal 200 in the information processing system 1 and the application installed in the producer terminal 200. In addition, Figure 37 The general user application unit shown in FIG corresponds to the general user terminals 300 and 3300 in the information processing systems 201 and 301 and the applications installed in the general user terminals 300 and 3300. Figure 37 In the example of FIG, one system manager application unit, one music maker application unit, and one general user application unit are shown, but a plurality of these application units may be included depending on the number of corresponding terminals.

[0335] Figure 37 The learning processing unit and the control unit of the server device shown in FIG correspond to the control units 130, 2130, and 3130 of the information processing devices 100, 2100, and 3100. For example, the learning processing unit of the server device corresponds to the composing unit 134 of the information processing devices 100, 2100, and 3100. The server database unit of the server device corresponds to the storage unit 120 of the information processing devices 100, 2100, and 3100.

[0336] Figure 37 The display operation unit and the control unit of the music composition maker application unit shown in FIG correspond to the control unit 250 of the producer terminal 200. For example, the display operation unit of the music composition maker application unit corresponds to the display control unit 251 of the producer terminal 200. Figure 37 The display operation unit and control unit of the general user application unit shown in FIG3 correspond to the control unit 350 of the general user terminals 300 and 3300. For example, the display operation unit of the general user application unit corresponds to the display control unit 351 of the general user terminals 300 and 3300. The display operation unit and control unit of the system administrator application unit and the general user application unit correspond to the control unit of the terminal device used by each user.

[0337] like Figure 37 As shown, the server device is connected to a system manager application unit, a music maker application unit, and a general user application unit via a network N such as the Internet.

[0338] [5-2. About the server device]

[0339] First, the configuration related to the server device will be described.

[0340] The server device includes a control unit, a learning processing unit, and a server database unit. The control unit of the server device has a generated musical piece information management function, a style information management function, a user operation history information management function, and user action history information. The learning processing unit of the server device has a machine learning processing function and a deep learning processing function.

[0341] [5-3. About the musical piece maker application unit]

[0342] Next, the configuration related to the musical piece maker application unit will be described.

[0343] The musical piece maker application unit includes a display operation unit and a control unit. The display operation unit of the musical piece maker application unit has a produced musical piece information display function and a style information display editing function. The musical piece maker application unit has a style information sharing function and a user operation history information transmission function.

[0344] The musical piece maker application unit is, for example, a musical piece editing software (DAW or the like), and can display, for example, musical piece information by a copyright protected work information display function. For example, when the DAW has an AI-assisted musical piece generation function, a new musical piece information can be generated using the style information display editing function. Note that the system manager application unit has the same configuration, and the user's authority to the system is different.

[0345] [5-4. About the general user application]

[0346] Next, the configuration related to the general user application unit will be described.

[0347] The general user application unit includes a display operation unit and a control unit. The display operation unit of the general user application unit has a generated musical piece information display function and a style information display editing function. The musical piece maker application unit has a style information sharing function, a user operation history information transmission function, and a user action history information transmission function.

[0348] [5-5. User interface (UI)]

[0349] Here, details of an automatic composition function including information display by an application (musical piece creation application) will be described with reference to Figure 38 and Figure 39 Figure 38 and Figure 39 ​is a diagram showing an example of a user interface according to an embodiment.

[0350] Figure 38 An example of a user interface when a musical composition creation application is displayed on a screen of the producer terminal 200 is shown.

[0351] In Figure 38 In the example shown in (b), the user interface IF11 displays musical composition data received by the musical composition creation application. Note that although details will be described below, the musical composition data in the musical composition creation application includes three types of data: melody, chord, and bass. Figure 38 The user interface IF11 shown in (b) displays data related to the melody among the three types of data.

[0352] The setting information ST11 displays information about a style palette that is an example of setting information in the automatic composition function. The style palette is specification information for specifying style information that becomes learning data for machine learning.

[0353] The setting information ST12 displays information about chords, which is an example of setting information in the automatic composition function. For example, the information about harmony is information for determining a probability that a composed sound included in a chord appears in a melody in musical composition data composed by the information processing apparatus 100. For example, when the user sets the information about harmony to "strict," the probability that a composed sound included in a chord appears in a melody in automatically composed musical composition data increases. On the other hand, when the user sets the information about harmony to "loose," the probability that a composed sound included in a chord appears in a melody in automatically composed musical composition data decreases. Figure 38 The example of (b) indicates that the user applies the information about chords to "strict."

[0354] The setting information ST13 displays note duration information, which is an example of setting information in the automatic composition function. For example, the note duration information is information for determining a note duration in musical composition data composed by the information processing apparatus 100. For example, when the user sets the note duration information to "long," the probability that a note of a sound to be emitted having a relatively long length (e.g., a whole note, a half note, etc.) appears in automatically composed musical composition data increases. On the other hand, when the user sets the note duration information to "short," the probability that a note of a sound to be emitted having a relatively short length (e.g., an eighth note, a sixteenth note, etc.) appears in automatically composed musical composition data increases.

[0355] The setting information ST14 displays information for determining the type and amount of material music other than the material music included in the designated information (the style palette specified by the user), which is an example of setting information in the automatic composition function. Such information is, for example, information for determining whether to strictly perform learning based on the music included in the style palette specified by the user in the music data composed by the information processing device 100. For example, when the user sets such information to "never", music other than the music included in the style palette is less likely to be used in the learning of automatic composition. On the other hand, when the user sets such information to "only", music other than the music included in the style palette is more likely to be used in the learning of automatic composition.

[0356] The music data MDT1 shows specific music data transmitted from the information processing device 100. Figure 38 In the example of , the music data MDT1 includes information indicating a chord progression such as Cm, information indicating pitches or note durations in a measure, transitions of pitches of notes (in other words, melody), and the like. Figure 26 As shown, for example, music data MDT1 may include four different types of content. That is, information processing device 100 can transmit multiple pieces of music data rather than just one type of automatically composed music data. This allows the user to select their favorite music data from among the multiple generated music data candidates, or to create their favorite music by combining multiple pieces of music data.

[0357] It should be noted that Figure 38 The user interface IF11 shown in FIG. 1 displays data related to melody among three types of data: melody, chords, and bass included in the music data, and other data is displayed on another user interface. Figure 39 Describe this.

[0358] like Figure 39 As shown, in addition to the user interface IF11 displaying data related to the melody, the producer terminal 200 may display a user interface IF12 displaying data related to the chord and a user interface IF13 displaying data related to the bass sound on the screen. Figure 39 Although not shown, annotation information different from that of the music data MDT1 in the user interface IF11 is displayed on the user interface IF12 or the user interface IF13. Specifically, note information related to the chord corresponding to the melody of the music data (e.g., the composition sound of a Cm chord, etc.) is displayed on the user interface IF12. In addition, note information related to the bass of the melody or chord corresponding to the music data (e.g., the sound of a "C" in the case of a Cm chord, etc.) is displayed on the user interface IF13.

[0359] The user can select information to be copied from the displayed user interfaces IF11, IF12, and IF13, and perform a work such as editing a part of the bass sound.

[0360] [6. Other Embodiments]

[0361] In addition to the above embodiments and modifications, the processing according to the above embodiments and modifications can be performed in various different forms (modifications).

[0362] [6-1. Other Configuration Examples]

[0363] Each of the above configurations is an example, and the information processing systems 1, 201, and 301 can be any system configuration as long as the above information processing can be implemented.

[0364] [6-2. Others]

[0365] In addition, in each of the processes described in the above embodiments, all or some of the processes described as being automatically performed can be manually performed, or all or some of the processes described as being manually performed can be automatically performed by a known method. In addition, unless otherwise specified, the processing procedure, specific names, and information including various data and parameters indicated in the document and the drawings can be arbitrarily changed. For example, the various information shown in each of the drawings is not limited to the information shown.

[0366] Further, each component of each device shown in the drawings is conceptual in function, and is not necessarily physically configured as shown in the drawings. That is, the specific form of distribution and integration of the devices is not limited to those shown, and all or a part thereof can be distributed and integrated in arbitrary units in function or physically according to various loads, usage situations, and the like.

[0367] Further, the above embodiments and modifications can be appropriately combined within a range not contradictory to the processing content.

[0368] Further, the effects described in the present specification are merely examples and are not limited thereto. There can be additional effects.

[0369] [7. Hardware Configuration]

[0370] The information devices (such as the information processing devices 100, 2100, and 3100, the producer terminal 200, the general user terminals 300 and 3300, and the like) according to the above embodiments and modifications are implemented by a computer 1000 having, for example, a configuration as shown in FIG. 10. Figure 40 Figure 40 ​is a hardware configuration diagram showing an example of a computer 1000 that implements the functions of the information processing apparatuses 1002 100 and 3100, the producer terminal 200, and the general user terminals 300 and 3300. Hereinafter, the information processing apparatus 100 according to the present embodiment will be described as an example. The computer 1000 includes a CPU 1100, a RAM 1200, a read only memory (ROM) 1300, a hard disk drive (HDD) 1400, a communication interface 1500, and an input / output interface 1600. Each unit of the computer 1000 is connected by a bus 1050.

[0371] The CPU 1100 operates based on a program stored in the ROM 1300 or the HDD 1400, and controls each unit. For example, the CPU 1100 loads a program stored in the ROM 1300 or the HDD 1400 to the RAM 1200, and executes processing corresponding to the various programs.

[0372] The ROM 1300 stores a boot program such as a basic input / output system (BIOS) that is executed by the CPU 1100 when the computer 1000 is activated, a program depending on the hardware of the computer 1000, and the like.

[0373] The HDD 1400 is a computer-readable recording medium that non-transitorily records a program executed by the CPU 1100, data used by the program, and the like. Specifically, the HDD 1400 is a recording medium that records, as an example of program data 1450, an information processing program according to the present disclosure.

[0374] The communication interface 1500 is an interface for the computer 1000 to connect to an external network 1550 (for example, the Internet). For example, the CPU 1100 receives data from another device or transmits data generated by the CPU 1100 to another device via the communication interface 1500.

[0375] The input / output interface 1600 is an interface for connecting an input / output device 1650 and the computer 1000. For example, the CPU 1100 receives data from an input device such as a keyboard and a mouse via the input / output interface 1600. Furthermore, the CPU 1100 transmits data to an output device such as a display, a speaker, a printer, and the like via the input / output interface 1600. Furthermore, the input / output interface 1600 can be used as a medium interface that reads a program and the like recorded in a predetermined recording medium (medium). For example, the medium is an optical recording medium such as a digital versatile disc (DVD), a phase change rewritable disc (PD), a magneto-optical recording medium such as a magneto-optical disc (MO), a tape medium, a magnetic recording medium, a semiconductor memory, and the like.

[0376] For example, in a case where the computer 1000 is used as the information processing apparatus 100 according to the present embodiment, the CPU 1100 of the computer 1000 executes the information processing program loaded on the RAM 1200 to realize the functions of the control unit 130 and the like. Further, the HDD 1400 stores the information processing program and data according to the present disclosure in the storage unit 120. Note that the CPU 1100 reads the program data 1450 from the HDD 1400 and executes the program data, but as another example, these programs can be acquired from another apparatus via the external network 1550.

[0377] Note that the present technology can also have the following configuration. (1)

[0379] An information processing apparatus including:

[0380] a storage unit that stores a plurality of pieces of musical composition feature information in which a plurality of types of feature amounts extracted from musical composition information are associated with predetermined identification information, the musical composition feature information being used as learning data in a musical composition process using machine learning;

[0381] a reception unit that receives instruction information transmitted from a terminal apparatus;

[0382] an extraction unit that extracts the musical composition feature information from the storage unit in accordance with the instruction information; and

[0383] an output unit that outputs presentation information of the musical composition feature information extracted by the extraction unit. (2)

[0385] The information processing apparatus according to (1), in which

[0386] the instruction information includes information on the feature amounts,

[0387] the extraction unit sorts the plurality of pieces of musical composition feature information using a predetermined rule based on the information on the feature amounts, and extracts musical composition feature information of a predetermined rank, and

[0388] the output unit outputs the presentation information of the musical composition feature information extracted by the extraction unit to an external apparatus together with rank information indicating the rank of the musical composition feature information. (3)

[0390] The information processing apparatus according to (2), in which the instruction information is operation information in the terminal apparatus. (4)

[0392] The information processing apparatus according to (3), wherein the piece characteristic information includes score information, the score information including chord progression information indicating a chord progression in a measure having a prescribed length, melody information indicating a melody, and bass information indicating a bass line. (5)

[0394] The information processing apparatus according to (4), wherein the score information further includes drum progression information indicating a drum progression in a measure having a prescribed length. (6)

[0396] The information processing apparatus according to (4), wherein the piece characteristic information includes lyric information indicating a lyric in a measure having a prescribed length. (7)

[0398] The information processing apparatus according to (6), wherein the piece characteristic information includes piece format information in which identification information of score information and identification information of lyric information for the same measure are registered in association with each other, and piece order information indicating an order of the piece format information. (8)

[0400] The information processing apparatus according to (4), wherein

[0401] The receiving unit receives instruction information for selecting one piece of score information, and

[0402] The extraction unit sorts piece characteristic information including the score information selected by the instruction information according to a predetermined rule, and extracts piece characteristic information of a predetermined rank. (9)

[0404] The information processing apparatus according to (6), wherein

[0405] The receiving unit receives instruction information giving an instruction to search for a lyric, and

[0406] The extraction unit sorts piece characteristic information including lyric information according to a predetermined rule, and extracts piece characteristic information of a predetermined rank, the lyric information including a lyric for which the instruction is given by the instruction information. (10)

[0408] The information processing apparatus according to (3), wherein

[0409] The terminal apparatus is a producer terminal apparatus in which an application program related to creation of a piece is installed,

[0410] The instruction information is operation history information indicating a history of operations performed by a producer creating a piece on the producer terminal apparatus when the application program is activated,

[0411] The extraction unit acquires music information in which the number of times of a predetermined operation exceeds a threshold value based on the operation history information, sorts music feature information used in the acquired music information in descending order of the number of times of the predetermined operation, and extracts music feature information of a predetermined rank, and

[0412] The output unit outputs presentation information of the music feature information extracted by the extraction unit to the producer terminal device. (11)

[0414] The information processing apparatus according to (3), wherein

[0415] The terminal device is a user terminal device on which an application for viewing music is installed,

[0416] The instruction information is operation history information indicating a history of operations performed by a user who views music on the user terminal device when the application is activated, and

[0417] The information processing apparatus further includes:

[0418] The analysis unit analyzes the operation history information to obtain the number of times of each operation. (12)

[0420] The information processing apparatus according to (11), wherein

[0421] The extraction unit acquires music information in which the number of times of a predetermined operation exceeds a threshold value based on the analysis result of the analysis unit, sorts music feature information used in the acquired music information in descending order of the number of times of the predetermined operation, and extracts music feature information of a predetermined rank, and

[0422] The output unit outputs presentation information of the music feature information extracted by the extraction unit to the producer terminal device on which an application related to creation of music is installed. (13)

[0424] The information processing apparatus according to (11), further including:

[0425] The generation unit acquires music information in which the number of times of a predetermined operation exceeds a threshold value based on the analysis result of the analysis unit, and generates a play list based on the acquired music information,

[0426] wherein,

[0427] The output unit outputs the play list to the user terminal device. (14)

[0429] The information processing apparatus according to (11), further including:

[0430] The composition unit composes the musical piece information using machine learning based on the musical piece feature information,

[0431] wherein,

[0432] The extraction unit obtains musical piece information for which the predetermined operation number exceeds a threshold value based on the analysis result of the analysis unit, sorts musical piece feature information used in the obtained musical piece information in descending order of the predetermined operation number, and extracts musical piece feature information of a predetermined rank,

[0433] The composition unit re-composes or arranges the musical piece information according to the musical piece feature information extracted by the extraction unit, and

[0434] The output unit outputs the re-composed or arranged musical piece information to the user terminal device. (15)

[0436] The information processing device according to (3), wherein

[0437] The terminal device is a user terminal device on which an application for viewing a musical piece is installed,

[0438] The instruction information is action history information indicating a movement history of the user terminal device, and

[0439] The information processing device further includes:

[0440] The analysis unit obtains musical piece information viewed through the user terminal device and analyzes the action history information to obtain a location of the user. (16)

[0442] The information processing device according to (15), wherein

[0443] The extraction unit sorts musical piece feature information used in musical piece information viewed more than a threshold value of times at a predetermined place using a predetermined rule based on the analysis result of the analysis unit, and extracts musical piece feature information of a predetermined rank, and

[0444] The output unit outputs presentation information of the musical piece feature information extracted by the extraction unit to a producer terminal device on which an application related to the creation of a musical piece is installed. (17)

[0446] The information processing device according to (15), further including:

[0447] The generation unit obtains musical piece information for which a predetermined operation number exceeds a threshold value at a predetermined place based on the analysis result of the analysis unit, and generates a play list based on the obtained musical piece information,

[0448] wherein,

[0449] The output unit outputs the playlist to a user terminal device located at a predetermined location. (18)

[0451] The information processing device according to (15), further comprising:

[0452] The composition unit uses machine learning to create music information based on music feature information.

[0453] in,

[0454] The extracting unit sorts the music feature information used in the music information having the predetermined operation number exceeding the threshold at the predetermined location in descending order of the predetermined operation number based on the analysis result of the analyzing unit, and extracts the music feature information of the preset ranking,

[0455] The composing unit recomposes or arranges the music information based on the music feature information extracted by the extracting unit, and

[0456] The output unit outputs the recomposed or arranged music information to a user terminal device located at a predetermined location. (19)

[0458] An information processing method executed by a computer, the method comprising:

[0459] receiving instruction information sent from a terminal device;

[0460] extracting one piece of music feature information from a plurality of pieces of music feature information according to the instruction information, in which a plurality of types of feature quantities extracted from the music information are associated with predetermined identification information; and

[0461] Output the extracted music feature information. (20)

[0463] An information processing program that enables a computer to:

[0464] receiving instruction information sent from a terminal device;

[0465] extracting music feature information according to the instruction information in the plurality of pieces of music feature information, in which a plurality of types of feature quantities extracted from the music information are associated with predetermined identification information; and

[0466] Output the extracted music feature information.

[0467] Reference Number List

[0468] 1. 201 and 301 information processing systems

[0469] 100, 2100, 3100 information processing devices

[0470] 110, 210, 310 communication unit

[0471] 120, 240, 340 storage unit

[0472] 121 user information storage unit

[0473] 122 style information storage unit

[0474] 123 possession information storage unit

[0475] 124 production information storage unit

[0476] 125 operation history information storage unit

[0477] 130, 250, 350, 2130, 3130, 3350 control unit

[0478] 131 reception unit

[0479] 132, 2132, 3132 extraction unit

[0480] 133 transmission unit

[0481] 134 composition unit

[0482] 135 registration unit

[0483] 136, 2136, 3136 history acquisition unit

[0484] 137, 2137, 3137 analysis unit

[0485] 200 producer terminal

[0486] 220, 320 input unit

[0487] 230, 330 output unit

[0488] 241, 341 operation history information

[0489] 251, 351 display control unit

[0490] 252, 352, 3352 transmission / reception unit

[0491] 253, 353 selection unit

[0492] 254, 354 reproduction unit

[0493] 260, 360 display unit

[0494] 300, 3300 general user terminal

[0495] 2125 user operation history information

[0496] 2138, 3138 generating unit

[0497] 3125 user action history information storage unit

[0498] 3126 position pattern information storage unit

[0499] 3341 action history information.

Claims

1. An information processing device, comprising: a storage unit that stores a plurality of pieces of music feature information in which a plurality of types of feature quantities extracted from the music information are associated with predetermined identification information, the music feature information being used as learning data in a music composition process using machine learning; a receiving unit, receiving instruction information sent from a terminal device; an extraction unit, extracting music feature information from the storage unit according to the instruction information; as well as an output unit for outputting demonstration information of the music feature information extracted by the extraction unit, The instruction information includes information about the feature amount, wherein the instruction information is operation information in the terminal device, The extracting unit sorts the plurality of pieces of music feature information using a predetermined rule based on the information on the feature amount, and extracts the music feature information of a preset ranking, and The output unit outputs the demonstration information of the music piece feature information extracted by the extraction unit together with ranking information indicating a ranking of the music piece feature information to an external device.

2. The information processing device according to claim 1, wherein The musical piece characteristic information includes musical score information including chord progression information indicating a chord progression in a measure having a prescribed length, melody information indicating a melody, and bass information indicating a bass progression.

3. The information processing device according to claim 2, wherein: The musical score information also includes drum progression information indicating a drum progression in the measure having a prescribed length.

4. The information processing device according to claim 2, wherein: The musical piece characteristic information includes lyrics information indicating lyrics in the measure having a prescribed length.

5. The information processing apparatus according to claim 4, wherein: The music piece characteristic information includes music piece format information in which identification information of the score information and identification information of the lyrics information for the same measure are registered in association with each other, and music piece order information indicating an order of the music piece format information. The information processing apparatus according to claim 2 , wherein: The receiving unit receives instruction information for selecting a piece of the musical score information, and The extracting unit sorts the musical piece feature information including the musical score information selected by the instruction information using a predetermined rule, and extracts the musical piece feature information of a preset ranking.

7. The information processing apparatus according to claim 4, wherein: The receiving unit receives instruction information giving an instruction to search for lyrics, and The extracting unit sorts the music feature information including lyrics information including the lyrics for which a search instruction is given by the instruction information using a predetermined rule, and extracts the music feature information of a preset sort.

8. The information processing apparatus according to claim 1, wherein: The terminal device is a producer terminal device on which an application program related to the creation of music is installed. the instruction information is operation history information indicating a history of operations performed on the producer terminal device by a producer who created a musical composition when the application was activated, The extracting unit obtains music information in which the number of predetermined operations exceeds a threshold value based on the operation history information, sorts the music feature information used in the obtained music information in descending order of the number of predetermined operations, and extracts the music feature information of a preset ranking, and The output unit outputs demonstration information of the music feature information extracted by the extraction unit to the producer terminal device.

9. The information processing apparatus according to claim 1, wherein: The terminal device is a user terminal device installed with an application for viewing music. The instruction information is operation history information indicating a history of operations performed on the user terminal device by a user viewing the music piece when the application is activated, and The information processing device further includes: The analyzing unit analyzes the operation history information to obtain the number of times each operation has occurred.

10. The information processing apparatus according to claim 9, wherein: The extracting unit obtains music information in which the number of predetermined operations exceeds a threshold value based on the analysis result of the analyzing unit, sorts the music feature information used in the obtained music information in descending order of the number of predetermined operations, and extracts the music feature information of a preset ranking, and The output unit outputs the demonstration information of the music feature information extracted by the extraction unit to a producer terminal device in which an application program related to creation of music is installed.

11. The information processing apparatus according to claim 9, further comprising: a generating unit that obtains music information for which the number of predetermined operations exceeds a threshold value based on the analysis result of the analyzing unit, and generates a playlist based on the obtained music information, in, The output unit outputs the playlist to the user terminal device.

12. The information processing apparatus according to claim 9, further comprising: A composing unit, based on the music feature information, uses machine learning to create music information, in, The extracting unit obtains music information in which the number of predetermined operations exceeds a threshold value based on the analysis result of the analyzing unit, sorts the music feature information used in the obtained music information in descending order of the number of predetermined operations, and extracts the music feature information of a preset ranking, The composing unit recomposes or arranges the music information based on the music feature information extracted by the extracting unit, and The output unit outputs the recomposed or arranged music information to the user terminal device.

13. The information processing apparatus according to claim 1, wherein: The terminal device is a user terminal device installed with an application for viewing music. The instruction information is action history information indicating a movement history of the user terminal device, and The information processing device further includes: An analyzing unit obtains music information viewed through the user terminal device and analyzes the action history information to obtain a user's position. The information processing apparatus according to claim 13 , wherein: The extracting unit sorts the music feature information used in the music information whose number of views exceeds a threshold at a predetermined location using a predetermined rule based on the analysis result of the analyzing unit, and extracts music feature information of a preset ranking, and The output unit outputs the demonstration information of the music feature information extracted by the extraction unit to a producer terminal device in which an application program related to creation of music is installed.

15. The information processing apparatus according to claim 13, further comprising: a generating unit that obtains music information for which the number of predetermined operations at a predetermined location exceeds a threshold value based on the analysis result of the analyzing unit, and generates a playlist based on the obtained music information, in, The output unit outputs the playlist to the user terminal device located at the predetermined place.

16. The information processing apparatus according to claim 13, further comprising: A composing unit, based on the music feature information, uses machine learning to create music information, in, The extracting unit sorts the music feature information used in the music information in which the number of predetermined operations exceeds a threshold at a predetermined location in descending order of the number of predetermined operations based on the analysis result of the analyzing unit, and extracts the music feature information of a preset ranking, The composing unit recomposes or arranges the music information based on the music feature information extracted by the extracting unit, and The output unit outputs the recomposed or arranged music information to the user terminal device located at the predetermined location.

17. An information processing method executed by a computer, the method comprising: receiving instruction information sent from a terminal device; extracting a piece of music feature information from a plurality of pieces of music feature information according to the instruction information, wherein a plurality of types of feature quantities extracted from the music information are associated with predetermined identification information in the plurality of pieces of music feature information; and Output the demo information of the extracted music feature information, The instruction information includes information about the feature amount, wherein the instruction information is operation information in the terminal device, sorting the plurality of pieces of music feature information using a predetermined rule based on the information on the feature amount, and extracting the music feature information of a preset ranking, and The demo information of the extracted musical piece feature information is output to an external device together with ranking information indicating a ranking of the musical piece feature information.

18. A computer-readable storage medium storing an information processing program, which, when executed by a computer, causes the computer to: receiving instruction information sent from a terminal device; extracting a piece of music feature information from a plurality of pieces of music feature information according to the instruction information, wherein a plurality of types of feature quantities extracted from the music information are associated with predetermined identification information in the plurality of pieces of music feature information; and Output the demo information of the extracted music feature information, The instruction information includes information about the feature quantity, wherein: The instruction information is the operation information in the terminal device, sorting the plurality of pieces of music feature information using a predetermined rule based on the information on the feature amount, and extracting the music feature information of a preset ranking, and The demo information of the extracted musical piece feature information is output to an external device together with ranking information indicating a ranking of the musical piece feature information.

Images