Information processing system, information processing method and program

Abstract

The information processing system includes: a content generating unit that generates content by using one or more material data generated from original content; and a metadata adding unit that adds content metadata to the content, the content metadata including material information related to the material data used to generate the content and generation information related to the generation of the content.

Description

Technical Field

[0001] The present disclosure relates to an information processing system, an information processing method, and a program. Background Art

[0002] With the recent development of digitization of contents constituted by images, audio data, and the like, technologies associated with copy protection and copyright management of digital data have been proposed.

[0003] Recently, creation from scratch or creation of works with reference to multiple other creations by utilizing artificial intelligence (hereinafter also referred to as AI) has also been achieved.

[0004] For example, PTL 1 presented below discloses a method for managing a user's usage permission by comparing with a pre-specified usage permission range of original content in a case where there is a possibility of copyright infringement determined by reading information associated with the content and embedded in the original content as a digital watermark or by extracting features of the content and comparing the features of the content with features of already registered content.

[0005] In addition, for example, PTL 2 presented below discloses a copyright providing system that promotes secondary use of copyrighted works while retaining the right to maintain the integrity of the copyrighted works by storing work information, which includes material data constituting the copyrighted work and reference data identifying other work information to be cited, processing data indicating specific processing of the material data of the copyrighted work or other work information, and usage condition data indicating usage conditions of the work information associated with the copyrighted work.

[0006] [Citation List]

[0007] [Patent Document]

[0008] [PTL 1]

[0009] JP 2001-136363A

[0010] [PTL 2]

[0011] Special Opening No. 10-55389 Summary of the Invention

[0012] [Technical Issues]

[0013] However, when the material data of an original creative work decomposed into its constituent elements is used for AI creation (content generated using artificial intelligence), it is difficult to determine the original creative work used in generating the AI ​​creative work, or the relationship between the AI ​​creative work and the original creative work (for example, the usage pattern of the original creative work used to generate the AI ​​creative work) based on the AI ​​creative work generated as a deliverable (content generated using artificial intelligence).

[0014] According to the aforementioned PTL 1, a content identifier or a licensed user identifier is embedded in the content. However, there is no description of information indicating the relationship between the original creative work and the creative work automatically created using AI or the like. Furthermore, while the aforementioned PTL 2 discloses the storage of data such as the material data constituting the work, reference data, and processing data as work information, it does not consider reference to the original creative work of the material data used to create the work, nor the management of generated information related to the creation.

[0015] [Solution to the problem]

[0016] According to the present disclosure, an information processing system is proposed, including: a content generation unit that generates content using one or more material data generated from original content; and a metadata addition unit that adds content metadata to the content, the content metadata including material information associated with the material data used to generate the content and generation information associated with the generation of the content.

[0017] According to the present disclosure, an information processing method executed by a processor is proposed, the method comprising: generating content using one or more pieces of material data generated from original content; and adding content metadata to the content, the content metadata comprising material information associated with the material data used to generate the content and generation information associated with the generation of the content.

[0018] According to the present disclosure, there is provided a program for causing a computer to function as a content generation unit and a metadata addition unit, wherein the content generation unit generates content using one or more pieces of material data generated from original content, and the metadata addition unit adds content metadata to the content, the content metadata including material information associated with the material data used to generate the content and generation information associated with the generation of the content. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 is a diagram depicting an overview of an information processing system according to one embodiment of the present disclosure.

[0020] Figure 2 is a block diagram depicting an example of the configuration of a music providing server according to the present embodiment.

[0021] Figure 3 is depicted through Figure 2 2 is a block diagram of an example of a configuration of logical functions according to the first embodiment implemented by a communication unit and a storage unit of a music providing server depicted in FIG.

[0022] Figure 4 are diagrams illustrating respective processes performed during the AI ​​authoring process in the first embodiment.

[0023] Figure 5 1 is a diagram illustrating a material generation process performed in the first embodiment in a case where the original creative work is a “musical composition”.

[0024] Figure 6 is a diagram illustrating an example of the AI ​​authoring process according to the first embodiment.

[0025] Figure 7 is a diagram illustrating another example of the AI ​​authoring process according to the first embodiment.

[0026] Figure 8 is a diagram illustrating another example of the AI ​​authoring process according to the first embodiment.

[0027] Figure 9 is a diagram illustrating another example of the AI ​​authoring process according to the first embodiment.

[0028] Figure 10 This is a diagram for explaining the case where metadata is individually managed using ID links in a database on a network in the first embodiment.

[0029] Figure 11 is a flowchart showing an example of the flow of a metadata adding operation procedure according to the first embodiment.

[0030] Figure 12 is depicted by Figure 2 2 is a block diagram of an example of a configuration of logical functions according to the second embodiment implemented by a communication unit and a storage unit of a music providing server depicted in FIG.

[0031] Figure 13 is a flowchart showing an example of the flow of a feedback process according to the second embodiment.

[0032] Figure 14 is depicted through Figure 2 2 is a block diagram of an example of a configuration of logical functions according to the third embodiment implemented by a communication unit and a storage unit of a music providing server depicted in FIG.

[0033] Figure 15 1 is a flowchart showing an example of the flow of a new creative work support information presentation process based on hit song analysis in the third embodiment. DETAILED DESCRIPTION

[0034] Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. Note that in this specification and the drawings, constituent elements having substantially the same functional configuration are given the same reference numerals to omit repeated descriptions.

[0035] Additionally, the description will be presented in the following order.

[0036] 1. Overview of the Information Processing System According to One Embodiment of the Present Disclosure

[0037] 2. Configuration of the Music Providing Server 10

[0038] 3. First embodiment: Adding metadata

[0039] 3-1. Background

[0040] 3-2. Functional Configuration

[0041] 3-3. Specific examples of the generation process and metadata addition

[0042] (3-3-1. AI creation process)

[0043] (3-3-2. Original creation metadata)

[0044] (3-3-3. Material Generation Process and Material Metadata)

[0045] (3-3-4. AI Creation Process and AI Creation Metadata)

[0046] [Process Example 1: Some elements changed]

[0047] [Process Example 1': Application of Style]

[0048] [Process Example 2: Generation of New Feature Information]

[0049] [Process Example 3: Style Extraction]

[0050] [Specific examples of AI-generated metadata]

[0051] (Transfer of CC license and license conditions)

[0052] (3-3-5. Supplementary description of metadata)

[0053] (1) Adding metadata to existing creative works

[0054] (2) Metadata Management

[0055] (3) Ensuring metadata authenticity

[0056] (4) Creator information and rights holder information

[0057] (5) Others

[0058] 3-4. Operation process

[0059] 3-5. Beneficial effects

[0060] 3-6. Other creative works

[0061] (3-6-1. Novel)

[0062] (3-6-2. Movies, videos or games)

[0063] (3-6-3. Characters (2D / 3D))

[0064] 4. Second embodiment: Feedback process

[0065] 4-1. Background

[0066] 4-2. Functional Configuration

[0067] 4-3. Operation process

[0068] 4-4. Beneficial Effects

[0069] 5. Third Example: Marketing Analysis

[0070] 5-1. Background

[0071] 5-2. Functional Configuration

[0072] 5-3. Operation process

[0073] 5-4. Beneficial Effects

[0074] 6. Summary

[0075] <<1. Overview of Information Processing System According to One Embodiment of the Present Disclosure>>

[0076] Figure 1 FIG is a diagram illustrating an overview of an information processing system according to an embodiment of the present disclosure. Figure 1 As shown, the information processing system according to the present embodiment includes an information processing terminal 20 operated by each user, and a music providing server 10 communicatively connected to the information processing terminal 20 via a network 3. Each information processing terminal 20 transmits and receives data to and from the music providing server 10. Each user is allowed to use various functions provided by the music providing server 10 through the information processing terminal 20.

[0077] According to one embodiment of the present disclosure, an AI music is presented as an example of an AI creation work. An AI music is a music piece generated using AI (artificial intelligence). The "AI creation work" in this specification refers to content automatically created by AI (without human assistance) and content created by humans using AI as a tool (by so-called AI creators). In addition, the logic included in the "AI" according to this embodiment is not particularly limited. For example, machine learning is adopted. In addition, the algorithms included in machine learning are not particularly limited. For example, linear regression, logistic regression, decision trees, neural networks, deep neural networks (so-called deep learning), etc. can be adopted.

[0078] In addition, although the description of this embodiment presents an "AI composition" as an example of an "AI composition," the "AI composition" of the present disclosure is not limited to "AI compositions" but can be applied to various AI-generated content (e.g., novels, music, videos, games, and 2D / 3D characters). The following describes details of AI compositions other than AI compositions.

[0079] The information processing terminal 20 can be implemented in the form of a smartphone, a tablet terminal, a cellular phone terminal, a personal computer, a wearable device, etc. In addition, the information processing terminal 20 includes a control unit (which can be implemented in the form of an electronic circuit such as a CPU (Central Processing Unit) and a microprocessor), a display unit, an operation input unit (for example, a keyboard, a mouse, buttons, switches, a touch panel, a touch panel display, gesture input, and audio input), an audio output unit, and the like.

[0080] The music providing server 10 provides an AI composition function. For example, AI composition is achieved by using material data generated by breaking down an original composition into constituent elements.

[0081] In the case where the material data obtained by decomposing the original creative work into its constituent elements is used for the AI ​​creation herein, in the related art, it is difficult to determine the relationship between the original creative work and the AI ​​creative work created therefrom.

[0082] Therefore, according to this embodiment, by associating an AI-created work with information that allows reference to the original creative work as metadata, generation information associated with the generation of the corresponding AI creation, and the like, it is possible to determine the relationship between the AI-created work and the original creative work of the material data used to create the AI-created work. In addition, in this specification, metadata added to an AI-created work will be referred to as "AI-created metadata," metadata added to the material data used for the AI-created work will be referred to as "material metadata," and metadata added to the original creative work used to generate the AI-created work or material data will be referred to as "original creation metadata." Furthermore, the general term for these types of data will also be referred to simply as "metadata."

[0083] Furthermore, the information processing terminal 20 is able to perform a feedback process for the creator based on the AI ​​creation metadata added to the AI ​​creation work in this manner, or perform a marketing process based on the AI ​​creation metadata.

[0084] The user is allowed to use the functions provided by the music providing server 10 to generate creative works using AI. In addition, for example, when material data generated from a creative work created by the user and provided (registered) to the music providing server 10 is used for an AI creative work, the user is allowed to receive distribution of property benefits from the music providing server 10. In addition, the user is allowed to enjoy the marketing results based on the AI ​​creative metadata analysis by the music providing server 10 according to the usage status of the AI ​​creative work.

[0085] The details of each function of the above-mentioned music providing server 10 will be specifically described in each of the following embodiments.

[0086] Although Figure 1 In the configuration of the example depicted in , the corresponding functions provided by the music providing server 10 as described above are provided by a single server device, but it is not required to provide these functions of the present disclosure in this manner. The various functions provided by the music providing server 10 described above can be provided by a predetermined platform. In this specification, for example, a "platform" can be a music distribution service system that collects music and performs user matching, etc. to provide music for users, a server device that drives an algorithm for implementing a service system and accumulates data, a server device group, a service providing entity, or an entire service ecosystem including users. For example, a specific system configuration of the platform may include multiple servers, or at least some of the processes may be performed by software operating in the information processing terminal 20.

[0087] <<2. Configuration Example of Music Providing Server 10>>

[0088] Figure 2 1 is a block diagram illustrating an example of the configuration of the music providing server 10 according to the present embodiment. Figure 2 As shown, the music providing server 10 according to the present embodiment includes a communication unit 120 , a control unit 100 , and a storage unit 140 .

[0089] The control unit 100 functions as an arithmetic processor and a controller, and controls the overall operation within the music providing server 10 according to various programs. For example, the control unit 100 is implemented in the form of an electronic circuit such as a CPU (Central Processing Unit) and a microprocessor. In addition, the control unit 100 may include a ROM (Read Only Memory) for storing programs to be used, calculation parameters, etc., and a RAM (Random Access Memory) for temporarily storing parameters that change as appropriate.

[0090] In addition, the control unit 100 can generate AI-generated works, generate material data for AI-generated works, add various metadata (AI-generated metadata and material metadata) to the AI-generated works and material data, provide feedback to the creator based on the AI-generated metadata, or perform marketing processes based on the AI-generated metadata. The specific functional configuration of the music providing server 10 will be described in detail in each of the following embodiments.

[0091] The communication unit 120 has a function for communicably connecting the music providing server 10 and other devices (external devices). For example, the communication unit 120 is implemented in the form of a wired / wireless LAN (Local Area Network), Wi-Fi (registered trademark), Bluetooth (registered trademark), a mobile communication network (LTE (Long Term Evolution), 3G (Third Generation Mobile Communication System)), etc., and, for example, transmits and receives data to and from the information processing terminal 20 or other servers.

[0092] The storage unit 140 is composed of a storage medium such as a semiconductor memory and a hard disk, and stores programs and data used for the processing performed by the music providing server 10, as well as content data. For example, the data stored in the storage unit 140 may include AI creative works (e.g., AI music), original creative works (e.g., music), material data (e.g., constituent elements of music), and corresponding types of metadata. Note that some or all of the programs and data described in this specification may be obtained from an external data source (e.g., a data server, a network storage device, an external memory, etc.) rather than being stored in the storage unit 140.

[0093] Subsequently, respective functions provided by the music providing server 10 according to the present embodiment will be described in detail with reference to the drawings in the first embodiment to the third embodiment.

[0094] <<3. First embodiment: Addition of metadata>>

[0095] <3-1. Background>

[0096] In recent years, in AI creation, a large number of creative works, broken down into their constituent elements, have been used as data constituting the origins of AI creations. Therefore, there is a need to distribute asset returns based on the contribution of original creative works to AI-created works, as well as to visualize these contributions. However, it is difficult to identify the original creative work based on the generated AI-created work, or to determine the relationship between the AI-created work and the original creative work (for example, how and where the original creative work is used).

[0097] Therefore, the information processing system of the first embodiment is characterized by adding, as metadata, information indicating a link to the original creative work used or the used material data, rights-related information, information associated with the generation, and the like when generating material data for AI creation from an original creative work or when generating an AI creative work. The metadata added in this manner allows the original creative work converted into material to be later identified based on the AI ​​creative work. The utilization of this added metadata will be described in detail in the second and third embodiments.

[0098] <3-2. Functional Configuration>

[0099] Figure 3 is depicted by Figure 2 1 is a block diagram showing an example of a configuration of the logical functions of the first embodiment implemented by the communication unit 120 and the storage unit 140 of the music providing server 10. Figure 3 As shown, the music providing server 10 - 1 according to the first embodiment includes a metadata adding unit 101 , a material generating unit 102 , an AI creative work generating unit 103 , a use determining unit 104 , a musical composition DB 141 , and a material DB 142 .

[0100] For example, the music providing server 10 - 1 may operate as a music providing platform and provide an AI creation tool for users (AI creators, etc.).

[0101] (1) Music DB 141

[0102] The music data stored in the music DB 141 include music data composed by the creator U1 and uploaded via the network 3a, music data distributed and uploaded by a third party, or music data generated by the AI ​​composition creation unit 103 (referred to as AI music).

[0103] In this system, it is assumed that the creator U1 is a trustworthy rights holder, and in the case where the music data is created by the creator U1 himself and uploaded to the music providing server 10-1, the music data is an appropriate creative work (not a suspected infringing product).

[0104] When the distributed creative work is registered by a third party (i.e., stored in the music DB 141), the music providing server 10-1 can determine whether to allow the creative work to be registered in the music DB 141, or whether to allow the creative work to be used within the platform (i.e., this system), for example, after determining whether the creative work is an appropriate creative work and is not a suspected infringing product.

[0105] (2)Material DB 142

[0106] The material DB 142 stores material data (eg, data obtained by breaking down a piece of music into its constituent elements) that can be used to generate AI-generated works. The material data stored in the material DB 142 may be provided by the creator or a third party, or may be generated by the material generation unit 102 .

[0107] When the distributed material data is registered by a third party, the music providing server 10-1 can determine whether to allow the material data to be registered in the material DB 142, or whether to allow the creative work to be used within the platform (i.e., this system), in a manner similar to the above-mentioned manner, for example, after determining whether the creative work is an appropriate creative work and is not a suspected infringing product.

[0108] (3) Material generation unit 102

[0109] The material generation unit 102 generates material data by breaking down the music (composed works) accumulated in the music DB 141 into their constituent elements. The generated material data is accumulated in the material DB 142 and used when the AI ​​composer generation unit 103 generates an AI music (AI composer). The details of the material data generation process (i.e., the material generation process) will be described below. In this specification, the composer that constitutes the source of the material data used to generate the AI ​​composer in this way is also referred to as the "original composer."

[0110] (4) Metadata adding unit 101

[0111] The metadata adding unit 101 adds metadata to generated material data or AI-generated works, including information that allows identification of the original creative work or material data (material information), rights-related information, and information related to generation (generation information). This generation information includes usage patterns of the original creative work or material, generation methods such as rules and algorithms used for AI creation, and the like. The details of the metadata adding process will be described below.

[0112] (5) AI Creative Work Generation Unit 103

[0113] The AI ​​creative work generation unit 103 uses the material data to generate an AI creative work created by AI. The AI ​​creative work generation unit 103 can act as a tool (so-called AI creation tool) used by people (AI creators U3, etc.) to generate AI creative works, or it can generate AI creative works by itself. The algorithm used in the AI ​​creative work generation process is not particularly limited. Various types of algorithms can be applied to the AI ​​creative work generation unit 103. A specific AI creation processing example will be described below.

[0114] Note that the AI ​​creative work generation unit 103 can generate AI creative works using not only the material data generated by breaking down a creative work into its constituent elements, but also the creative work itself. Furthermore, the AI ​​creative work generation unit 103 can use AI to generate material data that can be used to generate other AI creative works. Material data generated by AI is an example of an AI creative work and will be referred to as "AI material data" throughout this specification.

[0115] In addition, the AI ​​creative work generating unit 103 prohibits the use of the original creative work or material data determined to be unusable based on the use determination result obtained by the use determination unit 104.

[0116] (6) Use determination unit 104

[0117] The use determination unit 104 determines whether the original creative work or material data can be used for AI creation based on the metadata added to the original creative work or material data. For example, if the original creative work or material data is suspected of being an infringing product with metadata added, has an unknown copyright status, or is not permitted for use in AI creation (secondary use in a broad sense), the use determination unit 104 determines that the original creative work or material data cannot be used for AI creation.

[0118] In addition, in the case where a usage permission condition (an example of "rights permission information") is set as metadata, the usage determination unit 104 determines whether the original creative work or the material data can be used for AI creation based on the usage pattern of the original creative work or the material data for AI creation. For example, the usage permission condition can be set in advance by the rights-related persons (for example, the author and the copyright holder). For example, the usage permission condition can be a CC license (Creative Commons License) defined by Creative Commons. In the case where the usage pattern of the original creative work or the material data for AI creation meets the usage permission condition, the usage determination unit 104 determines that the use is permitted.

[0119] By using the determination unit 104 to determine whether the original creative work or material data can be used for AI creation, it is possible to avoid using original creative works or material data that may cause problems when used for AI creation, such as suspected infringing products.

[0120] The functional configuration of the music providing server 10-1 according to the present embodiment has been described above. Note that the functional configuration described above is not required to be implemented by a single device (music providing server 10-1), but may be implemented by a plurality of devices. In other words, Figure 3 The functional configuration shown in can be considered as a system configuration composed of multiple devices. For example, all the individual processes performed by the metadata adding unit 101, the material generating unit 102, the AI ​​creative work generating unit 103, and the use determining unit 104 do not need to be implemented by the music providing server 10-1, but can be implemented separately by other devices (for example, a server or the information processing terminal 20 used by the user).

[0121] <3-3. Specific examples of generation process and metadata addition>

[0122] Subsequently, specific examples of the respective generation processes and metadata addition performed in the present embodiment will be described in detail with reference to the drawings.

[0123] (3-3-1. AI creation process)

[0124] Figure 4 1 is a diagram illustrating the various processes performed in the present embodiment during the AI ​​creation process. Figure 4 As shown, the information processing system of this embodiment implements "AI creation", which executes the AI ​​creation process S3 for generating AI creation works using material data by the AI ​​creation work generation unit 103, and the AI ​​creation metadata adding process S4 executed by the metadata adding unit 101.

[0125] The logic used for the AI ​​creation process is not particularly limited. For example, the AI ​​creation process can be performed using machine learning as described above (specifically, the selection and application of the learning model, etc.).

[0126] The metadata adding unit 101 adds "information that allows identification of original material data (e.g., reference ID)", "learning process (generation information associated with generation details of AI creation works, such as usage patterns of corresponding material data for AI creation)" and the like as AI creation metadata based on the material metadata added to the material data for AI creation.

[0127] In this embodiment, by performing the AI-created metadata addition process for "AI creation" in this manner, the contribution of the original creative work to the AI-created work is visualized. This allows for feedback to be provided to those with rights to the original creative work based on the contribution of the original creative work to the AI-created work, when distributing the financial benefits of the AI-created work. Feedback based on AI-created metadata will be described in detail in the second embodiment.

[0128] In addition, the process for generating material data from the original creative work (material generation process S1) performed by the material generation unit 102, and the original creative metadata adding process S2 performed by the metadata adding unit 101, can be performed as "preprocessing" of "AI creation". According to the present embodiment, assuming that metadata indicating rights-related information associated with the original creative work, etc. (original creative metadata) has been added to the original creative work in advance, the metadata adding unit 101 adds "information that allows identification of the original creative work (for example, a reference ID)", "information indicating the type of elements constituting the material in the original creative work (that is, details of the material generation process)", etc. as material metadata based on the original creative metadata added to the original creative work.

[0129] Furthermore, "post-processing" of "AI creation" can be performed. "Post-processing" is not necessarily a process. For example, a recursive process can be performed as post-processing, such as adjustments made by a human to the AI ​​creation work generated by the AI ​​creation process S3, and the AI ​​creation process can be executed again based on the generated AI creation work.

[0130] (3-3-2. Original creation metadata)

[0131] First, a specific example of original creative metadata pre-added to an original creative work will be described. Note that in this embodiment, the following description will be given under the assumption that original creative metadata has been pre-added to the original creative work. However, this configuration is not necessarily required. The metadata adding unit 101 can add (additionally provide) original creative metadata to the original creative work.

[0132] In the case where the original creative work is a "music piece", for example, it is considered to add music bibliographic information, rights holder information, rights permission information, etc. as original creative metadata.

[0133] The following is a specific example of "music bibliographic information," "rights holder information," and "rights licensing information" added as original creation metadata. The data presented below is provided as an example only, and each information does not necessarily include all the data in the example.

[0134] First, an example of music bibliographic information will be presented in Table 1 below.

[0135] [Table 1]

[0136]

[0137] In the case of including a plurality of artist names or the like, a plurality of data may be added.

[0138] Multiple categories can be tagged as music categories.

[0139] Furthermore, if information such as music categories can be obtained by referring to an existing database (e.g., a music store provided by a business), the metadata adding unit 101 can add (additionally provide) this information. Alternatively, the metadata adding unit 101 can determine and add the music categories through machine learning. Note that the metadata adding unit 101 can treat unknown data as blank data when adding metadata.

[0140] (Rights Holder Information)

[0141] An example of rights holder information is given in Table 2 below. In the description here, terms such as "author" and "copyright holder" are used as an example of "right holder", and terms such as "copyright" and "divisible rights (e.g., reproduction rights, publishing rights, adaptation rights, and rights associated with the use of derivative copyrighted works)" are used as an example of "rights". However, these terms are not limited to terms that each represent a state in which legal rights are generated in a strict sense. For example, "copyright" can be generated based on the state considered by the current platform or service provider, a uniquely defined type, a rights protection state, a licensing state, etc.

[0142] [Table 2]

[0143] Rights holder information data -Author: Composer xxxx -Author: Lyrics xxxx -Author: Arranger xxxx ··· ··· -Rights holder: Publisher xxxx,xxxx -Rights holder: Adaptation rights xxxx, -Rights Holder: Other Rights ··· ···

[0144] Author information can be retained while being classified for each contribution mode (e.g., composition, lyrics, and arrangement). By retaining the music classified for each mode, when the corresponding music is used in the form of being decomposed into constituent elements (specifically, used after being generated as material data), information indicating the associated rights holder can be extracted as AI creation metadata. For example, in the case where only the musical elements of the corresponding music are used for AI creation, "composition" and "arrangement" can be determined as associated rights holders and extracted by the metadata adding unit 101 as AI creation metadata.

[0145] Copyright holder information can be set for each divisible right (for example, reproduction right, publishing right, adaptation right, and rights associated with the use of derivative copyrighted works). In addition, copyright holder information can be set in conjunction with a timestamp indicating the time when the copyright holder information was obtained. Whenever the attributes of the rights change, the information associated with the rights holder information and the timestamp is updated. For example, the rights holder information can be managed in the DB of a management company that manages music, etc., and can be associated as reference information. In the case where the rights holder information is managed by a person, the DB of the information management can be associated as reference information. The accuracy of copyright types is different for each country. Therefore, the rights information can be set as the corresponding divisible information block. In addition, in the absence of a corresponding divisible right, a data area indicating "other" can be provided to set the rights information in this data area.

[0146] In addition, in the case where reference to a DB of a predetermined copyright management organization (for example, included in Figure 3 In the case of a database in the rights management organization server 30 shown in FIG. 1 ), for example, the metadata adding unit 101 can obtain rights holder information from the copyright management organization's DB based on music descriptions such as music titles, and add (additionally provide) the rights holder information to the music as original creation metadata. In addition, the information obtained from the copyright management organization's DB can be treated as an estimated value (because the information registered in the copyright management organization's DB is not necessarily true).

[0147] Furthermore, in the case where the original creative work is a derivative creative work or a derivative copyrighted work, it is assumed that the information presented in Table 3 below is added as the rights holder information (referred to as a derivative creator or derivative author, respectively) associated with the derivative creative work or the derivative copyrighted work. The "derivative copyrighted work" here is a new copyrighted work created in this specification through adaptations such as translation, arrangement, deformation, and dramatization of the original copyrighted work (created in dependence on the original copyrighted work). Furthermore, it is assumed in this specification that "derivative creative works" include various new creative works that are created with a low level of dependence compared to "derivative copyrighted works" but are created using any ideas obtained from the original copyrighted work (original creative work) (influenced by the original copyrighted work to a certain extent). The fact that the original creative work is a derivative creative work or a derivative copyrighted work can be included in the original creative metadata in advance.

[0148] [Table 3]

[0149]

[0150]

[0151] In the case where the corresponding original creative work is a derivative creative work or a derivative copyrighted work, information associated with the original copyrighted work (author information and copyright holder information indicated in Table 2 presented above) may be added, or it is assumed that only information allowing identification of the original copyrighted work (e.g., a reference ID) is added.

[0152] Although various types of information associated with authors and copyright holders are listed above as "copyright holder information," this information is not limited to information associated with "copyright holders" or "authors" in the strict legal sense as described above, but may be information associated with associated persons or individuals registered under the rules set by platform personnel (providers, managers, operators, etc. of the platform) or associated persons deemed appropriate by the creator or platform. In addition, for example, account information associated with the content registrant may be added as rights holder information.

[0153] An example of rights permission information is subsequently presented in Table 4 below.

[0154] [Table 4]

[0155] Rights and Licensing Information data - Type of creative work xxxx - Rights protection status xxxx -Use license information xxxx - Infringement Signs xx ···

[0156] For example, the following types are assumed as creative work types. Note that each of the following types includes "AI creation" considering the case where the original creative work is an AI creation work.

[0157] (a) Human creation: a type of creative work that is newly created by humans

[0158] (b) Human-derived works: Works newly created by humans based on ideas derived from the original copyrighted work (corresponding to the above-mentioned “derivative works” in this specification)

[0159] (c) Human-derived creations: Works created by humans that are based on the original copyrighted work (corresponding to the “derivative copyrighted works” mentioned above in this specification)

[0160] (d) AI creation type 1: a type of creative work newly created by humans using AI as a tool (including humans as authors or copyright holders).

[0161] (e) AI Creation Type 2: This type of work is created solely by AI, with no human contribution to the creation. For example, consider a case where a human prepares the output of random frequency components or data constituting the source of learning, and AI alone performs the creation based on this preparation. In this case, a human author is not considered to exist, but a human copyright holder can be assumed to exist, as whether copyright is created may vary from country to country or from era to era (for example, the provider of the AI ​​creation tool is considered the copyright holder).

[0162] (f) AI-derived works: works newly created by humans using AI as a tool or solely by AI based on ideas derived from the original copyrighted work (corresponding to the above-mentioned “derivative creative works” in this specification)

[0163] (g) AI-derived works: works created by humans using AI as a tool or solely by AI that rely on the original copyrighted work (corresponding to the above-mentioned “derivative copyrighted works” in this specification)

[0164] (h) Unknown: The type of the creative work is unknown

[0165] For example, the type of the creative work described above can be used for copyright processing performed later. In addition, the creative work type can be added in advance as original creative metadata, or can be added by the metadata adding unit 101 after being acquired from a predetermined DB that accumulates information associated with the creative work type.

[0166] Furthermore, for example, the following status is assumed as the rights protection status.

[0167] (a) Public domain

[0168] (b) CC License (BY / SA / NC / ND): Creative Commons licenses. These types are described based on the rights holder's statement. Note that Creative Commons license types include "BY," "SA," "NC," and "ND," as well as types defined in other ways.

[0169] (c) Conditional permission: A record indicating the details of the condition can be added separately.

[0170] (d)Unknown

[0171] The rights protection status can be set for each so-called divisible right under copyright law or for each similar right. In this case, reference information for divisible rights information is added.

[0172] Furthermore, the availability of derivative works or derivative copyrighted works is specifically indicated as a usage permission status. Information indicating the usage permission status may be stated by the author, who has the right to maintain the integrity, or the copyright holder, who has the right to use the derivative copyrighted work. Alternatively, if the rights protection status is a CC license, and the conditional license status is used, information indicating the usage permission status may be referenced.

[0173] In addition, infringement flags are issued when a creative work is suspected of infringement. For example, infringement flags are issued based on notifications from users, infringement exposure by AI (for example, determining whether infringement exists based on the similarity or dissimilarity between the features of the creative work and pre-registered creative works), and judgments by platform personnel (for example, system administrators) who distribute the creative work.

[0174] The rights status of the above-mentioned "rights protection status", "usage permission information" and "infringement mark" do not need to be a legal status in the strict sense, but can be a status that the platform (e.g., service provider) deems appropriate, or a uniquely defined status.

[0175] (3-3-3. Material Generation Process and Material Metadata)

[0176] Next, a material generation process performed by the material generation unit 102 and addition of material metadata by the metadata addition unit 101 will be described.

[0177] (1) Material generation process

[0178] The material generating unit 102 generates material data by decomposing the constituent elements of the original creative work and accumulates the generated material metadata in the material DB 142 .

[0179] Will refer to Figure 5 The material generation process performed in the case where the original creative work is a "musical composition" is described by way of example. Figure 5 It is a diagram explaining the material generation process performed when the original creative work is a "music composition".

[0180] like Figure 5 As shown, for example, the material generation process for a piece of music is achieved by decomposing the music 200 into individual musical elements 210 (measures 210a (range information), individual instrument parts 210b (sound quality information), individual interval parts 210c (constituent element information), structure 210d (constituent element information), code 210e (abstract element information), and style 210f (abstract element information), etc.

[0181] A "bar" is an example of music broken down into a range in the time direction, and this range can be indicated using, for example, a timestamp. A "structure" is temporal configuration information, such as "first verse, second verse, chorus, and first verse." Furthermore, interval components constitute spatial configuration information for the music. Style extraction can be represented by a specific set of feature values ​​based on AI learning.

[0182] The generated material data can be Figure 5The minimum unit depicted, multiple combinations of minimum units, or abstract predetermined unit information.

[0183] Note, reference Figure 5 The described decomposition of musical composition elements is given only as an example, and the present embodiment is not limited to this decomposition.

[0184] (2) Material metadata

[0185] For example, the metadata adding unit 101 adds the following information as material metadata to the generated material data: The metadata adding unit 101 can add material metadata to each piece of material data generated from the original creative work by using original creative metadata previously added to the original creative work.

[0186] (a) Information that allows identification of the original creative work (information that uniquely identifies the original creative work by using a reference ID or a combination of multiple pieces of information)

[0187] (b) Information indicating which element type of material included in the original creative work is used, etc. (information associated with generation details) (i.e., information indicating how the material was generated, or information indicating what material was used as the corresponding material)

[0188] (c) Rights-related information (in the case of transmitting the rights holder information or license information associated with the original creative work without change, and in the case of transmitting only the corresponding part, information related to the creator and rights holder, or rights license)

[0189] An example of material metadata according to this embodiment is presented in Table 5 below.

[0190] [Table 5]

[0191]

[0192]

[0193] like Figure 5 As shown, the material metadata can be added to each minimum unit. However, in the case where the material data is composed of a combination of multiple units, the material metadata can be added to the combined unit.

[0194] (3-3-4. AI Creation Process and AI Creation Metadata)

[0195] Next, the AI ​​creative process performed by the AI ​​creative work generating unit 103 and the addition of AI creative metadata by the metadata adding unit 101 will be described.

[0196] First, several processing examples of AI creation and AI creation metadata addition will be covered.

[0197] [Process Example 1: Some Elements Changed]

[0198] (1) AI creation

[0199] Figure 6 : is a diagram for explaining an example of AI creation processing according to this embodiment. Figure 6 As shown, for example, the AI ​​creative work generation unit 103 can use AI (e.g., machine learning) to generate a new music (AI music 220) based on the corresponding material data (bar 210a, instrument part 210b, interval part 210c and code 210d) generated from a specific music.

[0200] At this time, in one example, the AI ​​composition generating unit 103 may generate an AI music by changing a part of the element information constituting the music. Figure 6 In the example depicted in , a new AI music is generated by changing the "code" of the element information that constitutes the music.

[0201] Which element information is changed in what manner can be specified by a person (e.g., the AI ​​creator U3), or can be automatically determined by the AI ​​creative work generation unit 103. For example, the AI ​​creative work generation unit 103 can change the code to a code uniquely generated by machine learning, etc., or to a code generated from another piece of music by executing a material generation process. In addition, the AI ​​creative work generation unit 103 can modify the original constituent elements of the change target through machine learning, etc.

[0202] The process for decomposing a musical composition into element information to generate material data, and the process for generating an AI musical composition based on the generated material data can be performed in a series of processes. Specifically, when generating an AI musical composition based on a musical composition selected by the AI ​​composer U3 or selected solely by the AI, for example, by initially performing a material generation process using the material generation unit 102 to decompose the corresponding musical composition, the various musical elements can be extracted (i.e., material data can be generated), and then the AI ​​composition generation unit 103 can be used to generate the AI ​​musical composition.

[0203] (2) Adding metadata to AI creation

[0204] The metadata adding unit 101 adds information such as "what combination of material data has been used (information that allows identification of the used material data (e.g., reference ID))" and "what element information has been changed with respect to the original music (e.g., usage pattern of the material data)" to the generated AI creation work (AI music) as AI creation metadata (AI music metadata).

[0205] In the second embodiment described below, information added as AI-created metadata to the generated AI-created work to identify the material data used in this manner is useful for calculating the contribution of the original creative work to the AI-created work when allocating financial benefits of the AI-created work. Specifically, the original creative work of the material data used and the usage pattern of the material data are identifiable from the AI-created metadata. Therefore, the financial benefits of the corresponding AI-created work can be appropriately fed back to the rights holders of the original creative work.

[0206] [Process Example 1': Application of Style]

[0207] (1) AI creation

[0208] Furthermore, a method of assigning different styles to a certain music piece may be adopted as another method of generating an AI music piece by the AI ​​composition generating unit 103 .

[0209] Figure 7 : is a diagram for explaining another example of AI creation processing according to this embodiment. Figure 7 As shown, for example, the AI ​​composition generation unit 103 generates a new AI music 222 having a style 214e different from the style of the music 200 based on the music 200 and the style 214e. In this way, for example, by changing a music by a certain artist to the style of a different artist, a music stylized according to a different artist can be generated.

[0210] (2) Adding metadata to AI creation

[0211] The metadata adding unit 101 adds information allowing identification of the used music (e.g., reference ID), information indicating the employed style (i.e., information allowing identification of the used material data), etc., to the generated AI music 222 as AI creation metadata.

[0212] In this way, for example, in the second embodiment described below, appropriate calculations can be achieved, such as subtracting the style from the original music and adding the contribution of the person related to the rights of the adopted style when calculating the contribution of the original creative work to the AI ​​creative work in order to distribute the property benefits of the AI ​​creative work.

[0213] [Process Example 2: Generation of New Feature Information]

[0214] (1) AI creation

[0215] In addition, the AI ​​creative work generation unit 103 is capable of newly generating new element information (i.e., material data) for AI creation, etc. as an AI creative work by combining multiple element information or using machine learning, etc. In this specification, the material data generated by the AI ​​creative work generation unit 103 will be referred to as "AI material data."

[0216] Figure 8 : is a diagram illustrating another example of AI creation processing according to this embodiment. Figure 8 As shown, for example, the AI ​​creative work generation unit 103 is capable of generating a new AI measure 224 (AI material data) by using a combination of individual element data obtained by extracting measure portions each having a certain length from a plurality of pieces of music (for example, measure 210a, measure 211a, measure 212a, and measure 213a, each generated by extracting a measure portion each having a certain length from each of the plurality of pieces of music through a material generation process).

[0217] The selection or combination of material data may be specified by a person, or may be automatically determined by the AI ​​creative work generation unit 103 .

[0218] (2) Adding metadata to AI creation

[0219] For example, the metadata adding unit 101 adds information such as "information allowing identification of the material data used (e.g., reference ID)" and "generation method (e.g., combination method and learning method)" to the generated new AI material data as AI material metadata.

[0220] In this way, for example, in the second embodiment described below, when calculating the contribution of an original creative work to an AI-created work in order to distribute the financial benefits of the AI-created work, it is possible to identify multiple pieces of material data corresponding to the generation sources of the AI ​​material data used in the AI-created work, and further identify the original creative works of each of the multiple pieces of material data. Therefore, it is possible to appropriately identify the material data of the original creative work and the rights holders.

[0221] [Process Example 3: Style Extraction]

[0222] (1) AI creation

[0223] In addition, the AI ​​creative work generation unit 103 is capable of extracting feature value information (or element information associated with these) included in multiple original creative works as common items, and generating new element information (AI material data) based on multiple original creative works (or element information associated with these).

[0224] Figure 9 : is a diagram for explaining another example of AI creation processing according to this embodiment. Figure 9 As shown, the AI ​​creative work generation unit 103 can extract feature value information (e.g., pitch, scale, and rhythm pattern) included in the plurality of musical pieces 200A to 200D as common items, and generate a style 226 based on the musical pieces 200A to 200D. In this way, for example, a creative style that allows for being called "Artist B style" can be generated as AI material data based on a plurality of musical pieces by Artist B.

[0225] Style extraction does not need to be performed from the perspective of the artist, but can be achieved from various perspectives, such as extraction from multiple perspectives of a specific category or age of a specific artist, style extraction of a specific age, and style extraction of female artists of a specific age.

[0226] (2) Adding metadata to AI creation

[0227] For example, the metadata adding unit 101 adds "information allowing identification of multiple used creative works (e.g., reference ID)" and "information associated with the extracted perspective of feature values" to the generated AI material data as AI material metadata.

[0228] In this way, for example, in the second embodiment described below, when calculating the contribution of original creative works to AI-created works in order to distribute the property benefits of AI-created works, it is possible to identify multiple original creative works corresponding to the generation sources of AI material data (e.g., "style") used for AI-created works. Therefore, it is possible to appropriately identify the persons related to the rights of the original creative works.

[0229] The above describes an example of processing of AI creation and AI creation metadata addition. Next, another specific example of AI creation metadata added to an AI creation work will be described.

[0230] [Specific examples of AI-generated metadata]

[0231] Table 6 below presents specific examples of AI-created metadata added to AI-created works.

[0232] [Table 6]

[0233]

[0234]

[0235] In Table 6 above, details equivalent to the music bibliographic data described above with reference to Table 1 (e.g., title, artist name, and music category) are assumed in "Bibliographic Information." In the case of an AI-created work created solely by AI, the name of the AI ​​tool or the name of the tool manager may be added, or a predetermined artist name (e.g., a fictitious artist name) defined by a person using the AI ​​tool may be added to "Artist Name."

[0236] In addition, details equivalent to the rights holder information described with reference to Table 2 (e.g., author and copyright holder) are assumed in the "Creator or Rights Holder Information." Contribution rate information corresponding to the usage type of the original creative work or the original creative material data may be further added in association with each creator or rights holder.

[0237] In addition, "rights licensing information" refers to details equivalent to the rights licensing information associated with the original creative work described in Reference Table 4 (for example, the creative work type, rights protection status, and usage permission information). Rights licensing information can be determined based on the licensing information associated with the original creative work or material data. For example, the metadata adding unit 101 can transfer the CC license or licensing conditions of the original creative work or material data when adding AI creative metadata to the generated AI creative work. The specific transfer of CC licenses and licensing conditions will be described below by way of example.

[0238] (Transfer of CC license and license conditions)

[0239] The metadata adding unit 101 needs to transfer the CC license or license conditions added to the original creative work or material data to the AI ​​creative work, depending on the type of CC license or license conditions. In this way, for example, the metadata adding unit 101 implements a process for prohibiting the use of AI creations as materials, or, in the case where the original creative work or material data corresponds to a derivative creative work of another creative work, implements a process for using only the usable portion of the original creative work or material data.

[0240] In addition, the metadata adding unit 101 can determine the transfer of CC licenses, licensing conditions, etc. of original creative works or material data based on the level of contribution of the original creative works or material data to the AI ​​creative works. For example, the metadata adding unit 101 can transfer the conditions of the original creative works or material data only when the AI ​​creative work depends on the original creative work to such an extent that the AI ​​creative work is determined to be identifiable as a derivative copyright work. There is no particular limitation on the algorithm used for determining derivative copyright works. A work can be determined to be a "derivative copyright work" not only in the case of a legal derivative copyright work in the strict sense, but also in the case of a state that the platform deems applicable or meets the conditions of a unique definition.

[0241] In addition, the metadata adding unit 101 can transfer conditions limited to the portion corresponding to the greatest contribution to the AI ​​creative work. For example, the CC license of the original creative work or material data can be transferred only to the measure portion of the AI ​​music.

[0242] Furthermore, if the AI-generated work is not a derivative copyrighted work but is determined to be influenced to a certain extent by the original creative work or source data, metadata adding unit 101 may transfer the rights and licensing information associated with the original creative work or source data. The criteria for determining "a certain degree of influence" are not particularly limited. For example, it may be assumed to be lower than the criteria used to determine a derivative copyrighted work.

[0243] (3-3-5. Supplementary description of metadata)

[0244] (1) Adding metadata to existing creative works

[0245] The metadata adding unit 101 can also add metadata to existing creative works. Existing creative works are assumed to be distributed creative works registered by third parties, creative works registered by real rights holders, and the like. As described above, each of these creative works corresponds to an original creative work that was decomposed into its constituent elements through the material generation process and then used for AI creation by the AI ​​creative work generation unit 103.

[0246] Specifically, for example, the metadata adding unit 101 may refer to a publicly available music database or information provided by a legitimate rights holder or copyright management organization to add original creation metadata to a music piece registered by a user in the music DB 141. This addition of original creation metadata can be performed with the permission of the legitimate rights holder, etc. As described above, it is also conceivable to distribute only the original creation metadata added with the permission of the legitimate rights holder, etc. as authentication information. Furthermore, it is also conceivable to provide a service that distributes a database of material data generated using only a material generation process for generating material data from existing creative works, and material metadata added to the material data.

[0247] In addition, when there is no additional metadata in the original creative work or material data used in the AI ​​creative work, as described above, the metadata adding unit 101 can refer to an open database, etc., and add metadata to these original creative works or material data when using the AI ​​creative work within the allowable range.

[0248] The metadata adding process according to this embodiment can be performed by the metadata adding unit 101 (i.e., as one of the AI ​​creation support services operating on the platform), or can be included in the AI ​​creation tool distributed to the user (i.e., an application that operates in the information processing terminal 20 used by the user and has a material generation processing function or an AI creation work generation function).

[0249] (2) Metadata Management

[0250] Each metadata can be presented in the form of a package and added to the content of the original creative work, material data, AI creative work, etc.

[0251] Alternatively, only an ID for identifying corresponding metadata may be added to the content, while the metadata may be managed in a database on the network separately from the content in a form associated with the corresponding ID. Figure 10 This is a diagram illustrating a case where metadata is individually managed using metadata ID links in a database on a network according to the present embodiment.

[0252] like Figure 10 As shown, for example, each metadata is managed by a database on the network (e.g., the metadata management server 40), and only an ID for identifying the corresponding metadata is added to each content (music, material data, and AI music). For example, the metadata adding unit 101a generates AI music metadata for the AI ​​music generated by the AI ​​creative work generating unit 103a based on the ID added to the music (original creative work) or material data used, with reference to each metadata (music metadata (original creative metadata), material metadata) managed by the metadata management server 40, and uploads the generated AI music metadata to the metadata management server 40, and further only adds the ID of the AI ​​music metadata to the AI ​​music.

[0253] In this way, the associated metadata can be managed separately through ID links using a database server or the like without adding the metadata itself to the content.

[0254] This management of metadata can be achieved by a predetermined copyright management organization, an organization providing metadata management services, or a platform person (platformer).

[0255] (3) Ensuring metadata authenticity

[0256] According to this embodiment, for example, metadata authenticity can be guaranteed by managing the contributors of the original metadata or using blockchain (distributed ledger technology). This will be described in detail below.

[0257] - Management of contributors of original creative metadata

[0258] For example, in the case where the author of the original creation metadata is an end user, the authenticity of the metadata can be guaranteed by managing the author, which is achieved by associating account information indicating the author with the original creation metadata, allowing only accounts registered with real names to add original creation metadata, or allowing access to the editing history of the original creation metadata.

[0259] Furthermore, for example, the authenticity of metadata can be guaranteed by providing a mechanism for notifying a service provider or a metadata manager in the system of original authored metadata suspected of not being authentic information, thereby enabling management of the contributor.

[0260] -Using blockchain

[0261] Furthermore, by managing metadata using blockchain (distributed ledger technology), metadata can be protected from alteration. Blockchain, an example of a distributed system, is a technology that, unlike centralized systems, eliminates the need for a server and ensures authenticity through mutual monitoring of data. Specifically, for example, metadata information (ledgers) shared by multiple business users (individual information processing devices) can be used to strictly maintain authenticity.

[0262] At this time, the registration of copyright information, etc. in the blockchain (addition of original creation metadata) can be performed by a qualified management organization. Note that this registration can be performed in a decentralized manner by multiple qualified management organizations (e.g., certified music publishers). In addition, in addition to the above, the end user can add original creation metadata (e.g., copyright information) to the original creation work. In this case, the distinction between a qualified management organization, a person equivalent to the management organization, and the end user can be recorded as the adder of the original creation metadata. Note that in the case where the adder of the original creation metadata is the end user, the original creation metadata can be processed as an estimated value.

[0263] (4) Creator information and rights holder information

[0264] The creator information or rights holder information added as metadata is not limited to information under a strict legal state such as copyright law.

[0265] According to the present disclosure, it is possible to manage authors or copyright holders under copyright law, or to manage information associated with people related to creative works in a broad sense in addition to legal rights such as copyright law. For example, information associated with people related to creative works includes accounts through which creative works are submitted and self-reported creator information, information associated with "creators," "owners," or "rights holders" uniquely defined by the platform, and the like.

[0266] Furthermore, according to the present disclosure, use patterns that do not correspond to "use" or "use for derivative copyright works" under copyright law are also broadly managed targets. For example, simply quoting an original creative work, or quoting in an extreme sense when the copyright protection of the original creative work is lost (for example, when the original creative work is overly subdivided and used in units of individual notes), can be considered "use" of the original creative work.

[0267] (5) Others

[0268] According to this embodiment, the "material data" used by the AI ​​creative work generation unit 103 for the AI ​​creative process includes not only data generated by the "material generation process" of decomposing and extracting the original creative work such as a completed musical piece, but also data generated as material data from the beginning.

[0269] For example, assuming that only the drum part is distributed as a package, or that only a five-bar phrase (or the melody included therein) is composed and distributed, such a sound source generated as material data from the beginning can also be included in the "material data" used when generating an AI song.

[0270] Furthermore, during the creation process of an original work, original creation metadata can be automatically added by a creation application or the like. For example, if multiple people are creating a piece of music through a conversation, metadata about the creator (rights-related person) can be added to each piece of material generated during the composition process. In this way, when the piece is completed, the creator of the material included in the complete piece of music is automatically included in the metadata of the complete piece of music as creator information. This addition of metadata during the composition process can be automatically performed by tracking the music composition tool.

[0271] <3-4. Operation process>

[0272] Then, reference will be made to Figure 11 The metadata adding operation process performed in this embodiment is described. Figure 11 1 is a flowchart showing an example of the flow of a metadata adding operation procedure according to the present embodiment. "Music piece" is used here as an example of a creative work.

[0273] like Figure 11 As shown, the material generating unit 102 first acquires a musical piece corresponding to the original creative work from the musical piece DB 141 (step S103), and performs a material generating process (step S106).

[0274] Subsequently, the metadata adding unit 101 adds information for identifying the original creative work, rights-related information, and the like as material metadata to the generated material data (step S109 ).

[0275] Thereafter, the AI ​​composition creation unit 103 creates a new music piece (AI music piece) using the plurality of material data (step S112 ).

[0276] Then, the metadata adding unit 101 adds information identifying the used material data, rights-related information, and the like as AI musical composition metadata to the newly generated AI musical composition (step S115 ).

[0277] The above has described the flow of the operation process according to the present embodiment. Various metadata can be generated and added at the timing of each process. Although the operation process of generating an AI creative work using multiple material data generated by the material generation process and adding AI creative metadata has been described here by way of example, the present embodiment is not limited to this example. AI creative works can be generated based on material data and original creative works, or can be generated using material data generated as material from the beginning without going through the material generation process. In addition, new AI creative works can be generated by changing part of the constituent element information related to the original creative work.

[0278] <3-5. Beneficial Effects>

[0279] According to the first embodiment, the contribution of an original work to an AI-generated work can be visualized by adding AI-generated metadata to the AI-generated work. This allows accurate identification of individuals who hold rights to the original work and appropriate feedback based on their contributions to the original work when distributing property interests in the AI-generated work, such as in the second embodiment described below.

[0280] Especially in the case of using a large number of original creative works for AI creation, it is also easy to organize rights relations.

[0281] <3-6. Other Creative Works>

[0282] According to the first embodiment described above, "music (music)" is used as an example of AI-generated content. However, this embodiment is not limited to this example and can be applied to other types of content, such as novels, movies, videos, games, and characters (2D, 3D). In any of these cases, the material generation process and AI-generated content generation process described in this embodiment can be performed. Specific examples will be described below.

[0283] (3-6-1. Novel)

[0284] "Novels" composed of text data are considered examples of creative works. For example, the material data generated as the constituent elements of "novels" include "plot," "main characters," "world setting," "items to be included," and "literary style."

[0285] "Plot" is the outline of a scene (e.g., events and developments). For example, a story might flow like this: "The main character helps someone. The main character is invited to a certain place by that person as a token of gratitude and does something. Afterward, the main character returns and transforms into something else."

[0286] For example, "main character" is characteristic information such as the character setting, the character's lines, answering habits, and the like.

[0287] The "literary style" is a so-called "style" that indicates wording, expressions, and the like that are unique to a novelist and gives an impression that the novel was written by the novelist.

[0288] The AI ​​creative work generation unit 103 is capable of generating a new novel (AI creative work) by using the above-mentioned material data or combining the material data. Specifically, for example, the AI ​​creative work generation unit 103 is capable of automatically generating a story that does not collapse or a story that becomes popular in the target of the corresponding work by following the plot of a popular novel or a hot novel. In addition, the AI ​​creative work generation unit 103 is capable of generating a new novel by using information (material data) associated with an eccentric protagonist, a type of character that is likely to become popular among readers, and the like. In addition, the AI ​​creative work generation unit 103 is capable of using the "literary style" of a certain novelist to generate a parody work that gives the impression that the novel is written by the corresponding novelist.

[0289] (3-6-2. Movies, videos or games)

[0290] In addition, "movies, videos, or games" are considered examples of creative works. For example, the material data generated as the constituent elements of these works include "plot," "scene," "character or actor's actions," "camera technique," "world setting," "attributes to be presented," and "direction."

[0291] The AI ​​creative work generation unit 103 can generate a new "movie, video, or game" (AI creative work) by using the above-mentioned material data or combining the material data. Specifically, for example, the AI ​​creative work generation unit 103 can combine characteristic scenes, actions, scene developments, etc. (material data), generate a new "scene" as AI material data through machine learning, etc., and generate a new movie as an AI creative work.

[0292] (3-6-3. Characters (2D / 3D))

[0293] Furthermore, "characters (2D or 3D)" (image data) are considered examples of creative works. For example, the material data generated as these components includes "physical condition or frame information," "clothing and fashion items," "drawing style," and so on. Furthermore, in addition to these, it also includes dynamic information representing the "movements" and "behaviors" unique to each character, as well as internal information such as "emotional models" and "character models."

[0294] The AI ​​creative work generation unit 103 can generate a new "character" by using the aforementioned material data or by combining the material data. Specifically, for example, the AI ​​creative work generation unit 103 can generate a new character by combining various pieces of material data generated from a large number of existing characters. Alternatively, for example, the AI ​​creative work generation unit 103 can create a new character by changing or adding some of the components of a previously generated character.

[0295] Specific examples other than music have been described above. Note that each piece of material data is not limited to data generated from an original creative work, but may be data generated as material data from the beginning (eg, scene setting information, character information, and CG data).

[0296] <<4. Second Embodiment: Feedback Process>>

[0297] The second embodiment of the present disclosure will be described later. According to this embodiment, based on the AI ​​creation metadata added to the AI ​​creation work, more appropriate feedback is achieved to the person related to the rights of the original creation work or material data.

[0298] <4-1. Background>

[0299] As described above, when material data obtained by decomposing an original creative work into its constituent elements is used for AI creation, it is difficult to determine the original creative work and the relationship between the generated AI creative work and the original creative work based on the generated AI creative work.

[0300] Therefore, according to the present embodiment, original creative works used for AI creation are clarified, and by using AI creation metadata added to AI creation works (see the first embodiment), more appropriate feedback to persons related to the rights of the original creative works can be achieved.

[0301] <4-2. Functional Configuration>

[0302] Figure 12 is depicted by Figure 2 1 is a block diagram illustrating an example of a configuration of logical functions according to the second embodiment implemented by the communication unit 120 and the storage unit 140 of the music providing server 10. Figure 12As shown, the material generation unit 102 according to the second embodiment includes an AI creative work generation unit 103, a music supply processing unit 105, a contribution rate determination unit 106, a feedback determination unit 107, a feedback presentation processing unit 108, a music DB 141, and a usage information DB 144. Although "music" is used as an example of a creative work, the present embodiment is not limited to this example and can be applied to other types of creative works (for example, novels, games, videos, and characters).

[0303] (1) Music supply processing unit 105

[0304] The music supply processing unit 105 performs a process for providing music to the viewer and listener U5. The "supply" of music here means providing for viewing and listening. The music stored in the music DB 141 is distributed to the user's information processing terminal 20 via the network 3d by streaming distribution, download distribution, etc., so that, for example, the music can be reproduced on the user's information processing terminal 20. The music DB 141 can also include AI music generated by the AI ​​creative work generation unit 103. In addition, the music supply processing unit 105 accumulates the number of reproductions of each music (including AI music) in the usage information DB 144 as usage information.

[0305] (2) Usage Information DB 144

[0306] The usage information DB 144 accumulates information related to the use of each piece of music, such as the number of times each piece of music has been reproduced. "Use" is not limited to "reproduction" (distribution) but can also include use when generating new AI music or AI materials using the AI ​​composition creation unit 103. When using a piece of music (including an AI piece of music) for AI composition, the AI ​​composition creation unit 103 accumulates the corresponding usage information in the usage information DB 144.

[0307] In this embodiment, the accumulation of usage information for a "music piece" is described as an example of an AI-generated work. However, AI-generated works are not limited to the aforementioned "music pieces" and can also include novels, movies, videos, games, characters, and so on. In these cases, each piece of usage information can be similarly accumulated. For example, suppose the usage information is the number of page views or downloads for a "novel," the number of playbacks for a "movie or video," the number of play sessions and downloads for a "game," and the number of downloads for a "character."

[0308] Furthermore, in the case where money is generated through usage (sales), money information is also accumulated in the usage information DB 144 .

[0309] (3) Contribution rate determination unit 106

[0310] The contribution rate determination unit 106 determines the contribution rate of the original creative work or material data to the AI ​​music based on the AI ​​music metadata added to the AI ​​music. According to this specification, "contribution rate" refers to information (contribution information) indicating the degree of contribution of the original creative work or material data (data generated as material data from the beginning) as the material generation source of the material data used when generating an AI creative work such as an AI music to the AI ​​creative work (the degree to which the AI ​​creative work uses the original creative work or material data).

[0311] It is assumed that as a result of using AI-created works (for example, watching and listening to AI music, and using it as material when generating another AI music), property interests such as currency, electronic currency, points equivalent to currency, valuations, etc. are generated. Therefore, it is desirable to appropriately feed back the property interests, valuations, etc. of AI-created works to the rights-related persons of the original creative works or the material data used as material for AI-created works. According to this embodiment, the usage pattern or rights-related persons of the original creation or the material data used as material are identified based on the AI ​​creation metadata added to the AI-created works, and the contribution rate of the original creation or the material data is determined. Therefore, appropriate feedback to the rights-related persons can be achieved.

[0312] A specific example of contribution ratio determination performed by the contribution ratio determination unit 106 will be described below.

[0313] The case of an AI musical composition generated by "Process Example 1: Partial Element Change" described in the first embodiment will be described by way of example. The contribution rate determination unit 106 identifies the original creative work used and the usage pattern based on the AI ​​musical composition metadata, and when determining the contribution rate of the original creative work of the generated AI musical composition, determines the contribution rate of the rights holder of the original creative work (the degree of contribution of the rights holder relative to the entire AI creative work). According to Process Example 1, the AI ​​musical composition is generated by changing a portion of the elements of the original creative work. Therefore, the contribution rate determination unit 106 reduces the contribution of the rights holders (e.g., the author and copyright holder) associated with the changed element information. For example, if the instrument part of the original musical composition used is changed, there is no contribution from the performer of the corresponding instrument. In addition, for example, if a measure is switched to a measure of another piece of music, the contribution of the proportion of the changed measure is reduced. However, this change in contribution can be weighted according to the importance of the changed measure to the entire musical composition. For example, the amount of change in contribution can be changed according to whether the changed measure falls within the chorus.

[0314] In addition, for example, in the case of an AI music piece generated by "Process Example 1': Application of Style" described in the first embodiment, the contribution rate determination unit 106 subtracts the lost style from the original music piece and adds the contribution of the rights-related person of the applied style (or the rights-related person associated with the style of the music piece corresponding to the source of the applied style).

[0315] In addition, for example, in the case where property interests are generated by using the AI ​​material data (an example of an AI creative work) generated by the "Process Example 2: Generation of New Element Information" described in the first embodiment as material for generating another AI creative work, for example, the contribution rate determination unit 106 similarly determines the contribution rate of the original creative work or material data based on the added AI creative metadata. For example, in the case of generating element information (e.g., a new AI measure) constituting a part of a musical piece based on a plurality of musical pieces or a plurality of material data, the contribution rate determination unit 106 can obtain the contribution rate by dividing into equal parts according to the number of musical pieces used, or can obtain the contribution rate corresponding to the degree of influence when the degree of influence of each musical piece (e.g., the melody length used for the AI ​​measure) is known.

[0316] In addition, for example, in the case where a property interest is generated by using the AI ​​material data "style" generated by the "Process Example 3: Extraction of Style" described in the first embodiment, for example, the contribution rate determination unit 106 similarly determines the contribution rate of the original creative work or material data based on the added AI creative metadata. For example, the contribution rate determination unit 106 may obtain an equal part divided by the number of multiple musical pieces used, or determine the contribution rate based on the degree of influence when the degree of influence of each musical piece is known. In addition, the contribution rate determination unit 106 may weight the contribution in consideration of the style extraction (e.g., "artist") (in this case, a relative reduction in the contribution rate of other elements is performed).

[0317] Note that in some cases, the above-mentioned multiple processes are combined and recursively processed to generate AI-generated works. Therefore, the contribution rate of each original work or material data can be calculated taking into account these processes.

[0318] In addition, in the case where the original creative work or material data is a derivative creative work, the contribution rate determination unit 106 can also determine the contribution rate of the original creative work (hereinafter referred to as the "original creative work") on which the derivative creative work depends. The contribution rate determination unit 106 can calculate the contribution of the rights-related person of each creative work based on which of the creative parts of the original creative work or the creative parts of the derivative creative work are used in the AI ​​creative work. For example, in the case where the AI ​​creative work only uses the part corresponding to the difference between the derivative creative work and the original creative work, the contribution rate determination unit 106 does not set the contribution rate of the original creative work.

[0319] In addition, the contribution rate determination unit 106 may also determine the contribution rate based on the weight corresponding to the importance of the used part relative to the entire AI creative work. For example, the contribution rate determination unit 106 may determine that the chorus part or a part that is unique compared to other creative works (a part that is not very similar) is an important part, and set a higher importance for the part than other parts, and then determine the contribution rate considering the weight corresponding to the importance. The important part can be determined based on the degree of recurrence of the corresponding elements, or based on a marketing analysis of whether configurable importance is expected (for example, in the configuration of "first verse, second verse and chorus", the element corresponding to "chorus" is expected to be important) or based on the usage status of the AI ​​creative work.

[0320] Although specific examples of determining contribution rates have been described above, determination of contribution rates is not limited to precise calculations, but may be merely approximate calculations, or determination of the contribution rate of a primary original creative work (e.g., calculating the percentage of a certain original creative work in the entire original creative work used to generate the AI ​​creative work).

[0321] (4) Feedback determination unit 107

[0322] The feedback determination unit 107 determines the distribution (feedback) of the property interests of the AI ​​creation work, etc. to the rights-related persons for each original creation work or each material data of the AI ​​creation work based on the contribution rate determined by the contribution rate determination unit 106.

[0323] Feedback can be given to all rights holders of original creative works or material data based on their contribution rate, or only to rights holders of original creative works or material data that have a specific or greater impact on AI-created works (used at a specific rate or higher). For example, if an original creative work is referenced during the generation of an AI-created work, but the original creative work only has an impact that is reduced to a level that is essentially negligible during the generation process, feedback will not be given to the rights holder of the corresponding original creative work.

[0324] Furthermore, feedback may be omitted where the original creative work has an impact but is not used sufficiently to be considered a derivative creative work.

[0325] In this way, whether to give feedback can be determined by comparison between the contribution rate and a predetermined threshold.

[0326] Below is an example of an assignment as feedback.

[0327] -Currency, electronic currency, and points equivalent to currency

[0328] - Only points in the platform (this system) and predetermined values ​​defined by the platform (this system) are allocated (based on the accumulation of usage and contribution feedback)

[0329] - Presenting a UI to indicate public recognition that usage exceeds a fixed level (this is for feedback indicating the number of times or specific usage patterns based on these, for example, in the case of "the authored code was used ten times by another person", feedback indicating this fact is given to the author.)

[0330] - Presenting the fact that an original creative work or material data was used (in this case, presentation may differ for each usage mode. For example, in the case of generating an AI-created work, “derivative creative work xxx has been generated” is presented. In the case of an AI-created work being affected to a certain extent, “creation xxx was affected” is presented. In the case of making a reference without contributing to the AI-created work, “used” is presented.)

[0331] Furthermore, as a feedback mode, a ranking display can be presented based on the actual generation of AI-generated works or the derivative use of a user's works or material data by others. This ranking display can be presented using user names, or it can be a ranking display of frequently used original works or material data. Furthermore, a display can be made that indicates the sections in which the user's material data or works are particularly used. In this way, users can identify more visual usage patterns of their material data or works, thereby ensuring their creative desire.

[0332] (5) Feedback presentation processing unit 108

[0333] The feedback presentation processing unit 108 presents feedback to the user (e.g., the creator U1 who is the person related to the rights of the original creative work or material data) based on the determination result of the feedback determination unit 107. Examples of feedback presentation include the granting of money, electronic data, points equivalent to money, the granting of non-monetary incentives, and notification of usage information.

[0334] The functional configuration of the material generation unit 102 of the present embodiment has been described above. Note that the functional configuration described above is not required to be implemented by a single device (material generation unit 102), but may be implemented by a plurality of devices. In other words, Figure 12 The functional configuration shown in can be regarded as a system configuration composed of a plurality of devices.

[0335] <4-3. Operation process>

[0336] Then, reference will be made to Figure 13 The operation process performed in this embodiment is described. Figure 13 1 is a flowchart showing an example of the flow of the feedback process according to the second embodiment. "Music piece" is taken here as an example of a creative work.

[0337] First, the contribution rate determination unit 106 of the material generation unit 102 acquires metadata of the AI ​​music (AI music metadata) (step S203 ), and determines the contribution rate of the original creative work or material data to the AI ​​music.

[0338] Subsequently, the feedback determination unit 107 determines whether the original creative work or material data has a certain or greater influence on the AI ​​music based on the contribution rate of the original creative work or material data (step S209). For example, the feedback determination unit 107 can set a predetermined threshold and determine whether there is an original creative work or material data whose contribution rate exceeds the predetermined threshold.

[0339] Thereafter, the feedback determination unit 107 acquires usage information associated with the AI ​​musical piece from the usage information DB 144 (step S212 ).

[0340] Then, the feedback determination unit 107 calculates feedback (distribution) for the original creative work or material data based on the usage information related to the AI ​​creative work and the contribution rate of the original creative work or material data to the AI ​​creative work (step S215). For example, in the case of distributing property benefits as feedback, the feedback determination unit 107 calculates the property benefits to be distributed to each original creative work or each material data based on the usage information of the AI ​​creative work and the contribution rate of the original creative work or material data according to the property benefits.

[0341] Thereafter, the feedback presentation processing unit 108 gives feedback presentation (for example, money giving process) to the right-related person of the original creative work or material data (step S218).

[0342] The above describes the operation process according to this embodiment. Note that the example described here is the operation process in which feedback is presented only to those with rights to original creative works or original creative data that have a certain or greater impact on the AI-generated work. However, this embodiment is not limited to this example. As described above, feedback can be presented to all original creative works or those with rights to original creative data.

[0343] <4-4. Beneficial Effects>

[0344] According to the second embodiment, AI creation metadata added to AI creation works can be used to clarify usage patterns of original creation works or material data used for AI creation works, and appropriate feedback to persons related to the rights of original creation works or material data can be achieved.

[0345] <<5. Third Example: Marketing Analysis>>

[0346] A third embodiment according to the present disclosure will be described later. According to this embodiment, more effective marketing analysis is achieved based on AI creation metadata added to AI creation works to support new creation works.

[0347] <5-1. Background>

[0348] In the related art, it is known to analyze the popularity factors of music, novels, etc. and provide further support. However, only performing analysis on a music unit basis, such as artist factors (e.g., personality and sound quality), publicity factors, and music categories (e.g., the latest popular categories), makes it difficult to perform more detailed music analysis, specifically, to perform analysis of each element constituting a creative work.

[0349] However, according to this embodiment, by using metadata added to the creative work (especially the AI ​​creation metadata added to the AI ​​creation work described in the first embodiment), more detailed analysis (for example, analysis of the original creative work or material data used for the AI ​​creation work) can be achieved.

[0350] The following describes a system for supporting new creative works according to this embodiment, which is implemented by analyzing creative works based on metadata. "Music" is presented here as an example of a creative work. Of course, the application of the support system according to this embodiment is not limited to "music," but can be other creative works (e.g., novels, games, videos, and characters).

[0351] <5-2. Functional Configuration>

[0352] Figure 14 is depicted by Figure 21 is a block diagram of an example of a configuration of logical functions according to the third embodiment implemented by the communication unit 120 and the storage unit 140 of the music providing server 10. Figure 14 As shown, the AI ​​creative work generation unit 103 according to the third embodiment includes an AI creative work generation unit 103, a music supply processing unit 105, a popular song selection unit 110, a feature value extraction unit 111, a popular element designation unit 112, a support information generation unit 113, a survey object music comparison unit 114, a music DB 141 and a usage information DB 144.

[0353] (Hot Song Selection Unit 110)

[0354] The hit song selection unit 110 selects a hit song from the music DB 141. There are no particular limitations on the definition of a hit song. For example, referring to the usage information DB 144, the hit song selection unit 110 may determine that a music song that has been played more than a predetermined number of times by a predetermined user segment (e.g., age and gender) within a predetermined time period is a hit song.

[0355] (Feature Value Extraction Unit 111)

[0356] The feature value extraction unit 111 extracts the various feature values ​​of the music selected as the hit song. Specifically, the feature value extraction unit 111 can extract the element information (material data) constituting the selected music as a feature value based on the metadata added to the selected music (for example, the AI ​​music metadata added to the AI ​​music). For example, the feature value extraction unit 111 is capable of extracting musical elements constituting the AI ​​music, such as measures, instrument parts, interval parts, codes, and styles. In addition, "new album or old album", "whether there is a collaboration", and others are also collected as music information. In addition, the feature value extraction unit 111 can also extract information associated with users who watch and listen to, purchase or reproduce (use) the music as the feature value of the corresponding music. Examples of information associated with a user include attribute information (e.g., age, gender, region, and country), social graphs and channels (means for viewing and listening to, purchasing, or reproducing music, e.g., what SNS (social networking service) is used, whether live reproduction is used), reproduction environment (e.g., time, place, and location information), accompanying information (e.g., the order of reproduction and the type of reproduction device for reproduction together with other music), etc.

[0357] (Hot Element Specifying Unit 112)

[0358] The hot factor specifying unit 112 specifies hot factors based on the extracted feature values. For example, the hot factor specifying unit 112 can specify feature information based on the feature values ​​of each popular song, where the feature information indicates features that have been played more than a predetermined value. Therefore, according to this embodiment, not only can hot factors be analyzed per song, but also per component, can be analyzed. Therefore, it is possible to specify feature information (e.g., phrase, code, interval, instrument, and measure) representing the estimated hot factors.

[0359] (Survey Subject Music Comparison Unit 114)

[0360] The subject music comparison unit 114 has a function for comparing a predetermined subject music with a hit song. Specifically, the subject music comparison unit 114 can compare the feature values ​​of the predetermined subject music with the feature values ​​of the hit song and identify hit songs that are similar to the predetermined subject music. For example, the subject music comparison unit 114 can determine the position of the subject music in the feature value space of the hit songs. When the feature values ​​are extracted based on the metadata added to the music, the subject music comparison unit 114 can use the feature information that is the same as or similar to the subject music to identify the hit song by comparing it with the feature information. Alternatively, the subject music comparison unit 114 can also determine the similarity between the subject music and the hit song. In addition, the subject music comparison unit 114 can compare the predetermined subject music with the elements that constitute the hit factor to compare the amount of the hit factor included and the similarity with the hit factor.

[0361] (Support Information Generating Unit 113)

[0362] The support information generation unit 113 generates support information associated with a piece of music (content) in response to a request from a user. For example, the support information generation unit 113 generates information indicating what conditions are recommended for generating a piece of music based on the results of a hit song analysis, and presents this information to the composer U1 or the AI ​​composer U3 who generated the piece of music using an AI tool.

[0363] For example, the support information generation unit 113 presents the popular elements specified by the popular element specifying unit 112 (e.g., codes, instrument parts, intervals, measures, etc. frequently used in a piece of music that is reproduced many times). Furthermore, the support information generation unit 113 can present the popular song elements in a segment (viewer and listener stratum, such as age and gender) specified by the user. In this way, for example, an artist can obtain support information (e.g., popular song element information in the corresponding segment) in a segment in which the artist desires to take action.

[0364] Furthermore, the support information generating unit 113 is capable of providing support information for a promising artist in a predetermined section (for example, an artist of a musical piece having elements of a hit song in a predetermined section).

[0365] Furthermore, the support information generation unit 113 generates information indicating a recommendation regarding the selection of a segment and an attraction method (e.g., publicity) for a designated piece of music (the survey-target music) based on the comparison result with the hit songs, and presents the segment and attraction method to the promoter U7, etc. For example, the support information generation unit 113 presents user attributes, channels, attraction methods used, etc., included in a segment that sold well for the hit songs using element information similar to the element information associated with the survey-target music.

[0366] Furthermore, the support information generating unit 113 can also predict a music piece that will become popular next based on the hot factor specified by the hot factor specifying unit 112 , and present the prediction result to the user as support information.

[0367] Thus, in this system, the end user can obtain information indicating segments suitable for presentation of music expected to sell, suitable channels for attracting people, and the level of popularity probability of a certain segment. In addition, the end user can obtain suggestions for improving the combination of elements of the music expected to sell (i.e., more likely to sell more) (e.g., adding popular melody lyrics and a slightly simpler song configuration).

[0368] (AI Creative Work Generation Unit 103)

[0369] As described above, the AI ​​composition generation unit 103 can generate an AI composition (AI composition) using music and material data through AI. Furthermore, the AI ​​composition generation unit 103 according to this embodiment can also use the popular element information specified by the popular element specifying unit 112 as the composition range information (frame information) to generate an AI composition. More specifically, the AI ​​composition generation unit 103 can automatically generate an AI composition (i.e., a popular composition) using material data specified as popular elements.

[0370] Furthermore, the AI ​​composition generating unit 103 can present the user (AI creator) who composes music using an AI tool with the popular element information specified by the popular element specifying unit 112. For example, the AI ​​composition generating unit 103 presents material data specified as the popular element in the segment specified by the user.

[0371] In addition, the AI ​​creative work generation unit 103 is also capable of generating music that guarantees contingency. For example, when generating a piece of music, the AI ​​creative work generation unit 103 can generate music while inserting popular elements of adjacent or different pieces into the music. Specifically, for example, popular elements of women in their twenties are used to generate music for men in their thirties. In addition, by using popular elements of different pieces at a specific rate, music that guarantees diversity can be generated. In addition, the AI ​​creative work generation unit 103 can generate music that targets the outer edge of the feature value space that is expected to become popular. At this time, the AI ​​creative work generation unit 103 can display the feature value space that is expected to become popular, and present the visualized music generation targeting the outer edge of the space in the form of a graph.

[0372] In addition, the AI ​​creative work generation unit 103 is capable of generating music by using an SNS graph (a social graph; a graph indicating relationships (links) between people and businesses on an SNS). Specifically, for example, the AI ​​creative work generation unit 103 is capable of automatically generating music that is likely to become popular by referring to the social graph, focusing on people who are influential in a specific segment, and generating music using element information preferred by the people. Alternatively, the AI ​​creative work generation unit 103 is capable of generating music that ensures contingency by referring to the social graph, and generating music using element information preferred by people who have no influence in the specific segment.

[0373] The above describes the functional configuration of the AI ​​creative work generation unit 103 of this embodiment. Note that the above functional configuration is not required to be implemented by a single device (AI creative work generation unit 103), but can be implemented by multiple devices. In other words, Figure 14 The functional configuration shown in can be regarded as a system configuration composed of a plurality of devices.

[0374] <5-3. Operation process>

[0375] Next, refer to Figure 15 The operation process for presenting support information for newly created works in this embodiment is described. Figure 15 : is a flowchart showing an example of the flow of a new creative work support information presentation process based on hit song analysis according to the present embodiment.

[0376] like Figure 15 As shown, first, the song selection unit 110 specifies the target (time period and segment (user layer)) for hot song selection (step S303). The target can be specified by the user or can be automatically determined.

[0377] Subsequently, the hit song selection unit 110 selects a hit song group in the designated target according to the number of reproduction times, for example (step S306 ).

[0378] Thereafter, the feature value extraction unit 111 acquires metadata of the selected hit song group (step S309 ), and extracts feature values ​​of the hit song group (acquires a feature value space) (step S312 ).

[0379] Then, the hot factor specifying unit 112 specifies hot factors based on the extracted feature values ​​of the hot song group (step S315 ).

[0380] Subsequently, the AI ​​composition generating unit 103 automatically generates a music piece (AI music piece) based on the designated hot elements (step S318 ).

[0381] In addition, the support information generating unit 113 may generate a UI for presenting information supporting composition and the like, and present the generated UI to the creator U1 or the AI ​​creator U3 (step S321 ).

[0382] On the other hand, the surveyed music comparison unit 114 can compare the feature value space of the surveyed music with the feature value space of popular songs (step S324), generate a UI for presenting information supporting the attraction (e.g., publicity) of the surveyed music, and present the UI (step S327).

[0383] <5-4. Beneficial Effects>

[0384] According to the third embodiment, more detailed marketing analysis is implemented based on metadata added to AI-created works (including AI-created metadata added to AI-created works) to provide effective support for new creative works.

[0385] <6. Overview>

[0386] While preferred embodiments of the present invention have been described in detail above with reference to the accompanying drawings, the present technology is not limited to these examples. Obviously, within the scope of the technical concepts described in the claims, a person skilled in the art having ordinary knowledge in the technical field of the present disclosure may conceive of various modified or corrected examples. Of course, it should be understood that these also fall within the technical scope of the present disclosure.

[0387] For example, a computer program can be generated for allowing hardware such as the CPU, ROM, RAM, etc. built in the above-mentioned music providing server 10 (10-1 to 10-3) to execute the functions of the music providing server 10. In addition, a recording medium that is computer-readable and stores the computer program is also provided.

[0388] In addition, the beneficial effects described in this specification are presented for explanation or exemplary purposes only and are not to be considered as limiting. In other words, in addition to or in place of the above beneficial effects, according to the description of this specification, the technology disclosed herein can provide other beneficial effects that are obvious to those skilled in the art.

[0389] Note that the present technology allows the following configurations.

[0390] (1) An information processing system comprising:

[0391] a content generating unit that generates content using one or more pieces of material data generated from original content; and

[0392] A metadata adding unit adds content metadata to the content, the content metadata including material information related to material data used to generate the content and generation information related to the generation of the content.

[0393] (2) The information processing system according to (1) above, wherein the content generation unit automatically generates content based on the material data using a predetermined rule or machine learning.

[0394] (3) The information processing system according to (1) or (2) above, wherein the material information associated with the material data used to generate the content is information capable of identifying the material data.

[0395] (4) The information processing system according to any one of (1) to (3) above, wherein the generation information associated with the generation of the content is details of the generation of the content and includes at least information indicating a usage pattern of the material data.

[0396] (5) The information processing system according to any one of (1) to (4) above, wherein information associated with a rights relationship of the material data and information allowing identification of original contents of the material data are added to the material data as metadata.

[0397] (6) The information processing system according to any one of (1) to (5) above, further comprising:

[0398] A material generation unit generates one or more pieces of material data based on the original content.

[0399] Here, the metadata adding unit adds information associated with the rights relationship of the material data and information allowing identification of the original content of the material data to the generated material data as metadata.

[0400] (7) The information processing system according to any one of (1) to (6) above, wherein the content generation unit generates the new content using the original content.

[0401] (8) The information processing system according to any one of (1) to (7) above, wherein information associated with a rights relationship of the original content is added to the original content as metadata.

[0402] (9) The information processing system according to any one of (1) to (8) above,

[0403] The content is music, and

[0404] Material data is range information, sound quality information, component element information, or abstract element information that constitutes music.

[0405] (10) An information processing method executed by a processor, the method comprising:

[0406] generating content using one or more pieces of material data generated from original content; and

[0407] Content metadata is added to the content, the content metadata including material information related to material data used to generate the content and generation information related to the generation of the content.

[0408] (11) A program that causes a computer to function as:

[0409] a content generating unit that generates content using one or more pieces of material data generated from original content; and

[0410] A metadata adding unit adds content metadata to the content, the content metadata including material information related to material data used to generate the content and generation information related to the generation of the content.

[0411] Reference Signs List

[0412] 10 (10-1 to 10-3): Music provision server

[0413] 20: Information processing terminal

[0414] 30: Rights Management Organization Server

[0415] 40: Metadata Management Server

[0416] 100: Control unit

[0417] 101: Metadata Addition Unit

[0418] 102: Material Generation Unit

[0419] 103: Creative Work Generation Unit

[0420] 104: Use judgment unit

[0421] 105: Music supply processing unit

[0422] 106: Contribution rate determination unit

[0423] 107: Feedback determination unit

[0424] 108: Feedback presentation processing unit

[0425] 110: Popular Song Selection Unit

[0426] 111: Feature value extraction unit

[0427] 112: Popular element designation unit

[0428] 113: Support information generation unit

[0429] 114: Comparison of the surveyed music

[0430] 120: Communication unit

[0431] 140: Storage unit

Claims

1. An information processing system, comprising: Music providing server, including: a material generating unit, wherein the material generating unit generates one or more material data by decomposing constituent elements of the original content, a content generating unit that generates content using one or more pieces of material data generated from original content, a metadata adding unit that adds, to the content, an ID for identifying corresponding content metadata, the content metadata including material information associated with material data used to generate the content and generation information associated with generation of the content; and A metadata management server manages content metadata. 2 . The information processing system according to claim 1 , wherein the content generation unit automatically generates the content based on the material data using a predetermined rule or machine learning. 3 . The information processing system according to claim 1 , wherein the material information associated with the material data used to generate the content is information that allows identification of the material data. 4 . The information processing system according to claim 1 , wherein the generation information associated with the generation of the content is details of the generation of the content, and includes at least information indicating a usage pattern of the material data. 5 . The information processing system according to claim 1 , wherein information associated with a rights relationship of the material data and information allowing identification of original contents of the material data are added to the material data as metadata.

6. The information processing system according to claim 1, further comprising: a material generating unit, wherein the material generating unit generates one or more material data according to the original content, The metadata adding unit adds information associated with a rights relationship of the material data and information allowing identification of original contents of the material data as metadata to the generated material data. 7 . The information processing system according to claim 1 , wherein the content generation unit generates new content using original content.

8. The information processing system according to claim 1, wherein information associated with a rights relationship of the original content is added to the original content as metadata.

9. The information processing system according to claim 1, wherein the content is a musical composition, and The material data is time range information, sound quality information, component element information or abstract element information constituting the music.

10. An information processing method, the method comprising: At the music providing server, Generate one or more pieces of material data by decomposing the constituent elements of the original content. Generate content using one or more pieces of material data generated from original content, adding, to the content, an ID for identifying corresponding content metadata, the content metadata including material information associated with material data used to generate the content and generation information associated with generating the content; as well as At the metadata management server, content metadata is managed. 11 . A computer-readable recording medium for storing a program which, when executed by a computer, causes the computer to execute the information processing method according to claim 10 .

Images