Content management apparatus, content management method, and program

Abstract

To enable a user to easily search for contents matching his / her taste and to continue his / her motivation for creation.SOLUTION: The content management device includes an acquisition unit that acquires collected sound data indicating sound data collected while a user is reproducing content or composite content, a harmonization determination unit that determines whether or not a sound of the collected sound data is harmonized with the reproduced content or composite content and outputs tag information tagged to the content or the composite content, and a reproduction configuration unit that selects at least one of the content and the composite content to be distributed to the user on the basis of the tag information regarding the user.SELECTED DRAWING: Figure 10

Description

[Technical Field]

[0001] The present disclosure relates to a content management device, a content management method, and a program. [Background technology]

[0002] Composite content can be created by combining the content created by multiple artists. The spread of the Internet has made it easier to combine content from multiple artists, and it has also made it easier to distribute the resulting content to a large number of users and get feedback. Artists can also view the distributed composite content in the process of creation while imagining how the content will be layered.

[0003] On the other hand, there is a playback method called random playback, which plays songs in random order. For example, Patent Document 1 discloses a method in which, when a user requests the start of playback, a predetermined number of songs belonging to categories, such as a specified genre, era, tempo, melody, instrument, etc. associated with the song are selected, and these are played back consecutively. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2014-093097 Summary of the Invention [Problem to be solved by the invention]

[0005] However, in a service where multiple artists create composite content by layering content, it can be cumbersome for artists to find content in the creative process that they want to layer, making it difficult to maintain their creative motivation.

[0006] The present disclosure has been made in consideration of the above, and aims to provide a content management device, a content management method, and a program that allow users to easily find content that suits their preferences and continue to foster their creative motivation. [Means for solving the problem]

[0007] In order to achieve the above-mentioned object, one aspect of the content management device of the present disclosure is a content management device in which multiple users overlap content in a tree shape to generate and distribute composite content, and is equipped with: an acquisition unit that acquires noise collection data indicating audio data collected while the user is playing the content or composite content; a harmony determination unit that determines whether the audio of the noise collection data is in harmony with the played content or composite content and outputs tag information tagged to the content or composite content; and a playback configuration unit that selects at least one of the content and composite content to be distributed to the user based on the tag information related to the user.

[0008] In order to achieve the above-mentioned object, a content management method according to one aspect of the present disclosure is a content management method in which multiple users overlap content in a tree shape to generate and distribute composite content, and includes the steps of acquiring noise collection data indicating audio data collected while a user is playing content or composite content, determining whether the audio of the noise collection data is in harmony with the played content or composite content, and outputting tag information tagged to the content or composite content, and selecting at least one of the content and composite content to be distributed to the user based on the tag information related to the user.

[0009] In order to achieve the above-mentioned object, one aspect of the program of the present disclosure is a program that causes a computer operating as a content management device to execute a content management method in which multiple users overlap content in a tree-like shape to generate and distribute composite content, and causes the computer to acquire noise data indicating audio data collected while the user is playing content or composite content, determine whether the audio of the noise data is in harmony with the played content or composite content, output tag information tagged to the content or composite content, and select at least one of the content and composite content to be distributed to the user based on the tag information related to the user. [Effects of the Invention]

[0010] According to the present disclosure, it is possible to easily find content that matches one's preferences, thereby achieving the effect of enabling one to continue to be motivated to create. [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 1 is a diagram illustrating an overview of a content management system according to the present disclosure. [Figure 2] FIG. 2 is a diagram illustrating an example of the configuration of a composite content according to the present disclosure. [Figure 3] FIG. 3 is a diagram illustrating an example of the configuration of a content management system according to the present disclosure. [Figure 4] FIG. 4 is a diagram illustrating an example of the configuration of a user terminal according to the first embodiment. [Figure 5] FIG. 5 is a diagram illustrating an example of the configuration of a content management device according to the first embodiment. [Figure 6] FIG. 6 is a diagram illustrating an example of information stored in the user information storage unit of the content management device according to the first embodiment. [Figure 7] FIG. 7 is a diagram showing an example of information stored in the content data storage unit of the content management device according to the first embodiment. [Figure 8]FIG. 8 is a diagram showing an example of information stored in the additional information storage unit of the content management device according to the first embodiment. [Figure 9] FIG. 9 is a diagram illustrating an example of information stored in the system information storage unit of the content management device according to the first embodiment. [Figure 10] FIG. 10 is a diagram illustrating an example of the configuration of a content management device according to the second embodiment. [Figure 11] FIG. 11 is a diagram illustrating an example of information stored in the user information storage unit of the content management device according to the second embodiment. [Figure 12] FIG. 12 is a diagram illustrating an example of the configuration of a content management device according to the third embodiment. [Figure 13] FIG. 13 is a diagram illustrating an example of information stored in the user information storage unit of the content management device according to the third embodiment. [Figure 14] FIG. 14 is a diagram illustrating an example of information stored in the display information storage unit of the content management device according to the third embodiment. [Figure 15] FIG. 15 is a diagram showing an example of a tree diagram screen according to the third embodiment. [Figure 16] FIG. 16 is a diagram showing an example of a distribution screen including a tree diagram according to the third embodiment. [Figure 17] FIG. 17 is a diagram illustrating an example of the configuration of a user terminal according to the fourth embodiment. [Figure 18] FIG. 18 is a diagram illustrating an example of the configuration of a content management device according to the fourth embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0012] Below, embodiments of a content management system according to the present disclosure will be described in detail with reference to the drawings. Note that the present disclosure is not limited to the description of the following embodiments. Furthermore, the components in the following embodiments include those that are easily replaceable by those skilled in the art, those that are substantially identical, or those that are equivalent. Furthermore, the components described below can be omitted, replaced, or modified in various ways without departing from the spirit of the present disclosure. In the following embodiments, components necessary for illustrating embodiments of a content management system according to the present disclosure will be described, and other components will be omitted. Note that in the following description of the embodiments, identical components will be given the same reference numerals, and different components will be given different reference numerals.

[0013] [Embodiment] [Content Management System Overview] A content management system 1 according to an embodiment of the present disclosure will be described using Fig. 1. Fig. 1 is a diagram illustrating an overview of a content management system according to the present disclosure. As shown in Fig. 1, the content management system 1 according to the present disclosure includes a content management device 100 that manages content, and a user terminal 200 that is operated by a user U. The content management device 100 and the user terminal 200 communicate with each other via a network N.

[0014] The content management system 1 is a system that generates composite content CTc by overlapping multiple content CTs. Each content CTs is audio data, including, for example, sounds SD1, SD2, and SD3. The composite content CTc is music data generated by synthesizing different content CTs, including, for example, sound SD4. The audio data may be in the form of sound source data in a format such as WAV (RIFF waveform Audio Format) or MP3 (MPEG-1 Audio Layer-3), but is not limited to these.

[0015] For example, the user terminal 201 of user U1 records the sound SD1 of the user U1's drum performance. The user terminal 202 of user U2 records the sound SD2 of the user U2's singing voice from a microphone, for example, via wireless communication. The user terminal 203 of user U3 records the sound SD3 of the user U3's guitar performance. The user terminals 201, 202, and 203 transmit the recorded sounds SD1, SD2, and SD3 (contents CTs) to the content management device 100 via the network N.

[0016] The content management device 100 generates a composite content CTc by synthesizing the sounds SD1, SD2, and SD3 of the respective contents CTs transmitted from the user terminals 201, 202, and 203. Based on a predetermined distribution request transmitted from the user terminal 204 of user U4, the content management device 100 distributes the composite content CTc to the user terminal 204 and causes the sound SD4 of the composite content CTc to be output. Furthermore, based on a predetermined distribution request transmitted from the user terminal 204, the content management device 100 may distribute the individual contents CTs that make up the composite content CTc and cause the sounds SD1, SD2, and SD3 of the respective contents CTs to be output.

[0017] In the following, when there is no particular distinction between individual content CTs and compound content CTc, they will simply be referred to as content CT. Furthermore, the act of a user U transmitting content CTs to the content management device 100 via the user terminal 200 and making the content CTs or new compound content CTc obtained by superimposing the content CTs with other content CTs or compound content CTc available for distribution on the content management system 1 will be referred to as "posting."

[0018] [Example of composite content configuration] Next, the configuration of composite content CTc composed of multiple contents CTs will be described with reference to FIG. 2. FIG. 2 is a diagram showing an example of the configuration of composite content according to the present disclosure. As shown in FIG. 2, original content CTs1, which is the basis of the composite content CTc, and individual contents CTs2-1, . . . , CTs5-2, which are overlaid on the original content CTs1, are represented by a tree diagram. Hereinafter, a collection of multiple contents CTs branching out in a tree shape like this will be referred to as a "lineage."

[0019] In the example shown in Figure 2, first, original content CTs1 is posted to track 1. Three pieces of content CTs2-1, CTs2-2, and CTs2-3 are connected to track 2, overlapping content CTs1 on track 1. Content CTs3-1 is connected to content CTs2-1 on track 3, and two pieces of content CTs4-1 and CTs4-2 are connected to content CTs3-1 on track 4. Meanwhile, three pieces of content CTs3-2, CTs3-3, and CTs3-4 are connected to content CTs2-3 on track 3, and content CTs4-3 is connected to content CTs3-3 on track 4, and two pieces of content CTs5-1 and CTs5-2 are connected to content CTs5 on track 5.

[0020] Of the overlapping contents CTs in this way, for example, composite content CTc5-1 consisting of contents CTs1, CTs2-3, CTs3-3, CTs4-3, and CTs5-1 is mixed for release because of its high degree of completion. At this time, only the composite content CTc5-1 has been released, and all the others are contents CT in the process of being created. For example, the user U watches the content CT in the process of being created while imagining that new content CTs are being overlaid on the content CT in the process of being created.

[0021] Here, each piece of content CTs has attributes. Examples of attributes include "rhythm" which includes drums, etc., "lead" which includes guitar, etc., "bass," "chord" which includes keyboard, etc., "sound effects" which include synthesizers, etc., and "lyrics" which include voice, poetry, etc. If the attribute of content CTs1 is "rhythm" and the attribute of content CTs2-1 is "lead," the composite content CTc, which is made up of overlapping pieces of content CTs1 and CTs2-1, will have a configuration in which a guitar melody is layered in time with the drum rhythm.

[0022] [Content Management System Configuration] Next, the configuration of a content management system 1 according to the present disclosure will be described with reference to Fig. 3. Fig. 3 is a diagram showing an example configuration of a content management system according to the present disclosure. As shown in Fig. 3, the content management system 1 includes a content management device 100 and a user terminal 200, which communicate with each other via a network N.

[0023] The content management device 100 is an information processing device that performs various information processes such as acquiring individual content CTs, generating composite content CTc, managing information about the content CT and user U, and distribution. The content management device 100 performs processes based on information transmitted from a user terminal 200 via a network N. The content management device 100 may be realized by an information processing device such as a PC (Personal Computer), a WS (Work Station), or a computer having server functions.

[0024] The user terminal 200 is an information processing device used by a user U. The user terminal 200 may be, for example, an information processing device such as a smartphone, a tablet terminal, a wearable terminal, a mobile phone, or a PDA (Personal Digital Assistant). Note that the example shown in FIG. 1 illustrates a case where the user terminal 200 is a smartphone.

[0025] The network N connects the content management device 100 and the user terminal 300 in a wired or wireless manner so that they can communicate with each other. If the network N is wired, it may be realized by Ethernet (registered trademark) defined in IEEE802.3 or the like. If the network N is wireless, it may be realized by a wireless LAN (Local Area Network) defined in IEEE802.11, Bluetooth (registered trademark), or the like.

[0026] [First embodiment] The features of the content management system 1 of the first embodiment will be described below. The content management system 1 of the first embodiment provides content CT that matches the preferences of the user U and content CT at a desired production stage. Examples of the preferences of the user U include genre, attributes, number of tracks, whether it is at the bottom of a genre, number of "likes," level of interest among other users U, whether it has been released, etc.

[0027] By the user U setting the genres and attributes that the user U himself / herself often posts, or by the content management device 100 learning them, it is possible to provide content CT in that genre before the attribute is overlapped. For example, if the attribute that the user U often overlaps is code and the content CTs4-2 shown in FIG. 2 is code, the composite content CTc3-1 before the content CTs4-2 is overlapped indicates that the attribute has been overlapped. Therefore, by playing the composite content CTc3-1, it becomes easier to imagine the attribute being overlapped. Conversely, if the user U often posts to composite content CTc on which a specific attribute has already been overlapped, it is possible to provide composite content CTc on which the attribute has already been overlapped.

[0028] By having the user U set the number of tracks that the user U often posts, or by having the content management device 100 learn the number of tracks, it is possible to provide content CT that overlaps up to the track just before that number of tracks. For example, when the number of tracks is small, it is highly likely that the direction of the music (content CT) has not yet been decided, and it is easy to put together a bold composition. Conversely, when the number of tracks is large, the composition is almost decided, and participation is likely to be limited to adding arrangements.

[0029] If the user U himself / herself prefers to overlay content CTs at the end of a line, the end content CT can be provided by the user U setting it or by the content management device 100 learning it. The end content CT is the first song to be newly overlaid on the song, and is therefore less likely to be influenced by the content connected by other users U, and has the characteristic of being able to easily express the individuality of the user U.

[0030] By selecting the content CT to be provided based on the number of "likes" and the level of interest of other users U, it is possible to satisfy the preferences of users U, such as whether they want to participate in the production of popular content CT or the production of lesser-known content CT. Furthermore, for users U who are not artists but listeners, it is also possible to satisfy the preferences of users U, such as whether they want to view popular content CT or lesser-known content CT.

[0031] Furthermore, listeners may find it difficult to hear content in the production process CT, and may wish to limit their listening to only released composite content CTc. Conversely, artists may wish to limit their listening to only content in the production process CT in which they themselves have had a chance to participate.

[0032] [User device configuration] Next, the configuration of the user terminal 200 according to the first embodiment will be described with reference to FIG. 4. In other words, the functional configuration required by the user terminal 200 in the content management system 1 according to the first embodiment will be described. FIG. 4 is a diagram showing an example of the configuration of the user terminal according to the first embodiment. As shown in FIG. 4, the user terminal 200 according to the first embodiment includes a communication unit 210, a storage unit 220, a control unit 230, an operation unit 240, a sound collection unit 250, an audio unit 260, and a display unit 270.

[0033] The communication unit 210 is a communication module that enables the user terminal 200 to communicate with external devices. The communication unit 210 is responsible for transmitting and receiving various types of data to and from external devices via wireless or wired communication. In the case of wireless communication, the communication unit 210 may be equipped with a communication antenna, a radio frequency (RF) circuit, a wireless local area network (LAN) card, or other communication processing circuits. In the case of wired communication, the communication unit 210 may be equipped with, for example, a network interface card (NIC) equipped with a wired LAN terminal, a transmission circuit, or other communication processing circuits.

[0034] The storage unit 220 is a storage device that stores various types of information. The storage unit 220 includes a main storage device and an auxiliary storage device. The main storage device may be realized by a semiconductor memory element such as a random access memory (RAM), a read only memory (ROM), or a flash memory. The auxiliary storage device may be realized by a hard disk, a solid state drive (SSD), an optical disk, or the like.

[0035] The control unit 230 is a controller that manages and controls the user terminal 200. The control unit 230 is realized by a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or the like executing various programs stored in the storage unit 220 using RAM as a working area. The control unit 230 may also be realized by an integrated circuit, such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0036] The control unit 230 includes an acquisition unit 231, a reception unit 232, a provision unit 233, and a posting unit 234. The control unit 230 realizes these functions and executes these processes by reading and executing a program (software) from the storage unit 220. Note that these functions of the control unit 230 may be realized by electronic circuits. Furthermore, the control unit 230 may execute these processes using one CPU, or may be provided with multiple CPUs that execute these processes in parallel.

[0037] The acquisition unit 231 acquires the content CTs from the user U. The acquisition unit 231 may acquire the content CTs in any manner, and for example, the acquisition unit 231 may acquire, as the content CTs, audio data input via the sound collection unit 250. The acquisition unit 231 may acquire the content CTs from an external device (for example, a recording device separate from the user terminal 200) via the communication unit 210.

[0038] The reception unit 232 receives a distribution request for the content CT from the user U. For example, the reception unit 232 may display a distribution request reception screen for the content CT on the display unit 270 to receive the distribution request from the user U. For example, the reception unit 232 receives a distribution request for distribution in a predetermined playback mode displayed on the display unit 270, when the user U operates the operation unit 240 to play the content in that playback mode.

[0039] The playback mode includes, for example, a normal mode in which one selected content CT is played, and a random playback mode in which multiple content CT are played randomly. In the random playback mode, multiple content CT to be played are selected based on the preferences and settings of the user U, and are played in a playback order and for a playback time based on the preferences and settings of the user U. The random playback mode further includes an artist mode, a user mode, and a fan mode. In the artist mode, for example, a content CT in the process of being created that the user U can newly add is selected. In the user mode, for example, a released composite content CTc is selected. In the fan mode, for example, content CT related to a specific content CT is played sequentially by the origin playback described below.

[0040] Furthermore, the receiving unit 232 receives various types of information such as additional information, setting information, or reaction information related to the content CT. The additional information received by the receiving unit 232 includes, for example, unique information, destination information, or comments from the user U when posting the content CTs. The unique information and destination information will be described later. The additional information is transmitted to the content management device 100 via the communication unit 210 and stored in the additional information storage unit 123 described later.

[0041] The setting information includes, for example, a category to be preferentially played when playing back the content CT at random, and playback condition settings related to the playback order. The setting information is transmitted to the content management device 100 via the communication unit 210 and stored in the user information storage unit 121, which will be described later.

[0042] The reaction information includes, for example, "likes" for the content CT, viewing time, number of repeated viewings, etc. The reaction information is transmitted to the content management device 100 via the communication unit 210, and after being collected by the statistics unit 133 described below, is stored as part of the unique information in the additional information storage unit 123. The setting information and reaction information may be received in any manner, and for example, the receiving unit 232 may receive various information input via the operation unit 240.

[0043] Here, the types of categories to be given priority for playback include, for example, genre, attribute, number of tracks, whether it is at the end of a genre, number of "likes," level of interest among other users U, whether it has been released, etc., similar to the preferences of the user U described above. The playback order also includes, for example, origin playback and branching playback.

[0044] In compositional playback, tracks are played back in order starting from track 1 based on a predetermined playback time, and the viewer can listen to the composition while grasping the structure of tracks 1, 2, and 3 as the sounds gradually overlap and become thicker. For example, when performing compositional playback of the composite content CTs3-1 shown in FIG. 2, the content is played back in the order of content CTs1, composite content STc which is an overlapping of contents CTs1 and CTs2-1, and composite content STc3-1. The playback time for each track may be equal intervals or may be changed according to the attributes. Furthermore, the playback order and playback time may be changed according to the peak of each track.

[0045] In branching playback, after playing a content CT on which some contents CTs are layered, the contents CT are played in the order in which they were layered. For example, in the case of branching playback of the composite content CTc3-1 shown in Fig. 2, the composite content CTc3-1, the composite content CTc on which the contents CTc3-1 and CTs4-1 are layered, and the composite content CTc on which the composite content CTc3-1 and CTs4-2 are layered are played in this order. If there are songs that have been released, processing may be performed to notify that they have been released by changing the playback order or playback time or adding sound effects during playback.

[0046] The providing unit 233 provides the content CT to the user U. The providing unit 233 acquires content data of the content CT distributed from the content management device 100 and playback information including the playback order of the content CT. The providing unit 233 may provide the content CT to the user U, for example, by causing the audio unit 260 to output the sound of the content CT distributed from the content management device 100 and causing the display unit 270 to display a distribution screen, video, etc. of the content CT.

[0047] The posting unit 234 transmits the content CTs acquired by the acquisition unit 231 to the content management device 100 via the communication unit 210. The posting unit 234 associates user information indicating the user U of the user terminal 200 with the content CTs and transmits the associated user information to the content management device 100. The user information is information indicating the user U who has sent the content CT, and includes, for example, a user ID described below. Furthermore, the posting unit 234 associates additional information related to the content CTs with the content CTs and transmits the associated additional information to the content management device 100.

[0048] The operation unit 240 is an input device that allows the user U to input various operations to the user terminal 200. The operation unit 240 outputs an operation signal corresponding to the received input operation to the control unit 230. The operation unit 240 includes, for example, a keyboard, a mouse, a touch panel overlaid on the display unit 270, buttons, switches, etc. The operation unit 240 can receive, for example, a key input operation, a click operation, or a touch operation. As in the example shown in FIG. 1, when the user terminal 200 is a smartphone, the operation unit 240 is a touch panel.

[0049] The sound collection unit 250 receives various types of sound as input. The sound collection unit 250 has a microphone function. For example, the sound collection unit 250 may receive input of voice or the sound of a musical instrument being played via a microphone.

[0050] The audio unit 260 outputs various sounds. The audio unit 260 has a speaker function. The audio unit 260 outputs, for example, the sound of the content CT.

[0051] The display unit 270 displays various types of information. For example, the display unit 270 displays a content CT distribution screen, a distribution request reception screen, a submission reception screen, video of the content CT, etc. The display unit 270 may display, for example, a GUI (Graphical User Interface) for executing various processes of the user terminal 200. The display unit 270 may be realized by a liquid crystal display, an organic EL (Electro Luminescence) display, a micro LED (Light Emitting Diode) display, etc.

[0052] [Content management device configuration] Next, the configuration of the content management device 100 according to the first embodiment will be described with reference to Fig. 5. Fig. 5 is a diagram showing an example of the configuration of the content management device according to the first embodiment. As shown in Fig. 5, the content management device 100 according to the first embodiment includes a communication unit 110, a storage unit 120, and a control unit 130.

[0053] The communication unit 110 is a communication module that allows the content management device 100 to communicate with external devices. The communication unit 110 is responsible for sending and receiving various types of data to and from external devices via wireless or wired communication. In the case of wireless communication, the communication unit 110 may be equipped with a communication antenna, an RF circuit, a communication processing circuit such as a wireless LAN card, etc. In the case of wired communication, the communication unit 110 may be equipped with, for example, a NIC equipped with a wired LAN terminal, a transmission circuit, other communication processing circuits, etc.

[0054] The storage unit 120 is a storage device that stores various types of information. The storage unit 120 includes a main storage device and an auxiliary storage device. The main storage device may be realized by a semiconductor memory element such as RAM, ROM, or flash memory. The auxiliary storage device may be realized by a hard disk, SSD, optical disk, or the like.

[0055] The storage unit 120 includes a user information storage unit 121, a content data storage unit 122, an additional information storage unit 123, and a system information storage unit 124. The storage unit 120 may be realized by a plurality of storage devices corresponding to the user information storage unit 121, the content data storage unit 122, the additional information storage unit 123, and the system information storage unit 124, respectively, or may be realized by dividing one storage device into a plurality of storage areas.

[0056] 6 is a diagram showing an example of information stored in a user information storage unit of the content management device according to the first embodiment. The user information storage unit 121 stores information about a user U who posts content CTs or views content CTs. In the example shown in FIG. 6, the user information storage unit 121 stores information relating to items such as "user ID," "user additional information," "posted information," "setting information," and "learning information" in association with each other.

[0057] The "user ID" is an identifier that identifies the user U who uses the content management system 1, and is represented by a character string, a number, or the like. The "user ID" may also be an identifier that identifies the user terminal 200 of the user U. The "user additional information" is additional information about the user U, and includes, for example, the nickname and icon that the user U displays in the content management system 1, the email address, telephone number, credit card information, and the like that the user U has notified the administrator.

[0058] The "posted information" is information about the content CTs posted by the user U, and is managed by the "content ID" described below. The "posted information" stores the same number of "content IDs" as the number of content CTs posted by the user U.

[0059] The "setting information" is information on various settings set by the user U, and includes, for example, setting information on the content CT to be preferentially played back when the content CT is played back randomly. The "setting information" is received by the receiving unit 232 of the user terminal 200 through the operation of the user U, and transmitted to the content management device 100 via the communication unit 210, and is acquired by the acquisition unit 131 of the control unit 130, which will be described later.

[0060] The "learning information" is information that learns the preferences of the user U as described above, and is used, for example, to select and configure the order of the content CT to be preferentially played when playing the content CT randomly. The "learning information" is generated in the learning unit 134 of the control unit 130, which will be described later.

[0061] 6 shows that the information of user U identified by user ID "UID#1" is "UDT#1," and the content IDs acquired from user terminal 200 of user ID "UID#1" are "CTID#1-1" and "CTID#1-2." It also shows that the information set by user U identified by user ID "UID#1" is "SET#1," and the information learned from the preferences of user U identified by user ID "UID#1" is "FAV#1."

[0062] 7 is a diagram showing an example of information stored in the content data storage unit of the content management device according to the first embodiment. The content data storage unit 122 stores information about content CTs created by a user U. In the example shown in FIG. 7, the content data storage unit 122 stores information relating to items such as "content ID" and "content data" in association with each other.

[0063] The "content ID" is an identifier for identifying each content CTs, and is represented by a character string, a number, etc. The "content ID" is the same as the "content ID" stored as "posted information" in the user information storage unit 121.

[0064] "Content data" is data of individual content CTs identified by a "content ID", and is, for example, sound source data, video data, etc.

[0065] That is, in FIG. 7, it is shown that the content data of the content CTs identified by the content ID "CTID#1-1" is "CTDT#1-1".

[0066] FIG. 8 is a diagram showing an example of information stored in the additional information storage unit of the content management device according to the first embodiment. The additional information storage unit 123 stores additional information relating to content CTs. In the example shown in FIG. 8, the additional information storage unit 123 stores information relating to items such as "content ID," "user ID," "unique information," "system ID," "hierarchy information," "target ID," and "target ID" in association with each other. The "content ID" is the same as the "content ID" stored in the content data storage unit 122. The "user ID" is the same as the "user ID" stored in the user information storage unit 121.

[0067] "Unique information" is information related to the content CTs, and includes, for example, attribute information, release information, play count information, like information, interest level information, etc. Attribute information indicates information on the attributes of the content CTs. The unique information may further include a sound source, such as the type of instrument, as a type of attribute. Release information indicates information on whether a composite content CTc has been released that is a descendant of the content CTs. Play count information indicates the number of times the content CTs has been viewed. The play count information may include both the number of plays of the content CTs alone and the number of plays of the composite content CTc that includes the content CTs. Like information indicates the number of "like" reactions that a user U has made to the content CTs. The like information may include both the number of likes for the content CTs alone and the number of likes for the composite content CTc that includes the content CTs. Interest level information indicates information on the level of interest in the content CTs. The level of interest may be determined, for example, by the viewing time or the number of repeated viewings. The interest level may be set to be high, for example, when content CT that is not to the user U's liking, content CT with a small number of tracks, content CT with a small number of plays, etc. is viewed for a long period of time.

[0068] The "system ID" is an identifier for identifying the system to which the contents CTs connected in the tree structure belong, and is represented by a character string, a number, etc. The "system ID" is the same as the "system ID" of the system information storage unit 124 described later.

[0069] The "hierarchical information" is information indicating the number of tracks to which the contents CTs are posted.

[0070] The "destination ID" is the "content ID" of the content CTs on which the content CTs identified by the "content ID" is superimposed. One "content ID" is stored as the "destination ID".

[0071] The "overlaid ID" is the "content ID" of the content CTs that are overlaid on the content CTs identified by the "content ID". One or more "content IDs" are stored as the "overlaid ID". If there are no content CTs that are overlaid on the content CTs, 0 (blank) is stored.

[0072] 8 shows that the user U who posted the content CTs identified by the content ID "CTID#1-1" has the user ID "UID#1", and the unique information of the content CTs is "UNQ#1". It also shows that the content belongs to the system identified by the system ID "TSID#1", its hierarchy is "LYR#1-1", the overlap destination is the content CTs identified by the content ID "CTID#4-2", and there are no content CTs overlapped with the content.

[0073] 9 is a diagram showing an example of information stored in the system information storage unit of the content management device according to the first embodiment. The system information storage unit 124 stores information about the system to which the content CTs belong. In the example shown in FIG. 9, the system information storage unit 124 stores information related to items such as "system ID," "system data," and "system additional information" in association with each other. The "system ID" is the same as the "system ID" stored in the additional information storage unit 123.

[0074] The "system data" is data of an individual system identified by a "system ID", and is, for example, the "content ID" of the content CTs to which it belongs, information indicating the number of tracks and connections of each content CT, and the like.

[0075] "System additional information" is additional information related to the system identified by the "system ID", and includes information such as the number of content CTs superimposed on the original content CTs, the number of participating users U, the total number of "likes" for the content CTs belonging to it, and the total number of plays.

[0076] The information stored in the user information storage unit 121, the content data storage unit 122, the additional information storage unit 123, and the system information storage unit 124 is not limited to that in the first embodiment, and any other information may be associated with each of them and stored.

[0077] 5 is a controller that manages and controls the content management device 100. The control unit 130 is realized by a CPU, an MPU, or the like executing various programs stored in the storage unit 120 using RAM as a work area. The control unit 130 may also be realized by an integrated circuit such as an ASIC or an FPGA.

[0078] The control unit 130 includes an acquisition unit 131, a superposition unit 132, a statistics unit 133, a learning unit 134, a reproduction configuration unit 137, and a provision unit 139. The control unit 130 realizes these functions and executes these processes by reading and executing a program (software) from the storage unit 120. Note that these functions of the control unit 130 may be realized by electronic circuits. Furthermore, the control unit 130 may execute these processes using one CPU, or may be provided with multiple CPUs that execute these processes in parallel.

[0079] The acquisition unit 131 acquires various types of information from inside or outside the content management device 100. For example, the acquisition unit 131 acquires content data of content CTs posted from the user terminal 200 together with a user ID and additional information, and outputs the content data to the content data storage unit 122. For example, the acquisition unit 131 acquires a distribution request for the content CT transmitted from the user terminal 200, and outputs the request to the playback configuration unit 137. For example, the acquisition unit 131 acquires setting information transmitted from the user terminal 200, and outputs the setting information to the user information storage unit 121. For example, the acquisition unit 131 acquires reaction information transmitted from the user terminal 200, and outputs the reaction information to the statistics unit 133.

[0080] The overlapping unit 132 generates a composite content CTc by overlapping a plurality of contents CTs. For example, the overlapping unit 132 receives designation of the original content CTs and the contents CTs to be overlapped, and generates the composite content CTc by overlapping the designated contents CTs on the original content CTs. Furthermore, the overlapping unit 132 receives designation of a content CTs to be further overlapped as the next content CTs for the composite content CTc, which is formed by overlapping several contents CTs, and generates a new composite content CTc. In this way, by repeatedly overlapping the contents CTs on the original content CTs, composite content CTc in the process of production at each stage or composite content CTc to be released is generated.

[0081] The statistical unit 133 compiles and outputs various information related to the individual contents CTs for each user U and for each set of specific contents CTs such as composite content CTc or a category. The statistical unit 133 compiles and outputs, for example, the number of "likes," the number of plays, the number of overlaps, the number of participants, the number of attributes posted, etc. The statistical unit 133 outputs the compiled information to the additional information storage unit 123 as part of the unique information, and also outputs it to the category information storage unit 124 as part of category additional information.

[0082] The learning unit 134 learns the preferences of the user U based on additional information such as unique information stored in the additional information storage unit 123. The learning unit 134 learns the preferences of the user U as an artist based on, for example, the genres and attributes that the user U himself / herself often posts, the number of tracks, whether or not the content is at the end of the genre, the "likes" and the level of interest of the content CT to be superimposed, etc. The learning unit 134 also learns the preferences of the user U as a listener based on, for example, the genres and attributes that the user U himself / herself often plays, the number of tracks, whether or not the content is at the end of the genre, whether or not it has been released, the "likes" and the level of interest of the content CT, etc. The learning unit 134 outputs the learned information to the user information storage unit 121 as learning information.

[0083] The playback configuration unit 137 selects content CT to be provided to the user U based on the setting information and learning information stored in the user information storage unit 121, configures the playback order of the content CT, and outputs the playback information. The playback configuration unit 137 may output the playback information based on a distribution request from the user U.

[0084] The providing unit 139 distributes the content CT or a distribution request acceptance screen for the content CT to the user terminal 200 via the communication unit 110 based on the playback information of the content CT configured by the playback configuration unit 137. That is, the providing unit 139 reads out content data of the content CT that matches the content CT included in the playback information from the content data storage unit 122, and distributes the content data to the user terminal 200 that has accepted the distribution request. At this time, the providing unit 139 may distribute the content CT in association with a distribution screen, video, etc. of the content CT.

[0085] [Action and effect] The content management device, content management method, and program described in the first embodiment are for generating and distributing composite content by multiple users by overlapping content in a tree structure, and include acquiring content posted by the users and additional information related to the content, overlaying the posted content on a target content or composite content specified by the user to generate composite content, learning the preferences of the users based on the additional information related to content posted or played by the users in the past and outputting learned information, and selecting at least one of the content and composite content to be distributed to the users based on the learned information related to the users. This allows the users to easily find content that follows the trends of content posted or played in the past, i.e., content that matches their preferences or content at a desired production stage.

[0086] Second Embodiment The features of the content management system 1 of the second embodiment will be described below. The content management system 1 of the second embodiment provides content CT that matches the preferences of the user U, and also provides content CT that encourages the user U to continue creating. Specifically, while the user U is playing the content CT, a predetermined phenomenon is used as a trigger to tag the content CT and its playback location, or narrow down content CT with a similar melody, and play these preferentially.

[0087] The predetermined phenomenon includes, for example, the user U's action of making a sound such as playing an instrument or singing, a specific operation by the user U via the operation unit 240, or harmony with the music being played when a sound is made. Furthermore, similar musical tunes may be determined based on genre, constituent attributes, frequency characteristics, etc. Furthermore, tags may be shared with other users U, and may be preferentially played as content CT that a specific user U is paying attention to.

[0088] [User device configuration] In the content management system 1 of the second embodiment, the basic functional configuration required by the user terminal 200 is the same as that of the content management system 1 of the first embodiment, so a description thereof will be omitted and only additional functions will be described.

[0089] The acquisition unit 231 of the second embodiment further acquires, as noise collected sound data, audio data input via the sound collection unit 250 while the content CT is being played. The posting unit 234 transmits the noise collected sound data acquired by the acquisition unit 231 to the content management device 100 via the communication unit 210. The posting unit 234 associates the noise collected sound data with a user ID indicating the user U of the user terminal 200, a content ID indicating the content CT being played, and playback location information, and transmits the noise collected sound data to the content management device 100.

[0090] The reception unit 232 of the second embodiment further receives a predetermined operation for tagging via the operation unit 240 or the like while the content CT is being played back. The reception unit 232 transmits tag information including the content ID and playback location of the tagged content CT to the content management device 100 via the communication unit 210. The reception unit 232 transmits the tag information to the content management device 100 in association with a user ID indicating a user U of the user terminal 200.

[0091] [Content management device configuration] Next, the configuration of a content management device 100A according to the second embodiment will be described with reference to Fig. 10. Fig. 10 is a diagram showing an example of the configuration of a content management device according to the second embodiment. Note that in the content management device 100A according to the second embodiment, the same components as those in the content management device 100 according to the first embodiment are denoted by the same reference numerals, and descriptions thereof will be omitted, and only additional functions will be described.

[0092] 10, the content management device 100A according to the second embodiment differs from the content management device 100 according to the first embodiment in that it includes a storage unit 120A and a control unit 130A instead of the storage unit 120 and the control unit 130. The storage unit 120A includes a user information storage unit 121A instead of the user information storage unit 121. The control unit 130A further includes a harmony determination unit 135A in addition to the components of the control unit 130 according to the first embodiment.

[0093] Fig. 11 is a diagram showing an example of information stored in a user information storage unit of a content management device according to the second embodiment. In the example shown in Fig. 11, the user information storage unit 121A stores information related to the item of "tag information" in addition to the items stored in the user information storage unit 121 according to the first embodiment.

[0094] "Tag information" is information about a tag that a user U has attached to a predetermined content CT or a predetermined playback location of the content CT, and includes, for example, a content ID and a playback location. When tagging is triggered by an operation by the user U or the sound being played, the tag information is received by the receiving unit 232 of the user terminal 200, transmitted to the content management device 100A via the communication unit 210, and acquired by the acquisition unit 131. When tagging is triggered by harmony with the music being played, the tag information is generated by the harmony determination unit 135A, described below, based on noise collected sound data that is acquired by the acquisition unit 231 of the user terminal 200 and transmitted to the content management device 100A via the communication unit 210.

[0095] That is, FIG. 11 shows that the tag information of user U identified by user ID "UID#1" is "TAG#1."

[0096] 10 further acquires tag information transmitted from the user terminal 200 together with the user ID, and stores the same in the user information storage unit 121A. The acquisition unit 131 acquires noise collected data transmitted from the user terminal 200 in association with the user ID, content ID, and playback location information, and outputs the acquired noise collected data to the harmony determination unit 135A.

[0097] The harmony determination unit 135A compares the content data with the noise data to determine whether they are in harmony. A well-known music analysis method, for example, can be used as a determination method. If the harmony determination unit 135A determines that the content data and the noise data are in harmony, it generates tag information by tagging the content CT and the harmonious parts. The harmony determination unit 135A associates the generated tag information with a user ID and stores it in the user information storage unit 121A.

[0098] The playback configuration unit 137 of the second embodiment further selects content CT to be provided to the user U based on the tag information stored in the user information storage unit 121, configures the playback order of the content CT, and outputs the playback information.

[0099] [Action and effect] The content management device, content management method, and program described in the second embodiment are for multiple users to overlap their content in a tree-like formation to generate and distribute composite content, and acquire noise collection data indicating audio data collected while the user is playing the content or composite content, determine whether the audio in the noise collection data harmonizes with the played content or composite content, output tag information tagged to the content or composite content, and select at least one of the content and the composite content to be distributed to the user based on the tag information related to the user. This makes it easy to find content that matches a user's preferences, and when a user plays a sound that harmonizes with the content being played, the user can have the content played again or similar content played, thereby maintaining their creative motivation.

[0100] Third Embodiment The following describes the features of the content management system 1 of the third embodiment. The content management system 1 of the third embodiment presents information on the content CTs and the composite content CTc to the user U. Specifically, various types of information are provided to the user U by displaying them on the user terminal 200 as display information.

[0101] The display information includes, for example, a tree diagram visually showing the lineage of content CTs connected in a tree shape, and various pieces of information related to the content CT. The various pieces of information related to the content CT include, for example, the number of "likes," the number of views, the number of overlaps, the number of participants, the number of attributes posted, and the like, for the user U who posted the individual content CTs, the lineage or a predetermined composite content CTc. The display information also includes, for example, "performance information," described below, which is a statistic of various pieces of information related to the content CT for each user U.

[0102] [User device configuration] In the content management system 1 of the third embodiment, the basic functional configuration required by the user terminal 200 is the same as that of the content management system 1 of the first embodiment, so a description thereof will be omitted and only additional functions will be described.

[0103] The acquisition unit 231 of the third embodiment further acquires the display information distributed from the content management device 100B and stores it in the storage unit 220 temporarily.

[0104] [Content management device configuration] Next, the configuration of a content management device 100B according to the third embodiment will be described with reference to Fig. 12. Fig. 12 is a diagram showing an example of the configuration of a content management device according to the third embodiment. Note that in the content management device 100B according to the third embodiment, components similar to those in the content management device 100 according to the first embodiment are given the same reference numerals and description thereof will be omitted, and only additional functions will be described.

[0105] 12, the content management device 100B according to the third embodiment differs from the content management device 100 according to the first embodiment in that it includes a storage unit 120B and a control unit 130B instead of the storage unit 120 and the control unit 130. The storage unit 120B includes a user information storage unit 121B instead of the user information storage unit 121, and also includes a display information storage unit 125B. The control unit 130B includes a display configuration unit 138B in addition to the components of the control unit 130 according to the first embodiment.

[0106] Fig. 13 is a diagram showing an example of information stored in a user information storage unit of a content management device according to the third embodiment. In the example shown in Fig. 11, the user information storage unit 121B stores information relating to the item of "performance information" in addition to the items stored in the user information storage unit 121 according to the first embodiment.

[0107] "Performance information" includes additional information on the content CTs posted by a user U, and information on the reactions of other users U to the content CTs, statistically collected for each user U, such as the number of posts, the number of "likes," the number of "derivative likes," the level of interest, the number of plays, the number of derivative plays, and the number of plays with collaborating artists. "Performance information" may also include statistical information categorized by the attributes posted by the user U, by track, by connected attributes, etc. The number of "derivative likes" and the number of derivative plays refer to the total number of "likes" and "plays" for the content CTs and all the content CTs layered on top of it.

[0108] That is, FIG. 13 shows that the performance information of user U identified by user ID "UID#1" is "ACV#1."

[0109] 14 is a diagram showing an example of information stored in a display information storage unit of a content management device according to the third embodiment. The display information storage unit 125B stores information relating to the design of a display screen to be displayed on the display unit 270 of the user terminal 200. In the example shown in FIG. 14, the display information storage unit 125B stores information relating to items such as "template ID" and "template data" in association with each other.

[0110] The "template ID" is an identifier that identifies an individual template related to display, and is represented by a character string, a number, or the like.

[0111] "Template data" is data for an individual template identified by a "template ID" and is written in, for example, a markup language such as HTML (HyperText Markup Language), XML (Extensible Markup Language), or CSS (Cascading Style Sheets), or a programming language such as Java (registered trademark), JavaScript (registered trademark), or PHP (Hypertext Preprocessor; registered trademark).

[0112] That is, in FIG. 14, the template data of the template identified by the template ID "TMPID#1" is "TMPDT#1."

[0113] The template includes design information for display screens such as a recommendation screen that displays a distribution screen for recommended content CT for user U, a distribution request acceptance screen, and a posting acceptance screen side by side, a tree diagram screen that shows system information in a tree diagram format, a details screen that displays a distribution screen for individual content CTs that make up composite content CTc, a distribution request acceptance screen, and a posting acceptance screen side by side, and a my page managed by user U.

[0114] FIG. 15 is a diagram showing an example of a tree diagram screen according to the third embodiment. In the example shown in FIG. 15, multiple circular marks connected by lines indicate individual content CTs, a central circular mark coordinated by a star shape indicates original content CTs, and lines connecting the circles indicate overlapping and non-overlapping relationships. Marks with a triangular shape in the center indicate content CTs containing sound source data of musical instruments or vocals, and marks with a square shape in the center indicate content CTs containing text data of lyrics. To the right of the circle, a content ID (e.g., "CTx1-0001"), an icon indicating user U, and user U's nickname (e.g., "AAA") are displayed. Furthermore, a circular mark surrounded by a ring-shaped line indicates a terminal content CT of the composite content CTc being played.

[0115] The upper right corner of FIG. 15 displays the number of content CTs superimposed on the original content CTs, the number of participants indicating the number of users U who posted content CTs included in the group, and the total number of "likes" for the content CTs included in the group. Furthermore, for each content CT, a color based on the number of "likes" is displayed as the background color around the mark of the content CT. In addition, in the example shown in FIG. 15, all content CTs belonging to the group are displayed, but it is also possible to display only the group related to the content CT being played, in which case it is also possible to display only the numerical value related to the displayed group. These numerical values ​​are calculated by the statistics unit 133 based on the unique information stored in the additional information storage unit 123.

[0116] Fig. 16 is a diagram showing an example of a distribution screen including a tree diagram according to the third embodiment. Fig. 16 shows changes in the display screen during origin playback. While original content CTs (content ID "CTx1-0001") on track 1 is being played, only the area around the mark indicating that content CTs is displayed (step S1). While composite content CTc on which content CTs (content ID "CTx1-0002") on track 2 are being played, the display area is expanded to display areas around the marks indicating each of the contents CTs constituting the composite content CTc (step S2).

[0117] Similarly, while playing a composite content CTc in which content CTs on track 3 (content ID "CTx1-0003"), content CTs on track 4 (content ID "CTx1-0004"), and content CTs on track 5 (content ID "CTx1-0005") are layered in this order, only the area around the marks indicating each of the contents CTs constituting the composite content CTc is displayed (steps S3, S4, S5). In this way, by displaying the marks indicating the contents CTs as they are gradually added to the tree diagram showing the lineage and by gradually expanding the display area, it is possible to play the content CTc while visually understanding how it is formed. Note that in the example shown in FIG. 16, the display area is simply changed by enlarging and reducing the display, but marks other than those of the lineage contents CTs related to the content CT being played may be hidden.

[0118] Furthermore, in addition to the examples of the display screens shown in FIGS. 15 and 16, for example, the performance information of the user U stored in the user information storage unit 121B may be displayed on the My Page.

[0119] 12 further compiles statistics on additional information of the content CTs and reaction information of other users U to the content CTs for each user U who posted the content CTs, and stores the statistics in the user information storage unit 121B as performance information of the user U. The statistics unit 133 further compiles statistics on the number of overlapping content CTs for each set of specific content CTs such as composite content CTc or a category, the number of participants indicating the number of users U who posted, and each numerical value included in the reaction information of other users U, based on the unique information stored in the additional information storage unit 123, and outputs the statistics to the display configuration unit 138B.

[0120] The display configuration unit 138B generates and outputs a display screen to be distributed. The display configuration unit 138B generates and outputs a display screen to be distributed based on, for example, a distribution request from the user U, template data stored in the display information storage unit 125B, and various information stored in the user information storage unit 121B, the content data storage unit 122, the additional information storage unit 123, and the lineage information storage unit 124. The display configuration unit 138B generates and outputs a display screen including a tree diagram that visually shows the lineage of the content CTs connected in a tree shape, to be displayed when distributing the content CT to the user U.

[0121] The providing unit 139 of the third embodiment further distributes the display screen configured by the display configuration unit 138B to the user terminal 200 via the communication unit 110.

[0122] [Action and effect] The content management device, content management method, and program described in the third embodiment are for multiple users to overlap their content in a tree-like structure to generate and distribute composite content, and acquire pedigree information indicating the pedigree of the content posted by the user and the multiple pieces of content connected in the tree-like structure, and generate a display screen including a tree diagram visually showing the pedigree of the content connected in the tree-like structure, to be displayed when distributing the content or composite content to the user, based on the pedigree information. This allows the pedigree of the content to be visually grasped, making it possible to easily present information about the content included in the composite content.

[0123] Furthermore, the content management device, content management method, and program described in the third embodiment generate and distribute composite content by overlapping content from multiple users in a tree structure, acquire content posted by the users and additional information related to the content, compile statistics on the additional information for each user, output the statistics as performance information for the user, and generate a display screen including the performance information. This allows users to visually grasp their performance with respect to the content, making it possible to easily present information about the content included in the composite content.

[0124] [Fourth embodiment] The features of the content management system 1 of the fourth embodiment will be described below. The content management system 1 of the fourth embodiment easily reflects the user U's evaluation of each piece of content CTs included in the composite content CTc. The content management system 1 reflects the user U's evaluation in, for example, the selection of the content CT to be provided, the playback order, the playback priority, or the revenue distribution to the user U.

[0125] [User device configuration] Next, the configuration of a user terminal 200C according to the fourth embodiment will be described with reference to FIG. 17. In other words, the functional configuration required by the user terminal 200C in the content management system 1 according to the fourth embodiment will be described. FIG. 17 is a diagram showing an example of the configuration of a user terminal according to the fourth embodiment. Note that in the user terminal 200C according to the fourth embodiment, the same components as those in the user terminal 200 according to the first embodiment will be assigned the same reference numerals and their description will be omitted, and only the additional functions will be described.

[0126] As shown in FIG. 17, the user terminal 200C according to the fourth embodiment differs from the user terminal 200 according to the first embodiment in that it further includes an imaging unit 280C and a biometric sensor 290C.

[0127] The imaging unit 280C is a camera provided in the user terminal 200 or connected to the user terminal 200, and captures the facial expression of the user U while the content CT is being played back. The imaging unit 280C outputs the captured video data to the acquisition unit 231.

[0128] The biosensor 290C is a sensor provided in the user terminal 200 or connected to the user terminal 200, and detects biometric information of the user U while the content CT is being played back. The biometric information includes, for example, body temperature, heart rate, pulse rate, blood pressure, etc. The biosensor 290C outputs the detected biometric information to the acquisition unit 231.

[0129] The acquisition unit 231 of the fourth embodiment further acquires video data captured by the imaging unit 280C and biometric information of the user U detected by the biometric sensor 290C while the content CT is being played back. The posting unit 234 transmits the video data and biometric information acquired by the acquisition unit 231 to the content management device 100 via the communication unit 210. The posting unit 234 transmits the video data and biometric information to the content management device 100 in association with a user ID indicating the user U of the user terminal 200 and a content ID indicating the content CT being played back.

[0130] [Content management device configuration] Next, the configuration of a content management device 100C according to the fourth embodiment will be described with reference to Fig. 18. Fig. 18 is a diagram showing an example of the configuration of a content management device according to the fourth embodiment. Note that in the content management device 100C according to the fourth embodiment, components similar to those in the content management device 100 according to the first embodiment are given the same reference numerals and description thereof will be omitted, and only additional functions will be described.

[0131] 18, the content management device 100C according to the fourth embodiment differs from the content management device 100 according to the first embodiment in that it includes a control unit 130C instead of the control unit 130. The control unit 130C includes an emotion recognition unit 136C in addition to the components of the control unit 130 according to the first embodiment.

[0132] The acquisition unit 131 of the fourth embodiment shown in FIG. 18 further acquires the video data and biometric information transmitted from the user terminal 200 together with the user IS and content ID, and outputs them to the emotion recognition unit 136C.

[0133] The emotion recognition unit 136C recognizes the emotion of the user U who viewed the content CT based on the video data and biometric information corresponding to the content CT and outputs the emotion data. The emotion recognition unit 136C recognizes the user U's level of excitement and its timing based on, for example, changes in the values ​​of biometric information such as body temperature, heart rate, pulse rate, and blood pressure. The emotion recognition unit 136C recognizes the user U's level of excitement and its timing based on changes in the user U's facial expression, for example, using well-known facial expression analysis. For example, when the excitement level exceeds a predetermined threshold, the emotion recognition unit 136C may automatically assign a "like" to the content, link it to the content ID, and output it to the additional information storage unit 123. Note that "likes" may be managed on a measure-by-measure basis rather than on a song (content CT) basis. In this case, if a manually entered "like" overlaps with a "like" based on emotion data, the number of "likes" may be counted multiple times, or a flag indicating a high priority may be set to prioritize playback during random playback.

[0134] Emotional data of the user U acquired from the imaging unit 280C, the biometric sensor 290C, etc., can also be used as an indicator of the degree of contribution to the creation of the composite content CTc. For example, when playing back overlapping content CTs during composition playback, the measure of which overlapping content CTs caused the highest level of excitement when listened to can be extracted and counted to determine the measure that had the greatest impact on the composite content CTc. Furthermore, for the measure with the highest level of excitement, the measure may be compared with the previous measures and melody for each track using waveforms, etc., and the user U who created the attribute with the greatest change may be deemed to have made a significant contribution to the composite content CTc. This may allow the artist to be registered as the favorite artist of the user U who listened to the content, so that songs created by the artist may be prioritized for playback during random playback, or songs immediately after the artist has overlapped may be prioritized for playback. Furthermore, if revenue is earned from the content CT, revenue distribution may be based on the degree of contribution.

[0135] [Action and effect] The content management device, content management method, and program described in the fourth embodiment are for generating and distributing composite content by allowing a plurality of users to overlap their contents in a tree-like configuration, and for obtaining at least one of video data capturing the facial expressions of the users while they are playing the content or the composite content and biometric information of the users, recognizing the emotions of the users who viewed the content based on the video data and biometric information corresponding to the content or the composite content and outputting emotional data, and selecting at least one of the content and the composite content to be distributed to the users based on the emotional data about the users. This allows the user's level of excitement to be recognized without any conscious operation by the users, making it easy to find content that matches their preferences and easily reflecting the user's evaluation of the composite content.

[0136] Other Embodiments The components of the content management system 1, including the content management devices 100, 100A, 100B, and 100C and the user terminals 200 and 200C shown in the drawings in each embodiment, are functional concepts and do not necessarily have to be physically configured as shown. In other words, the specific forms of the content management devices, user terminals, and content management systems are not limited to those shown in the drawings, and all or part of them may be functionally or physically distributed or integrated in any unit depending on the processing load, usage status, etc. of the content management devices, user terminals, and content management systems.

[0137] For example, some components of the user terminals 200 and 200C may be provided in a cloud server that can communicate over a network via the communication unit 210. Specifically, at least one of the storage unit 220, the acquisition unit 231, the reception unit 232, the provision unit 233, and the posting unit 234 may be provided in the cloud server.

[0138] Furthermore, some of the functions of the control units 130, 130A, 130B, and 130C of the content management devices 100, 100A, 100B, and 100C may be included in the control unit 230 of the user terminals 200 and 200C. For example, the harmony determination unit 135A of the second embodiment and the emotion recognition unit 136C of the fourth embodiment may be included in the control unit 230 of the user terminals 200 and 200C.

[0139] The configurations of the content management device, user terminal, and content management system are realized, for example, as software, by programs loaded into memory. In the above embodiment, these functional blocks are described as being realized by the cooperation of these hardware and software. In other words, these functional blocks can be realized in various forms using only hardware, only software, or a combination of both. [Explanation of symbols]

[0140] 1. Content Management System 100, 100A, 100B, 100C Content management device 110 Communications Department 120, 120A, 120B storage section 121, 121A, 121B User information storage unit 122 Content data storage unit 123 Additional information storage unit 124 System information storage unit 125B Display information storage section 130, 130A, 130B, 130C control unit 131 Acquisition Department 132 Polymerization section 133 Statistics Department 134 Learning Department 135A Harmony judgment section 136C Emotion Recognition Department 137 Playback component 138B Display component 139 Provision Department 200, 200C, 201, 202, 203, 204 User terminal 210 Communications Department 220 Storage section 230 Control Unit 231 Acquisition Department 232 Reception Department 233 Provision Department 234 Submissions Department 240 Operation section 250 Sound collection section 260 Sound Department 270 Display section 280C Imaging unit 290C Biometric Sensor CT,CTs Contents CTc Mixed Content N Network SD1, SD2, SD3, SD4 sound U,U1,U2,U3,U4 users

Claims

1. A content management device in which a plurality of users create and distribute composite content by layering content in a tree structure, an acquisition unit that acquires noise collected data indicating audio data collected while a user is playing content or composite content; a harmony determination unit that determines whether or not the sound of the noise data is in harmony with the reproduced content or composite content, and outputs tag information tagged to the content or composite content; a playback configuration unit that selects at least one of content and composite content to be distributed to a user based on the tag information related to the user; Equipped with Content management device.

2. the reproduction configuration unit selects at least one of content or composite content similar to the tagged content or composite content in at least one of genre, attribute, and melody of the content based on the tag information; The content management device according to claim 1 .

3. The acquisition unit further acquires content posted by users and additional information related to the content; a superimposition unit that superimposes the posted content on the destination content or composite content designated by the user to generate composite content; a learning unit that learns the preferences of the user based on the additional information related to content that the user has posted or played in the past, and outputs learning information; Further provided with the reproduction configuration unit further selects at least one of the content and the composite content to be distributed to the user based on the learning information about the user; The content management device according to claim 1 .

4. The additional information includes at least one of the genre, attribute, number of tracks, and whether or not the content is at the end of a tree structure. The content management device according to claim 3 .

5. The acquisition unit further acquires user reaction information regarding the content, a statistics unit that calculates the reaction information for each content and outputs the calculated reaction information as part of the additional information; The content management device according to claim 3 .

6. the acquisition unit further acquires setting information including conditions for the content to be played; the reproduction configuration unit further selects at least one of the content and the composite content to be distributed to the user based on the setting information related to the user; The content management device according to claim 1 .

7. The setting information includes at least one of the genre, attribute, number of tracks, and whether or not the content is at the end of a tree structure. The content management device according to claim 6.

8. the acquisition unit further acquires a distribution request from a user for randomly reproducing at least one of a plurality of contents and a composite content; the playback configuration unit configures a distribution order of at least one of a plurality of contents and a composite content based on the distribution request. The content management device according to any one of claims 1 to 7.

9. A content management method in which a plurality of users create and distribute composite content by layering content in a tree structure, comprising: acquiring noise data indicating audio data collected while a user is playing content or composite content; determining whether the sound of the noise data is in harmony with the reproduced content or composite content, and outputting tag information tagged to the content or composite content; selecting at least one of content and composite content to be distributed to the user based on the tag information related to the user; Including, Content management methods.

10. A program for causing a computer operating as a content management device to execute a content management method in which multiple users create and distribute composite content by layering content in a tree structure, the program comprising: acquiring noise data indicating audio data collected while a user is playing content or composite content; determining whether the sound of the noise data is in harmony with the reproduced content or composite content, and outputting tag information tagged to the content or composite content; selecting at least one of content and composite content to be distributed to the user based on the tag information related to the user; to the computer, program.

Images