Content providing system, content providing method, and storage medium

Abstract

The present technology relates to a content provision system, a content provision method, and a storage medium with which it is possible to provide content adapted to a user and a comment thereon. Provided is a content provision system comprising a control unit that performs: control in which a script generated by a creator and consisting of content identification information and comment information corresponding to a comment is stored in a predetermined storage medium such that the script can be viewed by a user, and read-out of the content indicated by the content identification information included in the script is executed according to the script selected by the user so that the content is provided to the user; control in which a comment is read out according to the comment information included in the script and provided to the user before and / or after the content is provided; and control in which the script to be selected next is switched according to the interaction of the user with the content or the comment.

Description

[Technical field]

[0001] The present technology relates to a content providing system, a content providing method, and a storage medium, and in particular to a content providing system, a content providing method, and a storage medium that are capable of providing content and comments thereon that are adapted to a user. [Background technology]

[0002] In recent years, with the diversification of methods for providing content, various services and devices have been provided (see, for example, Patent Documents 1 and 2).

[0003] Patent Document 1 discloses a device that automatically selects a stream to be played back based on sequence information that controls the playback order of the streams and outputs the selected stream to a television monitor. This device combines the stream with a character string to be output according to the sequence information and outputs the combined stream.

[0004] Patent document 2 discloses a program that sequentially extracts elements from hypertext downloaded based on an address extracted from a program list, and if there is text, synthesizes the text to produce speech, and if there is a link, extracts the material at the link destination and outputs the material corresponding to that material, repeating this process. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] International Publication No. 2004 / 073309 [Patent Document 2] JP 2002-342206 A Summary of the Invention [Problem to be solved by the invention]

[0006] Incidentally, when providing content and comments on the content, it is required to provide content and comments that are suitable for the user.

[0007] The present technology has been developed in light of these circumstances, and makes it possible to provide content and comments thereon that are suited to the user. [Means for solving the problem]

[0008] A content providing system according to one aspect of the present technology includes a script generated by a creator, the script being composed of content identification information and comment information corresponding to a comment, the script being stored in a predetermined storage medium so as to be viewable by a user, and the system controls the reading of content indicated by the content identification information included in the script in accordance with a script selected by the user, and the reading of the content to be provided to the user, and also controls the reading of comments in accordance with the comment information included in the script at least either before or after the provision of the content, and the provision of the content to the user; A response to the comment by the user The content providing system includes a control unit that controls switching of the next script to be selected in response to an interaction.

[0009] A content providing method according to one aspect of the present technology includes: storing a script, which is generated by a creator and is composed of content identification information and comment information corresponding to a comment, in a predetermined storage medium so as to be viewable by a user; and controlling the reading of content indicated by the content identification information included in the script to be executed and provided to the user according to a script selected by the user, and controlling the reading of comments according to the comment information included in the script to be provided to the user at least either before or after the provision of the content; A response to the comment by the user This is a content providing method in which the next script to be selected is switched in response to an interaction.

[0010] A storage medium according to one aspect of the present technology controls a computer to: store a script, generated by a creator, comprising identification information of content and comment information corresponding to a comment, in a predetermined storage medium so as to be viewable by a user; and, in accordance with a script selected by a user, read out content indicated by the content identification information included in the script and provide the content to the user; and, at least either before or after providing the content, read out comments in accordance with the comment information included in the script and provide the content to the user; A response to the comment by the user This is a storage medium on which a program is recorded for functioning as a control unit that controls switching of the next script to be selected in response to an interaction.

[0011] In a content providing system, a content providing method, and a storage medium according to one aspect of the present technology, a script generated by a creator and consisting of content identification information and comment information corresponding to a comment is stored in a predetermined storage medium so as to be viewable by a user, and the content indicated by the content identification information included in the script is read out and provided to the user according to a script selected by the user, and a comment is read out and provided to the user according to the comment information included in the script at least either before or after the provision of the content, A response to the comment by the user Depending on the interaction, the next selected script is switched. [Brief description of the drawings]

[0012] [Figure 1] FIG. 1 is a representative diagram showing an overview of the present technology. [Diagram 2] 1 is a diagram showing an overview of a content providing system to which the present technology is applied. [Diagram 3] 1 is a diagram showing a flow of content playback by a content providing system to which the present technology is applied. [Figure 4] FIG. 13 is a diagram showing an example of rights processing when distributing content including music. [Diagram 5] FIG. 11 is a diagram showing an example of rights processing when performing VPC type distribution. [Figure 6] 1 is a diagram showing an example of the overall configuration of a content providing system to which the present technology is applied. [Figure 7] FIG. 11 is a diagram illustrating an example of a script used in the content providing system. [Figure 8] 1 is a diagram illustrating an example of the configuration of an embodiment of a content providing system to which the present technology is applied. [Figure 9] FIG. 2 is a diagram illustrating an example of the configuration of a creator terminal device. [Figure 10] 2 is a diagram illustrating an example of a functional configuration of a control unit in a creator terminal device. FIG. [Figure 11] FIG. 2 is a diagram illustrating an example of the configuration of a user terminal device. [Figure 12] 11 is a diagram illustrating an example of a functional configuration of a control unit in a user terminal device. [Figure 13] FIG. 2 is a diagram illustrating an example of the configuration of a distribution server or a processing server. [Figure 14] 11 is a diagram illustrating an example of a functional configuration of a control unit in a distribution server or a processing server. [Figure 15] FIG. 11 is a sequence diagram showing a process flow when using voice synthesis to provide a musical piece that has been made into a program along with an introduction and an end of the musical piece. [Figure 16] FIG. 11 is a sequence diagram showing a process flow for playing back a program of songs as a playlist in a case where the introduction and conclusion of a song can be provided using voice synthesis. [Figure 17] FIG. 11 is a sequence diagram showing a process flow when using live voices to provide a musical piece that has been made into a program along with an introduction and an end of the musical piece. [Figure 18] FIG. 11 is a sequence diagram showing a process flow for playing back a program of songs as a playlist in a case where the introduction and conclusion of a song can be provided using live vocals. [Figure 19] 11A and 11B are diagrams showing examples of presentation of music and its introduction and post-synopsis in response to user interaction. [Figure 20] FIG. 13 illustrates an example of user interaction. [Figure 21] FIG. 11 is a diagram showing another example of a script used in the content providing system. [Figure 22] 11 is a sequence diagram showing a process flow for presenting a piece of music and its introduction and post-mentioned explanation in response to user interaction. FIG. [Figure 23] FIG. 2 is a diagram illustrating an example of a user interface of a program creation tool. [Figure 24] 13A and 13B are diagrams illustrating examples of music selection support contents according to branch types. [Diagram 25] FIG. 13 is a diagram showing an example of presentation of recommended music according to the type of branch. [Figure 26] 4 is a flowchart illustrating an overall process according to the first embodiment. [Figure 27] 4 is a flowchart illustrating an overall process according to the first embodiment. [Figure 28] 4 is a flowchart illustrating an overall process according to the first embodiment. [Figure 29] FIG. 11 is a diagram illustrating an example of a process for detecting glue. [Diagram 30] FIG. 13 is a diagram showing an example of program branching in response to groove detection. [Diagram 31] FIG. 11 is a diagram showing another example of a script used in the content providing system. [Diagram 32] 11 is a sequence diagram showing a process flow for presenting a piece of music corresponding to groove detection and its introduction and post-mentioned explanation. FIG. [Diagram 33] 13A and 13B are diagrams showing examples of preference information that can be acquired from reactions to introductory and post-introductory statements. [Diagram 34] 11A and 11B are diagrams illustrating examples of types of prefaces and postfaces that are correlated with the acquisition of preference information. [Diagram 35] FIG. 11 is a diagram showing a flow of generating preference information. [Diagram 36] FIG. 11 is a sequence diagram showing a process flow when generating preference information in accordance with reactions to an introduction and a post-presentation. [Figure 37]FIG. 1 is a diagram showing a flow of creating a template for a program and generating the program using the template. [Figure 38] FIG. 11 is a sequence diagram showing a process flow when generating a template. [Figure 39] 11 is a sequence diagram showing a process flow when characteristics obtained by analyzing the introduction and conclusion are added to a piece of music. FIG. [Diagram 40] FIG. 11 is a sequence diagram showing a process flow for generating a program based on features given to a piece of music. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] Hereinafter, an embodiment of the present technology will be described with reference to the drawings. The description will be given in the following order.

[0014] 1. First embodiment: Basic configuration 2. Second embodiment: User behavior detection function 3. Third embodiment: User preference information generation function 4. Fourth embodiment: Template provision function 5. Fifth embodiment: Characterization function 6. Variations 7. Computer Configuration

[0015] <Representative image>

[0016] FIG. 1 is a representative diagram showing an overview of this technology.

[0017] This technology executes a script for a program in which content has been made into a program and plays back the content and its comments, and provides the user with content and its comments that are suited to the user by switching the next script to be selected depending on the user's interaction with the content or comments.

[0018] In Fig. 1, the DJ distributes the music he selected from a music distribution server and uses a microphone to send comments about the music. At the same time, the user listens to the music selected by the DJ and the comments sent by the DJ, which are distributed from the music distribution server.

[0019] Here, the DJ is a virtual character created by a creator, and in response to the comment "Guitar is the best!!", the user agrees by saying "Yeah, guitar is good." In this case, if there are piano and guitar songs as the next candidate songs, the DJ selects the guitar song that the user agreed with and distributes it from the song distribution server, so that the user is provided with the song and its comment that suits him / her.

[0020] <1. First embodiment>

[0021] (Virtual podcast system overview) Fig. 2 shows an overview of a content providing system to which the present technology is applied. In the example of Fig. 2, a virtual podcast system is illustrated as an embodiment of the content providing system to which the present technology is applied.

[0022] The virtual podcast system is a system that allows creators to create podcast programs simply by operating their own terminal device, selecting music and writing text. Podcasts are a method of publishing audio and video data files on the Internet, and are a type of Internet radio or Internet television. Note that text is not limited to being provided as text, and can be provided as an audio file.

[0023] A podcast program created by a creator is registered in a distribution server, whereby a user can listen to the podcast program by operating his / her own terminal device and playing the program distributed from the distribution server.

[0024] Meanwhile, creators who distribute podcast programs will want to distribute the podcast programs they create efficiently so that more users can view them.

[0025] Furthermore, when music is distributed as a podcast, the creator must process the copyright of the music, which is a hassle for the creator, and therefore they will likely want someone else to process the copyright of the music on their behalf.

[0026] In recent years, creators have been opening their own video distribution channels on video distribution sites and disseminating information through video content on a variety of themes. In return for providing users with video content, creators receive compensation in the form of advertising revenue based on the number of times the video is played, as well as advertising revenue from producing videos in collaboration with advertisers.

[0027] For podcast creators, compensation for the podcasts they create is an extremely important concern, and they will want to be fairly compensated.

[0028] The above-mentioned programming, distribution copyright processing, and monetization are unavoidable issues for creators who distribute podcast programs, and a mechanism for easily resolving these issues is required.The virtual podcast system provides a mechanism for creators to create and distribute podcast programs and enable users to listen to the podcast programs, while also meeting the creators' requests for programming, distribution copyright processing, and monetization.

[0029] FIG. 3 shows the playback flow of a podcast program generated by the virtual podcast system.

[0030] FIG. 3 shows the Nth and N+1th tracks that are consecutive in time among the tracks included in a podcast program.

[0031] Each track consists of a warm-up, a song, and an after-song.

[0032] The introduction is an introduction to the song, and is made up of text (sentences). In this example, the introduction is written as "This song was written by..., it's such a great song!". The text corresponding to this introduction can be converted to voice and read aloud by TTS (Text To Speech).

[0033] A song includes an ID for identifying the song, and information about the song's title and artist. For example, by using a song ID of "1234567," a user can request a streaming service to which the user has a subscription to receive the song identified by the song ID.

[0034] The postscript is a postscript after listening to the song, and is composed of text (a sentence). In this example, the text "It's the best after all..." is written as the postscript. The text corresponding to this postscript can be read aloud using TTS.

[0035] When distributing a podcast program, the following two cases are assumed for the rights processing required to include music in the program.

[0036] First, there is the case of distributing a program that includes music. In this case, as shown in Figure 4, a creator creates a podcast program that is a complete package including music and speech (introduction and conclusion), and the podcast program is distributed, so copyright processing for the music occurs with the creator who distributes it.

[0037] The second is the case of VPC type distribution. In this case, as shown in Figure 5, the music is distributed using a music distribution service, and the creator only creates and distributes the talk (introduction and conclusion), so the creator does not need to handle the copyright of the music.

[0038] In other words, when a creator distributes a podcast program, the creator distributes the configuration data, introduction, and conclusion of the program. As a result, the music portion of the program is distributed by a music distribution service, so the creator does not have to handle the copyright of the music.

[0039] In VPC-type distribution, the music streamed by the music distribution service and the speech (introduction and conclusion) distributed by the creator are combined into a program on the user terminal device used by the user, and the rights processing for the music portion of the podcast program that has been turned into a program on the user terminal device is handled by the user.

[0040] In this way, with VPC-type distribution, when distributing a podcast, the creator does not create a complete packaged podcast program, but instead distributes song identification information (song ID), so that the song streamed by the music distribution service can be played on the user terminal device used by the user based on that song ID.

[0041] In other words, since the music is played on the user terminal device using the rights that the user has already acquired through a contract with the music distribution service, no copyright processing of the music occurs for the creator. On the other hand, the user can also play music within the normal music distribution range of the music distribution service to which the user has subscribed, so that the user can play the music identified by the music ID specified by the creator without paying any additional fees. In the virtual podcast system, podcast programs are distributed by this VPC (Virtual Podcast) type distribution.

[0042] In addition, whether the user has a paid user contract (premium user) or a free user contract (free user), the user can use the right to play songs, for example, by simply allowing the insertion of advertisements for products or services, or songs that the music distribution company providing the music distribution service wants to promote.

[0043] FIG. 6 shows an example of the overall configuration of a virtual podcast system.

[0044] As shown in Figure 6, the functions provided by this virtual podcast system can be broadly divided into creator-side functions provided by a creator terminal device, various distribution service-side functions provided by a distribution server, and user-side functions provided by a user terminal device.

[0045] In the creator terminal device, a program creation tool and an audio creation tool are executed in response to operations by the creator (PodCaster), and a podcast program is generated.

[0046] For example, the program creation tool generates a podcast program based on the song ID of a song selected from a song selection list (catalog) provided by the music distribution service and the introductory and post-narrative text of the song for which sound adjustments have been made during voice synthesis by the voice creation tool, and registers the program with the program distribution service.

[0047] The voice creation tool provides a function for adjusting the sound of the TTS based on the data for voice creation provided by the voice distribution service. Creators can use the voice creation tool to adjust the sound of the TTS to suit their own preferences.

[0048] The program distribution service provides a service of distributing podcast programs registered by a program creation tool to user terminal devices.

[0049] The music distribution service corresponds to a music distribution service to which a user who uses a user terminal device has a contract (subscription). In response to a request from the user terminal device, the music distribution service distributes music identified by a music ID set in a podcast program. The music distribution service also provides a music list for selection to the creator terminal device.

[0050] The audio distribution service provides a service of distributing TTS voice obtained by synthesizing the introductory and post-narrative texts of songs set in podcast programs to user terminal devices, and also provides data for creating voice to creator terminal devices.

[0051] In the user terminal device, the program renderer is executed in response to an operation by a user (listener), and the podcast program is played back.

[0052] When playing a desired program from among the podcast programs made available by the program distribution service, the program renderer renders the music distributed from the music distribution service and the TTS voice distributed from the voice distribution service based on configuration data (reproduction data) regarding the composition of the program.

[0053] In this way, the podcast program is played back (reproduced) and can be viewed by the user. Note that the program renderer executed on the user terminal device can also be considered as a playback player.

[0054] Figure 7 shows an example of a script that describes the structure of a podcast program.

[0055] As shown in Fig. 7, in the virtual podcast system, a podcast program is composed of multiple sets of song IDs of songs to be made into a program and introductory and postscripts of those songs. The composition of this podcast program is described by the script shown in Fig. 7.

[0056] In FIG. 7, the script begins with information about the program, such as the program title, owner, release date, and name of the service that distributes the music.

[0057] In the script, information about the program is described, followed by information about the track. Figure 7 shows an example of the description of the first track out of N tracks.

[0058] In the track, information regarding the target track number (Number), warm-up, song, and after-song is written.

[0059] A song (song) contains an identification (id) for identifying the song, as well as information about the song's title and artist name, etc. For example, by describing a song ID of "1234567", a request can be made to a music distribution service called "serviceA" to distribute the song identified by that song ID.

[0060] The warm-up and after-song sections contain comment information that corresponds to comments about the song. For example, the warm-up section can contain text such as "This song was written by... It's such a great song!", and the after-song section can contain text such as "It really is the best...", and these texts can be converted into voice and read aloud using a TTS service.

[0061] In FIG. 7, only the first track is described, i.e., an example of description of information about the first song is shown, but for the second and subsequent songs, similar to the first song, each song will be described in a set of song ID, introduction and conclusion.

[0062] In this way, a script consisting of the song ID of the song and an introduction and an end of the song is generated by the creator terminal device used by the creator, and is made available to users by being registered in the program distribution service.

[0063] Meanwhile, in the user terminal device used by the user, in accordance with the script published by the program distribution service, the song indicated by the song ID is controlled to be streamed using the rights that the user has already acquired by contracting with the music distribution service, and the preface and postface TTS voices are controlled to be provided.

[0064] In other words, the script only contains the song ID and the introduction and conclusion of the song in text form, and does not contain the actual song and audio data to be played in the podcast program, but on the user terminal device, the song and audio data are played based on the information indicated by the song ID and introduction and conclusion written in the script, thereby recreating the program created by the creator.

[0065] In addition, it is possible to turn a playlist into a program by generating a script with introductory and postscripts for songs (or their song IDs) in an existing playlist, so that the user can easily turn a playlist into a program by simply inputting the introductory and postscripts for the songs.

[0066] (System Configuration) FIG. 8 shows the configuration of a virtual podcast system as an example of the configuration of an embodiment of a content providing system to which the present technology is applied.

[0067] 8, the content providing system 1 includes a creator terminal device 10, a user terminal device 20, a program distribution server 30A, a music distribution server 30B, an audio distribution server 30C, and a processing server 30D.

[0068] In the content providing system 1, a creator terminal device 10, a user terminal device 20, a program distribution server 30A, a music distribution server 30B, an audio distribution server 30C, and a processing server 30D are connected to one another via a network 50.

[0069] The creator terminal device 10 is a device such as a smartphone, a tablet terminal, or a personal computer, and is used by a creator.

[0070] The creator terminal device 10 generates a script for a podcast program in response to an operation by the creator, and transmits (uploads) the script to the program distribution server 30A via the network 50.

[0071] The user terminal device 20 is a device such as a smartphone, a tablet terminal, a music player, a game machine, a wearable terminal, or a personal computer, and is used by a user.

[0072] In response to a user's operation, the user terminal device 20 accesses the program distribution server 30A via the network 50 and receives (downloads) the script of the podcast program.

[0073] The program distribution server 30A is composed of one or more servers that provide a program distribution service. The program distribution service is a service for distributing podcast programs, and is provided by a program distribution business operator.

[0074] The program distribution server 30A receives a program script transmitted (uploaded) from the creator terminal device 10 via the network 50, and registers the script in a storage medium so that the user using the user terminal device 20 can view it.

[0075] When the program distribution server 30A receives a program playback request transmitted from a user terminal device 20 via the network 50, it reads the script of the program from the storage medium and distributes it to the user terminal device 20 that has made the playback request.

[0076] The music distribution server 30B is composed of one or more servers that provide a music distribution service. The music distribution service is a service that distributes music over the Internet and is provided by a music distribution company. For example, the music distribution service is provided in the form of a flat-rate all-you-can-listen streaming service.

[0077] When the music distribution server 30B receives a music distribution request transmitted from a user terminal device 20 via the network 50, it identifies the music corresponding to the received distribution request and distributes the streaming data of the music to the user terminal device 20 that originated the distribution request.

[0078] The voice distribution server 30C is composed of one or more servers that provide a voice distribution service. The voice distribution service is a service that distributes voices such as TTS voices and live voices via the Internet, and is provided by a voice distribution company.

[0079] When the voice distribution server 30C receives a voice distribution request transmitted from a user terminal device 20 via the network 50, it acquires the voice corresponding to the received distribution request and distributes the voice data to the user terminal device 20 that originated the distribution request.

[0080] The processing server 30D is composed of one or more servers that provide various services such as a template generation service, a music analysis service, a pre-explanation and post-explanation analysis service, a music feature analysis service, or a music feature management service, which will be described later. For example, a different server is used as the processing server 30D for each service provided.

[0081] When the processing server 30D receives a request from a creator terminal device 10, a user terminal device 20, or another server via the network 50, it performs processing according to the received request and sends a response including the processing results to the terminal device or server that originated the request.

[0082] In the following description, when there is no need to distinguish between program distribution server 30A, music distribution server 30B, and audio distribution server 30C, they will be referred to as distribution server 30. Also, the program distribution provider, music distribution provider, and audio distribution provider may be the same provider or different providers.

[0083] The network 50 includes a communication network such as the Internet, an intranet, or a mobile phone network, and enables interconnection between devices using a communication protocol such as TCP / IP (Transmission Control Protocol / Internet Protocol).

[0084] (Configuration of creator terminal device) FIG. 9 shows an example of the configuration of the creator terminal device 10 of FIG.

[0085] As shown in FIG. 9, in the creator terminal device 10, a central processing unit (CPU) 101, a read only memory (ROM) 102, and a random access memory (RAM) 103 are interconnected by a bus 104.

[0086] The CPU 101 executes programs stored in the ROM 102 or storage unit 107 to control the operation of each unit of the creator terminal device 10. The RAM 103 stores various types of data as appropriate.

[0087] An input / output I / F 110 is also connected to the bus 104. An input unit 105, an output unit 106, a storage unit 107, a communication unit 108, and a short-range wireless communication unit 109 are connected to the input / output I / F 110.

[0088] The input unit 105 supplies various types of input data to each unit including the CPU 101 via an input / output I / F 110. For example, the input unit 105 includes an operation unit 111, a camera unit 112, and a sensor unit 113.

[0089] The operation unit 111 is operated by the creator, and supplies operation data corresponding to the operation to the CPU 101. The operation unit 111 is composed of physical buttons, a touch panel, and the like.

[0090] The camera unit 112 photoelectrically converts the light from the subject incident thereon, and generates and outputs captured image data by performing signal processing on the resulting electrical signal. The camera unit 112 is composed of an image sensor, a signal processing unit, etc.

[0091] The sensor unit 113 senses spatial information, time information, and the like, and outputs sensor data obtained as a result of the sensing.

[0092] The sensor unit 113 includes an acceleration sensor, a gyro sensor, etc. The acceleration sensor measures acceleration in three directions of the X, Y and Z axes. The gyro sensor measures angular velocity in three axes of the X, Y and Z axes. Note that an inertial measurement unit (IMU) may be provided to measure three-dimensional acceleration and angular velocity using a three-directional accelerometer and a three-axis gyroscope.

[0093] In addition, the sensor unit 113 may include various sensors such as a sound sensor (microphone) that detects sounds such as the creator's voice, a biosensor that measures information such as a living organism's heart rate, body temperature, or posture, a proximity sensor that measures objects in the vicinity, and a magnetic sensor that measures the magnitude and direction of a magnetic field.

[0094] The output unit 106 outputs various types of information under control of the CPU 101 via the input / output I / F 110. For example, the output unit 106 includes a display unit 121 and a sound output unit 122.

[0095] The display unit 121 displays an image corresponding to image data under the control of the CPU 101. The display unit 121 includes a panel unit such as a liquid crystal panel or an OLED (Organic Light Emitting Diode) panel, a signal processing unit, and the like.

[0096] The sound output unit 122 outputs sound corresponding to the sound data under the control of the CPU 101. The sound output unit 122 is composed of a speaker, headphones connected to an output terminal, or the like.

[0097] The storage unit 107 records various data and programs under the control of the CPU 101. The CPU 101 reads out various data from the storage unit 107 and processes the data, and executes the programs.

[0098] The storage unit 107 is configured as an auxiliary storage device such as a semiconductor memory, etc. The storage unit 107 may be configured as an internal storage, or may be an external storage such as a memory card.

[0099] The communication unit 108 communicates with other devices via the network 50 under the control of the CPU 101. The communication unit 108 is configured as a communication module compatible with cellular communication (e.g., LTE-Advanced, 5G, etc.), wireless communication such as a wireless LAN (Local Area Network), or wired communication.

[0100] A short-range wireless communication unit 109 performs wireless communication according to a short-range wireless communication standard such as Bluetooth (registered trademark) or NFC (Near Field Communication), and exchanges various types of data.

[0101] The configuration of the creator terminal device 10 shown in FIG. 9 is just an example, and for example, a microphone may be provided as an input unit, an image processing circuit such as a GPU (Graphics Processing Unit), a power supply circuit, and the like may also be provided.

[0102] 10 shows an example of the functional configuration of the control unit 100 in the creator terminal device 10. The functions of the control unit 100 are realized by the CPU 101 executing programs such as a program creation tool and an audio creation tool.

[0103] 10, the control unit 100 has an input receiving unit 151, a music information acquiring unit 152, a program generating unit 153, an audio information acquiring unit 154, an audio generating unit 155, and a registration unit 156.

[0104] The input receiving unit 151 receives operation data supplied from the input unit 105 in response to an operation by the creator, and supplies the operation data to a program generating unit 153 .

[0105] The music information acquisition unit 152 acquires music information related to music supplied from the communication unit 108 that communicates with the music distribution server 30B, and supplies the information to the program production unit 153. The music information includes information such as the music list and music IDs received from the music distribution server 30B.

[0106] The program generation unit 153 processes the music information supplied from the music information acquisition unit 152 and comment information regarding the introduction and conclusion based on the operation data supplied from the input reception unit 151, to generate a script for the podcast program and supply it to the registration unit 156.

[0107] The audio information acquisition unit 154 acquires audio information relating to the preface and postface audio supplied from the communication unit 108, which communicates with the audio distribution server 30C, and supplies the information to the audio generation unit 155. The audio information includes information about the audio at the time of audio synthesis or audio creation received from the audio distribution server 30C.

[0108] The audio generation unit 155 processes the audio information supplied from the audio information acquisition unit 154 to generate audio for the creator to set the introductory and post-narration, and supplies this to the program generation unit 153.

[0109] When generating a podcast program, the program generation unit 153 uses the audio provided from the audio generation unit 155 and provides the creator with information regarding the settings of the introduction and conclusion (such as audio during audio synthesis), thereby generating a script for the program and providing it to the registration unit 156. Note that the program script can include information regarding user interaction.

[0110] The registration unit 156 controls the communication unit 108 to upload the program script supplied from the program production unit 153 to the program distribution server 30A via the network 50, thereby registering the program script.

[0111] (Configuration of user terminal device) FIG. 11 shows an example of the configuration of the user terminal device 20 of FIG.

[0112] In Fig. 11, the configuration of the user terminal device 20 corresponds to the configuration of the creator terminal device 10 shown in Fig. 9. That is, the components from the CPU 201 to the short-range wireless communication unit 209 have the same functions as those from the CPU 101 to the short-range wireless communication unit 109 described above, and therefore the description thereof will be omitted here.

[0113] 12 shows an example of the functional configuration of the control unit 200 in the user terminal device 20. The functions of the control unit 200 are realized by the CPU 201 executing a program renderer or the like.

[0114] 12, the control unit 200 includes a program acquisition unit 251, a music acquisition unit 252, an audio acquisition unit 253, a renderer unit 254, a presentation control unit 255, and an interaction processing unit 256.

[0115] The program acquisition unit 251 acquires a script of a podcast program in response to a user operation, which is supplied from the communication unit 208 that communicates with the program distribution server 30A, and supplies the script to the renderer unit 254.

[0116] The music acquisition unit 252 acquires streaming data of a music piece corresponding to the music ID supplied from the communication unit 208 that communicates with the music distribution server 30B, and supplies the data to the renderer unit 254.

[0117] The audio acquisition unit 253 acquires audio data corresponding to the preceding and following explanations, which is supplied from the communication unit 208 that communicates with the audio distribution server 30C, and supplies the data to the renderer unit 254.

[0118] Based on the program script supplied from the program acquisition unit 251, the renderer unit 254 performs rendering processing on the pre-mentioned audio data supplied from the audio acquisition unit 253, the music streaming data supplied from the music acquisition unit 252, and the post-mentioned audio data supplied from the audio acquisition unit 253, and supplies the resulting data to the presentation control unit 255.

[0119] The presentation control unit 255 supplies the data provided from the rendering unit 254 to the output unit 206, thereby presenting the podcast program to the user.

[0120] For example, the presentation control unit 255 can supply the introductory audio data, the streaming data of the song, and the concluding audio data to the sound output unit 222, thereby outputting and presenting the introductory and concluding audio set in the program together with the sound of the song that has been made into a program, before and after the song.

[0121] The interaction processing unit 256 performs processing related to the user's interaction and supplies the processing result to the renderer unit 254. For example, the interaction processing unit 256 determines the user's response from the user's physical or emotional movements based on the sensor data supplied from the sensor unit 213. The renderer unit 254 processes the program script based on the processing result supplied from the interaction processing unit 256.

[0122] (Server configuration) Fig. 13 shows an example of the configuration of the distribution server 30 in Fig. 8. The distribution server 30 corresponds to any one of the program distribution server 30A, the music distribution server 30B, and the audio distribution server 30C shown in Fig. 8. The processing server 30D can also be configured in a similar manner.

[0123] In the distribution server 30 or the processing server 30D, the CPU 301, the ROM 302, and the RAM 303 are connected to one another via a bus 304. An input / output I / F 310 is further connected to the bus 304. An input unit 305, an output unit 306, a storage unit 307, a communication unit 308, and a drive 309 are connected to the input / output I / F 310.

[0124] The input unit 305 includes a microphone, a keyboard, a mouse, etc. The output unit 306 includes a speaker, a display, etc.

[0125] The storage unit 307 is configured with a HDD (Hard Disk Drive), a semiconductor memory, etc. The communication unit 308 is configured as a communication module compatible with wireless communication such as a wireless LAN, or wired communication such as Ethernet (registered trademark).

[0126] The drive 309 drives a removable recording medium 311 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory.

[0127] 14 shows an example of the functional configuration of the control unit 300 in the distribution server 30 or the processing server 30D. The functions of the control unit 300 are realized by the CPU 301 executing the programs of each service.

[0128] In FIG. 14, the control unit 300 includes a request receiving and responding unit 351 , a processing unit 352 , and a database 353 .

[0129] The request reception / response unit 351 receives various requests supplied from the communication unit 308 that communicates with the creator terminal device 10 , the user terminal device 20 , or other servers, and supplies the requests to the processing unit 352 .

[0130] The processing unit 352 performs various processes in response to various requests supplied from the request receiving and responding unit 351 .

[0131] The database 353 is recorded in a storage unit 307 that is a large-capacity storage such as a HDD or semiconductor memory.

[0132] For example, database 353 of program distribution server 30A stores scripts of podcast programs, etc. Also, database 353 of music distribution server 30B stores songs provided by a music distribution service in association with music IDs. Furthermore, database 353 of audio distribution server 30C stores information related to audio during voice synthesis and voice creation, audio data for introductions and conclusions, etc.

[0133] When performing various processes, the processing unit 352 processes various data stored in the database 353 , generates responses according to various requests, and supplies the responses to the request acceptance / response unit 351 .

[0134] The request receiving and responding unit 351 controls the communication unit 308 to transmit responses corresponding to various requests supplied from the processing unit 352 via the network 50 to the creator terminal device 10, the user terminal device 20, or another server that originated the request.

[0135] Next, the flow of processing executed by each device in the content providing system 1 will be described.

[0136] (First example) FIG. 15 is a sequence diagram showing a process flow in which voice synthesis is used to provide a musical piece that has been made into a program along with an introduction and an end of that musical piece.

[0137] 15, the program creation tool is executed by a creator terminal device 10, and the program renderer is executed by a user terminal device 20. Also in Fig. 15, the program distribution service is provided by a program distribution server 30A, the music distribution service is provided by a music distribution server 30B, and the TTS service is provided by a voice distribution server 30C.

[0138] In the creator terminal device 10, the control unit 100 executes the program creation tool, and the processes of steps S11 to S13 are carried out.

[0139] The program creation tool acquires the song list transmitted from the song distribution server 30B and presents it to the creator (S11).

[0140] The program creation tool generates a script for the podcast program based on the song ID of the song selected by the creator from the song list and the introductory and post-narrative text of the song entered by the creator (S12), and registers it on the program distribution server 30A (S13).

[0141] As a result, in the program distribution server 30A, the script of the podcast program created by the creator is stored in the database 353, and is made viewable by the user using the user terminal device 20.

[0142] In the user terminal device 20, the control unit 200 executes a program renderer, and the program renderer operates in cooperation with each distribution server 30 to execute the processes of steps S14 to S25.

[0143] When a user instructs the program renderer to play a podcast program that is publicly available for viewing on the program distribution server 30A, the program renderer receives a script of the program distributed from the program distribution server 30A (S14, S15).

[0144] Based on the introduction set at the beginning of the received script, the program renderer requests the audio distribution server 30C to perform voice synthesis of the text of the introduction (S16).

[0145] In response to a request from the program renderer, voice distribution server 30C performs voice synthesis on the introductory text (S17), and distributes the result of the voice synthesis (S18).

[0146] As a result, the program renderer receives the results of the voice synthesis distributed from the voice distribution server 30C and performs rendering processing to play back the TTS voice of the introductory part set in the music program.

[0147] Next, based on the song ID set following the introduction of the received script, the program renderer requests the song distribution server 30B, which provides the music distribution service to which the user has subscribed, to distribute the song identified by the song ID (S19).

[0148] In response to a request from the program renderer, the music distribution server 30B checks the rights that the user has acquired through a contract with the music distribution service (S20), and if it determines that the user has legitimate rights and is able to play the music identified by the music ID, it streams the music (S21).

[0149] As a result, the program renderer receives the streaming data of the music distributed from the music distribution server 30B and performs rendering processing, thereby playing the music identified by the music ID as a programed music.

[0150] Thereafter, when playback of the streaming music is completed, the program renderer requests the audio distribution server 30C to perform voice synthesis of the text of the postscript based on the postscript set next to the music ID of the received script (S22).

[0151] In response to a request from the program renderer, voice distribution server 30C performs voice synthesis of the text described below (S23), and distributes the result of the voice synthesis (S24).

[0152] As a result, the program renderer receives the results of the voice synthesis distributed from the voice distribution server 30C and performs rendering processing to play the TTS voice for the postscript portion set in the music that has been made into a program.

[0153] In addition, since the podcast program script includes the song IDs of multiple songs along with the introductory and post-introductory text for each song, after steps S16 to S24 are completed, the process returns to step S16 (S25), and steps S16 to S25 are repeated according to the number of song IDs.

[0154] As a result, the program renderer repeatedly plays back the introduction, the song, and the conclusion in this order for each song ID set in the script, allowing the user to listen to the podcast program.

[0155] The above describes the flow of the processes executed by each device when using voice synthesis to provide a musical piece that has been made into a program along with an introduction and post-note for that piece.

[0156] (Second example) FIG. 16 is a sequence diagram showing a process flow in playing back a program of music as a playlist in a case where the introduction and conclusion of a music piece can be provided using voice synthesis.

[0157] In Figure 16, the program creation tool and program renderer are executed on the terminal devices of the creator and the user, respectively, and the program distribution service, music distribution service, and TTS service are provided by each distribution server, respectively, as in the first example described with reference to Figure 15.

[0158] In steps S31 to S33 in FIG. 16, similarly to steps S11 to S13 in FIG. 15, a program script is generated by a program creation tool and registered in the program distribution server 30A.

[0159] When a user instructs the program renderer to play a program that is publicly available for viewing on the program distribution server 30A, the program renderer receives the script of the program distributed from the program distribution server 30A (S34, S35). Here, it is assumed that the user instructs the program to be played as a playlist, for example.

[0160] The program renderer requests music distribution server 30B, which provides a music distribution service to which the user has subscribed, to distribute the music identified by the music ID set in the received script (S36).

[0161] In response to a request from the program renderer, the music distribution server 30B checks the rights that the user has acquired through a contract with the music distribution service (S37), and if it is determined that the user has legitimate rights and is able to play the music identified by the music ID, it streams the music (S38).

[0162] As a result, the program renderer receives the streaming data of the music distributed from the music distribution server 30B and performs rendering, thereby playing the music identified by the music ID.

[0163] Furthermore, since the program script lists the song IDs of multiple songs in the order in which they are to be played, after steps S36 to S38 are completed, processing returns to step S36 (S39), and steps S36 to S39 are repeated according to the number of song IDs.

[0164] As a result, the program renderer repeatedly plays back the songs in the order of the song IDs set in the script, allowing the user to listen to the songs being played back as a playlist.

[0165] In this way, when a request for playing back a playlist is received from a user, the music piece indicated by the music piece ID included in the script is read out and provided to the user according to the script selected by the user, without reading out the introduction and conclusion included in the script.

[0166] The above describes the flow of the process executed by each device when a program of songs is played back as a playlist in a case where the introduction and end of a song can be provided using voice synthesis.

[0167] (Third example) FIG. 17 is a sequence diagram showing a process flow in the case where live voices are used to provide a musical piece that has been made into a program along with an introduction and an end of the musical piece.

[0168] In Fig. 17, a program creation tool and a program renderer are executed on the terminal devices of the creator and the user, respectively, and a program distribution service and a music distribution service are provided by each distribution server, respectively, which is similar to the first example described with reference to Fig. 15. On the other hand, in the third example of Fig. 17, unlike the first example shown in Fig. 15, a live voice distribution service is provided by voice distribution server 30C instead of a TTS service.

[0169] In steps S51 to S53 in FIG. 17, similarly to steps S11 to S13 in FIG. 15, a script for the podcast program is generated by a program creation tool and registered in the program distribution server 30A.

[0170] However, in the sequence diagram of Figure 17, the introduction and conclusion of the song are not included as text in the script, but are read out by the creator in his or her own voice, and therefore the audio data (file) is registered in the audio distribution server 30C (S54).

[0171] That is, in the script registered in the program distribution server 30A, a music ID that identifies the music piece is set, along with link information to live voice data of the introduction and conclusion.

[0172] In steps S55 and S56 of Figure 17, similar to steps S14 and S15 of Figure 15, when a command is issued to play a podcast program that is publicly available for viewing on the program distribution server 30A, the program renderer receives a script of the program distributed from the program distribution server 30A.

[0173] The program renderer accesses the audio distribution server 30C based on the link information for the introduction set at the beginning of the received script, and requests distribution of the live voice of the introduction (S57).

[0174] In response to a request from the program renderer, the audio distribution server 30C processes the live voice data of the introductory speech registered by the creator (S58), and distributes the live voice data (S59).

[0175] As a result, the program renderer receives the live voice data of the introductory speech distributed from the audio distribution server 30C and performs rendering to reproduce the live voice of the introductory speech set in the music program.

[0176] In steps S60 to S62 of FIG. 17, similar to steps S19 to S21 of FIG. 15, the program renderer plays the music streamed from the music distribution server 30B based on the music ID set following the introduction of the received script.

[0177] Thereafter, when playback of the streaming music is completed, the program renderer accesses the audio distribution server 30C based on the link information set next to the music ID in the received script, and requests live voice distribution of the latter part (S63).

[0178] In response to a request from the program renderer, the audio distribution server 30C processes the live voice data of the post-narration registered by the creator (S64), and distributes the live voice data (S65).

[0179] As a result, the program renderer receives the live voice data of the post-narration distributed from the audio distribution server 30C and performs rendering to reproduce the live voice of the post-narration part set in the music program.

[0180] In addition, since the script of the podcast program includes the song IDs of multiple songs along with link information for the live vocal introduction and conclusion of each song, after steps S57 to S65 are completed, the process returns to step S57 (S66), and steps S57 to S66 are repeated.

[0181] As a result, the program renderer repeatedly plays back the introduction, the song, and the conclusion in this order for each song ID set in the script, allowing the user to listen to the podcast program.

[0182] The above describes the flow of the processes executed by each device when using live voices to provide a musical piece that has been made into a program along with an introduction and an end of that musical piece.

[0183] (Example 4) FIG. 18 is a sequence diagram showing a process flow in playing back a program of music as a playlist in a case where the introduction and end of a music piece can be provided using live voice.

[0184] In Figure 18, the program creation tool and program renderer are executed on the terminal devices of the creator and the user, respectively, and the program distribution service, music distribution service, and live voice distribution service are provided by each distribution server, respectively, as in the third example described with reference to Figure 17.

[0185] In steps S71 to S74 of Figure 18, similar to steps S51 to S54 of Figure 17, the program script is registered in the program distribution server 30A by the program creation tool, and audio data (files) of the introductory and concluding remarks read in the creator's natural voice are registered in the audio distribution server 30C.

[0186] When a user instructs the program renderer to play a program that is publicly available for viewing on the program distribution server 30A, the program renderer receives the script of the program distributed from the program distribution server 30A (S75, S76). Here, it is assumed that the user instructs the program to be played as a playlist, for example.

[0187] The program renderer requests music distribution server 30B, which provides a music distribution service to which the user has subscribed, to distribute the music identified by the music ID set in the received script (S77).

[0188] In response to a request from the program renderer, the music distribution server 30B checks the rights that the user has acquired through a contract with the music distribution service (S78), and if it is determined that the user has legitimate rights and is able to play the music identified by the music ID, it streams the music (S79).

[0189] As a result, the program renderer receives the streaming data of the music distributed from the music distribution server 30B and performs rendering, thereby playing the music identified by the music ID.

[0190] Furthermore, since the program script lists the song IDs of multiple songs in the order in which they are to be played, after steps S77 to S79 ​​are completed, processing returns to step S77 (S80), and steps S77 to S80 are repeated.

[0191] As a result, the program renderer repeatedly plays back the songs in the order of the song IDs set in the script, allowing the user to listen to the songs being played back as a playlist.

[0192] In this way, when a request for playing back a playlist is received from a user, the music piece indicated by the music piece ID included in the script is read out and provided to the user according to the script selected by the user, without reading out the introduction and conclusion included in the script.

[0193] The above describes the flow of the process executed by each device when a program of songs is played back as a playlist in a case where the introductory and post-narrative parts of the songs can be provided using live vocals.

[0194] Incidentally, the present technology has a feature in that when playing back content such as music and its introductory and post-narrative comments, the script to be selected next is switched according to the user's interaction with the content or the comments. This technical feature will be described in more detail below with reference to the drawings.

[0195] (Example of presentation based on interaction) FIG. 19 shows an example of the presentation of a piece of music and its introduction and post-synopsis in response to user interaction.

[0196] As shown in FIG. 19, in the user terminal device 20, after the reproduction of the song A is finished, a voice is reproduced as a postscript, "I really like this song, what did you think of that song?".

[0197] At this time, if the user responds affirmatively to the postscript (Yes), the following voice is played as an introduction to the next song B: "This song is really good. With you like that...", and then the next song B is played. When the playback of song B ends, the following voice is played as an introduction: "No matter how many times I listen to it, it's the best", and then the introduction voice of the next song is played.

[0198] On the other hand, if the user responds negatively to the postscript (No), the audio "Is that so? Well, maybe..." is played as an introduction to the next song C, and then the next song C is played.

[0199] In this way, when playing a podcast program, the user terminal device 20 can change the song to be played after confirming the user's impressions of the played song. This allows the user to experience not just one-way listening to a program, but also changing the next song and its introduction and conclusion depending on the answer, for example, by asking "How was it?" after a friend plays a recommended song.

[0200] FIG. 20 shows an example of user interaction.

[0201] As shown in FIG. 20, after playback of song 1 has finished on user terminal device 20, the following audio is played as an afterword: "I really love this song. I hope everyone listening to it likes it too."

[0202] At this time, in the user terminal device 20, if the user responds to the audio played as the postscript to song 1 with the part "I love it" or "I'd be happy if you thought I liked it," it is assumed that the user agrees with the content of the postscript, and the script in agreement is selected.

[0203] Specifically, as shown by arrows T1 and T2 in the figure, if a predetermined action such as a nodding action of the user is detected during a predetermined response acceptance period when the voice "I love you" or "I would be happy if you think that I like you" is played, the user is deemed to be in agreement and the script for the agreement side is selected. In this case, in the user terminal device 20, based on the script for the agreement side, after the introductory voice of the song 2-A is played, the song 2-A is played.

[0204] Here, the reason why the response acceptance period includes the periods indicated by the arrows T11 and T21 in the figure, that is, the predetermined period after the target voice is played, is because it is necessary to receive a response from the user for a while after the voice described below is played. In other words, it is assumed that no user will respond around the beginning of the window corresponding to "I love you" or "I hope you like me."

[0205] On the other hand, if there is no reaction from the user within a specified period of time when the audio "I love you" or "I'd be happy if you think that you love me" is played, the script with no reaction is selected, and the introductory audio for song 2-B is played, followed by song 2-B.

[0206] In this way, a decision is made by applying the results of the analysis of the user response to the branching conditions described in the script of the podcast program, and the introduction, music piece, and conclusion corresponding to the branching decision result are selected from the script as the next item to be played.

[0207] FIG. 21 shows an example of a script describing the structure of a podcast program.

[0208] In FIG. 21, similar to the example script shown in FIG. 7, a song ID, a prologue, and a postscript are written as a set for each song.

[0209] That is, in the warm-up and after-song sections, comment information corresponding to comments about the music piece is written.

[0210] For example, by writing an introductory statement such as "Please listen to my favorite song, Sky High by Beautiful Summers. It always makes me so happy whenever I listen to it," and a postscript such as "I really love this song. I hope everyone listening to it likes it too," it is possible to use a TTS service to convert these texts into audio and read them out loud.

[0211] In addition, the branching conditions (branch:condition) are set as "I love you" and "I'd be happy if you thought I loved you." As branching conditions based on these conditions, a script is written for the case where "I agree" and a script is written for the case where "There is no reaction."

[0212] Specifically, the script for song 2-A (Track Number: 2-A) is written as the script for when there is consent (branch:condition:yes), and the script for song 2-B (Track Number: 2-B) is written as the script for when there is no response (branch:condition:no).

[0213] (Processing flow) FIG. 22 is a sequence diagram showing a process flow when a piece of music and its introduction and post-mentioned are presented in response to user interaction.

[0214] 22, a program creation tool and a program renderer are executed on the terminal devices of a creator and a user, respectively, and a program distribution service, a music distribution service, and a TTS service are provided by each distribution server, respectively, as in the first example described with reference to Fig. 15. Also, the consent detection process is executed by the interaction processing unit 256 of the user terminal device 20.

[0215] In steps S91 to S93 in FIG. 22, similarly to steps S11 to S13 in FIG. 15, a script for a podcast program is generated by a program creation tool and registered in the program distribution server 30A.

[0216] However, in the sequence diagram of FIG. 22, when the introduction and end of the song are included as text in the script, a branching condition according to the user's response and text regarding the song to be selected according to that branching are also included.

[0217] In steps S94 to S105 of FIG. 22, the podcast program is played back by the program renderer, as described in steps S14 to S25 of FIG.

[0218] In other words, when the program renderer is instructed to play a podcast program published on the program distribution server 30A, it accesses the music distribution server 30B and the audio distribution server 30C based on the script of the program, and repeatedly plays the introduction, music, and post-commentary in that order for each song identified by the song ID.

[0219] At this time, the user terminal device 20 judges whether or not consent is detected as a user's response to the audio of the conclusion after playing music piece 1 based on the branching conditions described in the script, and if consent is detected, the introduction, music piece 2-A, and conclusion are played based on the script for music piece 2-A (S105, S106).If consent is not detected, such as there is no user reaction, the introduction, music piece 2-B, and conclusion are played based on the script for music piece 2-B.

[0220] In addition, based on the branching conditions described in the script, if agreement is detected as the user's response to the audio of the latter part after playing song 1, the introduction, song 2-A, and the latter part are played based on the script for song 2-A, and this branching flow may be recorded as history.

[0221] This allows a user or another user to later replay a sequence that has been selectively played back by a user, such as ..., music 1, after-talk of music 1, before-talk of music 2-A, music 2-A, .... In a program that reproduces such a sequence of music, there are no branching conditions, and the music that a user followed is played back continuously as it is.

[0222] In this way, by recording the order of scripts selected in response to user interaction as a history, it becomes possible for the same user or another user to play the scripts again in the same order. Alternatively, it is also possible to play only the songs in the order indicated by the script as a playlist, without playing the introduction and conclusion of the script.

[0223] Furthermore, the creator may also be able to access the scripts recorded as history by operating the creator terminal device 10. This allows the creator to check what kind of interactions the user has performed, and to understand what kind of users like what kind of music.

[0224] The above describes the flow of the processes executed by each device when presenting a piece of music and its introduction and post-explanation in response to user interaction.

[0225] (Example of a program creation tool UI) FIG. 23 shows an example of a user interface (UI) of a program creation tool.

[0226] In FIG. 23, a program creation screen 410 is a screen that is displayed when the creator terminal device 10 executes a program creation tool, and is a UI for creating a podcast program.

[0227] The program creation screen 410 has an introductory section setting area 411 , a music piece setting area 412 , a post-opening section setting area 413 , and a branching condition setting area 414 .

[0228] The intro setting area 411 is an area for setting the intro for the Nth song. In this example, the text "Please listen to my favorite song, Sky High by Beautiful Summers. It always makes me so happy when I listen to it" is input in response to the creator's operation.

[0229] The music setting area 412 is an area for setting the Nth music piece. In this example, the music piece "sky high" by the artist "beautiful summers" is selected in response to the creator's operation. Also, the music setting area 412 displays an image of the jacket of the selected music piece.

[0230] The postscript setting area 413 is an area for setting the postscript of the Nth song. In this example, the text "I really love this song. I hope everyone listening to it likes it too" is input in response to the creator's operation.

[0231] Here, as a method of inputting the introduction and the post-explanation in the introduction setting area 411 and the post-explanation setting area 413, for example, if the creator terminal device 10 is a device such as a smartphone having a touch panel, the creator can tap the software keyboard displayed on the display unit 121 on which the touch panel is superimposed to input the desired introduction and post-explanation as text.

[0232] Alternatively, if the creator terminal device 10 can use a cloud-based voice recognition API (Application Programming Interface) service, the voice recognition service may be used to convert the voice input of the desired introduction and postscript by the creator into text. Furthermore, if the creator terminal device 10 is a device such as a personal computer having a keyboard, the creator may operate the keyboard to input the desired introduction and postscript text.

[0233] These preface and postface texts may be used as branching conditions, and the next script (music) may be selected depending on the user's interaction. In this case, the branching decision is made by analyzing the relationship between the timing of the voice reading out these texts and the timing of the user's interaction.

[0234] Furthermore, in the music setting area 412, when the creator selects a desired music piece, a music candidate list provided by the music distribution server 30B may be presented, and the creator may select a desired music piece from the music candidate list. If the candidate music pieces presented in the music candidate list already have introductions and conclusions that can be viewed, the introductions and conclusions may be presented as reference information together with the candidate music pieces.

[0235] Here, as a method of selecting a desired song in the song setting area 412, for example, if the creator terminal device 10 is a device such as a smartphone having a touch panel, the desired song may be selected by tapping, or if the creator terminal device 10 is a device such as a personal computer having a mouse, the desired song may be selected by clicking. Furthermore, a song may be selected by voice input of the song title, humming, or the like.

[0236] The branching condition setting area 414 is an area for setting a branching condition for the introduction or conclusion. In this example, in response to the creator's operation, "I love you" and "I hope you like me" are selected from the conclusion sentence as parts that are expected to elicit a user reaction, and it is selected what kind of reaction the user has to the selected parts to cause a branch.

[0237] Here, song 2-A is set as the N+1 song to be played when the user reacts (Reaction:Consent) to the selected portion, and an introduction and an end of song 2-A are also set. Also, song 2-B is set as the N+1 song to be played when the user does not react (No Reaction) to the selected portion, and an introduction and an end of song 2-B are also set.

[0238] When setting the branching conditions or selecting music in the branching condition setting area 414, the input methods described above and below or the method of selecting a desired music can be used.

[0239] In addition, when setting the next song (the N+1th song) according to the branching condition, it is necessary to provide songs according to the user's reaction, and simply presenting a list of song candidates may not allow the user to select an appropriate song. Therefore, when setting the next song, for example, the following song selection support function may be provided.

[0240] That is, in response to a question about whether a song is liked or disliked, the like branch would be recommended songs with the same tendency (songs that are likely to be liked) or songs with a cooperative recommendation system such as "people who like this song also like this song." On the other hand, the dislike branch or the no response branch would be recommended songs with a different tendency.

[0241] In addition, when setting the branching conditions, a function of supporting music selection may be provided by giving meaning to the branching.

[0242] For example, as shown in Fig. 24, the branching conditions can be set so that "agree" means that a song with the same tendency (similar song) is presented as the next song, and "disagree" means that a song with the opposite tendency (dissimilar song) is presented as the next song. Furthermore, "no reaction" can be set so that a song other than songs with the same tendency and songs with the opposite tendency is presented as the next song.

[0243] Then, when a branch such as "Agree," "Disagree," or "No response" is selected in response to the creator's operation, a recommended song for the next song is presented in accordance with the type of branch selected.

[0244] For example, as shown in Fig. 25, when "Agree" is selected as a branching condition for the introduction, music, or conclusion of the Nth music piece using a program creation tool, candidate music pieces 1 to 4 that have the same tendency as the Nth music piece are presented as the N+1th candidate music piece for the Agree branch. Music pieces with the same tendency may include similar music pieces such as music pieces in the same genre, music pieces that have been analyzed in the same way by collaborative analysis, and music pieces with the same tendency of BPM (Beats Per Minute) by acoustic analysis. Music pieces that the user has listened to in the past may also be presented.

[0245] Although not shown in the figure, when "disagree" is selected as the branching condition, candidate songs with opposing tendencies are presented. Also, although explanation is omitted to avoid repetition, branching conditions and songs can be set in the same way for songs N+2 and onward.

[0246] (Overall processing) 26 to 28 are flowcharts illustrating an overall picture of the processing in the first embodiment.

[0247] The processing shown in Figures 26 to 28 is realized by the cooperative operation of the creator terminal device 10 (its control unit 100), the user terminal device 20 (its control unit 200), and the distribution server 30 or the processing server 30D (its control unit 300) in a content provision system to which the present technology is applied.

[0248] That is, this process is executed by at least one of the control units 100, 200, and 300.

[0249] In the content providing system 1, as shown in FIG. 26, when there is input from a creator using the creator terminal device 10 ("Yes" in S211), a script consisting of content identification information and comment information corresponding to comments on the content is generated based on the input (S212), and the script is stored in a specified storage medium so as to be viewable by a user using the user terminal device 20 (S213).

[0250] Here, the content includes songs distributed by a music distribution service, and the identification information of the content includes a song ID that can identify the song. The comments are, for example, an introduction and an endnote set for the song, and at least one of the introduction and the endnote may be set. For example, when making songs into a program, in addition to inserting an introduction or endnote for each song, a narration or the like may be inserted as an introduction, and then three songs may be played in succession, or four songs may be played in succession, and then impressions of the songs may be inserted as an endnote.

[0251] The comment information includes text representing the comment, or link information to the live voice of the creator, etc. The comment information will be described as corresponding to a comment on the content, but is not necessarily related to the content, and may correspond to a comment unrelated to the content. The predetermined storage medium may be, for example, the storage unit 307 (database 353) of the program distribution server 30A.

[0252] Scripts can include branching conditions to switch which script to select next based on user interactions, which can include positive interactions such as agreement or empathy, as well as negative interactions such as no response.

[0253] In addition, in the content providing system 1, as shown in FIG. 27, when a user makes a request to play a script stored in a specified storage medium ("Yes" in S231), the content indicated by the content identification information included in the script is read out and provided to the user (S232).

[0254] Here, the content identification information includes a music ID that can identify a music piece. When reading out the content indicated by the content identification information, the user can use the rights that the user has already acquired by contracting with a specific service. For example, the specific service is a music distribution service, and the rights that the user has already acquired include the rights of a paid premium user and a free user.

[0255] Furthermore, the content providing system 1 is controlled so that before or after providing the content, a comment is read out in accordance with the comment information included in the script and provided to the user (S233).

[0256] Here, the comment includes at least one of a preface and a postface, and the preface and postface that are read out in accordance with the comment information of the script include voice such as TTS voice or live voice.

[0257] The comments indicated by the comment information (text such as introduction and conclusion) may be converted (translated) into a foreign language and provided to the user. For example, if the system knows the user's profile and knows the user's native language, the comments may be converted into the native language and provided to the user as text, or the text may be synthesized by TTS and the synthesized voice result provided to the user.

[0258] Furthermore, in the content providing system 1, as shown in FIG. 28, when a user using the user terminal device 20 interacts with content or a comment ("Yes" in S251), the content providing system 1 is controlled so that the next script to be selected is switched in accordance with the user's interaction (S252).

[0259] Here, the interaction includes positive interactions such as agreement and sympathy, and negative interactions such as no reaction. When switching the script to be selected next, a branching condition included in the script is used.

[0260] In this specification, the smallest unit of a "script" is "introduction / post-explanation+contents," and a program can be expressed by arranging, for example, "introduction+contents+post-explanation," "introduction+contents+post-explanation," and "introduction+contents+post-explanation." Thus, a "script" can express "a part of a program" or "the entire program." Here, the above "introduction / post-explanation" may be audio data or text information expressing a comment, or identification information or link information pointing to them. Furthermore, the content may be audio data or video data, or identification information or link information pointing to them.

[0261] As described above, when making content into a program, the content and the comments on the content are provided together by utilizing the user's contract with the service, text-to-speech synthesis, etc., so that the content and the comments can be provided more easily. Furthermore, when providing the content and the comments, the script to be selected next is switched according to the user's interaction, so that the content and the comments suited to the user can be provided.

[0262] <2. Second embodiment>

[0263] In the content providing system 1, an evaluation of content by a user using the user terminal device 20 may be identified by detecting the user's physical movements, such as behavior, or emotional movements.

[0264] For example, when a user is getting into the rhythm of a song being played, he or she may sway their body or sing along with the song, and detecting these actions can be used to evaluate the user's performance of the song. Hereinafter, the state in which a user is getting into the rhythm of a song being played will be referred to as "getting into the rhythm," and the process for detecting "getting into the rhythm" will be referred to as "deep groove detection."

[0265] (Example of presentation based on glue detection) FIG. 29 shows an example of a process for detecting glue.

[0266] In FIG. 29, a groove detection unit 271 performs groove detection using playback song information related to the song being played based on detection results from a BPM detection unit 272, a singing voice detection unit 273, and an emotion detection unit 274, and detects whether the user is keeping up with the rhythm of the song being played.

[0267] The result of the nori detection is used for judgment (branch judgment) using the branch conditions described in the script (the branch conditions described above and below). The result of the nori detection is not limited to the binary value of the presence or absence of nori motion, i.e., "with nori" and "without nori", but may be determined by degree.

[0268] The BPM detection unit 272 detects BPM (Beats Per Minute) based on sensor data from a sensor 213-1 attached to the user's body or the like, and supplies the BPM to the rhythm detection unit 271. The sensor 271-1 may be the sensor unit 213 provided in the user terminal device 20, or may be another sensor. When detecting the BPM, captured image data obtained by capturing an image with the camera unit 212 or the like may be used.

[0269] The singing voice detection unit 273 detects the user's singing voice based on the voice data corresponding to the sound collected by the microphone 213-2, and supplies the detected singing voice to the rhythm detection unit 271. The detected singing voice is not limited to the lyrics of the song, because the user does not necessarily sing the lyrics as they are. The microphone 213-2 can be the sensor unit 213 (sound sensor) provided in the user terminal device 20.

[0270] The emotion detection unit 274 detects emotions such as the user's emotional reactions based on sensor data from the sensor 213-3 attached to the user's body or the like, and supplies the detected emotions to the groove detection unit 271. The sensor 271-3 may be a dedicated sensor (such as a pulse sensor) or a combination of multiple sensors, and may be included in the sensor unit 213 provided in the user terminal device 20.

[0271] The rhythm detection section 271, the BPM detection section 272, the singing voice detection section 273, and the emotion detection section 274 can be provided as functions of the interaction processing section 256 (FIG. 12) of the control section 200.

[0272] FIG. 30 shows an example of program branching in response to groove detection.

[0273] As shown in FIG. 30, in the user terminal device 20, after the reproduction of the piece of music 1 is finished, a voice saying "I really love this piece of music..." is reproduced as an afterword.

[0274] At this time, in the user terminal device 20, groove detection is performed to detect whether or not the user is making groove movements such as tapping along to the rhythm or getting into the rhythm while listening to the song 1, and a branching decision is made using the detection result.

[0275] As for the presence or absence of this groove movement, for example, if periodic movements of the user's body (hands, feet, head, whole body, etc.) are observed that are in the same cycle as the BPM of song 1, or if the user is singing along with song 1, then it is deemed that there is "groove movement," as described above with reference to Figure 29.

[0276] In the user terminal device 20, if the user's response when listening to a song is "groovy" based on the result of the groove detection, the script for the "groovy" side is selected, and after the introductory audio of song 2-A is played, song 2-A is played.

[0277] On the other hand, in the user terminal device 20, if the user's response when listening to a song is "not in tune (still moving)" based on the detection result of the groove detection, the script for "not in tune (still moving)" is selected, and after the introductory audio for song 2-B is played, song 2-B is played.

[0278] In this way, a judgment is made by applying the detection results of the rhythm detection to the branching conditions described in the script of the podcast program, and a set of introduction, music, and conclusion corresponding to the branching judgment result is selected from the script as the next item to be played.

[0279] In the example of Fig. 30, the branching is performed depending on the presence or absence of the rhythmic motion of "grooving" or "not grooved", but the branching may be changed depending on the type of user's response. Specifically, if the type of user's response is to go along with the rhythm of song 1, the branching may be performed to song 3-A, if the response is to hum the melody of song 1, the branching may be performed to song 3-B, and if no reaction from the user is observed, the branching may be performed to song 3-C.

[0280] FIG. 31 shows an example of a script describing the structure of a podcast program.

[0281] In FIG. 31, similar to the examples of the script shown in FIG. 7 and FIG. 21, a song ID, a prologue, and a postscript are described as a set for each song.

[0282] That is, in the warm-up and after-song sections, comment information corresponding to comments about the music piece is written.

[0283] In addition, upbeat is set as the branching condition (branch:type), and a script for the case of "with rhythm" and a script for the case of "without rhythm (not moving)" are written respectively.

[0284] Specifically, the script for song 2-A (Track Number: 2-A) is written as the script for "with rhythm" (branch:type:upbeat:yes), and the script for song 2-B (Track Number: 2-B) is written as the script for "without rhythm (no movement)" (branch:type:upbeat:no).

[0285] (Processing flow) FIG. 32 is a sequence diagram showing a process flow when a piece of music and its introduction and post-mentioned are presented in accordance with groove detection.

[0286] In Fig. 32, the program creation tool and the program renderer are executed on the terminal devices of the creator and the user, respectively, and the program distribution service, the music distribution service, and the TTS service are provided by the respective distribution servers, similar to the first example described with reference to Fig. 15. Also, the groove detection process is executed by the interaction processing unit 256 of the user terminal device 20.

[0287] In steps S111 to S113 in FIG. 32, similarly to steps S11 to S13 in FIG. 15, a script for the podcast program is generated by a program creation tool and registered in the program distribution server 30A.

[0288] However, in the sequence diagram of FIG. 32, when the introduction and end of the song are included as text in the script, a branching condition according to the user's response and text regarding the song to be selected according to that branching are also included.

[0289] In steps S114 to S125 of FIG. 32, the podcast program is played back by the program renderer, as described in steps S14 to S25 of FIG.

[0290] In other words, when the program renderer is instructed to play a podcast program published on the program distribution server 30A, it accesses the music distribution server 30B and the audio distribution server 30C based on the script of the program, and repeatedly plays the introduction, music, and post-commentary in that order for each song identified by the song ID.

[0291] At this time, the user terminal device 20 judges whether or not the user is responding to the reproduced music piece 1 with a groove action based on the branching conditions described in the script, and if the user is responding with a groove action, the introduction, music piece 2-A, and the end are reproduced based on the script for music piece 2-A (S125, S126). If the user is responding without a groove action, the introduction, music piece 2-B, and the end are reproduced based on the script for music piece 2-B.

[0292] The above describes the flow of the process executed by each device when presenting a piece of music and its introduction and post-notes in response to rhythm detection.

[0293] <3. Third embodiment>

[0294] In the user terminal device 20, information agreed to by the user with respect to the audio played back as the introduction or conclusion may be collected, and the user's preference information may be generated and used for recommending songs, automatically generating introductions and conclusions, etc. Here, the user's preference information can be generated regardless of the presence or absence of branching conditions described in the script.

[0295] In other words, the user is deemed to agree with a particular comment based on the user's interactions during a particular period of time corresponding to the period during which preface and postface comments are provided to the user, and user preference information is generated.

[0296] (Example of generating preference information) FIG. 33 shows an example of preference information that can be acquired from reactions to the introduction and post-presentation.

[0297] As shown in FIG. 33, after the playback of the piece of music 1 ends, the user terminal device 20 plays back a voice saying, "This guitar phrase is the best! It's electrifying!" as a postscript.

[0298] At this time, in the user terminal device 20, if the user's reaction to the audio played back as a follow-up is shown to be "That's right! It's thrilling!" as indicated by the arrow T3 in the figure, then there is a possibility that the user likes Mr. A, the guitar player of Song 1.

[0299] FIG. 34 shows examples of pre-explanation and post-explanation types that are correlated with the acquisition of user preference information.

[0300] 34, an example belonging to the category of "likes and dislikes" is a comment (introduction and conclusion) about a song, "This song is great!", and preference information regarding likes and dislikes of a song can be obtained according to the user's reaction to this comment (agreement, etc.). Also, an example belonging to the category of "impressions of a song, etc." is a comment, "It makes me feel very sad!", and preference information regarding impressions of a song can be obtained according to the user's reaction.

[0301] An example of the "When do you want to listen to it?" category is the comment "It's a perfect song for driving!", and preference information about the time when you want to listen to music can be obtained based on the user's response. Also, an example of the "Music composition" category is the comment "I can't get enough of the chord progression!", and preference information about a favorite chord progression can be obtained based on the user's response.

[0302] An example of a comment that belongs to the category of "quality of performance" is "The guitar is great!", and preference information about a favorite guitarist can be obtained based on the user's response. An example of a comment that belongs to the category of "song evaluation" is "It's a great song!", and preference information about whether the user likes or dislikes a song can be obtained based on the user's response.

[0303] In this way, by analyzing the user's reaction (such as agreement) to the introduction and conclusion, for example, when the user says "I like this kind of music," it is possible to analyze preference information such as "what exactly do you like about it?" and "when do you like to listen to it?" The preference information acquired in this way can be used for recommending music, automatically generating introductions and conclusions that evoke empathy, and so on.

[0304] For example, if the postscript mentioned above, "This guitar phrase is great, isn't it!...", is played after song 1, the reaction of the user who listens to the postscript will be analyzed and preference information will be generated, regardless of whether or not there are branching conditions written in the script.

[0305] FIG. 35 shows a flow of generating preference information in response to a comment.

[0306] In FIG. 35, the agreement detection unit 281 detects a user's response, such as a nod, based on sensor data from the sensor unit 213 to determine whether the user agrees with the earlier or later explanation, and supplies the determination result to the rendering unit 254.

[0307] The renderer unit 254 identifies the position of the user's response based on the determination result from the agreement detection unit 281. In this example, it is identified that the response occurred at the "guitar..." portion described later, and the identification result is supplied to the preference analysis unit 282.

[0308] The preference analysis unit 282 analyzes and classifies the introduction and conclusion sentences written in the script. In this example, information about Mr. A, the guitar player of Song 1, is analyzed, and the conclusion is classified as "quality of performance." Furthermore, the preference analysis unit 282 detects the content of the user's consent based on the analysis and classification results of the conclusion and the identification results from the renderer unit 254.

[0309] In this example, since the user nods at the "guitar..." part described later, preference information is generated that "the user likes guitar player A." The preference information is recorded and accumulated in a predetermined storage medium such as database 353. As a result, information about guitar player A is included in the preference information of the user.

[0310] It should be noted that since there is a possibility that the same information is repeatedly acquired within another program, such information can also be accumulated in the database 353 or the like and used to generate user preference information.

[0311] The agreement detection unit 281 can be provided as a function of the interaction processing unit 256 (FIG. 12) of the control unit 200. The preference analysis unit 282 can be provided as a function of the interaction processing unit 256 (FIG. 12) of the control unit 200 or the processing unit 352 (FIG. 14) of the control unit 300.

[0312] (Processing flow) FIG. 36 is a sequence diagram showing a process flow when generating preference information in response to a pre- and post-explanation.

[0313] In Fig. 36, the program creation tool and the program renderer are executed on the terminal devices of the creator and the user, respectively, and the program distribution service, the music distribution service, and the TTS service are provided by the distribution servers, respectively, as in the first example described with reference to Fig. 15. Also, the agreement detection process is executed by the agreement detection unit 281 of the user terminal device 20, and the preference analysis process is executed by the preference analysis unit 282 of the processing server 30D.

[0314] In steps S131 to S133 in FIG. 36, similarly to steps S11 to S13 in FIG. 15, a script for the podcast program is generated by a program creation tool and registered in the program distribution server 30A.

[0315] However, in the sequence diagram of Figure 36, when the introduction and conclusion of the song are included as text in the script, it is possible to include or not include text regarding the branching conditions based on the user's response and the song to be selected based on that branching.

[0316] In steps S134 to S145 of FIG. 36, the podcast program is played back by the program renderer, as described in steps S14 to S25 of FIG.

[0317] In other words, when the program renderer is instructed to play a podcast program published on the program distribution server 30A, it accesses the music distribution server 30B and the audio distribution server 30C based on the script of the program, and repeatedly plays the introduction, music, and post-commentary in that order for each song identified by the song ID.

[0318] At this time, the user terminal device 20 detects the user's consent to the reproduced introduction or conclusion, and extracts the sentences of the agreed-upon parts (S146, S147). Then, the processing server 30D transmits the sentences of the agreed-upon parts and analyzes them, thereby generating and storing the user's preference information (S148, S149).

[0319] The above describes the flow of the processes executed by each device when generating preference information in response to the previous and subsequent reactions.

[0320] <4. Fourth embodiment>

[0321] A program may be automatically generated as a podcast program by creating a template using an introduction and an endnote. For example, a three-act structure is known as a common structure for movie scripts, and just like movies, there is a flow of music that users find comfortable. Therefore, if this flow of music can be extracted and a program with music that follows the same flow can be generated, it will be possible to provide a program that satisfies users.

[0322] In the content providing system 1, a podcast program is replaced with a music information classification, and the flow of music is made into a template. When classifying music, for example, the music can be classified by analyzing metadata attached to the music, the music itself, or the introduction and conclusion of the music.

[0323] In the analysis of the introduction and end of a song, the classification may be weighted using the user's agreement with the introduction and end of a song, where the assumption is that the user's agreement indicates that the introduction and end of a song are highly credible.

[0324] Furthermore, the content providing system 1 uses templates to automatically select music pieces and automatically generate podcast programs.

[0325] For example, a program with a good musical flow is extracted from existing programs, made into a template, and a new program is generated by automatically selecting musical pieces using the template. At this time, the rhythm and playback status of the musical pieces in the program may be used to assign a score and select the musical pieces.

[0326] Also, for example, a template may be used to generate a program for a specific user. That is, a program that has been highly rated by a specific user may be extracted and made into a template, and the template may be used to select music for that user, thereby automatically generating the program.

[0327] Also, for example, a template may be used to generate a program with the same flow as a program created by a user. That is, a template for a selected program is generated, and multiple candidate songs are presented according to the template, and the creator selects a desired song from the presented candidate songs, and a program is generated using the selected songs. When presenting the candidate songs, artists that the user likes and has given "likes" to, songs that the user has played in the past, etc. may be presented preferentially.

[0328] Furthermore, when generating a template, the branching conditions written in the script may be left as they are, so that when the template is used, a musical sequence that a user has once followed can be extracted and reproduced (replayed).

[0329] For example, in the sequence diagram shown in Figure 22 above, if agreement is detected as a user response to the audio for the end of song after playing song 1 based on the branching conditions described in the script, the introduction, song 2-A, and end are played based on the script for song 2-A, and this branching flow is recorded.

[0330] This allows a user or another user to later reproduce a sequence that was selectively played by a user, such as ..., music 1, after-talk of music 1, before-talk of music 2-A, music 2-A, .... In a program that reproduces such a sequence of music, there are no branching conditions, and the music that a user followed is played continuously as it is.

[0331] (Example of program generation using templates) FIG. 37 shows the flow of creating a program template and generating a program using that template.

[0332] 37, a music information management service is provided by music information management unit 371. In this music information management service, when a creator generates a script for a podcast program, analysis results of the music of the music ID included in the script and analysis results of the introduction and conclusion are acquired and registered in music management information DB 381. In music management information DB 381, detailed information of the music is accumulated for each music ID by registering the analysis results of the music and the introduction and conclusion.

[0333] Furthermore, a template generation service is provided by the program template generation unit 372. In this template generation service, when using information related to a program extracted by the program extraction unit 373, a program template is generated by inquiring of the music information management service and referring to detailed information about the music.

[0334] The program extraction unit 373 extracts highly rated programs from among registered programs by appropriately referring to a program management DB 382 that manages podcast programs and a program evaluation data DB 383 that manages evaluation data such as the rhythm of the music in the programs. Note that, although the case where highly rated programs are extracted as the programs to be extracted is exemplified here, programs may be extracted based on other criteria, such as programs with excellent music flow.

[0335] The program generating unit 374 generates a new program using the template generated by the program template generating unit 372. When a new program is generated, detailed information about the songs in the program and information about similar songs may be registered in the song management information DB 381.

[0336] The music information management unit 371, the program template generation unit 372, the program extraction unit 373, and the program generation unit 374 can be provided as functions of the processing unit 352 (FIG. 14) of the control unit 300, but a different processing server 30D can be used for each service. The music management information DB381, the program management DB382, and the program evaluation data DB383 are included in the database 353.

[0337] (Processing flow) FIG. 38 is a sequence diagram showing the process flow when generating a template.

[0338] In FIG. 38, the program distribution service is provided by a program distribution server 30A, and the music information management service, music analysis service, pre-explanation / post-explanation analysis service, and template generation service are provided by a processing server 30D.

[0339] The music analysis service performs analysis (BPM, etc.) of music that can be distributed in advance, and provides the analysis results to the music information management service (S151, S152). In addition, when a creator uses a program creation tool to generate a script for a podcast program and registers it in the program distribution server 30A, the music information management service is provided with the music ID and information on the introduction and conclusion included in the script (S153, S154).

[0340] The music information management service obtains the analysis results of the introduction and conclusion by sending the information about the introduction and conclusion to the introduction and conclusion analysis service (S155, S156). As a result, the music information management service obtains the analysis results of the music and the analysis results of the introduction and conclusion, and registers them in the music management information DB 381. The music information management service then notifies the program distribution service of the completion of registration (S157).

[0341] When a creator or a user instructs the template generation service to create a template from a program (S158), the template generation service requests the program to be created as a template from the program distribution service, and obtains the script sent as a response (S159, S160). For example, the target programs may include programs with excellent musical flow, highly rated programs, etc.

[0342] The template generation service can also obtain analysis results of the music, introduction, and conclusion for each music ID by inquiring of the music information management service using the music ID, introduction, and conclusion included in the acquired script (S161 to S163). Then, the template generation service generates a program template based on the acquired analysis results, and registers it in the program distribution server 30A (S164, S165).

[0343] As a result, the content providing system 1 has in advance a template indicating the order of recommended scripts, so that, for example, when there is input from a creator using the creator terminal device 10, the system can present the next script to be selected as a recommendation in accordance with the template, based on the song indicated by the song ID included in the script and the introduction and conclusion.

[0344] Since it is expected that information about songs and introductions and conclusions will change each time they are used in a program, the analysis results registered in the song information management service will be updated accordingly. It is also possible to handle cases where multiple introductions and conclusions are added to one song.

[0345] The above describes the flow of the processes executed by each device when generating a template.

[0346] In the content providing system 1, a template showing the order of recommended scripts is held in advance, so that it is possible to present the script to be selected next as a recommendation according to the template based on the song indicated by the song ID included in the current script and the introduction and conclusion, but it is also possible to visualize the contents of the template, such as the BPM of the song and the characteristics of each instrument part. The creator may operate the creator terminal device 10 to select the script to be selected next while referring to this template.

[0347] A mechanism may be provided in which a creator operates the creator terminal device 10 to generate a new program script by referring to a template showing the recommended script order, uploads the script to the program distribution server 30A, and shares the process of creating the program script, including how to use the template, with other users. Furthermore, when a new program script created by re-editing another user's script is shared, the other user who created the original script may be notified of this.

[0348] <5. Fifth embodiment>

[0349] In the content providing system 1, the introductory and post-argument statements that are most commonly agreed upon can be analyzed, and the analysis results can be assigned as the characteristics of the song.

[0350] In other words, when it is determined that a user agrees with a comment based on the user's interaction during a specified period corresponding to the period during which introductory and post-narrative comments are provided to the user, features obtained by analyzing the comment are assigned to the content, such as a song.

[0351] (Processing flow) FIG. 39 is a sequence diagram showing a process flow when characteristics obtained by analyzing the introduction and conclusion are imparted to a piece of music.

[0352] The program renderer is executed by the user terminal device 20, and the program distribution service, music distribution service, and TTS service are provided by the respective distribution servers, similar to the first example described with reference to Fig. 15. The agreement detection process is executed by the user terminal device 20. The music feature analysis service and music feature management service are provided by the processing server 30D.

[0353] In steps S171 to S182, the podcast program is played back by the program renderer, as described in steps S14 to S25 of FIG.

[0354] In other words, when the program renderer is instructed to play a podcast program published on the program distribution server 30A, it accesses the music distribution server 30B and the audio distribution server 30C based on the script of the program, and repeatedly plays the introduction, music, and post-commentary in that order for each song identified by the song ID.

[0355] At this time, in the user terminal device 20, if the user's consent to the postscript reproduced based on the script is detected, a consent sentence corresponding to the agreed part is extracted from the postscript (S183, S184). The extracted consent sentence is sent to the music feature analysis service and analyzed (S185, S186).

[0356] When analyzing the agreement contained in the disclaimer, the analysis results can be accumulated and scored. In addition, when a certain number of users are deemed to agree with the disclaimer (or the agreement), the characteristics obtained by analyzing the agreement are defined as the characteristics of the song. The characteristics of the song obtained in this way are sent to a song characteristic management service, where they are managed, and assigned to the song (S187).

[0357] The above describes the flow of the process executed by each device when the features obtained by analyzing the above and following descriptions are imparted to a piece of music.

[0358] Furthermore, in the content providing system 1, a program consisting of multiple scripts can be automatically generated based on the characteristics obtained by analyzing the comments in the introduction, conclusion, etc. In other words, multiple scripts are automatically selected based on the characteristics (music characteristics) given to the content such as music.

[0359] (Processing flow) FIG. 40 is a sequence diagram showing the process flow when generating a podcast program based on features given to music pieces.

[0360] In FIG. 40, a program distribution service is provided by a program distribution server 30A, and a music feature management service, a program creation service, and a text expression conversion service are provided by a processing server 30D.

[0361] The program production service requests the music feature management service to perform a search using music features, and obtains a music ID list in response (S191, S192).The program production service also uses the obtained music ID list to send music IDs to the program distribution service (S193).The program distribution service then returns a set of introductions and conclusions for the music corresponding to the music IDs from the program production service (S194, S195).

[0362] In the program generation service, N song IDs obtained from a song ID list, which is a search result using the characteristics of the songs, are sequentially sent to the program distribution service, and the introduction and end of the song corresponding to the song ID are repeatedly obtained (S193 to S196).

[0363] In addition, the program creation service can unify the expressions of the introduction and the closing remarks by sending the acquired introduction and closing remarks to a text expression conversion service (S197 to S199). For example, if the introduction and closing remarks are created by different creators, there is a risk that the expressions will vary even for words with similar meanings, such as "right" and "right?", so the text expression conversion service is used to unify the text expressions.

[0364] Then, in the program generation service, a script for a podcast program is generated using N song IDs and the introduction and conclusion after text expression conversion obtained for each song ID, and the script is registered in the program distribution server 30A (S200, S201).

[0365] The above has described the flow of the processes executed by each device when generating a podcast program based on features assigned to music pieces.

[0366] <6. Variations>

[0367] (How to play comments) You can also search for the introduction and conclusion of a song and play the search results together. Here, you can create tags for songs and play songs together by tag, so that you can play songs that are restricted to the guitar of a guitarist, for example.

[0368] Furthermore, if the introduction and conclusion obtained as search results were created by different creators, there is a risk that even phrases with similar meanings, such as "right" and "that's right," will be expressed in different ways. To prevent this, a sentence expression conversion service is used to unify the sentence expression, for example by changing the tone without changing the meaning (for example by converting it into a certain dialect).

[0369] Furthermore, if the creator does not permit such functions, it will not be possible to use the introductory and post-introductory portion of just one song from a program or to convert written expressions, so you will have to select from those permitted by the creator.

[0370] In this way, when creating a podcast program, not only the music but also the comments in the introduction and closing remarks can be quoted and made into a program. In other words, the comments in the introduction and closing remarks are not just metadata that simply describes the music, but are also important sources of information that show what makes a music piece popular. In other words, after the podcast program is created, the quality of the comments in the introduction and closing remarks can be improved by user responses.

[0371] (Support for devices without interaction detection function) In the above explanation, various embodiments of the content providing system 1 have been described in which the next script to be selected is changed depending on the user's interaction with the content and comments indicated by the script. However, if the user terminal device 20 is a headphone or speaker that does not have the function of detecting user interaction, the program may be played according to a default playback route set in advance in the script or the most popular playback route.

[0372] (Other examples of interactions) If fatigue is detected based on the user's interaction with the content and comments indicated by the script (reaction speed, size of gestures, volume, etc.), the BPM of the song currently being played may be lowered, or the BPM of the song indicated by the script to be selected next may be controlled to be relatively slow.

[0373] <7. Computer Configuration>

[0374] The processing of each step in the above-mentioned flowchart can be executed by hardware or software. When a series of processes is executed by software, a program constituting the software is installed in the computer of each device.

[0375] The program executed by the computer can be provided by being recorded on a removable recording medium such as a package medium, etc. The program can also be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting.

[0376] In a computer, the program can be installed in the storage unit via the input / output I / F by inserting a removable recording medium into a drive. The program can also be received by a communication unit via a wired or wireless transmission medium and installed in the storage unit. Alternatively, the program can be pre-installed in the ROM or storage unit.

[0377] Here, in this specification, the processing performed by a computer according to a program does not necessarily have to be performed in chronological order according to the order described in the flowchart. In other words, the processing performed by a computer according to a program also includes processing executed in parallel or individually (for example, parallel processing or processing by objects).

[0378] The program may be processed by one computer (processor), or may be distributed among a plurality of computers. Furthermore, the program may be transferred to a remote computer for execution.

[0379] Furthermore, in this specification, a system refers to a collection of multiple components (devices, modules (parts), etc.), regardless of whether all the components are in the same housing. Therefore, multiple devices housed in separate housings and connected via a network, and a single device in which multiple modules are housed in a single housing, are both systems.

[0380] The embodiments of the present technology are not limited to the above-described embodiments, and various modifications are possible without departing from the spirit of the present technology. For example, the present technology can be configured as cloud computing in which one function is shared and processed jointly by multiple devices via a network.

[0381] Each step described in the above flow chart can be executed by one device or can be shared among multiple devices. Furthermore, when one step includes multiple processes, the multiple processes included in the step can be executed by one device or can be shared among multiple devices.

[0382] Furthermore, the effects described in this specification are merely examples and are not limiting, and other effects may also be obtained.

[0383] The present technology can be configured as follows.

[0384] (1) a script including identification information of the content and comment information corresponding to the comment, the script being generated by the creator, is stored in a predetermined storage medium so as to be viewable by a user; controlling the reading of content indicated by content identification information included in a script selected by a user to be executed and provided to the user, and controlling the reading of comments according to comment information included in the script at least either before or after the provision of the content to be provided to the user; Controlling to switch the next selected script in response to the user's interaction with the content or the comment. Equipped with a control unit Content delivery system. (2) The control unit controls to switch the next selected script in response to an interaction by the user with the comment. The content providing system according to (1) above. (3) The control unit determines that the user agrees with a comment in response to an interaction of the user during a predetermined period corresponding to a period during which the comment is provided to the user, and controls to switch a script to be selected next. The content providing system according to (2) above. (4) The control unit performs control so as to determine that the user agrees with a certain comment in response to an interaction of the user during a certain period corresponding to a period during which the comment is provided to the user, and to generate user preference information. The content providing system according to (3) above. (5) When the control unit determines that a certain number of users agree with a certain comment in response to user interactions during a certain period corresponding to a period during which the comment is provided to the users, the control unit assigns a feature obtained by analyzing the certain comment to the content. The content providing system according to (3) above. (6) The control unit automatically selects a plurality of the scripts based on a feature given to the content. The content providing system according to (5) above. (7) The control unit converts the comment information included in the selected plurality of scripts so that the sentence expressions of the comments indicated by the comment information are unified. The content providing system according to (6) above. (8) The control unit controls, when the user agrees with the comment, to switch the next selected script to a script having content identification information indicating content similar to the content. The content providing system according to (2) above. (9) The control unit controls to record the order of the scripts selected in response to the user's interaction as a history, so that the user can replay the scripts in the same order again. The content providing system according to (1) above. (10) The control unit controls the reading of the content indicated by the content identification information included in the script selected by the user, using the right already acquired by the user through a contract with a specific service, and provides the content to the user. A content providing system according to any one of (1) to (9). (11) The control unit is a function of generating a script including content identification information and comment information based on an input from a creator, and storing the script in a predetermined storage medium so that the script can be viewed by a user; The system further has a function of setting information indicative of a user's interaction and a script to be selected next when the interaction is detected, in the script based on an input from a creator. The content providing system according to (1) above. (12) The control unit is A function of setting a part of a comment corresponding to the comment information, Depending on the user's interaction during a predetermined period corresponding to the period during which a part of the set comment is provided to the user, the user is considered to agree with the comment, and control is performed to switch to a script to be selected next. The content providing system according to (11) above. (13) It comes with a template that shows the recommended script order. The control unit performs control so as to present a script to be selected next as a recommendation according to the template, based on the content indicated by the content identification information included in the script and the comment indicated by the comment information. The content providing system according to (11) above. (14) The control unit controls to switch the script to be selected next depending on the viewing status of the content by the user. The content providing system according to (1) above. (15) The control unit controls to switch the script to be selected next in response to a physical or emotional movement of the user. The content providing system according to (14) above. (16) The control unit detects an interaction of the user based on sensor data obtained by performing sensing on the user. A content providing system according to any one of (1) to (15). (17) The content includes music, The comment includes at least one of an introduction and an end of the song set to the music piece, The specific service includes a music distribution service to which the user subscribes. A content providing system according to any one of (1) to (10). (18) a first terminal device used by the creator; a second terminal device used by the user; a first server having the predetermined storage medium storing the script; a second server that distributes the content; A content providing system according to any one of (1) to (17) including: (19) a script including identification information of the content and comment information corresponding to the comment, the script being generated by the creator, is stored in a predetermined storage medium so as to be viewable by a user; controlling the reading of content indicated by content identification information included in a script selected by a user to be executed and provided to the user, and controlling the reading of comments according to comment information included in the script at least either before or after the provision of the content to be provided to the user; Controlling to switch the next selected script in response to the user's interaction with the content or the comment. How content is provided. (20) Computer, a script including identification information of the content and comment information corresponding to the comment, the script being generated by the creator, is stored in a predetermined storage medium so as to be viewable by a user; controlling the reading of content indicated by content identification information included in a script selected by a user to be executed and provided to the user, and controlling the reading of comments according to comment information included in the script at least either before or after the provision of the content to be provided to the user; Controlling to switch the next selected script in response to the user's interaction with the content or the comment. A storage medium that records a program for functioning as a control unit. [Explanation of symbols]

[0385] 1 Content providing system, 10 Creator terminal device, 20 User terminal device, 30 Distribution server, 30A Program distribution server, 30B Music distribution server, 30C Audio distribution server, 30D Processing server, 50 Network, 100 Control unit, 101 CPU, 102 ROM, 103 RAM, 104 Bus, 105 Input unit, 106 Output unit, 107 Memory unit, 108 Communication unit, 109 Near field wireless communication unit, 110 Input / output I / F, 111 Operation unit, 112 Camera unit, 113 Sensor unit, 121 Display unit, 122 Sound output unit, 151 Input reception unit, 152 Music information acquisition unit, 153 Program generation unit, 154 Audio information acquisition unit, 155 Audio generation unit, 156 registration unit, 200 control unit, 201 CPU, 202 ROM, 203 RAM, 204 bus, 205 input unit, 206 output unit, 207 memory unit, 208 communication unit, 209 short-range wireless communication unit, 210 input / output I / F, 211 operation unit, 212 camera unit, 213 sensor unit 213-1 to 213-3 sensors, 221 display unit, 222 sound output unit, 251 program acquisition unit, 252 music acquisition unit, 253 audio acquisition unit, 254 rendering unit, 255 presentation control unit, 256 interaction processing unit, 271 groove detection unit, 272 BPM detection unit, 273 singing voice detection unit, 274 emotion detection unit, 281 Agreement detection unit, 282 Preference analysis unit, 300 Control unit, 301 CPU, 302 ROM, 303 RAM, 304 Bus, 305 Input unit, 306 Output unit, 307 Memory unit, 308 Communication unit, 309 Drive, 310 Input / output I / F, 351 Input reception unit, 352 Processing unit, 353 Database, 371 Music information management unit, 372 Program template generation unit, 373 Program extraction unit, 374 Program generation unit, 381 Music information management DB, 382 Program management DB, 383 Program evaluation data DB

Claims

1. a script including identification information of the content and comment information corresponding to the comment, the script being generated by the creator, is stored in a predetermined storage medium so as to be viewable by a user; controlling the reading of content indicated by content identification information included in a script selected by a user to be executed and provided to the user, and controlling the reading of comments according to comment information included in the script at least either before or after the provision of the content to be provided to the user; The next script to be selected is switched in response to the user's interaction with the comment. Equipped with a control unit Content delivery system.

2. The control unit determines that the user agrees with a comment in response to an interaction of the user during a predetermined period corresponding to a period during which the comment is provided to the user, and controls to switch a script to be selected next. The content providing system according to claim 1 .

3. The control unit performs control so as to determine that the user agrees with a certain comment in response to an interaction of the user during a certain period corresponding to a period during which the comment is provided to the user, and to generate user preference information. The content providing system according to claim 2 .

4. When the control unit determines that a certain number of users agree with a certain comment in response to user interactions during a certain period corresponding to a period during which the comment is provided to the users, the control unit assigns a feature obtained by analyzing the certain comment to the content. The content providing system according to claim 2 .

5. The control unit automatically selects a plurality of the scripts based on a feature given to the content. The content providing system according to claim 4 .

6. The control unit converts the comment information included in the selected plurality of scripts so that the sentence expressions of the comments indicated by the comment information are unified. The content providing system according to claim 5 .

7. The control unit controls, when the user agrees with the comment, to switch the next selected script to a script having content identification information indicating content similar to the content. The content providing system according to claim 1 .

8. The control unit controls to record the order of the scripts selected in response to the user's interaction as a history, so that the user can replay the scripts in the same order again. The content providing system according to claim 1 .

9. The control unit controls the reading of the content indicated by the content identification information included in the script selected by the user, using the right already acquired by the user through a contract with a specific service, and provides the content to the user. The content providing system according to claim 1 .

10. The control unit is a function of generating a script including content identification information and comment information based on an input from a creator, and storing the script in a predetermined storage medium so that the script can be viewed by a user; Based on input from a creator, the script is provided with information indicating a user interaction and the next script to be selected when that interaction is detected. It also has the function of setting The content providing system according to claim 1 .

11. The control unit is A function of setting a part of a comment corresponding to the comment information, Depending on the user's interaction during a predetermined period corresponding to the period during which a part of the set comment is provided to the user, the user is considered to agree with the comment, and control is performed to switch to a script to be selected next. The content providing system according to claim 10.

12. It comes with a template that shows the recommended script order. The control unit performs control so as to present a script to be selected next as a recommendation according to the template, based on the content indicated by the content identification information included in the script and the comment indicated by the comment information. The content providing system according to claim 10.

13. The control unit controls to switch the script to be selected next depending on the viewing status of the content by the user. The content providing system according to claim 1 .

14. The control unit controls to switch the script to be selected next in response to a physical or emotional movement of the user. The content providing system according to claim 13.

15. The control unit detects an interaction of the user based on sensor data obtained by performing sensing on the user. The content providing system according to claim 1 .

16. The content includes music, The comment includes at least one of an introduction and an end of the song set to the music piece, The specific service includes a music distribution service to which the user subscribes. The content providing system according to claim 9 .

17. a first terminal device used by the creator; a second terminal device used by the user; a first server having the predetermined storage medium storing the script; a second server that distributes the content; The content providing system according to claim 1 , comprising:

18. a script including identification information of the content and comment information corresponding to the comment, the script being generated by the creator, is stored in a predetermined storage medium so as to be viewable by a user; controlling the reading of content indicated by content identification information included in a script selected by a user to be executed and provided to the user, and controlling the reading of comments according to comment information included in the script at least either before or after the provision of the content to be provided to the user; The next script to be selected is switched in response to the user's interaction with the comment. How content is provided.

19. Computer, a script including identification information of the content and comment information corresponding to the comment, the script being generated by the creator, is stored in a predetermined storage medium so as to be viewable by a user; controlling the reading of content indicated by content identification information included in a script selected by a user to be executed and provided to the user, and controlling the reading of comments according to comment information included in the script at least either before or after the provision of the content to be provided to the user; The next script to be selected is switched in response to the user's interaction with the comment. A storage medium that records a program for functioning as a control unit.

Images