Server and method

Abstract

To activate a clipping of a live distribution.SOLUTION: A server comprises: means of transmitting a moving image data according to a live distribution to a terminal of a viewer via a network; means of determining whether or not a condition according to one of or both of a gifting and a comment in the live distribution is satisfied, means of performing a notification to the terminal of the viewer via the network in the case where it is determined that the condition is satisfied; and means of performing a processing for generating the moving image data according to one part of the live distribution so as to be associated with the viewer in the case where a responce corresponded to the notification is received from the terminal of the viewer via the network.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to a server, a computer program, and a method.

Background Art

[0002] With the development of IT technology, the ways of information exchange have changed. In the Showa era, one-way information transmission such as newspapers and televisions was mainly used. In the Heisei era, mobile phones and personal computers became popular, and the communication speed of the Internet was greatly improved. As a result, instant two-way communication services such as chat services emerged, and on-demand video distribution services were accepted along with the reduction of memory costs. And now, in the Reiwa era, with the further improvement of the functions of smartphones and the speed of networks represented by 5G, services that realize real-time communication by video, especially live streaming services, are rapidly increasing in popularity. Live streaming services are expanding their users, especially among young people, as services that allow everyone to share the same enjoyable time even when they are in different places.

[0003] Patent Document 1 discloses a technique that presents a list in which a system automatically trims exciting parts of a live video to viewers who are selecting a video, facilitating the selection of live videos by viewers.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Non-Patent Documents

[0005]

Non-Patent Document 1

Non-Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0006] Conventionally, clipping of live broadcasts is performed by the broadcaster himself or by a system (for example, Patent Document 1), and clipping by viewers is not assumed. In this case, the number of clips generated and the number of shares do not increase, and the advantage of clips being easy to spread cannot be utilized.

[0007] This disclosure has been made in view of such problems, and its purpose is to provide a technology that can more actively activate clipping of live broadcasts.

Means for Solving the Problems

[0008] One aspect of the present invention relates to a server. This server includes means for transmitting video data related to a live broadcast to a viewer's terminal via a network, means for determining whether conditions related to gifting or comments or both during the live broadcast are satisfied, means for notifying the viewer's terminal via the network when it is determined that the conditions are satisfied, and means for performing a process for generating video data related to a part of the live broadcast in association with the viewer when a response to the notification is received from the viewer's terminal via the network.

[0009] Another aspect of the present invention is a computer program. This computer program enables a terminal of a viewer of a live stream to receive video data related to the live stream from a server via a network, and when it is determined that conditions related to gifting and / or comments during the live stream are satisfied, to start a display that prompts an instruction for generating video data related to a part of the live stream and associating it with the viewer on the live stream screen.

[0010] In addition, any combination of the above components, or those obtained by mutually replacing the components and expressions of the present invention among an apparatus, a method, a system, a computer program, a recording medium storing the computer program, etc. are also effective as aspects of the present invention.

Advantages of the Invention

[0011] According to the present invention, clipping of live streams can be more activated.

Brief Description of the Drawings

[0012]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Embodiments for Carrying Out the Invention

[0013] Hereinafter, the same or equivalent components, members, processes, and signals shown in each drawing are denoted by the same reference numerals, and redundant explanations are omitted as appropriate. Also, some of the members that are not important for explanation in each drawing are omitted from the display.

[0014] In the live distribution system according to the embodiment, viewers of the live distribution can cut out a part of the live distribution to generate a short video, and share it with others or watch it again later. A part of the live distribution or the video data related thereto is referred to as a clip of the live distribution. The clip is associated with the viewer who generated it. In this embodiment, when the server monitors the live distribution and the clip promotion notification conditions regarding gifting or comments or both during the live distribution are satisfied, a clip promotion notification is sent to each user terminal of each viewer of the live distribution all at once. In response to receiving the clip promotion notification, each user terminal starts a display for prompting the viewer to generate a clip. When the server and the user terminal receive a clip generation instruction from the viewer, they perform a process for generating a clip.

[0015] In this way, in this embodiment, when a high-value gift is used, or a big win is drawn in a lottery, or the comment frequency increases due to excitement, etc., at the memorable moments, the best moments occur in the live distribution. Each viewer of the live distribution is prompted to generate a clip of such a moment. As a result, it becomes easier for the viewer to generate a clip of a memorable moment, and the omission of generating a clip of a memorable moment can be reduced. In addition, since it is notified to multiple viewers of the live distribution all at once, the number of generated clips increases, and the best moments of the live distribution are spread to more places by more viewers. Therefore, the live distribution and the exposure of the distributor thereof can be increased, and the recognition degree can be improved.

[0016] FIG. 1 is a schematic diagram showing the configuration of a live distribution system 1 according to an embodiment of the present disclosure. The live distribution system 1 provides a two-way live distribution service in which a distributor (also referred to as a liver or a streamer) LV and viewers (also referred to as an audience) AU (AU1, AU2, …) can communicate with each other in real time. As shown in FIG. 1, the live distribution system 1 includes a server 10, a user terminal 20 on the distributor side, and user terminals 30 (30a, 30b, …) on the viewer side. In addition to the distributor who is distributing the live distribution and the viewers who are viewing the live distribution, there are also users who have logged in to the live distribution platform but are neither distributing nor viewing. Such users are called active users. The distributor, the viewer, and the active user may be collectively referred to as a user. The server 10 may be configured by one or more information processing devices connected to the network NW. The user terminals 20 and 30 may be portable terminals such as smartphones, tablet terminals, laptop PCs, recorders, portable game machines, wearable devices, etc., or may be stationary devices such as desktop PCs. The server 10, the user terminal 20, and the user terminal 30 are communicably connected to each other by various wired or wireless networks NW.

[0017] In the live distribution system 1, a distributor LV, a viewer AU, and an administrator (not shown) who manages the server 10 are involved. The distributor LV is a person who transmits content in real time by recording and uploading content such as their own songs, talks, performances, fortune-telling, and game commentaries on their user terminal 20 directly to the server 10. The administrator provides a platform for live distribution of content on the server 10 and mediates or manages the real-time interaction between the distributor LV and the viewer AU. The viewer AU accesses the platform with their user terminal 30, selects and views the desired content. During the live distribution of this content, the viewer AU performs operations such as commenting, cheering, or requesting fortune-telling via the user terminal 30, and the distributor LV who provides the content responds to such comments, cheers, or requests, and the response is transmitted to the viewer AU in video and / or audio, thereby establishing two-way communication.

[0018] In this specification, "live distribution" may mean a data transmission mode that realizes a state in which the content recorded and / or filmed by the user terminal 20 of the distributor LV can be played and viewed on the user terminal 30 of the viewer AU substantially in real time, or may mean the distribution itself realized by such a transmission mode. The live distribution may be realized using existing live distribution technologies such as HTTP Live Streaming, Common Media Application Format, Web Real-Time Communications, Real-Time Messaging Protocol, MPEG DASH, etc. The live distribution includes a transmission mode in which the viewer AU can view the content with a predetermined delay while the distributor LV is recording and / or filming the content. Regarding the magnitude of the delay, at least a delay of a magnitude that allows the interaction between the distributor LV and the viewer AU to be established is permitted. However, the live distribution is distinguished from the so-called on-demand type of distribution in which the entire data of the recorded and / or filmed content is once stored in the server and then provided from the server to the user in response to the request from the user at an arbitrary timing.

[0019] In this specification, "video data" is data including image data (also referred to as video data) generated by the imaging functions of user terminals 20 and 30 and audio data (also referred to as audio data) generated by the voice input functions of user terminals 20 and 30. The video data is played back on user terminals 20 and 30, enabling users to view content. In this embodiment, it is assumed that processes for changing the format, size, and specifications of the data, such as compression, decompression, encoding, decoding, and transcoding, are performed between the time when the video data is generated on the user terminal of the distributor and the time when it is played back on the user terminal of the viewer. Since the content (e.g., video image and audio) represented by the video data remains substantially unchanged before and after such processes, in this embodiment, the video data after such processes is described as being the same as the video data before such processes. That is, when the video data is generated on the user terminal of the distributor and then played back on the user terminal of the viewer via server 10, the video data generated on the user terminal of the distributor, the video data passing through server 10, and the video data received and played back on the user terminal of the viewer are all the same video data.

[0020] In this specification, "distribution time" is a parameter associated with a single live distribution and refers to the length of the period during which the live distribution continues. The distribution time is calculated regardless of whether there are viewers for the live distribution.

[0021] In the example of FIG. 1, the distributor LV is live-distributing a talk. The user terminal 20 of the distributor LV generates video data by recording the image and voice of the distributor LV who is talking, and transmits it to the server 10 via the network NW. At the same time, the user terminal 20 enables the distributor LV to confirm the content of the distribution by displaying the recorded video image VD of the distributor LV on the display of the user terminal 20.

[0022] The user terminals 30a and 30b of viewers AU1 and AU2 who requested to watch the live stream of the streamer LV on the platform each receive video data related to the live stream via the network NW, and play the received video data to display moving images VD1 and VD2 on the display and output sound from the speaker. The moving images VD1 and VD2 displayed on each user terminal 30a and 30b are substantially the same as the moving image VD captured by the user terminal 20 of the streamer LV, and the sound output from each user terminal 30a and 30b is also substantially the same as the sound recorded by the user terminal 20 of the streamer LV.

[0023] The recording and video recording on the user terminal 20 of the streamer LV and the playback of the video data on the user terminals 30a and 30b of the viewers AU1 and AU2 are substantially performed simultaneously. When a viewer AU1 inputs a comment about the content of the talk of the streamer LV into the user terminal 30a, the server 10 displays the comment on the user terminal 20 of the streamer LV in real time and also on the user terminals 30a and 30b of each viewer AU1 and AU2. When the streamer LV who read the comment develops a talk covering the content, the moving image and sound of the talk are output on the user terminals 30a and 30b of each viewer AU1 and AU2, and it is recognized that a conversation between the streamer LV and the viewer AU1 has been established. In this way, in the live stream system 1, a live stream enabling two-way communication that is not one-way is realized.

[0024] FIG. 2 is a block diagram showing the functions and configuration of the user terminal 20 in FIG. 1. The user terminal 30 has the same functions and configuration as the user terminal 20. Each block shown in FIG. 2 and subsequent block diagrams can be realized by elements and mechanical devices including the CPU of a computer in terms of hardware, and can be realized by a computer program or the like in terms of software. Here, however, functional blocks realized by their cooperation are depicted. Therefore, it is understood by those skilled in the art who have read this specification that these functional blocks can be realized in various forms by a combination of hardware and software.

[0025] The distributor LV and the viewer AU download and install the live distribution application program according to the present embodiment (hereinafter referred to as the live distribution app) from the download site to the user terminals 20 and 30 via the network NW. Alternatively, the live distribution app may be pre-installed on the user terminals 20 and 30. When the live distribution app is executed by the user terminals 20 and 30, the user terminals 20 and 30 communicate with the server 10 via the network NW to realize various functions. Hereinafter, the functions realized by the user terminals 20 and 30 (processors such as the CPUs thereof) executing the live distribution app will be described as the functions of the user terminals 20 and 30. These functions are actually the functions realized by the live distribution app on the user terminals 20 and 30. In other embodiments, these functions may be realized by a computer program described in a programming language such as HTML (HyperText Markup Language) that is transmitted from the server 10 to the web browsers of the user terminals 20 and 30 via the network NW and executed by the web browsers.

[0026] The user terminal 20 includes a distribution unit 100 that generates video data recording the user's image and voice and provides it to the server 10, a viewing unit 200 that acquires and plays back video data from the server 10, and an off-distribution processing unit 400 that processes requests from active users. When performing distribution, the user activates the distribution unit 100, when viewing, the viewing unit 200, and when searching for a live distribution to view, viewing the profile of the distributor, or viewing archives or clips, the off-distribution processing unit 400. The user terminal in which the distribution unit 100 is active is the distributor side, that is, the user terminal on the video data generation side, the user terminal in which the viewing unit 200 is active is the viewer side, that is, the user terminal on the video data playback side, and the user terminal in which the off-distribution processing unit 400 is active is the user terminal of the active user.

[0027] The distribution unit 100 includes an imaging control unit 102, an audio control unit 104, a video transmission unit 106, a distribution-side UI control unit 108, and a distribution-side communication unit 110. The imaging control unit 102 is connected to a camera (not shown in FIG. 2) and controls imaging by the camera. The imaging control unit 102 acquires image data from the camera. The audio control unit 104 is connected to a microphone (not shown in FIG. 2) and controls audio input by the microphone. The audio control unit 104 acquires audio data from the microphone. The video transmission unit 106 transmits video data including the image data acquired by the imaging control unit 102 and the audio data acquired by the audio control unit 104 to the server 10 via the network NW. The transmission of video data by the video transmission unit 106 is performed in real time. That is, the generation of video data by the imaging control unit 102 and the audio control unit 104 and the transmission of the generated video data by the video transmission unit 106 are performed substantially simultaneously.

[0028] The distribution-side UI control unit 108 controls the UI for the distributor. The distribution-side UI control unit 108 is connected to a display (not shown in FIG. 2) and displays a moving image on the display by playing the video data to be transmitted by the video transmission unit 106. The distribution-side UI control unit 108 is connected to input means such as a touch panel, a keyboard, and a display (not shown in FIG. 2) and acquires input from the distributor via these input means. The distribution-side UI control unit 108 superimposes a predetermined frame image on the moving image. The frame image includes various user interface objects (hereinafter simply referred to as objects) for receiving input from the distributor, comments input by the viewer, and system comments generated by the server 10. The distribution-side UI control unit 108 receives, for example, a tap input on an object by the distributor.

[0029] The distribution-side communication unit 110 controls communication with the server 10 during live distribution. The distribution-side communication unit 110 transmits the content of the input by the distributor acquired by the distribution-side UI control unit 108 to the server 10 via the network NW. The distribution-side communication unit 110 receives various types of information associated with the live distribution from the server 10 via the network NW.

[0030] The viewing unit 200 includes a viewing-side UI control unit 202 and a viewing-side communication unit 204. The viewing-side communication unit 204 controls communication with the server 10 during live distribution. The viewing-side communication unit 204 receives video data and clip promotion notifications related to the live distribution in which the distributor and the viewer participate from the server 10 via the network NW.

[0031] The viewing-side UI control unit 202 controls the UI for the viewer. The viewing-side UI control unit 202 is connected to a display and a speaker (not shown in FIG. 2), and displays a moving image on the display and outputs sound from the speaker by playing the received video data. The fact that an image is output on the display and sound is output from the speaker can be collectively referred to as "the video data is being played". The viewing-side UI control unit 202 is connected to input means such as a touch panel, a keyboard, and a display (not shown in FIG. 2), and acquires the input by the viewer via these input means. The viewing-side UI control unit 202 superimposes a predetermined frame image on the image of the video data acquired from the server 10. The frame image includes various objects for receiving input from the viewer, comments input by the viewer, and system comments generated by the server 10. The viewing-side communication unit 204 transmits the content of the input by the viewer acquired by the viewing-side UI control unit 202 to the server 10 via the network NW. The viewing-side communication unit 204 transmits a clip generation instruction to the server 10 via the network NW.

[0032] The off-air processing unit 400 includes an off-air UI control unit 402 and an off-air communication unit 404. The off-air UI control unit 402 controls the UI for active users. For example, the off-air UI control unit 402 generates a live distribution selection screen that displays a list of currently available live distributions and accepts the selection of a live distribution by an active user, and causes it to be displayed on the display. The off-air UI control unit 402 generates a profile screen for any user and causes it to be displayed on the display. The off-air UI control unit 402 plays back an archive generated by recording and recording past live distributions. The off-air UI control unit 402 generates a clip selection screen that displays a list of clips associated with an active user and accepts the selection of a clip by the active user, and causes it to be displayed on the display. The off-air UI control unit 402 plays back the selected clip.

[0033] The off-air communication unit 404 controls communication with the server 10 outside the live distribution. The off-air communication unit 404 receives, from the server 10 via the network NW, information for generating a live distribution selection screen, information for generating a profile screen, archive data, and information for generating a clip selection screen. The off-air communication unit 404 transmits the content of the input by the active user to the server 10 via the network NW.

[0034] Figure 3 is a block diagram showing the functions and configuration of the server 10 in FIG. 1. The server 10 includes a distribution information providing unit 302, a relay unit 304, a gift processing unit 308, a payment processing unit 310, a condition determination unit 322, a clip promotion notification unit 324, a clip processing unit 326, a clip sharing unit 328, a distribution analysis unit 330, a stream DB 314, a user DB 318, a gift DB 320, and a clip DB 332.

[0035] FIG. 4 is a data structure diagram showing an example of the stream DB314 in FIG. 3. The stream DB314 holds information on currently ongoing live broadcasts and information on past live broadcasts (also referred to as archives). The stream DB314 includes a stream ID that identifies a live broadcast in the live broadcast platform provided by the live broadcast system 1, a distributor ID that is a user ID identifying the distributor of the live broadcast, a viewer ID that is a user ID identifying the viewers of the live broadcast, the archive data of the live broadcast, the score of the live broadcast, and the number of clips indicating the number of times clips have been generated from the live broadcast by the viewers of the live broadcast, and holds them in association with each other. As information indicating the number of times clips have been generated from a live broadcast, instead of / in addition to the above-mentioned number of clips, for example, the number of clips including clips generated by the distributor, the number of viewers who have generated clips from the live broadcast, the level according to the number of times clips have been generated, the number of clips generated from the live broadcast by the viewers of the live broadcast, etc. may be adopted.

[0036] The score of a live broadcast is an indicator representing the excitement of the live broadcast. A live broadcast with a high score value is recognized as "lively" and "popular". The score varies depending on, for example, the number of viewers, the distribution time, the number of comments, the number of shares, the number of gifts acquired, the number of viewers who have given gifts, the number of cheers, the number of clips, etc. In particular, the score calculation algorithm is set such that the score becomes higher as the number of clips increases. The higher the score, the higher or more prominent the thumbnail of the live broadcast is displayed on the live broadcast selection screen. Therefore, the higher the score, the more it will catch the eye of more active users.

[0037] The archived data of a live stream is, if it is a currently ongoing live stream, the video data of that live stream from the start of the live stream to the present, and if it is a past live stream, the video data of the entire live stream. The archived data includes video data generated by the user terminal of the broadcaster and data of objects such as gift effects and comments that are displayed superimposed on the video. The archived data may hold the video data and the object data as integrated data, or may hold them as separate data. The same applies to the data of a clip that is a partial copy of the archived data.

[0038] In the live streaming platform provided by the live streaming system 1 according to the present embodiment, when a user conducts a live stream, that user becomes the broadcaster, and when the same user watches a live stream broadcast by another user, the user becomes a viewer. Therefore, the distinction between the broadcaster and the viewer is not fixed, and a user ID that was registered as a broadcaster ID at one time may be registered as a viewer ID at another timing.

[0039] FIG. 5 is a data structure diagram showing an example of the user DB 318 in FIG. 3. The user DB 318 holds information regarding users. The user DB 318 holds, in association with each other, a user ID that identifies a user, the points that the user has, and the rewards given to the user.

[0040] Points are an electronic value that circulates within the live streaming platform. A user purchases points using a credit card or other payment means. Rewards are an electronic value defined within the live streaming platform and are an indicator for determining the amount of money that a broadcaster receives from the administrator of the live streaming platform. In the live streaming platform, when a viewer gives a gift to a broadcaster during or outside of a live stream, the viewer's points are consumed, and at the same time, the broadcaster's rewards increase by a corresponding amount.

[0041] FIG. 6 is a data structure diagram showing an example of the gift DB 320 in FIG. 3. The gift DB 320 holds information about gifts that can be used by viewers in a live stream. A gift is a digital item or electronic data having the following characteristics. · It can be purchased for a price in points or money, or can be given for free. · It can be given by a viewer to a streamer. Giving a gift to a streamer is also referred to as using the gift or throwing the gift. · There are types where the purchase and use of the gift occur simultaneously as a set, and there are also types where the viewer can use it at any timing after purchase. · When a viewer gives a gift to a streamer, an appropriate reward is given to that streamer. · When a gift is used, an effect associated with the gift may occur. For example, an effect corresponding to the gift appears on the live stream room screen.

[0042] The gift DB 320 holds, in association, a gift ID that identifies a gift, a reward given to the streamer when the gift is given to the streamer, and a price point that is the price to be paid when using the gift. A viewer can give the gift to the streamer by paying the price point of the desired gift during the viewing of the live stream. The payment of this price point may be made by an appropriate electronic payment means. For example, it may be made by the viewer paying the price point to the administrator. Alternatively, payment by bank transfer or credit card may also be used. The relationship between the reward given and the price point can be arbitrarily set by the administrator. For example, it may be set that the reward given = the price point. Or, the price point may be set to the points obtained by multiplying the reward given by a predetermined coefficient such as 1.2, or the price point may be set to the points obtained by adding a predetermined fee point to the reward given.

[0043] In the present embodiment, in addition to normal gifts (e.g., "GFT1", "GFT2"), the following three types of special gifts different from normal gifts are provided. (1) High-value gifts where the consideration points are equal to or greater than the threshold value (= 30,000). Example: "GFT3". The effect of high-value gifts is more luxurious than that of normal gifts (for example, longer duration, larger data size, better appearance, more ostentatious). (2) Random gifts where the amount of reward given to the distributor is determined by lottery. Example: "RAN1". When "RAN1" is used, 200 points of the viewer who used it are consumed and a lottery is conducted. As a result of the lottery, the distributor is given one of 100 points, 200 points, or 1000 points. If the result of the lottery is 1000 points, it is a win because it is higher than the consideration points of "RAN1". This may be configured using, for example, the random gift technology described in Non-Patent Document 2. (3) Interaction gifts that induce further actions of viewers and / or distributors when used. Example: "RedE". When "RedE" is used, viewers watching the live distribution where it is used are also given an opportunity to earn points. This may be configured using, for example, the lucky bag technology described in Non-Patent Document 1.

[0044] Figure 7 is a data structure diagram showing an example of the clip DB332 in Figure 3. The clip DB332 holds information on clips generated in the live distribution system 1. The clip DB332 associates and holds a clip ID for identifying the clip, the data of the clip, a creator ID which is the user ID of the user (viewer) who generated the clip, a stream ID for identifying the live distribution from which the clip originated, the start time and end time of the clip in the live distribution, and a trigger gift ID which is the gift ID of the gift that caused the clip promotion notification when the clip corresponds to a clip promotion notification. The clip ID may be a URL.

[0045] The data of the clip includes video data related to a part of the original live stream. This video data includes the video data generated by the user terminal of the distributor and the data of objects such as gift effects and comments that are superimposed and displayed on the video.

[0046] In the example of FIG. 7, the clip "CL1" is a 60-second video obtained by cutting out the part from 2:34 (2 minutes and 34 seconds after the start) to 3:34 (3 minutes and 34 seconds after the start) of the live stream "ST1" by the viewer "VR1" of the live stream "ST1". The clip "CL1" is a clip generated in response to a clip promotion notification sent all at once due to the use of the high-value gift "GFT3".

[0047] Returning to FIG. 3, when the distribution information providing unit 302 receives a notification to start a live stream from the user terminal 20 of the distributor via the network NW, it registers the stream ID that identifies the live stream and the distributor ID of the distributor of the live stream in the stream DB 314. In addition, the distribution information providing unit 302 starts recording the archive data of the live stream. The distribution information providing unit 302 acquires in real time the video data generated by the distributor of the live stream and the data of objects such as gift effects and comments that are superimposed and displayed on the video, and accumulates them in the stream DB 314 as archive data. In the present embodiment, the server 10 is configured such that when the distributor starts a live stream, the distributor can select whether to save the archive data. If it is selected not to save, the recording of the archive data is not performed, and thus the generation of clips that rely on the archive data is also restricted or prohibited.

[0048] When the distribution information providing unit 302 receives a request for providing information regarding a live distribution from the off-distribution communication unit 404 of the user terminal of an active user via the network NW, it refers to the stream DB 314 and generates a list of currently viewable live distributions. The distribution information providing unit 302 transmits the generated list to the user terminal of the requester via the network NW. The off-distribution UI control unit 402 of the user terminal of the requester generates a live distribution selection screen based on the received list and displays it on the display of the user terminal.

[0049] When the off-distribution UI control unit 402 of the user terminal receives the selection of a live distribution by the active user on the live distribution selection screen, it generates a distribution request including the stream ID of the selected live distribution and transmits it to the server 10 via the network NW. The distribution information providing unit 302 starts providing the live distribution specified by the stream ID included in the received distribution request to the user terminal of the requester. The distribution information providing unit 302 updates the stream DB 314 so that the user ID of the active user of the user terminal of the requester is included in the viewer ID of the stream ID. As a result, the active user becomes a viewer of the selected live distribution.

[0050] The relay unit 304 relays the transmission of video data from the user terminal 20 of the distributor to the user terminal 30 of the viewer in the live distribution started by the distribution information providing unit 302. The relay unit 304 receives the video data related to the live distribution from the user terminal 20 of the distributor via the network NW and transmits the video data to the user terminal 30 of the viewer. When there are a plurality of viewers of the live distribution, the relay unit 304 transmits the video data related to the live distribution to the plurality of user terminals of the plurality of viewers via the network NW.

[0051] The relay unit 304 receives, from the viewer-side communication unit 204, a signal indicating user input by a viewer during live distribution, that is, during playback of video data. The signal indicating user input may be an object designation signal indicating designation of an object displayed on the display of the user terminal 30. The object designation signal may include the viewer ID of the viewer, the distributor ID of the distributor who is performing the live distribution being viewed by the viewer, and the object ID for specifying the object. When the object is a gift icon, the object ID becomes the gift ID. In that case, the object designation signal becomes a gift use signal indicating use of a gift by the viewer for the distributor. Similarly, the relay unit 304 receives, from the distribution-side communication unit 110 of the distribution unit 100 of the user terminal 20, a signal indicating user input by the distributor during playback of video data, for example, an object designation signal.

[0052] The gift processing unit 308 performs processing related to gifts used during live distribution. The gift processing unit 308 updates the user DB 318 so as to increase the reward of the distributor according to the grant reward of the gift specified by the gift ID included in the gift use signal. The gift processing unit 308 refers to the gift DB 320 and specifies the grant reward corresponding to the gift ID included in the received gift use signal. The gift processing unit 308 updates the user DB 318 so as to add the specified grant reward to the reward corresponding to the distributor ID included in the gift use signal. The gift processing unit 308 performs the processing described with reference to FIG. 6 for special gifts.

[0053] The payment processing unit 310 processes payment of the consideration for the gift by the viewer in response to reception of the gift use signal. The payment processing unit 310 refers to the gift DB 320 and specifies the consideration points of the gift specified by the gift ID included in the gift use signal. The payment processing unit 310 updates the user DB 318 so as to subtract the specified consideration points from the points of the viewer specified by the viewer ID included in the gift use signal.

[0054] The condition determination unit 322 determines whether or not the clip promotion notification conditions related to gifting, comments, or both during live distribution are satisfied. The condition determination unit 322 monitors the state of the live distribution and waits for the occurrence of a target event related to gifting, comments, or both. When the condition determination unit 322 detects the occurrence of the target event, it determines that the clip promotion notification conditions are satisfied.

[0055] The target event is an event that has nothing to do with whether or not there is an instruction for generating a clip by a viewer of the live distribution. Even if there is an instruction for generating a clip by a viewer of the live distribution, the target event is not detected. Also, since the target event is an event that occurs during the live distribution, it does not include the start of the live distribution by the distributor. Although a clip icon is always displayed on the live distribution room screen displayed on the viewer's user terminal described later, this is displayed regardless of the clip promotion notification due to the detection of the target event. The target event is configured to be settable by the administrator with gifting and comments as factors.

[0056] Examples of the target event are as follows. (1) When a gift that meets a predetermined standard is used during the live distribution. The gift that meets the predetermined standard includes a special gift different from a normal gift. In particular, the gift that meets the predetermined standard includes a gift with a price equal to or higher than a threshold value and an interactive gift. In the example of FIG. 6, when a high-value gift "GFT3" with a price of "50000" exceeding the threshold value (= 30000) is used, the condition determination unit 322 detects the occurrence of the target event and determines that the clip promotion notification conditions are satisfied. Also, when the interactive gift "RedE" is used, the condition determination unit 322 detects the occurrence of the target event and determines that the clip promotion notification conditions are satisfied. (2) When the lottery result due to gifting is a winning result. In the example of FIG. 6, when the random gift "RAN1" is used and the result of the lottery is 1000 points, that is, when it is a winning result, the condition determination unit 322 detects the occurrence of the target event and determines that the clip promotion notification condition is satisfied. If the result of the lottery is not a winning result (100 points, 200 points) even when the random gift "RAN1" is used, the condition determination unit 322 does not detect the occurrence of the target event. (3) When the gifting mode during live distribution meets a predetermined standard. For example, when the number of gifts used within a predetermined period such as 10 seconds or 1 minute exceeds a threshold value, or when a gift combo is completed, or when the live distribution parameters related to gifting reach a critical point, the condition determination unit 322 detects the occurrence of the target event and determines that the clip promotion notification condition is satisfied. (4) When the comment mode meets a predetermined standard. For example, when the number of comments posted within a predetermined period such as 10 seconds or 1 minute exceeds a threshold value, the condition determination unit 322 detects the occurrence of the target event and determines that the clip promotion notification condition is satisfied. (5) When the live distribution score exceeds a threshold value. The live distribution score increases as gifting increases and / or as comments increase. When this score exceeds the threshold value, the condition determination unit 322 detects the occurrence of the target event and determines that the clip promotion notification condition is satisfied. (6) When the gifting mode meets a predetermined standard and the comment mode meets a predetermined standard.

[0057] In this embodiment, the target event is set to be a common one that does not depend on the distributor or individual live broadcasts. However, in other embodiments, the target event may be set to be different for each distributor, or may be set to be different for each group of distributors, or may be set to be different for each individual live broadcast. For example, the amount of gifts that feel special may be different between new distributors and veteran distributors. Reflecting this, the threshold value of the consideration for the gift, which is the criterion for determining whether it is a high-value gift, may be changed according to the level of the distributor. For example, in a live broadcast of a distributor with a level of 10 or less, it may be determined that the clip promotion notification condition is satisfied when a gift with a consideration point exceeding 10,000 is used, and in a live broadcast of a distributor with a level exceeding 10, it may be determined that the clip promotion notification condition is satisfied when a gift with a consideration point exceeding 50,000 is used.

[0058] In this embodiment, the determination of whether the clip promotion notification condition is satisfied is performed based on rules. However, in other embodiments, this determination may be made using machine learning. For example, first, data on past live broadcasts regarding the relationship between gifting and / or comments and the number of clips is input into a machine learning model as learning data for learning. By inputting data on gifting and / or comments of the currently ongoing live broadcast into this machine learning model, the expected number of clips is output. The server may be configured to send a clip promotion notification to viewers when the number of clips output in this way exceeds a threshold value. Considering that the tendency of the change in the number of clips is different for each distributor, a machine learning model may be generated for each distributor.

[0059] When it is determined that the clip promotion notification conditions are met for a currently ongoing live stream, the clip promotion notification unit 324 sends a clip promotion notification to the user terminals of each viewer of the live stream all at once via the network NW. The clip promotion notification unit 324 sends a clip promotion notification triggered by the fulfillment of the clip promotion notification conditions. The clip promotion notification is a notification for receiving an instruction from the viewer to generate a clip associated with the viewer from the live stream.

[0060] The transmission targets of the clip promotion notification may be the user terminals of all viewers of the live stream, or may be the user terminals of some of the multiple viewers of the live stream. Alternatively, the distributor may specify in advance the attributes of the viewers who can generate clips, and the configuration may be such that the clip promotion notification is sent only to the user terminals of the viewers with the specified attributes. For example, the distributor registers a blacklist or a whitelist in the system in advance, and the server is configured to send a clip promotion notification only to the user terminals of the viewers who are not listed in the blacklist or only to the user terminals of the viewers who are listed in the whitelist in the live stream of the distributor. Alternatively, the server may be configured to send a clip promotion notification only to the followers of the distributor or the viewers who subscribe to the distributor. Alternatively, the server may refer to the list of comment-ban targets or activity-restricted persons managed by the administrator, and be configured not to send a clip promotion notification to the viewers listed in such a list. Alternatively, the clip promotion notification may be sent to, or only to, the user terminal of the viewer who has achieved the fulfillment of the corresponding clip promotion notification conditions. For example, when a certain viewer uses a high-value gift while watching a live stream, the server determines that the clip promotion notification conditions are met. The server may send a clip promotion notification only to the user terminal of the viewer who has used the high-value gift.

[0061] When the clip processing unit 326 receives a response to the clip promotion notification via the network NW from the user terminal of one of the multiple viewers who have received the clip promotion notification, it performs a process for generating a clip associated with the viewer. The generation of a clip from a live distribution may be realized using, for example, the technique described in Patent Document 1.

[0062] When the clip processing unit 326 receives a clip generation instruction in response to a clip promotion notification, it performs a process for generating a clip including a period immediately before the timing when it is determined that the clip promotion notification conditions corresponding to the clip promotion notification are satisfied. The clip generation instruction includes the viewer ID of the viewer who instructed the generation of the clip and the stream ID of the live distribution being viewed by the viewer. In the example of FIG. 7, an expensive gift “GFT3” is used at time 3:30 (3 minutes and 30 seconds after the start) of the live distribution “ST1”. The condition determination unit 322 detects the use of the expensive gift “GFT3” and determines that the clip promotion notification conditions are satisfied at time 3:34. The clip promotion notification unit 324 transmits a clip promotion notification to the user terminal of the viewer. In response to this clip promotion notification, the viewer “VR1” instructs the creation of a clip on their own user terminal, and the clip processing unit 326 receives a clip generation instruction from the user terminal. In the clip generation process according to this clip generation instruction, the end time of the clip is set so that the clip includes a period immediately before the timing (time 3:34) when it is determined that the clip promotion notification conditions are satisfied. For example, the end time of the clip is fixed at the timing (time 3:34) when it is determined that the clip promotion notification conditions are satisfied, and the minimum value of the clip length is set to 60 seconds. As a result, the clip generated by the viewer “VR1” has a start time of 2:34 and an end time of 3:34, and includes the time 3:30 when the expensive gift “GFT3” was used.

[0063] The clip processing unit 326 may generate a clip while interacting with the creator (= viewer) through an interface for clip generation, or may generate a clip automatically in its entirety when receiving a clip generation instruction.

[0064] The clip processing unit 326 associates the generated clip data with the user ID of the creator of the clip (= the viewer who sent the clip generation instruction), the stream ID of the live stream from which the clip was derived, the start time and end time of the clip, and the gift ID of the trigger gift, and registers them in the clip DB 332. In the example of FIG. 7 above, the clip processing unit 326 associates the clip ID "CL1", the generated clip data, the creator ID "VR1" (= the viewer who instructed the creation of the clip), the stream ID "ST1", the start time "2:34", the end time "3:34", and the trigger gift ID "GFT3", and registers them in the clip DB 332.

[0065] The clip sharing unit 328 performs processing to enable sharing of clips by the distributor or viewer with others on the live distribution platform or on other SNS or messaging service platforms. When a clip is generated by the clip processing unit 326 and registered in the clip DB 332, the clip sharing unit 328 issues the clip ID or URL of the clip and sends it to the user terminal of the creator. The creator shares the clip with others by posting the issued URL to the desired platform. When others specify the shared URL on their own terminal, the clip sharing unit 328 provides the clip data corresponding to the specified URL to the others' terminals. Also, if the live distribution that was the source of the clip corresponding to the specified URL is in progress, the clip sharing unit 328 also provides information for viewing the live distribution to the others' terminals. The clip sharing unit 328 may issue the clip URL to the distributor of the live distribution that was the source of the clip.

[0066] The distribution analysis unit 330 monitors the live distribution and updates the parameters of the live distribution. When the live distribution ends, the distribution analysis unit 330 provides the final value of the parameters of the live distribution to the user terminal of the distributor of the live distribution via the network NW. The distribution analysis unit 330 includes the final value of the number of clips of the ended live distribution in the final value of this parameter.

[0067] The operation of the live distribution system 1 with the above configuration will be described. FIG. 8 is a flowchart showing a series of processing flows in the live distribution system 1 when a clip promotion notification is made during the live distribution. The server 10 monitors the state of the currently ongoing live distribution and determines whether the clip promotion notification condition is satisfied (S202). If not satisfied (N in S202), the server 10 continues the monitoring and makes the determination in step S202 again. When the clip promotion notification condition is satisfied (Y in S202), the server 10 simultaneously transmits the clip promotion notification to the plurality of user terminals of the plurality of viewers of the live distribution (S204). The server 10 receives a clip generation instruction from one of the plurality of user terminals among the plurality of user terminals to which the clip promotion notification was transmitted in step S204 (S206). The server 10 performs a clip generation process (S208). The server 10 registers the data of the generated clip in the clip DB 332 and transmits information (such as a URL) for specifying the clip to the user terminal of the viewer who instructed the clip generation.

[0068] When the viewer's user terminal receives the URL of the clip, the viewer shares the clip with others by operating the user terminal. At this time, the user terminal performs clip sharing processing (S210). The server 10 generates a clip generation notification including that a clip has been generated from the live distribution and the URL of the clip, and transmits it to the user terminal of the distributor of the live distribution (S212). When the distributor's user terminal receives the clip generation notification, the distributor shares the clip with others by operating the user terminal. At this time, the user terminal performs clip sharing processing (S214). The server 10 updates the stream DB314 so that the number of clips corresponding to the live distribution that is the source of the clip generated in step S208 is incremented by 1 (S216).

[0069] FIG. 9 is a representative screen diagram of the live distribution room screen 608 displayed on the display of the viewer's user terminal 30. When the viewer taps the thumbnail on the live distribution selection screen (not shown), the live distribution room screen 608 in FIG. 9 is displayed on the display. The live distribution room screen 608 displays the moving image generated by the distributor's user terminal 20 in real time. The live distribution room screen 608 includes a distributor's moving image 610 obtained by reproducing the video data received from the server 10, a gift object 612, a comment input area 616, a comment display area 618, an end viewing button 620, and a clip icon 614. The viewing-side UI control unit 202 generates the live distribution room screen 608 by superimposing and displaying other objects, that is, the gift object 612, the comment input area 616, the comment display area 618, the end viewing button 620, and the clip icon 614 on the moving image 610 obtained by reproducing the video data. The clip icon 614 is displayed from the time when the display of the live distribution room screen 608 is started on the viewer's user terminal 30, regardless of the clip promotion notification.

[0070] The comment display area 618 may include comments input by viewers, comments input by other viewers, and system comments. The system comments can include comments indicating to the distributor who gave which gift, and comments for prompting viewers to generate clips. The viewing-side UI control unit 202 generates a comment display area 618 including comments of other viewers and system comments received from the server 10, and includes the generated comment display area 618 in the live distribution room screen 608.

[0071] The comment input area 616 accepts input of comments by viewers. The viewing-side communication unit 204 generates a comment input signal including the comments input in the comment input area 616, and transmits it to the server 10 via the network NW. At the same time, the viewing-side UI control unit 202 updates the comment display area 618 to display the comments input in the comment input area 616.

[0072] The viewing end button 620 is an object for accepting an instruction from a viewer to stop viewing the live distribution.

[0073] The clip icon 614 is an object for accepting an instruction from a viewer of the live distribution to generate a clip. The clip icon 614 is displayed on the live distribution room screen 608 regardless of whether the clip promotion notification condition is satisfied. When a tap on the clip icon 614 is detected, the viewing-side UI control unit 202 of the user terminal 30 generates a clip generation instruction including the viewer ID of the viewer and the stream ID of the live distribution, and transmits it to the server 10 via the network NW. When the clip processing unit 326 of the server 10 receives the clip generation instruction, it performs clip generation processing. The clip generated in this way is registered in the clip DB 332 as a clip not derived from a clip promotion notification. Specifically, no trigger gift ID is associated with the data of such a clip (clip "CL5" in FIG. 7).

[0074] When the viewing-side UI control unit 202 of the user terminal 30 detects a tap on the gift object 612, it generates a gift information request and transmits it to the server 10 via the network NW. When the relay unit 304 of the server 10 receives the gift information request, it refers to the gift DB 320 to identify the gift IDs of available gifts. The server 10 generates gift information including the identified gift ID and transmits it to the user terminal 30 of the requester. The viewing-side UI control unit 202 of the user terminal 30 generates a gift area 622 for accepting the selection of a gift based on the received gift information. The gift area 622 includes a gift object 624 of the gift specified by the gift ID included in the received gift information. The viewing-side UI control unit 202 causes the generated gift area 622 to be displayed on the live distribution room screen 608.

[0075] FIG. 10 is a representative screen diagram of the live distribution room screen 608 on which the gift area 622 is superimposed and displayed on the display of the viewer's user terminal 30. The gift area 622 includes a gift object 624 of the gift. When the viewer taps the gift object 624 corresponding to the high-value gift "GFT3" in the gift area 622 on the live distribution room screen 608 of FIG. 10, the viewing-side UI control unit 202 of the user terminal 30 accepts the designation of the gift object 624 by the viewer. The viewing-side UI control unit 202 generates an effect 626 corresponding to the high-value gift "GFT3" represented by the designated gift object 624. The viewing-side UI control unit 202 causes the generated effect 626 to be displayed on the live distribution room screen 608. At the same time, the viewing-side communication unit 204 generates a gift use signal including the gift ID of the high-value gift "GFT3" represented by the designated gift object 624 and transmits it to the server 10. By the server 10 sending an effect display instruction signal including the gift ID of the high-value gift "GFT3" to the user terminal 20 of the distributor and the user terminals of other viewers, the same effect is also displayed on the user terminals of the distributor and other viewers participating in the live distribution.

[0076] FIG. 11 is a representative screen diagram of a live delivery room screen 608 on which an effect 626 is superimposed and displayed on the display of the viewer's user terminal 30. The comment display area 618 in FIG. 11 includes a system comment 638 indicating that a viewer (user ID "VR1" in this example) has given a high-value gift (a "heart" in this example) to the deliverer. The system comment 638 may be included in the reply to the above object designation signal.

[0077] The server 10 detects an event that a high-value gift "GFT3" has been used in the live delivery being performed on the live delivery room screen 608 in FIG. 11, and determines that the clip promotion notification condition is satisfied. The server 10 sends a clip promotion notification to the user terminals 30 of all viewers participating in the live delivery. The viewing-side UI control unit 202 of the user terminal 30 starts a display prompting an instruction for generating a clip on the live delivery room screen 608 based on the received clip promotion notification. When receiving the clip promotion notification, the viewing-side UI control unit 202 generates a system comment 640 including text prompting the viewer to generate a clip, and causes it to be displayed in the comment display area 618. The content of the system comment 640 may be included in the clip promotion notification.

[0078] FIG. 12 is a representative screen diagram of a live delivery room screen 608 including a system comment 640 related to clip promotion in the comment display area 618, which is displayed on the display of the viewer's user terminal 30. The system comment 640 includes an action icon 642. When receiving the clip promotion notification, the viewing-side UI control unit 202 of the user terminal 30 starts highlighting the clip icon 614. This highlighting continues for a predetermined period. In the example of FIG. 12, a blinking object 644 for highlighting is displayed around the clip icon 614.

[0079] When the viewing-side UI control unit 202 of the user terminal 30 detects a tap on the action icon 642 or a tap on the highlighted clip icon 614, it generates a clip generation instruction including the viewer ID of the viewer and the stream ID of the live distribution, and transmits it to the server 10 via the network NW. When the clip processing unit 326 of the server 10 receives the clip generation instruction, it performs clip generation processing. The clip generated in this way is registered in the clip DB 332 as a clip derived from the clip promotion notification, as described above.

[0080] In the present embodiment, as a display for promoting the generation of a clip, (1) displaying a system comment 640 for promoting the generation of a clip in the comment display area 618 and (2) highlighting the originally existing clip icon 614 are adopted. However, the present invention is not limited to this, and only one of these may be adopted. Alternatively, in addition to or instead of this, when the viewing-side UI control unit 202 receives a clip promotion notification, it may start displaying a new icon (different from the clip icon 614) related to the generation of a clip on the live distribution room screen 608.

[0081] FIG. 13 is a representative screen diagram of a clip sharing screen 650 displayed on the display of the viewer's user terminal 30. In the live distribution room screen 608 of FIG. 12, when the action icon 642 or the clip icon 614 is tapped to start the clip generation process, and when the generation of the clip is completed, the clip sharing screen 650 shown in FIG. 13 is displayed on the display of the user terminal 30. The clip sharing screen 650 has a clip object 654 representing the generated clip and a share reception area 652 including a plurality of icons of a plurality of platforms that are candidates for the sharing destination. When the viewer who is the generator of the clip selects and taps the icon corresponding to the desired platform from the icons displayed in the share reception area 652, the viewer-side communication unit 204 generates a share request including information specifying the platform corresponding to the selected icon and the URL of the clip, and transmits it to the server 10 via the network NW. The clip sharing unit 328 of the server 10 performs the clip sharing process according to the received share request. Such sharing of clips may be realized using known techniques.

[0082] FIG. 14 is a representative screen diagram of a live distribution room screen 660 displayed on the display of the distributor's user terminal 20. The live distribution room screen 660 has a moving image 610 of the distributor, an end distribution button 662, and a comment display area 664. The comment display area 664 includes a system comment 638 indicating that the viewer (in this example, user ID "VR1") has given a high-value gift (in this example, "heart") to the distributor, and a system comment 666 indicating that the viewer (in this example, user ID "VR1") has generated a clip from the live distribution.

[0083] In the live distribution room screen 608 of FIG. 12, when the action icon 642 or the clip icon 614 is tapped and the clip generation process is started, and when the generation of the clip is completed, the server 10 generates a clip generation notification and transmits it to the user terminal 20 of the distributor. Based on the received clip generation notification, the distribution-side UI control unit 108 of the user terminal 20 starts a display prompting an instruction to share the generated clip on the live distribution room screen 660. When receiving the clip generation notification, the distribution-side UI control unit 108 generates a system comment 666 including text prompting the distributor to share the clip, and causes it to be displayed in the comment display area 664.

[0084] When a tap on the system comment 666 is detected, the distribution-side UI control unit 108 of the user terminal 20 superimposes and displays a share reception area conforming to or similar to the share reception area 652 of FIG. 13 on the live distribution room screen 660, and receives a share request there.

[0085] FIG. 15 is a representative screen diagram of the live distribution result screen 680 displayed on the display of the user terminal 20 of the distributor who has ended the live distribution. When the distributor taps the distribution end button 662 on the live distribution room screen 660 of FIG. 14, the distribution-side communication unit 110 of the user terminal 20 generates a distribution end request and transmits it to the server 10. When receiving the distribution end request, the server 10 ends the live distribution. The distribution analysis unit 330 transmits the final value of the parameters including the final value of the number of clips of the ended live distribution to the user terminal 20 of the distributor of the live distribution via the network NW. The distribution-side UI control unit 108 of the user terminal 20 generates a live distribution result screen 680 including the received final value and causes it to be displayed on the display. The live distribution result screen 680 includes a clip number display area 682 indicating the final value of the number of clips of the ended live distribution.

[0086] In the above embodiments, examples of the holding unit and the DB are a hard disk and a semiconductor memory. Also, based on the description in this specification, those skilled in the art who have read this will understand that each part can be realized by a CPU not shown in the drawings, a module of an installed application program, a module of a system program, a semiconductor memory that temporarily stores the content of data read from a hard disk, or the like.

[0087] According to the live distribution system 1 according to this embodiment, when the clip promotion notification condition is satisfied during live distribution, the generation of clips is promoted to viewers by highlighting an icon or making a comment on the live distribution room screen of the live distribution. As a result, viewers can more easily generate and share clips of special moments, and can suppress or prevent forgetting such clips. In addition, not only viewers who contributed to the occurrence of the target event (for example, viewers who used a high-value gift), but also a plurality of viewers of the live distribution are notified of clip promotion at once, so that more viewers will generate clips and each will share it on a separate platform. Therefore, the speed of diffusion of the original live distribution of the clip or its distributor can be increased.

[0088] Conventionally, the clipping of live distributions by viewers has not been recommended because of the perspective of rights processing and the difficulty of control. However, the present inventors have found that allowing viewers to clip can greatly increase the recognition of the original live distribution and the distributor, and have found that such advantages outweigh the disadvantages. In this embodiment, by further advancing from allowing viewers to clip to a configuration in which the system recommends and promotes clips to viewers, such advantages can be enjoyed more.

[0089] Also, in the live distribution system 1 according to the present embodiment, the clip promotion notification conditions are satisfied by using special gifts such as high-value gifts and interactive gifts, or by winning a random gift. Therefore, viewers can more surely generate clips including the luxurious effects of high-value gifts, can more surely generate clips including the lively state by using interactive gifts, and can more surely generate clips that cut out the state where both the distributor and the viewers are very happy when winning a random gift. In addition, by many viewers spreading the clips that capture such wonderful moments to more places, the awareness of the live distribution and its distributor can be further enhanced.

[0090] Also, in the live distribution system 1 according to the present embodiment, the number of clips is counted as an analysis result of the live distribution and presented to the distributor. In the present embodiment, since viewers are encouraged to generate clips, the number of clips will be larger. By showing a large number of clips, the motivation of the distributor for distribution can be improved.

[0091] Referring to FIG. 16, the hardware configuration of the information processing apparatus according to the present embodiment will be described. FIG. 16 is a block diagram showing a hardware configuration example of the information processing apparatus according to the present embodiment. The illustrated information processing apparatus 900 can realize, for example, each of the server 10 and the user terminals 20 and 30 in the present embodiment.

[0092] The information processing apparatus 900 includes a CPU 901, a ROM (Read Only Memory) 902, and a RAM (Random Access Memory) 903. The information processing apparatus 900 may further include a host bus 907, a bridge 909, an external bus 911, an interface 913, an input device 915, an output device 917, a storage device 919, a drive 921, a connection port 925, and a communication device 929. Furthermore, the information processing apparatus 900 includes an imaging device (not shown) such as a camera. The CPU 901 is an example of a hardware configuration for realizing the functions realized by the components described in this specification. The functions described in this specification may be realized by circuitry programmed to realize the described functions. The circuitry programmed to realize the functions described in this specification includes a CPU (a Central Processing Unit), a DSP (Digital Signal Processor), a general-purpose processor, an application-specific processor, an integrated circuit, ASICs (Application Specific Integrated Circuits), and / or combinations thereof. In this specification, a unit that realizes a specific function may be realized as circuitry programmed to realize the function.

[0093] The CPU 901 functions as an arithmetic processing unit and a control unit, and controls all or part of the operations within the information processing apparatus 900 in accordance with various programs recorded in the ROM 902, the RAM 903, the storage device 919, or the removable recording medium 923. For example, the CPU 901 controls all of the operations of each functional unit included in the server 10 and the user terminals 20 and 30 in the present embodiment. The ROM 902 stores programs, arithmetic parameters, etc. used by the CPU 901. The RAM 903 temporarily stores programs used in the execution of the CPU 901 and parameters that change as appropriate during the execution thereof. The CPU 901, the ROM 902, and the RAM 903 are interconnected by a host bus 907 formed by an internal bus such as a CPU bus. Further, the host bus 907 is connected to an external bus 911 such as a PCI (Peripheral Component Interconnect / Interface) bus via a bridge 909.

[0094] The input device 915 may be a device operated by a user, such as a mouse, a keyboard, a touch panel, buttons, switches, and levers, or may be a device that converts a physical quantity, such as a sound sensor like a microphone, an acceleration sensor, an inclination sensor, an infrared sensor, a depth sensor, a temperature sensor, and a humidity sensor, into an electrical signal. The input device 915 may be, for example, a remote control device using infrared rays or other radio waves, or may be an external connection device 927 such as a mobile phone corresponding to the operation of the information processing apparatus 900. The input device 915 includes an input control circuit that generates an input signal based on information input by the user or a physical quantity sensed and outputs the input signal to the CPU 901. By operating this input device 915, the user inputs various data to the information processing apparatus 900 and instructs processing operations.

[0095] The output device 917 is composed of a device capable of visually or auditorily notifying the user of the acquired information. The output device 917 can be, for example, a display such as an LCD, PDP, or OELD, an acoustic output device such as a speaker and headphones, and a printer device. The output device 917 outputs the result obtained by the processing of the information processing device 900 as video such as text or an image, or as sound such as an acoustic sound.

[0096] The storage device 919 is a data storage device configured as an example of the storage unit of the information processing device 900. The storage device 919 is composed of, for example, a magnetic storage unit device such as an HDD (Hard Disk Drive), a semiconductor storage device, an optical storage device, or a magneto-optical storage device. This storage device 919 stores the programs executed by the CPU 901, various data, and various data acquired from the outside.

[0097] The drive 921 is a reader / writer for a removable recording medium 923 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and is built in or externally attached to the information processing device 900. The drive 921 reads the information recorded on the mounted removable recording medium 923 and outputs it to the RAM 903. Also, the drive 921 writes a recording to the mounted removable recording medium 923.

[0098] The connection port 925 is a port for directly connecting a device to the information processing apparatus 900. The connection port 925 can be, for example, a USB (Universal Serial Bus) port, an IEEE1394 port, a SCSI (Small Computer System Interface) port, etc. Also, the connection port 925 may be an RS-232C port, an optical audio terminal, an HDMI (registered trademark) (High-Definition Multimedia Interface) port, etc. By connecting the external connection device 927 to the connection port 925, various data can be exchanged between the information processing apparatus 900 and the external connection device 927.

[0099] The communication device 929 is, for example, a communication interface composed of a communication device for connecting to the network NW. The communication device 929 can be, for example, a communication card for a wired or wireless LAN (Local Area Network), Bluetooth (registered trademark), or WUSB (Wireless USB). Also, the communication device 929 may be a router for optical communication, a router for ADSL (Asymmetric Digital Subscriber Line), or a modem for various communications. The communication device 929 transmits and receives signals, etc. using a predetermined protocol such as TCP / IP, for example, between the Internet and other communication devices. Also, the communication network NW connected to the communication device 929 is a network connected by wire or wirelessly, and is, for example, the Internet, a home LAN, infrared communication, radio wave communication, or satellite communication. Note that the communication device 929 realizes the function as a communication unit.

[0100] An imaging device (not shown) such as a camera uses various members such as an imaging element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor), and a lens for controlling the formation of a subject image on the imaging element to image real space and generate an imaging image. The imaging device may capture still images or may capture moving images.

[0101] As described above, the configuration and operation of the live distribution system 1 according to the embodiment have been described. This embodiment is an example, and it is understood by those skilled in the art that various modifications are possible for each component and each combination of processes, and such modifications are also within the scope of the present disclosure.

[0102] In the embodiment, the case where the clip promotion notification is transmitted to the viewers of the live distribution has been described, but the present invention is not limited to this, and the clip promotion notification may be transmitted to the distributor instead of / in addition to the viewers.

[0103] In the embodiment, the case where it is determined whether or not the clip promotion notification condition is satisfied during the live distribution has been described, but the present invention is not limited to this. For example, when an active user is viewing the archive of the live distribution, it may be determined whether or not the clip promotion notification condition is satisfied. For example, when a scene where a high-value gift is used is played back during the viewing of the archive, it may be determined that the clip promotion notification condition is satisfied, and a clip promotion notification may be transmitted to the user terminal of the viewer of the archive.

[0104] In the embodiment, the case where the clip data includes video data generated by the distributor's user terminal and data of an object that is superimposed and displayed on the video such as a gift effect or a comment has been described, but the present invention is not limited to this, and the clip data may include video data generated by the distributor's user terminal and may not include object data.

[0105] The conversion rate from the consideration points of the gift to the awarded rewards in the embodiment is an example, and these may be appropriately set by, for example, the administrator of the live distribution system.

[0106] The technical idea according to the embodiment may be applied to virtual live distribution using an avatar that moves in synchronization with the movement of the distributor instead of the image of the distributor, or to live commerce. Further, in the embodiment, the case where the server relays the video data related to the live distribution generated by the user terminal of the distributor and transmits it to the user terminal of the viewer has been described, but it is not limited to this. For example, when setting a virtual distributor instead of the actual distributor, the technical idea according to the present embodiment may be applied. The virtual distributor is, for example, an AI virtual distributor whose appearance uses an avatar, whose voice is composed of a TTS (Text-To-Speech) engine, and whose speech content is obtained from a machine learning model that takes the comments of the viewers as input. In this case, the user terminal of the distributor does not exist, and the processing on the distributor side is performed by the server.

[0107] In the processing procedures described in this specification, particularly in the processing procedures described using flowcharts and flow diagrams, it is possible to omit a part of the steps (steps) constituting the processing procedure, add steps not explicitly shown as steps constituting the processing procedure, and / or change the order of the steps. As long as such omissions, additions, and order changes do not depart from the spirit of the present disclosure, the processing procedures with such omissions, additions, and order changes are included in the scope of the present disclosure.

[0108] At least a part of the functions realized by the server 10 may be realized by a device other than the server 10, for example, the user terminals 20 and 30. At least a part of the functions realized by the user terminals 20 and 30 may be realized by a device other than the user terminals 20 and 30, for example, the server 10. For example, the superimposition of a predetermined frame image on the image of the video data performed on the user terminal of the viewer may be performed by the server 10 or may be performed on the user terminal of the distributor. Alternatively, the generation of the clip performed by the server 10 may be performed on the user terminal of the viewer or the user terminal of the distributor.

Claims

1. Means for transmitting video data related to a live broadcast to a viewer's terminal via a network; Means for determining whether conditions related to gifting or commenting or both during the live broadcast are satisfied; Means for notifying the viewer's terminal via the network when it is determined that the conditions are satisfied; Means for performing processing for generating video data related to a part of the live broadcast in association with the viewer when a response to the notification is received from the viewer's terminal via the network. A server comprising the above.

2. The server according to claim 1, wherein the means for determining determines that the conditions are satisfied when a gift that meets a predetermined criterion is used during the live broadcast.

3. The server according to claim 2, wherein the gift that meets the predetermined criterion includes a gift whose price is equal to or higher than a threshold value.

4. The server according to claim 1, wherein the means for determining determines that the conditions are satisfied when the result of a lottery due to gifting is a winning result.

5. The server according to claim 1, wherein the means for notifying transmits a notification for receiving, from the viewer, an instruction for generating video data related to a part of the live broadcast in association with the viewer via the network.

6. The server according to claim 1, wherein the means for performing processing performs processing for generating video data related to a part of the live broadcast including a period immediately before the timing when it is determined that the conditions are satisfied.

7. The server according to claim 1, wherein the means for determining determines whether the conditions are satisfied regardless of the presence or absence of an instruction for generating video data related to a part of the live broadcast by the viewer.

8. The transmitting means transmits video data related to the live broadcast to a plurality of terminals of a plurality of viewers via the network, The notifying means notifies a plurality of terminals of a plurality of viewers via the network when it is determined that the conditions are satisfied, The server according to claim 1, wherein the means for performing processing performs processing for generating video data related to a part of the live broadcast in association with one of the plurality of viewers when a response to the notification is received from the terminal of one of the plurality of viewers via the network.

9. The server according to claim 8, further comprising means for transmitting, via the network, information indicating the number of times video data related to a part of the live broadcast has been generated to the terminal of the distributor of the live broadcast.

10. A computer program for causing a terminal of a viewer of a live broadcast to implement: a function of receiving video data related to the live broadcast from a server via a network; and a function of starting a display prompting an instruction for generating video data related to a part of the live broadcast in association with the viewer on the live broadcast screen when it is determined that conditions related to gifting or comments or both during the live broadcast are satisfied.

11. The function of starting is to start displaying a comment related to the generation of video data related to a part of the live broadcast in the comment display area of the live broadcast screen, and / or to start displaying an icon related to the generation of video data related to a part of the live broadcast on the live broadcast screen. The computer program further causes the terminal to implement: a function of transmitting, via the network, an instruction for generating video data related to a part of the live broadcast in association with the viewer to the server when the comment or icon is specified by the viewer, as claimed in claim 10.

12. The terminal is further caused to implement a function of displaying, on the live broadcast screen regardless of whether the conditions are satisfied, an icon for receiving an instruction for generating video data related to a part of the live broadcast in association with the viewer. The computer program as claimed in claim 10, wherein the function of starting is to start highlighting the icon.

13. The terminal is further caused to implement a function of displaying, on the live broadcast screen regardless of whether the conditions are satisfied, another icon for receiving an instruction for generating video data related to a part of the live broadcast in association with the viewer, as claimed in claim 11.

14. The computer program as claimed in claim 13, wherein the function of starting is to start highlighting the another icon.

15. A method comprising: transmitting, via a network, video data related to a live broadcast to a terminal of a viewer; determining whether conditions related to gifting or comments or both during the live broadcast are satisfied; notifying the terminal of the viewer via the network when it is determined that the conditions are satisfied; and performing processing for generating video data related to a part of the live broadcast in association with the viewer when a response to the notification is received from the terminal of the viewer via the network. ​ ​ ​

Images