Computer program and terminal

Abstract

To provide a computer program and a terminal that achieve live distribution that can be enjoyed by more viewers by increasing the variety of gift use experiences in the live distribution.SOLUTION: A live distribution system 1 provides an interactive live distribution service that allows real-time interaction between a distributor (liver, streamer LV) and viewers (audience AU1, AU2, ...). A computer program is transmitted from a server 10 to web browsers of user terminals 20, 30 via a network NW and is executed by the web browsers. The computer program achieves a function for shifting from a live distribution screen for displaying in real time a moving image generated at a terminal of the distributor on a terminal of a viewer of the live distribution when the distributor stops the live distribution to a post-distribution screen for displaying a predetermined image and a function for accepting an instruction of a gift use from the viewer on the post-distribution screen.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] This disclosure relates to computer programs and terminals.

Background Art

[0002] With the development of IT technology, the ways of information exchange have changed. In the Showa era, one-way information transmission such as newspapers and televisions was dominant. In the Heisei era, mobile phones and personal computers became popular, and the communication speed of the Internet was greatly improved. As a result, real-time two-way communication services such as chat services emerged, and on-demand video distribution services were accepted with the reduction of storage costs. Currently, in the Reiwa era, with the high functionality of smartphones and the further improvement of network speeds represented by 5G, services that realize real-time communication by video, especially live streaming services, are rapidly increasing in popularity. Live streaming services, as services that allow everyone to share the same enjoyable time even when they are in different places, are expanding their users mainly among young people.

[0003] Gifts such as tipping are an important factor in boosting live streaming and an important source of income for streamers. Patent Document 1 discloses a technique for boosting distribution by displaying a tipping effect image during live streaming.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] Generally, when viewers send gifts during a live stream, the streamer can see in real time who sent what through effects and comments, allowing them to immediately express gratitude or take action such as performing. This has become an established form of communication between streamers and viewers in live streams.

[0006] On the other hand, some viewers want to support streamers without drawing attention to themselves. The current gift usage experience described above cannot accommodate this desire.

[0007] This disclosure is made in light of these challenges, and its purpose is to provide technology that enables live streaming to be enjoyed by more viewers by increasing the variety of gift usage experiences during live streaming. [Means for solving the problem]

[0008] One aspect of the present invention relates to a computer program. This computer program provides a function to transition the terminal of a live stream viewer from a live stream screen that displays a video generated on the streamer's terminal in real time to a post-stream screen that displays a predetermined image when the streamer stops the live stream, and a function to receive instructions from the viewer to use a gift on the post-stream screen.

[0009] Another aspect of the present invention is also a computer program. This computer program provides a live streamer's terminal with the function of receiving instructions from the streamer to stop the live stream, and the function of displaying a screen containing information related to the live stream on the display after the live stream has been stopped. The information includes information about gifts used by the viewer on the post-stream screen displayed on the viewer's terminal when the live stream is stopped.

[0010] Yet another aspect of the present invention is also a computer program. This computer program provides a terminal for a live stream viewer with the following functions: the ability to receive instructions from the viewer to stop watching the live stream; and the ability to display a screen on the display asking the live stream broadcaster whether or not to use a gift in response to the stoppage of the live stream.

[0011] Yet another aspect of the present invention is also a computer program. This computer program provides the terminal of a live stream viewer with the following functions: a function to receive instructions from the viewer to use a gift during the live stream, and a function to stop the display of the video related to the live stream in response to receiving an instruction to use a gift.

[0012] Furthermore, any combination of the above components, or any substitution of components or expressions of the present invention between devices, methods, systems, computer programs, recording media storing computer programs, etc., are also valid embodiments of the present invention. [Effects of the Invention]

[0013] According to the present invention, by increasing the variety of gift usage experiences in live streaming, it is possible to realize live streaming that can be enjoyed by more viewers. [Brief explanation of the drawing]

[0014] [Figure 1] This is a schematic diagram showing the configuration of a live streaming system according to an embodiment of the present disclosure. [Figure 2] Figure 1 is a block diagram showing the functions and configuration of the user terminal. [Figure 3] This block diagram shows the functions and configuration of the server in Figure 1. [Figure 4] Figure 3 is a data structure diagram showing an example of a stream database. [Figure 5] Figure 3 is a data structure diagram showing an example of a user database. [Figure 6]It is a data structure diagram showing an example of the gift DB in FIG. 3. [Figure 7] It is a data structure diagram showing an example of the post-delivery image DB in FIG. 3. [Figure 8] It is a data structure diagram showing an example of the off-delivery acquired gift DB in FIG. 3. [Figure 9] It is a schematic diagram showing the processing in the live delivery system before and after the deliverer stops the live delivery. [Figure 10] It is a chart showing the flow of processing in the live delivery system before and after the deliverer stops the live delivery. [Figure 11] It is a representative screen diagram of the live delivery selection screen displayed on the display of the viewer's user terminal. [Figure 12] It is a representative screen diagram of the live delivery room screen displayed on the display of the viewer's user terminal. [Figure 13] It is a representative screen diagram of the live delivery room screen on which the gift area is superimposed and displayed on the display of the viewer's user terminal. [Figure 14] It is a representative screen diagram of the live delivery room screen on which an effect is superimposed and displayed on the display of the viewer's user terminal. [Figure 15] It is a representative screen diagram of the live delivery room screen displayed on the display of the deliverer's user terminal. [Figure 16] It is a representative screen diagram of the live delivery room screen on which an effect is superimposed and displayed on the display of the deliverer's user terminal. [Figure 17] It is a representative screen diagram of the live delivery selection screen on which a dialog is superimposed and displayed on the display of the viewer's user terminal. [Figure 18] It is a representative screen diagram of the post-delivery screen displayed on the display of the viewer's user terminal. [Figure 19] It is a representative screen diagram of the live delivery analysis screen displayed on the display of the deliverer's user terminal. [Figure 20] It is a representative screen diagram of the timeline screen displayed on the display of the viewer's user terminal. [Figure 21] This is a block diagram showing an example of the hardware configuration of the information processing device according to this embodiment. [Figure 22] This is a representative screenshot of a live streaming room screen, where the gift area is superimposed and displayed on the viewer's user device screen. [Figure 23] This is a representative screenshot of a live streaming room screen where dialog boxes are superimposed and displayed on the viewer's user device screen. [Modes for carrying out the invention]

[0015] In the following, identical or equivalent components, members, processes, and signals shown in each drawing will be denoted by the same reference numerals, and redundant explanations will be omitted where appropriate. In addition, some components that are not explanatoryly important in each drawing will be omitted from the display.

[0016] In the live streaming system according to this embodiment, a mechanism is provided that allows viewers to send gifts to the streamer for a certain period of time when the live stream ends or when viewers leave the live stream. In this mechanism, the streamer is not notified in real time of the gift being sent, but it is possible to see who sent the gift on the live stream analytics screen, which becomes available after the live stream has stopped.

[0017] This system allows viewers to send gifts without the streamer receiving a real-time notification, enabling them to send gifts with a casual "Thank you for your hard work!" kind of feeling. As a result, a live streaming platform is created where viewers who want to support streamers discreetly can also enjoy gifting.

[0018] Figure 1 is a schematic diagram showing the configuration of a live streaming system 1 according to an embodiment of the present disclosure. The live streaming system 1 provides a two-way live streaming service that allows broadcasters (also called Livers or Streamers) LV and viewers (also called audiences) AU (AU1, AU2, ...) to communicate in real time. As shown in Figure 1, the live streaming system 1 comprises a server 10, a user terminal 20 on the broadcaster's side, and user terminals 30 (30a, 30b, ...) on the viewer's side. Broadcasters and viewers are sometimes collectively referred to as users. The server 10 may be composed of one or more information processing devices connected to a network NW. User terminals 20 and 30 may be mobile terminals such as smartphones, tablet terminals, laptop PCs, recorders, portable game consoles, or wearable devices, or they may be stationary devices such as desktop PCs. The server 10, user terminals 20 and 30 are connected to each other via various wired or wireless networks NW so that they can communicate with one another.

[0019] The live streaming system 1 involves a streamer (LV), a viewer (AU), and an administrator (not shown) who manages the server 10. The streamer (LV) is a person who broadcasts content in real time by recording or videotaping their own songs, talks, performances, fortune-telling, game commentary, etc., on their user terminal 20 and uploading it directly to the server 10. In this embodiment, the streamer (LV) provides fortune-telling to the viewer (AU) through live streaming. The administrator provides a platform for live streaming of content on the server 10 and mediates or manages real-time interactions between the streamer (LV) and the viewer (AU). The viewer (AU) accesses the platform on their user terminal 30, selects the desired content, and watches it. During the live streaming of this content, the viewer (AU) performs operations via their user terminal 30 to comment, show support, or request fortune-telling. The streamer (LV) providing the content responds to such comments, support, and requests, and this response is transmitted to the viewer (AU) via video and / or audio, thus establishing two-way communication.

[0020] In this specification, "live streaming" may mean a data transmission method that enables content recorded on the broadcaster LV's user terminal 20 to be played back and viewed on the viewer AU's user terminal 30 in substantially real time, or it may mean the streaming itself realized by such a transmission method. Live streaming may be realized using existing live streaming technologies such as HTTP Live Streaming, Common Media Application Format, Web Real-Time Communications, Real-Time Messaging Protocol, or MPEG DASH. Live streaming includes a transmission method that enables the viewer AU to view the content with a predetermined delay while the broadcaster LV is recording the content. Regarding the magnitude of the delay, at least a delay large enough for communication between the broadcaster LV and the viewer AU to take place is permitted. However, live streaming is distinguished from so-called on-demand streaming, where the entire data of the recorded content is temporarily stored on a server, and then the data is provided to the user from the server at any time requested by the user.

[0021] In this specification, "video data" refers to data that includes image data (also called video data) generated by the imaging function of user terminals 20 and 30, and audio data (also called audio data) generated by the audio input function of user terminals 20 and 30. The video data is played back on user terminals 20 and 30, enabling users to view the content. In this embodiment, it is assumed that between the time the video data is generated on the distributor's user terminal and the time it is played back on the viewer's user terminal, processing is performed to change the format, size, and specifications of the data, such as compression, decompression, encoding, decoding, and transcoding. Since the content represented by the video data (e.g., moving images and sound) does not substantially change before and after such processing, in this embodiment, the video data after such processing is described as being the same as the video data before such processing. That is, when video data is generated on the distributor's user terminal and then played back on the viewer's user terminal via the server 10, the video data generated on the distributor's user terminal, the video data passing through the server 10, and the video data received and played back on the viewer's user terminal are all the same video data.

[0022] In the example shown in Figure 1, the streamer LV is live-streaming fortune-telling. The streamer LV's user terminal 20 generates video data by recording the image and sound of the streamer LV performing the fortune-telling, and transmits it to the server 10 via the network NW. In addition, the user terminal 20 displays the recorded video VD of the streamer LV on its display, allowing the streamer LV to confirm the content of the broadcast.

[0023] The user terminals 30a and 30b of viewers AU1 and AU2, who requested the platform to view the live stream of broadcaster LV, respectively receive video data related to the live stream via the network NW. By playing the received video data, they display video images VD1 and VD2 on their displays and output sound from their speakers. The video images VD1 and VD2 displayed on each user terminal 30a and 30b are substantially identical to the video image VD captured by broadcaster LV's user terminal 20, and the sound output by each user terminal 30a and 30b is substantially identical to the sound recorded by broadcaster LV's user terminal 20.

[0024] The recording and video recording on the broadcaster LV's user terminal 20 and the playback of video data on the viewer AU1 and AU2's user terminals 30a and 30b are performed substantially simultaneously. When one viewer AU1 enters a comment on the content of the broadcaster LV's fortune-telling into user terminal 30a, server 10 displays the comment in real time on the broadcaster LV's user terminal 20, as well as on the user terminals 30a and 30b of each viewer AU1 and AU2. When the broadcaster LV reads the comment and engages in conversation over its content, the video and audio of that conversation are output to the user terminals 30a and 30b of each viewer AU1 and AU2, thereby recognizing that a conversation has taken place between the broadcaster LV and viewer AU1. In this way, the live streaming system 1 realizes live streaming that enables two-way communication rather than one-way communication.

[0025] Figure 2 is a block diagram showing the functions and configuration of user terminal 20 in Figure 1. User terminal 30 has the same functions and configuration as user terminal 20. Each block shown in Figure 2 and subsequent block diagrams can be realized in hardware terms by elements and mechanical devices such as the CPU of a computer, and in software terms by computer programs, etc., but here we are depicting functional blocks that are realized through the cooperation of these. Therefore, it will be understood by those skilled in the art who have read this specification that these functional blocks can be realized in various ways by combinations of hardware and software.

[0026] The broadcaster (LV) and viewer (AU) download and install the live streaming application program according to this embodiment (hereinafter referred to as the live streaming app) from a download site via the network (NW) to the user terminals 20 and 30. Alternatively, the live streaming app may be pre-installed on the user terminals 20 and 30. When the live streaming app is executed by the user terminals 20 and 30, the user terminals 20 and 30 communicate with the server 10 via the network (NW) and realize various functions. Hereinafter, the functions realized by the execution of the live streaming app by the user terminals 20 and 30 (their CPUs or other processors) will be described as functions of the user terminals 20 and 30. These functions are actually functions that the live streaming app enables on the user terminals 20 and 30. In other embodiments, these functions may be realized by a computer program written in a programming language such as HTML (HyperText Markup Language), which is transmitted from the server 10 to the web browser of the user terminals 20 and 30 via the network (NW) and executed by that web browser.

[0027] The user terminal 20 includes a distribution unit 100 that generates video data recording the user's image and voice and provides it to the server 10, a viewing unit 200 that acquires and plays the video data from the server 10, an analysis result provision unit 250, and a timeline provision unit 260. The user activates the distribution unit 100 when distributing, and the viewing unit 200 when viewing. The user terminal with the distribution unit 100 active is the distributor side, i.e., the user terminal that generates the video data, and the user terminal with the viewing unit 200 active is the viewer side, i.e., the user terminal that plays the video data.

[0028] The distribution unit 100 includes an image capture control unit 102, an audio control unit 104, a video transmission unit 106, and a distribution-side UI control unit 108. The image capture control unit 102 is connected to a camera (not shown in Figure 2) and controls image capture by the camera. The image capture control unit 102 acquires image data from the camera. The audio control unit 104 is connected to a microphone (not shown in Figure 2) and controls audio input from the microphone. The audio control unit 104 acquires audio data from the microphone. The video transmission unit 106 transmits video data, including image data acquired by the image capture control unit 102 and audio data acquired by the audio control unit 104, to the server 10 via the network NW. The transmission of video data by the video transmission unit 106 is performed in real time. That is, the generation of video data by the image capture control unit 102 and the audio control unit 104, and the transmission of the generated video data by the video transmission unit 106 are performed substantially simultaneously. The distribution-side UI control unit 108 controls the UI for the distributor. The distribution-side UI control unit 108 is connected to a display (not shown in Figure 2) and displays moving images on the display by playing the video data that is to be transmitted by the video transmission unit 106. The distribution-side UI control unit 108 displays operation objects and instruction receiving objects on the display and accepts tap input from the broadcaster.

[0029] The viewing unit 200 includes a viewing-side UI control unit 202, a superimposed information generation unit 204, an input information transmission unit 206, and a post-distribution control unit 208. The viewing unit 200 receives video data related to live streaming in which the broadcaster and viewers participate from the server 10 via the network NW. The viewing-side UI control unit 202 controls the UI for viewers. The viewing-side UI control unit 202 is connected to a display and speaker (not shown in Figure 2) and plays the received video data to display the video on the display and output sound from the speaker. The simultaneous output of an image on the display and sound from the speaker can be said to mean that "video data is being played". The viewing-side UI control unit 202 is connected to input means such as a touch panel, keyboard, and display (not shown in Figure 2) and acquires user input via these input means. The superimposed information generation unit 204 superimposes a predetermined frame image onto the video data image acquired from the server 10. The frame image includes various user interface objects (hereinafter simply referred to as "objects") for receiving input from the user, comments entered by the viewer, and information obtained from the server 10. The input information transmission unit 206 transmits the user input obtained by the viewer-side UI control unit 202 to the server 10 via the network NW.

[0030] The post-broadcast control unit 208 controls the processing when the broadcaster stops the live broadcast and when viewers stop watching the live broadcast. The post-broadcast control unit 208 accepts instructions from viewers to use "Otsukare Gift" only within a predetermined period (hereinafter referred to as the "recovery period") after the broadcaster stops the live broadcast. The post-broadcast control unit 208 accepts instructions from viewers to use "Otsukare Gift" after they stop watching the live broadcast. Details of the functions of the post-broadcast control unit 208 will be described later.

[0031] The analysis result provision unit 250 provides the broadcaster with the results of its analysis of past live streams. When the analysis result provision unit 250 receives a request from the broadcaster to display the analysis results, it generates an analysis result request and sends it to the server 10 via the network NW. The analysis result provision unit 250 receives the analysis results from the server 10. Based on the received analysis results, the analysis result provision unit 250 generates a live stream analysis screen, described later, which includes information related to the live stream, and displays it on the display.

[0032] The timeline provider unit 260 obtains the user's timeline information from the server 10 and presents it to the user. When the timeline provider unit 260 receives a timeline display instruction from the user, it generates a timeline request and sends it to the server 10 via the network NW. The timeline provider unit 260 receives timeline information from the server 10. Based on the received timeline information, the timeline provider unit 260 generates the timeline screen described later and displays it on the display.

[0033] Figure 3 is a block diagram showing the functions and configuration of the server 10 in Figure 1. The server 10 includes a distribution information provision unit 302, a relay unit 304, a gift processing unit 308, a payment processing unit 310, a post-distribution image registration unit 322, a post-distribution image provision unit 324, a non-distribution gift registration unit 326, a distribution analysis unit 328, a timeline update unit 330, a stream DB 314, a user DB 318, a gift DB 320, a post-distribution image DB 332, a non-distribution acquired gift DB 334, and a timeline DB 336 that holds timeline information for each user.

[0034] Figure 4 is a data structure diagram showing an example of the Stream DB 314 in Figure 3. The Stream DB 314 holds information about live streaming that is currently taking place. The Stream DB 314 stores, in association with a Stream ID that identifies a live stream on the live streaming platform provided by the Live Streaming System 1, a Streamer ID which is a User ID that identifies the streamer of the live stream, and a Viewer ID which is a User ID that identifies the viewers of the live stream. In the live streaming platform provided by the Live Streaming System 1 according to this embodiment, when a user conducts a live stream, that user becomes a streamer, and when the same user watches a live stream conducted by another user, they become a viewer. Therefore, the distinction between streamer and viewer is not fixed, and a User ID that was registered as a Streamer ID at one time may be registered as a Viewer ID at another time.

[0035] Figure 5 is a data structure diagram showing an example of the user DB318 in Figure 3. The user DB318 holds information about users. The user DB318 associates a user ID that identifies a user, the points that the user possesses, and the rewards that have been awarded to the user. Points are electronic value that circulates within the live streaming platform. Users purchase points using credit cards or other payment methods. Rewards are an indicator used to determine the amount of money that a streamer receives from the administrator of the live streaming platform. On the live streaming platform, when viewers send gifts to streamers during or outside of live streams, the viewers' points are consumed, and the streamer's reward increases by a corresponding amount.

[0036] Figure 6 is a data structure diagram showing an example of the gift DB320 in Figure 3. The gift DB320 holds information about gifts that viewers can use during live streaming. A gift is electronic data with the following characteristics: • Can be purchased with points or money, or given away for free. • Something that viewers can send to streamers. Sending a gift to a streamer is also called using a gift or throwing a gift. Some gifts require both purchase and use to occur simultaneously, while others allow viewers to use them at their own discretion after purchase. When viewers send gifts to streamers, the streamers receive appropriate rewards. • When a gift is used, effects associated with the gift may occur. For example, an effect corresponding to the gift may appear on the live streaming room screen.

[0037] Gift DB320 stores a gift ID that identifies a gift, a reward given to the streamer when the gift is sent to the streamer, consideration points that must be paid when using the gift, and the type of gift, all associated with each other. Viewers can send a gift to the streamer during a live stream by paying the consideration points for the desired gift. This payment of consideration points may be made by an appropriate electronic payment method, for example, by the viewer paying the consideration points to the administrator. Alternatively, bank transfer or credit card payment may be used. The relationship between the reward and consideration points can be arbitrarily set by the administrator. For example, the reward may be set to equal the consideration points. Alternatively, the consideration points may be set to the points obtained by multiplying the reward by a predetermined coefficient such as 1.2, or the consideration points may be set to the points obtained by adding a predetermined fee point to the reward.

[0038] The type of gift indicates whether it is a regular gift or a "thank you gift." Regular gifts can be used within a live stream and are disabled for use outside of live streams. Thank you gifts can be used outside of live streams, and are especially disabled for use during the recovery period after the streamer stops streaming and when viewers stop watching.

[0039] Figure 7 is a data structure diagram showing an example of the post-broadcast image DB332 in Figure 3. The post-broadcast image DB332 stores the post-broadcast images displayed on the viewer's user terminal 30 during the retrieval period. The post-broadcast image DB332 stores the broadcaster's broadcaster ID and the image data of the post-broadcast images registered by that broadcaster in association. In the example in Figure 7, the post-broadcast image DB332 stores the image data of a common post-broadcast image that is displayed after a live broadcast by a broadcaster who has not registered a post-broadcast image in advance, as the image data corresponding to broadcaster ID=(default).

[0040] Figure 8 is a data structure diagram showing an example of the off-stream gift DB334 in Figure 3. The off-stream gift DB334 holds information about gifts received by the streamer outside of live streaming. In particular, the off-stream gift DB334 holds information about "thank you" gifts received by the streamer during the collection period after the live stream has ended, and information about "thank you" gifts received from viewers when they stop watching the live stream. The off-stream gift DB334 stores the stream ID of the finished live stream or the live stream that was stopped being watched, the gifter ID that identifies the viewer who used the "thank you" gift, and the gift ID and gift type that identify the "thank you" gift used by that viewer, in association with each other.

[0041] Returning to Figure 3, when the distribution information provision unit 302 receives notification from the broadcaster's user terminal 20 via the network NW that a live broadcast will be started, it registers the stream ID that identifies the live broadcast and the broadcaster ID of the broadcaster of the live broadcast in the stream DB 314. When the distribution information provision unit 302 receives a request for information about live broadcasts from the viewing unit 200 of the viewer's user terminal 30 via the network NW, it refers to the stream DB 314 and generates a list of currently viewable live broadcasts. The distribution information provision unit 302 sends the generated list to the requesting user terminal 30 via the network NW. The viewing-side UI control unit 202 of the requesting user terminal 30 generates a live broadcast selection screen based on the received list and displays it on the user terminal 30's display.

[0042] When the input information transmission unit 206 of the user terminal 30 receives a live stream selection from a viewer on the live stream selection screen, it generates a distribution request including the stream ID of the selected live stream and sends it to the server 10 via the network NW. The distribution information provision unit 302 starts providing the live stream identified by the stream ID included in the received distribution request to the requesting user terminal 30. The distribution information provision unit 302 updates the stream DB 314 so that the viewer ID of the stream ID includes the user ID of the viewer on the requesting user terminal 30.

[0043] The relay unit 304 relays the transmission of video data from the broadcaster's user terminal 20 to the viewer's user terminal 30 in a live broadcast initiated by the distribution information provision unit 302. The relay unit 304 receives signals from the input information transmission unit 206 indicating user input from the viewer during the live broadcast, i.e., during the playback of video data. The signals indicating user input may be object specification signals indicating the specification of an object displayed on the user terminal 30's display, and such object specification signals include the viewer's viewer ID, the broadcaster ID of the broadcaster conducting the live broadcast that the viewer is watching, and an object ID that identifies the object. If the object is a gift, the object ID becomes the gift ID. Similarly, the relay unit 304 receives signals indicating user input from the broadcaster during the playback of video data, such as object specification signals, from the distribution unit 100 of the user terminal 20.

[0044] When the relay unit 304 receives a live streaming stop signal from a viewer's user terminal 30 indicating that the viewer has stopped watching the live stream, it stops transmitting the video data related to the live stream to the user terminal 30 that sent the signal. The live streaming stop signal includes the viewer's viewer ID and the stream ID of the live stream that the viewer stopped watching. At the same time, the relay unit 304 updates the stream DB 314 so that the viewer ID included in the received live streaming stop signal is removed from the viewer ID of the stream ID included in the signal.

[0045] The gift processing unit 308 updates the user DB 318 to increase the distributor's reward according to the reward granted for the gift identified by the gift ID included in the object specification signal. The gift processing unit 308 refers to the gift DB 320 and identifies the reward granted corresponding to the gift ID included in the received object specification signal. The gift processing unit 308 updates the user DB 318 to add the identified reward granted to the reward corresponding to the distributor ID included in the object specification signal.

[0046] The payment processing unit 310 processes the payment of the gift by the viewer in response to the receipt of the object specification signal. The payment processing unit 310 refers to the gift DB 320 and identifies the gift points identified by the gift ID included in the object specification signal. The payment processing unit 310 updates the user DB 318 to subtract the identified gift points from the viewer points identified by the viewer ID included in the object specification signal.

[0047] The post-distribution image registration unit 322 accepts pre-registration of post-distribution images by the distributor. The distributor's user terminal 20 displays a screen on its display that accepts input of post-distribution images, and the distributor inputs the desired post-distribution image on this screen. When the user terminal 20 receives the input of a post-distribution image, it generates a post-distribution image registration request that includes that post-distribution image and sends it to the server 10 via the network NW. When the post-distribution image registration unit 322 receives the post-distribution image registration request from the distributor's user terminal 20, it registers the post-distribution image included in the request in the post-distribution image DB 332, associating it with the distributor ID of the distributor who sent the request. This allows the distributor to pre-register post-distribution images.

[0048] When the post-broadcast image provision unit 324 receives notification from the broadcaster's user terminal 20 that the live broadcast has ended, it obtains a post-broadcast image corresponding to the broadcaster's broadcaster ID from the post-broadcast image registration unit 322. If there is no prior registration, the post-broadcast image provision unit 324 obtains a default post-broadcast image. The post-broadcast image provision unit 324 transmits the obtained post-broadcast image to the user terminal 30 of the viewer who was watching the finished live broadcast until the end of the broadcast via the network NW. The post-broadcast image provision unit 324 identifies the target viewer (user terminal 30) by referring to the stream DB 314. The user terminal 30 generates a post-broadcast screen from the post-broadcast image. The post-broadcast screen is displayed on the user terminal 30's display during the recovery period of the finished live broadcast.

[0049] The off-stream gift registration unit 326 registers information about gifts sent from viewers to the streamer (or from one user to another) outside of live streaming in the off-stream acquired gift DB 334. In particular, the off-stream gift registration unit 326 registers information about "thank you" gifts that can be used within the collection period in the off-stream acquired gift DB 334. The off-stream gift registration unit 326 also registers information about "thank you" gifts sent by viewers when they stop watching in the off-stream acquired gift DB 334.

[0050] "Otsukare Gifts" are gifts used outside of live streams, but the reward granting and payment processing associated with their use are the same as those for regular gifts used within live streams. The difference between regular gifts and Otsukare Gifts lies in the real-time nature of notifications. Notifications regarding regular gifts to streamers are made in real time. Notifications regarding Otsukare Gifts to streamers are made non-real-time. For example, when a regular gift is used within a live stream, effects corresponding to the viewer's user device 30 and the streamer's user device 20 are displayed, so the streamer can know in real time that a regular gift has been used. No such effect is generated when an Otsukare Gift is used within the collection period. As will be described later, the use of an Otsukare Gift is notified to the streamer non-real-time through the live stream analytics screen.

[0051] When the distribution analysis unit 328 receives an analysis result request from the broadcaster's user terminal 20, it analyzes various metrics of the broadcaster's past live streams (number of viewers, number of new viewers, broadcast time, points earned, rewards earned, etc.) and generates analysis results. The distribution analysis unit 328 also refers to the non-broadcast acquired gift DB 334 and obtains information on "Otsukare Gifts" used during the collection period of the target past live stream, as well as information on "Otsukare Gifts" used when viewers stopped watching the live stream midway, and includes this information in the analysis results. The distribution analysis unit 328 sends the generated analysis results to the requesting user terminal 20.

[0052] The timeline update unit 330 updates the timeline database 336. When the timeline update unit 330 receives a timeline request from a user's user terminal, it retrieves the user's timeline information from the timeline database 336. The timeline update unit 330 sends the retrieved timeline information to the user terminal of the requesting user.

[0053] The operation of the live streaming system 1 with the above configuration will now be explained. Figure 9 is a schematic diagram showing the processing in the live streaming system 1 before and after the streamer stops the live stream. In Figure 9, the processing is shown chronologically from left to right, so we will explain it in that order. First, the streamer generates the desired post-stream image on their user terminal 20 before starting the live stream. The user terminal 20 sends the generated post-stream image to the server 10. The post-stream image registration unit 322 of the server 10 registers the received post-stream image in the post-stream image DB 332.

[0054] The broadcaster conducts a live stream using their own user terminal 20, and viewers A, B, and C watch the live stream using their respective user terminals 30a, 30b, and 30c. The live stream room screen is displayed on the displays of user terminals 20, 30a, 30b, and 30c. When viewer A uses a regular gift 502 during the live stream, the corresponding effect 504 and a comment stating "Viewer A has sent a regular gift" are displayed on the live stream room screens of user terminals 20, 30a, 30b, and 30c. This is achieved when viewer A's user terminal 30a generates an object specification signal including the gift ID of the regular gift 502 and sends it to the server 10, the gift processing unit 308 of the server 10 extracts the gift ID and viewer ID from the received object specification signal and includes them in an effect generation instruction signal, the gift processing unit 308 sends the effect generation instruction signal to the broadcaster's user terminal 20 and the user terminals 30b and 30c of other viewers B and C, and each user terminal displays an effect and comment based on the effect generation instruction signal received. As a result, the broadcaster can know in real time that viewer A has sent them a regular gift.

[0055] Viewer C stops watching the live stream before the streamer stops watching. Viewer C's user terminal 30c receives the instruction to stop watching and immediately stops displaying the live stream room screen, then displays a dialog on the display asking Viewer C whether or not to send an "Otsukare Gift 506" to the streamer. If Viewer C chooses to send it, user terminal 30c generates an "Otsukare Gift Usage Signal" indicating the use of the "Otsukare Gift 506" and sends it to server 10. The "Otsukare Gift Usage Signal" includes the viewer ID of the viewer who used the "Otsukare Gift", the stream ID that identifies the live stream that the viewer stopped watching, the streamer ID of the streamer of that live stream, and the gift ID that identifies the "Otsukare Gift" that was used. The gift processing unit 308 and payment processing unit 310 of server 10 perform reward granting processing and payment processing, respectively, based on the received "Otsukare Gift Usage Signal". When the non-streaming gift registration unit 326 of server 10 receives the "Otsukare Gift Usage Signal", it refers to the gift DB 320 and identifies the type of "Otsukare Gift" corresponding to the gift ID included in the signal. The undelivered gift registration unit 326 adds a new entry to the undelivered acquired gift DB 334 according to the information contained in the received Otsukare gift usage signal and the identified Otsukare gift type. The stream ID, gifter ID, gift ID, and gift type of the entry are set to the stream ID, viewer ID, gift ID, and identified Otsukare gift type contained in the received Otsukare gift usage signal, respectively.

[0056] Figure 10 is a chart showing the processing flow in the live streaming system 1 before and after the streamer stops the live stream. The following explanation will refer to Figures 9 and 10. The streaming-side UI control unit 108 of the streamer's user terminal 20 receives a stream termination instruction from the streamer to stop the live stream (S202). Upon receiving the stream termination instruction, the streaming-side UI control unit 108 generates a live stream termination signal indicating the end of the live stream and sends it to the server 10 via the network NW (S204). The live stream termination signal includes the streamer's streamer ID and the stream ID of the live stream that the streamer has terminated. Upon receiving the stream termination instruction, the streaming-side UI control unit 108 stops displaying the live streaming room screen (S206). As a result, the display on the streamer's user terminal 20 may transition to a predetermined screen such as the home screen of the live streaming application.

[0057] When the post-distribution image provision unit 324 of server 10 receives a live distribution termination signal, it refers to the post-distribution image DB 332 and identifies the post-distribution image corresponding to the broadcaster ID included in the signal (S208). The post-distribution image provision unit 324 refers to the stream DB 314 and identifies the viewer ID corresponding to the stream ID included in the live distribution termination signal as the viewer ID of the viewer to whom the post-distribution image is to be sent (S210). The viewer with the viewer ID identified in this way is the viewer who was watching the live distribution when the broadcaster stopped the live distribution. The post-distribution image provision unit 324 refers to the gift DB 320 and identifies the gift ID of an available "thank you gift". The post-distribution image provision unit 324 transmits the post-distribution image and gift ID identified in step S208 to the user terminal 30 of the viewer identified in step S210 via the network NW (S212). In the examples shown in Figures 9 and 10, in step S210, viewers A and B are identified as the destination viewers, and the post-distribution image is sent to viewer A's user terminal 30a and viewer B's user terminal 30b.

[0058] When the post-distribution control unit 208 of viewer A's user terminal 30a receives the post-distribution image and gift ID from the server 10, it generates a post-distribution screen that includes the post-distribution image and the gift object of the "Otsukare Gift" (S214). The post-distribution control unit 208 transitions the display of the user terminal 30a from the live distribution room screen to the post-distribution screen (S216). The post-distribution control unit 208 accepts instructions to use the "Otsukare Gift" on the post-distribution screen (S218). If the post-distribution control unit 208 accepts instructions to use the "Otsukare Gift" (Y in S218), it generates an "Otsukare Gift usage" signal and sends it to the server 10 via the network NW (S220). The "Otsukare Gift usage" signal includes the viewer ID of the viewer who used the "Otsukare Gift", the stream ID that identifies the completed live distribution, the broadcaster ID of the broadcaster of the live distribution, and the gift ID that identifies the "Otsukare Gift" that was used. The gift processing unit 308 and payment processing unit 310 of server 10 perform reward granting processing (S222) and payment processing (S224) respectively based on the received tired gift usage signal. When the off-delivery gift registration unit 326 of server 10 receives a tired gift usage signal, it refers to the gift DB 320 and identifies the type of tired gift corresponding to the gift ID contained in the signal. The off-delivery gift registration unit 326 adds a new entry to the off-delivery acquired gift DB 334 according to the information contained in the received tired gift usage signal and the identified type of tired gift (S226). The stream ID, gifter ID, gift ID, and gift type of the entry are set to the stream ID, viewer ID, gift ID, and identified type of tired gift contained in the received tired gift usage signal, respectively. In the example in Figure 9, viewers A and B use tired gift 508 within the collection period.

[0059] If the "Thank You Gift" is not accepted in step S218, or after generating and sending the "Thank You Gift Used" signal, the post-distribution control unit 208 determines whether the retrieval period has ended (S228). The length of the retrieval period can be arbitrarily set by the administrator. For example, the length of the retrieval period can be set to 30 seconds, 1 minute, 3 minutes, etc. The post-distribution control unit 208 has a timer function, and this timer starts counting from the screen transition in step S216. In step S228, the timer count value and the length of the retrieval period are compared, and if the former is smaller than the latter, the process returns to step S218. Otherwise, the process proceeds to step S230. When the retrieval period has ended, the post-distribution control unit 208 stops displaying the post-distribution screen (S230). As a result, the display on viewer A's user terminal 30a may transition to a predetermined screen such as the home screen of the live streaming application. The same process as viewer A's user terminal 30a is performed on viewer B's user terminal 30b.

[0060] After the collection period for a live stream that has ended has finished, the streamer can view the live stream analysis screen for that live stream. As described above, the analysis result provision unit 250 of the user terminal 20 generates the live stream analysis screen in response to a request from the streamer and displays it on the display. This live stream analysis screen includes information on the "Otsukare Gift" (thank you gift) stored in the non-stream acquired gift DB 334.

[0061] Figure 11 is a representative screen view of the live stream selection screen 600 displayed on the viewer's user terminal 30. The live stream selection screen 600 includes thumbnails 602 representing each live stream in the list of currently viewable live streams received from the server 10. The viewer-side UI control unit 202 generates the live stream selection screen 600 based on the list of live streams obtained from the server 10 and displays it on the display.

[0062] Figure 12 is a representative screen view of the live streaming room screen 608 displayed on the viewer's user terminal 30. When a viewer taps the thumbnail 602 on the live streaming selection screen 600 in Figure 11, the live streaming room screen 608 in Figure 12 is displayed on the screen. The live streaming room screen 608 displays the video generated on the broadcaster's user terminal 20 in real time. The live streaming room screen 608 includes the broadcaster's video 610 obtained by playing video data received from the server 10, a gift object 612, a comment input area 616, a comment display area 618, and an end-viewing button 620. The live streaming room screen 608 is generated when the viewer-side UI control unit 202 plays video data to obtain the video 610, and the superimposed information generation unit 204 superimposes other objects, namely the gift object 612, the comment input area 616, the comment display area 618, and the end-viewing button 620 onto it.

[0063] The comment display area 618 may include comments entered by viewers, comments entered by other viewers, and notifications from the system. Notifications from the system include information indicating who sent which gifts to the streamer. The superimposed information generation unit 204 generates a comment display area 618 that includes comments from other viewers and notifications from the system received from the server 10, and the viewer-side UI control unit 202 includes the generated comment display area 618 in the live streaming room screen 608.

[0064] The comment input area 616 accepts comments from viewers. The input information transmission unit 206 generates a comment input signal containing the comments entered in the comment input area 616 and transmits it to the server 10 via the network NW. Simultaneously, the superimposed information generation unit 204 updates the comment display area 618 to display the comments entered in the comment input area 616.

[0065] The "End Viewing" button 620 is an object that receives instructions from viewers to stop watching the live stream.

[0066] When the input information transmission unit 206 of the user terminal 30 detects a tap on the gift object 612, it generates a gift information request and sends it to the server 10 via the network NW. Upon receiving the gift information request, the server 10 refers to the gift DB 320 to identify the gift ID of an available gift. In this case, since it is live streaming, the gift ID of a regular gift is identified, and the gift ID of a thank-you gift is not identified. The server 10 generates gift information including the identified gift ID and sends it to the requesting user terminal 30. The superimposed information generation unit 204 of the user terminal 30 generates a gift area 622 for accepting gift selection based on the received gift information. The gift area 622 includes the gift object 624 of the gift identified by the gift ID included in the received gift information. The viewer-side UI control unit 202 displays the generated gift area 622 on the live streaming room screen 608.

[0067] Figure 13 is a representative screen view of the live streaming room screen 608, which is displayed on the viewer's user terminal 30 with the gift area 622 superimposed. The gift area 622 includes a gift object 624 for a normal gift. When a viewer taps the gift object 624 in the gift area 622 on the live streaming room screen 608 in Figure 13, the viewer-side UI control unit 202 of the user terminal 30 accepts the viewer's designation of the gift object 624. The superimposed information generation unit 204 generates an effect 626 corresponding to the normal gift represented by the designated gift object 624. The viewer-side UI control unit 202 displays the generated effect 626 on the live streaming room screen 608. At the same time, the input information transmission unit 206 generates an object designation signal including the gift ID of the normal gift represented by the designated gift object 624 and sends it to the server 10.

[0068] Figure 14 is a representative screen view of the live streaming room screen 608, which is displayed on the viewer's user terminal 30 with the effect 626 superimposed. The comment display area 618 in Figure 14 includes a system message 638 indicating that a viewer (user ID "SS5" in this example) has sent a regular gift ("heart" in this example) to the broadcaster. The system message 638 may also be included in the reply to the object designation signal described above.

[0069] Figure 15 is a representative screen view of the live streaming room screen 630 displayed on the display of the broadcaster's user terminal 20. When the broadcaster starts live streaming on the user terminal 20, the live streaming room screen 630 shown in Figure 15 is displayed on the display. The live streaming room screen 630 displays the video generated on the broadcaster's user terminal 20 in real time. The live streaming room screen 630 has a video of the broadcaster 632 obtained by playing video data generated on the broadcaster's user terminal 20, a comment display area 634, and a broadcast end button 636. The video 632 is substantially the same as the video 610 of the live streaming room screen 608 displayed on the display of the viewer's user terminal 30. The comment display area 634 is substantially the same as the comment display area 618 of the live streaming room screen 608 displayed on the display of the viewer's user terminal 30.

[0070] Figure 16 is a representative screen view of the live streaming room screen 630 with effect 642 superimposed, as displayed on the display of the streamer's user terminal 20. Figure 16 shows the live streaming room screen 630 as displayed on the display of the streamer's user terminal 20 when the live streaming room screen 608 of Figure 14 is displayed on the display of the viewer's user terminal 30. When the viewer's user terminal 30 receives an instruction from the viewer to use a normal gift, it generates an object specification signal including the gift ID of the normal gift and sends it to the server 10. The gift processing unit 308 of the server 10 extracts the gift ID and viewer ID from the received object specification signal and includes them in the effect generation instruction signal. The gift processing unit 308 sends the generated effect generation instruction signal to the streamer's user terminal 20 and the user terminals of other viewers. The streaming-side UI control unit 108 of the streamer's user terminal 20 displays the effect based on the received effect generation instruction signal and updates the comment display area 634. The comment display area 634 in Figure 16 includes a system message 640 indicating that a viewer has sent a normal gift to the streamer. This system message 640 is the same as system message 638 in the comment display area 618 of Figure 14.

[0071] If a viewer wants to stop watching a live stream, they tap the "End Viewing" button 620 on the live streaming room screen 608. When the post-stream control unit 208 of the viewer's user terminal 30 detects the tap on the "End Viewing" button 620, it accepts it as an instruction to stop watching the live stream. Upon receiving this instruction, the post-stream control unit 208 generates a live stream viewing stop signal that includes the viewer's viewer ID and the stream ID of the live stream that the viewer stopped watching, and sends it to the server 10 via the network NW. At the same time, the post-stream control unit 208 stops displaying the live streaming room screen 608 on the display and transitions to the live stream selection screen 600, which displays a dialog 646 overlaid on the screen asking the viewer whether or not to send a "thank you gift" to the streamer.

[0072] Figure 17 is a representative screen view of the live stream selection screen 600, which is displayed on the viewer's user terminal 30, with a dialog box 646 superimposed on it. Dialog box 646 is a screen that asks the viewer whether or not to use a gift for the live streamer when they stop watching the live stream. Dialog box 646 includes a gift object 644 for a "thank you gift" and a "don't send" button 648 to accept the instruction to exit dialog box 646 without sending a thank you gift. When the "don't send" button 648 is tapped, dialog box 646 disappears without sending a thank you gift.

[0073] In the dialog 646 of Figure 17, when a viewer taps the gift object 644, the post-distribution control unit 208 of the user terminal 30 receives the viewer's designation of the gift object 644. Upon receiving the designation of the gift object 644, the post-distribution control unit 208 generates an "Otsukare Gift Usage Signal" that includes the viewer ID of the viewer who designated the use of the Otsukare Gift corresponding to the gift object 644, the stream ID that identifies the live stream that the viewer stopped watching, the broadcaster ID of the broadcaster of the live stream, and the gift ID that identifies the Otsukare Gift that was used, and sends it to the server 10.

[0074] If a broadcaster wants to stop live streaming, they tap the end-stream button 636 on the live streaming room screen 630. The broadcast-side UI control unit 108 on the broadcaster's user terminal 20 detects the tap on the end-stream button 636 and accepts it as an instruction to end streaming. Upon receiving the instruction to end streaming, the broadcast-side UI control unit 108 generates a live streaming end signal and sends it to the server 10 via the network NW. Subsequently, the process described with reference to Figure 10 is performed. As a result, when the broadcaster stops live streaming, the display on the viewer's user terminal 30 transitions from the live streaming room screen 608 to the post-stream screen 650.

[0075] Figure 18 is a representative screen view of the post-broadcast screen 650 displayed on the viewer's user terminal 30. The post-broadcast screen 650 includes a timer object 652 indicating the remaining time of the retrieval period for the completed live broadcast, an end button 654, a post-broadcast image 656 pre-registered by the broadcaster of the completed live broadcast, and a gift object 658 for a thank-you gift. When the post-broadcast control unit 208 of the user terminal 30 detects a tap on the end button 654, it ends the retrieval period at that point regardless of the remaining time, and transitions the display from the post-broadcast screen 650 to the live broadcast selection screen 600. The post-broadcast control unit 208 also transitions the display from the post-broadcast screen 650 to the live broadcast selection screen 600 if the remaining time of the retrieval period becomes 0 without the end button 654 being tapped (the retrieval period expires). This allows the post-broadcast control unit 208 to accept instructions to use a thank-you gift only during the retrieval period.

[0076] The post-distribution control unit 208 of the user terminal 30 receives instructions from viewers to use a "Thank You Gift" on the post-distribution screen 650. When the post-distribution control unit 208 detects a tap on a gift object 658 displayed on the post-distribution screen 650, it generates a "Thank You Gift" usage signal including the gift ID of the "Thank You Gift" corresponding to the tapped gift object 658 and sends it to the server 10 via the network NW.

[0077] Figure 19 is a representative screen view of the live streaming analysis screen 660 displayed on the display of the streamer's user terminal 20. The live streaming analysis screen 660 includes a metric display area 662 that displays various metrics of the streamer's past live streams, and an Otsukare Gift information display area 664 that displays information about Otsukare Gifts used by viewers on the post-stream screen of the live stream. The Otsukare Gift information display area 664 is configured to allow the streamer to send a message to viewers who used Otsukare Gifts. The Otsukare Gift information display area 664 has the total value of reward points for Otsukare Gifts earned by the streamer in relation to the live stream being analyzed, detailed information about Otsukare Gifts indicating who used which Otsukare Gift, and a thank you button 666 for receiving instructions to send a thank you message to the giver of each Otsukare Gift earned.

[0078] When the broadcasting UI control unit 108 detects a tap on the thank you button 666, it generates a thank you message registration request that includes the broadcaster's broadcaster ID, the viewer ID of the sender of the thank you gift corresponding to the tapped thank you button 666, and the gift ID of the thank you gift, and sends it to the server 10 via the network NW. The timeline update unit 330 of the server 10 updates the timeline DB 336 to post or include a thank you message from the broadcaster, which includes information about the thank you gift identified by the gift ID included in the received thank you message registration request, to the timeline of the viewer whose viewer ID is included in the request. The thank you message may also be generated by filling in the blanks in a predefined message, which may contain blanks, with the information included in the thank you message registration request. For example, for a standard message such as "Thank you (blank 2) for the broadcast from (blank 1) (date)", you may insert the broadcaster ID included in the thank-you message registration request into (blank 1), the date of the live broadcast corresponding to the request into (date), and the type of thank-you gift identified by the gift ID included in the request into (blank 2).

[0079] Alternatively, the thank-you message may be generated on the broadcaster's user terminal 20. In this case, when the broadcaster's UI control unit 108 detects a tap on the thank-you button 666, it displays a screen on the display that accepts input for the thank-you message. The viewer ID of the viewer to whom the message will be sent may be pre-filled on this screen. This reduces the burden on the broadcaster.

[0080] Figure 20 is a representative screen view of the timeline screen 670 displayed on the viewer's user terminal 30. The timeline screen 670 includes a thank-you message 672 from the broadcaster to the viewer.

[0081] In the embodiments described above, examples of the holding portion include a hard disk and a semiconductor memory. Furthermore, it will be understood by those skilled in the art who have read this specification that each portion can be realized based on the description herein by a CPU (not shown), a module of an installed application program, a module of a system program, or a semiconductor memory that temporarily stores the contents of data read from the hard disk.

[0082] According to the live streaming system 1 of this embodiment, viewers can send "thank you gifts" to the streamer during the collection period after the live stream ends or immediately after leaving the live stream. Information about the "thank you gifts" received by the streamer is notified to the streamer in real time. This allows viewers to simply show their support to the streamer as a token of appreciation without having the streamer read out their gift. As a result, a live streaming platform is realized where viewers who, for example, do not want to stand out but still want to support the streamer can confidently and wholeheartedly support the streamer.

[0083] Furthermore, in the live streaming system 1 according to this embodiment, a post-stream image prepared by the streamer is displayed during the collection period after the live stream, and the acceptance of "thank you gifts" stops after the collection period has passed. This makes it possible to implement a collection period for "thank you gifts" in an application in a non-inappropriate manner. An example of real-world tipping is the monkey show held at Senso-ji Temple in Asakusa. In this show, the monkey performs a high-level performance towards the end, and then runs to the audience with a collection box, causing the audience to spontaneously give (real) tips. This embodiment implements such a non-inappropriate tipping collection method in an application.

[0084] Furthermore, in the live streaming system 1 according to this embodiment, viewers are given the option to send a "thank you gift" after the live stream ends or after they stop watching the live stream midway. Therefore, the amount of such "thank you gifts" used depends more on the quality of the live stream content than on the length of the live stream. Consequently, a system is provided that makes it easier for streamers who provide high-quality performance in a short amount of time to earn rewards.

[0085] Furthermore, in the live streaming system 1 according to this embodiment, notifications for "thank you gifts" sent after stopping viewing a live stream are not made in real time. That is, even if a thank you gift is sent, it will not appear as an effect on the live streaming room screen, but the fact that a thank you gift has been sent will be notified to the streamer through the live streaming analysis screen. Therefore, it is possible to strike a balance between the viewer's feelings of "I don't want my name called during the stream, but I want to support them" and "I want my goodwill to be conveyed," and the streamer's feelings of "I'm happy to know that there are so many people supporting me" and "Knowing that people have left during the stream might lead to a decrease in motivation."

[0086] Referring to Figure 21, the hardware configuration of the information processing device according to this embodiment will be described. Figure 21 is a block diagram showing an example of the hardware configuration of the information processing device according to this embodiment. The illustrated information processing device 900 can, for example, realize the server 10 and user terminals 20 and 30 in this embodiment.

[0087] The information processing device 900 includes a CPU 901, a ROM (Read Only Memory) 903, and a RAM (Random Access Memory) 905. The information processing device 900 may also include a host bus 907, a bridge 909, an external bus 911, an interface 913, an input device 915, an output device 917, a storage device 919, a drive 921, a connection port 925, and a communication device 929. Furthermore, the information processing device 900 may include an imaging device such as a camera (not shown). The information processing device 900 may also have a processing circuit such as a DSP (Digital Signal Processor) or an ASIC (Application Specific Integrated Circuit) instead of, or together with, the CPU 901.

[0088] The CPU 901 functions as an arithmetic processing unit and control unit, controlling the overall operation or a part of the operation within the information processing unit 900 according to various programs recorded in the ROM 903, RAM 905, storage device 919, or removable recording medium 923. For example, the CPU 901 controls the overall operation of each functional unit included in the server 10 and user terminals 20 and 30, respectively, in this embodiment. The ROM 903 stores programs and arithmetic parameters used by the CPU 901. The RAM 905 temporarily stores programs used in the execution of the CPU 901 and parameters that change as appropriate during its execution. The CPU 901, ROM 903, and RAM 905 are interconnected by a host bus 907, which is composed of internal buses such as the CPU bus. Furthermore, the host bus 907 is connected to an external bus 911, such as a PCI (Peripheral Component Interconnect / Interface) bus, via a bridge 909.

[0089] The input device 915 may be a device operated by the user, such as a mouse, keyboard, touch panel, buttons, switches, and levers, or it may be a device that converts physical quantities into electrical signals, such as a sound sensor like a microphone, an acceleration sensor, a tilt sensor, an infrared sensor, a depth sensor, a temperature sensor, or a humidity sensor. The input device 915 may also be a remote control device that uses infrared or other radio waves, or it may be an external connection device 927 such as a mobile phone that is compatible with the operation of the information processing device 900. The input device 915 includes an input control circuit that generates an input signal based on information input by the user or a physical quantity sensed and outputs it to the CPU 901. By operating this input device 915, the user inputs various data to the information processing device 900 or instructs it to perform processing operations.

[0090] The output device 917 is comprised of a device capable of notifying the user of acquired information visually or audibly. The output device 917 may be, for example, a display such as an LCD, PDP, or OLED, an audio output device such as a speaker and headphones, or a printer. The output device 917 outputs the results obtained from the processing of the information processing device 900 as text or images, or as sound.

[0091] The storage device 919 is a data storage device configured as an example of the storage unit of the information processing device 900. The storage device 919 is composed of, for example, a magnetic storage device such as an HDD (Hard Disk Drive), a semiconductor storage device, an optical storage device, or a magneto-optical storage device. This storage device 919 stores programs executed by the CPU 901, various data, and various data acquired from external sources.

[0092] The drive 921 is a reader / writer for removable recording media 923, such as magnetic disks, optical disks, magneto-optical disks, or semiconductor memory, and is either built into or external to the information processing device 900. The drive 921 reads information recorded on the installed removable recording media 923 and outputs it to the RAM 905. The drive 921 also writes data to the installed removable recording media 923.

[0093] The connection port 925 is a port for directly connecting equipment to the information processing device 900. The connection port 925 may be, for example, a USB (Universal Serial Bus) port, an IEEE1394 port, or a SCSI (Small Computer System Interface) port. Alternatively, the connection port 925 may be an RS-232C port, an optical audio terminal, or an HDMI (High-Definition Multimedia Interface) port. By connecting an external device 927 to the connection port 925, various types of data can be exchanged between the information processing device 900 and the external device 927.

[0094] The communication device 929 is a communication interface composed of, for example, a communication device for connecting to a network NW. The communication device 929 may be, for example, a communication card for wired or wireless LAN (Local Area Network), Bluetooth®, or WUSB (Wireless USB). Alternatively, the communication device 929 may be a router for optical communication, a router for ADSL (Asymmetric Digital Subscriber Line), or a modem for various types of communication. The communication device 929 sends and receives signals, for example, to the Internet or other communication devices using a predetermined protocol such as TCP / IP. The communication network NW connected to the communication device 929 is a network connected by wire or wireless, and may be, for example, the Internet, a home LAN, infrared communication, radio wave communication, or satellite communication. The communication device 929 performs the function of a communication unit.

[0095] An imaging device such as a camera (not shown) is a device that captures real space and generates an image using various components such as an image sensor, such as a CCD (Charge Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor), and a lens for controlling the imaging of a subject onto the image sensor. The imaging device may capture still images or it may capture moving images.

[0096] The configuration and operation of the live streaming system 1 according to the embodiment have been described above. This embodiment is illustrative, and it will be understood by those skilled in the art that various modifications are possible in combinations of each component and each process, and that such modifications are also within the scope of this disclosure.

[0097] In this embodiment, we described a case where, after a viewer stops watching a live stream midway, a dialog box 646 is presented to ask the viewer whether or not to send a "thank you gift," but this is not the only example. There are three other examples of configurations in which a "thank you gift" is sent to the streamer when a viewer stops watching a live stream. (First variation) When the instruction to use the "Thank You Gift" is received in dialog 646, the broadcaster is notified in real time. (Second variation) Instead of dialog 646, include a "Thank you for your hard work" gift among the gifts available during the live stream. (Third variation) Instead of dialog 646, a dialog box is displayed to ask the viewer a question after they tap the end-of-view button 620, but before they actually stop watching the live stream. The following explains each example.

[0098] (First variation) When a tap on the gift object 644 is detected in the dialog 646 of Figure 17, the post-distribution control unit 208 of the viewer's user terminal 30 generates a "Thank You Gift Used" signal and sends it to the server 10. The gift processing unit 308 of the server 10 extracts the gift ID and viewer ID from the received "Thank You Gift Used" signal and includes them in the effect generation instruction signal. The gift processing unit 308 sends the generated effect generation instruction signal to the broadcaster's user terminal 20 and the user terminals of other viewers. The broadcast-side UI control unit 108 of the broadcaster's user terminal 20 displays an effect based on the received effect generation instruction signal and updates the comment display area 634.

[0099] In this case, the "Thank You Gift" effect will be displayed on the live stream room screen after the viewer who sent the gift has stopped watching. This allows the streamer to know in real time that they have received a "Thank You Gift" from the sender. Also, since the sender is not present when the "Thank You Gift" effect is displayed, it is relatively inconspicuous.

[0100] The "Thank You Gift" effect may include the giver's initials, or the initial letters themselves may be used as the effect.

[0101] (Second variation) In this modified version, the viewer's user terminal 30 receives instructions from the viewer to use a "thank you gift" during the live stream, and stops displaying the video related to the live stream in response to receiving the instruction to use the "thank you gift". Notification to the streamer regarding the use of the "thank you gift" is not made in real time.

[0102] Figure 22 is a representative screen view of the live streaming room screen 682, which is displayed on the display of the viewer's user terminal 30, with the gift area 680 superimposed. The gift area 680 includes a gift object 624 for a normal gift and a gift object 684 for a thank-you gift. When a viewer taps the gift object 684 in the gift area 680 on the live streaming room screen 682 in Figure 22, the post-distribution control unit 208 of the user terminal 30 receives an instruction from the viewer to use the thank-you gift corresponding to the gift object 684. The post-distribution control unit 208 generates a thank-you gift usage signal that includes the gift ID of the thank-you gift represented by the gift object 684 and sends it to the server 10. At the same time, the post-distribution control unit 208 stops displaying the live streaming room screen 682 in response to receiving the instruction to use the thank-you gift. The processing of the server 10 when it receives the thank-you gift usage signal is in accordance with the corresponding processing in the embodiment.

[0103] Similar to the first modification, notifications regarding the use of "Otsukare Gifts" to the broadcaster may be made in real time. That is, the post-broadcast control unit 208 may display the corresponding effect on the display in response to receiving instructions to use an "Otsukare Gift". The post-broadcast control unit 208 may stop displaying the live broadcast room screen 682 once the display of the effect is finished. The post-broadcast control unit 208 may also generate an "Otsukare Gift Usage Signal" including the gift ID of the "Otsukare Gift" represented by the gift object 684 and send it to the server 10. The server 10 may extract the gift ID and viewer ID from the received "Otsukare Gift Usage Signal" and include them in the effect generation instruction signal. The gift processing unit 308 may send the generated effect generation instruction signal to the broadcaster's user terminal 20 and the user terminals of other viewers. The broadcast-side UI control unit 108 of the broadcaster's user terminal 20 may display the effect based on the received effect generation instruction signal and update the comment display area 634.

[0104] (Third variation) Figure 23 is a representative screen view of the live streaming room screen 694, which is displayed on the viewer's user terminal 30 with a dialog 686 superimposed on it. When a tap on the end-viewing button 620 is detected on the live streaming room screen 694, the post-distribution control unit 208 of the user terminal 30 generates a dialog 686 asking the viewer whether or not to send an "Otsukare Gift" to the broadcaster, and superimposes it on the live streaming room screen 694. The dialog 686 is a screen that asks the viewer whether or not to use an "Otsukare Gift" to the broadcaster of the live stream in response to stopping viewing of the live stream. The dialog 686 includes an "Otsukare Gift" gift object 688, an exit button 690 to accept the instruction to end the dialog 686 and stop viewing the live stream without sending an "Otsukare Gift," and a cancel button 692.

[0105] When a viewer taps the gift object 688 in the dialog 686 of Figure 23, the post-distribution control unit 208 of the user terminal 30 generates an "Otsukare Gift Usage Signal" that includes the viewer ID of the viewer who specified the use of the Otsukare Gift corresponding to the gift object 688, the stream ID that identifies the live stream that the viewer is about to stop watching, the broadcaster ID of the broadcaster of the live stream, and the gift ID that identifies the Otsukare Gift that was used, and sends it to the server 10. At the same time, the post-distribution control unit 208 stops displaying the live streaming room screen 694 in response to receiving the instruction to use the Otsukare Gift. The processing of the server 10 when it receives the Otsukare Gift Usage Signal is in accordance with the corresponding processing in the embodiment. Note that, as in the first modified example, notification to the broadcaster regarding the Otsukare Gift that was used may be made in real time.

[0106] The conversion rate from gift consideration points to awarded rewards in this embodiment is just one example, and these may be set as appropriate by, for example, the administrator of the live streaming system.

[0107] The technical concept of the embodiment may also be applied to virtual live streaming or live commerce, where an avatar that moves in sync with the streamer's movements is used instead of the streamer's image.

[0108] In the processing procedures described herein, particularly those described using flowcharts, it is possible to omit some of the steps constituting the processing procedure, to add steps not explicitly included as constituting the processing procedure, and / or to change the order of such steps. Processing procedures with such omissions, additions, or changes in order are included within the scope of this disclosure, provided they do not deviate from the spirit of this disclosure.

[0109] At least some of the functions implemented by server 10 may be implemented by devices other than server 10, such as user terminals 20 and 30. At least some of the functions implemented by user terminals 20 and 30 may be implemented by devices other than user terminals 20 and 30, such as server 10. For example, the superposition of a predetermined frame image onto an image of video data performed on the playback-side user terminal may be performed by server 10 or on the generation-side user terminal.

Claims

1. On the device of the live broadcaster, A function to accept instructions from the broadcaster to stop live broadcasting, A function to display a screen including information related to the live streaming on the display after the live streaming is stopped; The information is a computer program including information regarding gifts used by the viewer on a post-streaming screen that is displayed on the viewer's terminal when the live streaming is stopped.

2. The computer program product according to claim 1 , wherein the screen is configured to allow a broadcaster to send a message to a viewer who has used a gift.

3. On the device of the live broadcast viewer, A function to accept instructions from viewers to stop watching live broadcasts, A function of displaying an inquiry screen on a display inquiring of the broadcaster of the live stream whether or not to use a gift when viewing of the live stream is stopped, and a computer program for realizing the function.

4. On the device of the live broadcast viewer, The ability to receive gift usage instructions from viewers during live streaming, A function for stopping the display of video images related to a live broadcast upon receipt of an instruction to use a gift, and a computer program for realizing this function.

5. The computer program product according to claim 4 , wherein the notification to the distributor regarding the used gift is performed in non-real time.

6. a function of displaying a corresponding effect on a display in response to receiving an instruction to use the gift is further realized in the terminal; The computer program product according to claim 4 , wherein the stopping function includes a function of stopping display of the moving image related to the live distribution when the display of the effect ends.

7. A terminal of a live broadcaster, A means for receiving instructions to stop live streaming; and and a means for displaying information related to the live distribution on a display after the live distribution is stopped, The information includes information regarding the gifts used by the viewer on a post-streaming screen that is displayed on the viewer's device when the live streaming is stopped.

8. A terminal of a live broadcast viewer, A means for receiving instructions to stop watching the live broadcast; and The terminal is provided with a means for displaying, upon stopping viewing of the live broadcast, an inquiry screen on a display for inquiring of the broadcaster of the live broadcast whether or not to use the gift.

9. A terminal of a live broadcast viewer, A means for receiving instructions from viewers on how to use gifts during live streaming; The terminal is provided with a means for stopping the display of the video image related to the live distribution in response to receiving an instruction to use the gift.

Images