Server and Method

Abstract

To realize gifting adapted to the nature of live streaming.SOLUTION: A server comprises: means for relaying transmission of video data from a user terminal on the generation side of video data related to live streaming to a user terminal on the playing side; means for generating a gift based on a portion of the live streaming recorded while playing the video data; and means for performing processing for giving the generated gift to a streamer of the live streaming while playing the video data.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to a server and a method.

Background Art

[0002] With the development of IT technology, the ways of information exchange have changed. In the Showa era, one-way information transmission such as newspapers and television was dominant. In the Heisei era, mobile phones and personal computers became popular, and the communication speed of the Internet was greatly improved. As a result, real-time two-way communication services such as chat services emerged, and on-demand video distribution services were also accepted with the reduction of storage costs. And now, in the Reiwa era, with the further improvement of the functionality of smartphones and the speed of networks represented by 5G, services that realize real-time communication by video, especially live streaming services, are rapidly increasing in popularity. Live streaming services, as services that allow everyone to share the same enjoyable time even when they are in different places, are expanding their users, especially among young people.

[0003] Patent Document 1 discloses a technique for assisting the selection of live broadcast videos by determining the exciting part of a live broadcast video, cutting out that part as a short video, and providing the short video to viewers who are searching for a live broadcast they want to watch.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Non-Patent Documents

[0005]

Non-Patent Document 1

[0006] Gifts such as tips are an important element in making live streams more exciting. By offering a wide variety of gifts and putting thought and effort into each one, you can expect to make your live streams even more engaging.

[0007] Traditionally, gifts for live streams are pre-prepared by the platform operators, meaning the available gifts are the same for every live stream. However, because live streams have the inherent limitation of not being able to predict the content beforehand, pre-prepared gifts may not always meet the needs of both the streamer and the viewers. A gift system tailored to live streaming is needed.

[0008] This disclosure was made in light of these challenges, and its purpose is to provide technology that enables gifting adapted to the nature of live streaming. [Means for solving the problem]

[0009] Certain aspects of this disclosure relate to a server. This server includes means for relaying the transmission of video data related to live streaming from a user terminal generating video data to a user terminal playing it back; means for generating gifts based on a portion of the live stream recorded during playback of the video data; and means for processing the generated gifts to the live stream broadcaster during playback of the video data.

[0010] Another aspect of the present invention is a computer program. This computer program enables a terminal to have the following functions: to receive instructions from a user to record a portion of a live stream while the video data related to the live stream is being played back; and to display a gift generated based on the recorded portion of the live stream on the display while the video data is being played back.

[0011] Furthermore, any combination of the above components, or any substitution of components or expressions of the present invention between devices, methods, systems, computer programs, recording media storing computer programs, etc., are also valid embodiments of the present invention. [Effects of the Invention]

[0012] According to the present invention, gifting adapted to the nature of live streaming can be realized. [Brief explanation of the drawing]

[0013] [Figure 1] This is a schematic diagram showing the configuration of a live streaming system according to an embodiment of the present disclosure. [Figure 2] This is a schematic diagram showing an example of live streaming implemented by the live streaming system shown in Figure 1. [Figure 3] Figure 1 is a block diagram showing the functions and configuration of the user terminal. [Figure 4] This block diagram shows the functions and configuration of the server in Figure 1. [Figure 5] Figure 4 is a data structure diagram showing an example of a stream database. [Figure 6]It is a data structure diagram showing an example of the army DB in FIG. 4. [Figure 7] It is a data structure diagram showing an example of the user DB in FIG. 4. [Figure 8] It is a data structure diagram showing an example of the gift DB in FIG. 4. [Figure 9] It is a flowchart showing the flow of a series of gift usage processes in the server of FIG. 1. [Figure 10] It is a representative screen diagram of the live distribution selection screen displayed on the display of the viewer's user terminal. [Figure 11] It is a representative screen diagram of the live distribution room screen displayed on the display of the viewer's user terminal. [Figure 12] It is a representative screen diagram of the screenshot waiting screen displayed on the display of the viewer's user terminal. [Figure 13] It is a representative screen diagram of the live distribution room screen displayed on the display of the viewer's user terminal. [Figure 14] It is a representative screen diagram of the live distribution room screen displayed on the display of the distributor's user terminal. [Figure 15] It is a representative screen diagram of the live distribution room screen displayed on the display of the viewer's user terminal. [Figure 16] It is a representative screen diagram of the live distribution room screen displayed on the display of the viewer's user terminal. [Figure 17] It is a block diagram showing an example of the hardware configuration of the information processing apparatus according to the embodiment. [Figure 18] It is a representative screen diagram of the live distribution room screen displayed on the display of the viewer's user terminal. [Figure 19] It is a representative screen diagram of the live distribution room screen displayed on the display of the viewer's user terminal. [Figure 20] It is a representative screen diagram of the viewer selection screen displayed on the display of the distributor's user terminal. [Figure 21] It is a representative screen diagram of the live distribution room screen displayed on the display of the viewer's user terminal. [Figure 22] This is a representative screenshot of the live streaming room screen displayed on the viewer's user device. [Figure 23] This is a representative screenshot of the live streaming room screen displayed on the streamer's user device. [Modes for carrying out the invention]

[0014] In the following, identical or equivalent components, members, processes, and signals shown in each drawing will be denoted by the same reference numerals, and redundant explanations will be omitted where appropriate. In addition, some components that are not explanatoryly important in each drawing will be omitted from the display.

[0015] In the live streaming system according to this embodiment, broadcasters and viewers can generate gifts from a portion of the live stream. For example, broadcasters and viewers can turn a screenshot capturing a special moment into a gift within the live stream. This dramatically increases the originality of gifting and the engagement of broadcasters and viewers.

[0016] [Live streaming system configuration] Figure 1 is a schematic diagram showing the configuration of a live streaming system 1 according to an embodiment of the present disclosure. The live streaming system 1 provides a two-way live streaming service that allows broadcasters (also called Livers or Streamers) LV and viewers (also called audiences) AU (AU1, AU2, ...) to communicate in real time. As shown in Figure 1, the live streaming system 1 comprises a server 10, a user terminal 20 on the broadcaster's side, and user terminals 30 (30a, 30b, ...) on the viewer's side. Broadcasters and viewers are sometimes collectively referred to as users. The server 10 may be composed of one or more information processing devices connected to a network NW. User terminals 20 and 30 may be mobile terminals such as smartphones, tablet terminals, laptop PCs, recorders, portable game consoles, or wearable devices, or they may be stationary devices such as desktop PCs. The server 10, user terminals 20 and 30 are connected to each other via various wired or wireless networks NW so that they can communicate with one another.

[0017] The live streaming system 1 involves a streamer (LV), a viewer (AU), and an administrator (not shown) who manages the server 10. A streamer (LV) is a person who broadcasts content in real time by recording or videotaping their own songs, talks, performances, fortune-telling, game commentary, etc., on their user terminal 20 and uploading it directly to the server 10. The administrator provides a platform for live streaming of content on the server 10 and mediates or manages real-time interactions between the streamer (LV) and the viewer (AU). Viewer (AU) accesses the platform on their user terminal 30 to select and watch desired content. During the live streaming of this content, viewer (AU) can comment or show support via their user terminal 30, and the streamer (LV) providing the content responds to such comments and support. This response is transmitted to the viewer (AU) via video and / or audio, thus establishing two-way communication.

[0018] In this specification, "live streaming" may mean a data transmission method that enables content recorded on the broadcaster LV's user terminal 20 to be played back and viewed on the viewer AU's user terminal 30 in substantially real time, or it may mean the streaming itself realized by such a transmission method. Live streaming may be realized using existing live streaming technologies such as HTTP Live Streaming, Common Media Application Format, Web Real-Time Communications, Real-Time Messaging Protocol, or MPEG DASH. Live streaming includes a transmission method that enables the viewer AU to view the content with a predetermined delay while the broadcaster LV is recording the content. Regarding the magnitude of the delay, at least a delay large enough for communication between the broadcaster LV and the viewer AU to take place is permitted. However, live streaming is distinguished from so-called on-demand streaming, where the entire data of the recorded content is temporarily stored on a server, and then the data is provided to the user from the server at any time requested by the user.

[0019] In this specification, "video data" refers to data that includes image data (also called video data) generated by the imaging function of user terminals 20 and 30, and audio data (also called audio data) generated by the voice input function of user terminals 20 and 30. The video data is played back on user terminals 20 and 30, enabling users to view the content.

[0020] Figure 2 is a schematic diagram showing an example of live streaming implemented by the live streaming system 1 in Figure 1. In the example in Figure 2, the broadcaster (LV) is live streaming a talk. The broadcaster (LV)'s user terminal 20 generates video data by recording the image and sound of the broadcaster (LV) giving the talk, and transmits it to the server 10 (not shown in Figure 2) via the network (NW). In addition, the user terminal 20 displays the recorded video (VD) of the broadcaster (LV) on its display, allowing the broadcaster (LV) to confirm the content of the stream.

[0021] The user terminals 30a, 30b, and 30c of viewers AU1, AU2, and AU3, who requested to view the live stream from broadcaster LV on the platform, each receive video data related to the live stream via the network NW. By playing the received video data, they display video images VD1, VD2, and VD3 on their displays and output sound from their speakers. The video images VD1, VD2, and VD3 displayed on each user terminal 30a, 30b, and 30c are substantially identical to the video images VD captured by broadcaster LV's user terminal 20, and the sound output by each user terminal 30a, 30b, and 30c is substantially identical to the sound recorded by broadcaster LV's user terminal 20.

[0022] The recording and video recording on the broadcaster LV's user terminal 20 and the playback of video data on the viewer AU1, AU2, and AU3's user terminals 30a, 30b, and 30c are performed substantially simultaneously. When viewer AU1 inputs a comment on the content of broadcaster LV's talk into user terminal 30a, server 10 displays the comment in real time on broadcaster LV's user terminal 20 and also on the user terminals 30a, 30b, and 30c of each viewer AU1, AU2, and AU3. When broadcaster LV reads the comment and adds a comment over it, the video and audio of that conversation are output to the user terminals 30a, 30b, and 30c of each viewer AU1, AU2, and AU3, and it is recognized that a conversation has taken place between broadcaster LV and viewer AU1. In this way, the live streaming system 1 realizes live streaming that enables two-way communication rather than one-way communication.

[0023] Figure 3 is a block diagram showing the functions and configuration of user terminal 20 in Figure 1. User terminal 30 has the same functions and configuration as user terminal 20. Each block shown in Figure 3 and subsequent block diagrams can be realized hardware-wise by elements and mechanical devices such as the CPU of a computer, and software-wise by computer programs, etc., but here we are depicting functional blocks realized through the cooperation of these. Therefore, it will be understood by those skilled in the art who have read this specification that these functional blocks can be realized in various ways by combinations of hardware and software.

[0024] The broadcaster (LV) and viewer (AU) download and install the live streaming application program according to this embodiment (hereinafter referred to as the live streaming app) from a download site via the network (NW) to the user terminals 20 and 30. Alternatively, the live streaming app may be pre-installed on the user terminals 20 and 30. When the live streaming app is executed by the user terminals 20 and 30, the user terminals 20 and 30 communicate with the server 10 via the network (NW) and realize various functions. Hereinafter, the functions realized by the execution of the live streaming app by the user terminals 20 and 30 (their CPUs or other processors) will be described as functions of the user terminals 20 and 30. These functions are actually functions that the live streaming app enables on the user terminals 20 and 30. In other embodiments, these functions may be realized by a computer program written in a programming language such as HTML (HyperText Markup Language), which is transmitted from the server 10 to the web browser of the user terminals 20 and 30 via the network (NW) and executed by that web browser.

[0025] The user terminal 20 includes a distribution unit 100 that generates video data recording the user's image and voice and provides it to the server 10, and a viewing unit 200 that retrieves the video data from the server 10 and plays it back. The user activates the distribution unit 100 when distributing data, and the viewing unit 200 when viewing data. The user terminal with the distribution unit 100 active is the distributor side, i.e., the user terminal that generates the video data, and the user terminal with the viewing unit 200 active is the viewer side, i.e., the user terminal that plays back the video data.

[0026] The distribution unit 100 includes an image capture control unit 102, an audio control unit 104, a video transmission unit 106, and a distribution-side UI control unit 108. The image capture control unit 102 is connected to a camera (not shown in Figure 3) and controls image capture by the camera. The image capture control unit 102 acquires image data from the camera. The audio control unit 104 is connected to a microphone (not shown in Figure 3) and controls audio input from the microphone. The audio control unit 104 acquires audio data from the microphone. The video transmission unit 106 transmits video data, including image data acquired by the image capture control unit 102 and audio data acquired by the audio control unit 104, to the server 10 via the network NW. The transmission of video data by the video transmission unit 106 is performed in real time. That is, the generation of video data by the image capture control unit 102 and the audio control unit 104, and the transmission of the generated video data by the video transmission unit 106 are performed substantially simultaneously. The distribution-side UI control unit 108 controls the UI for the distributor. The distribution-side UI control unit 108 is connected to a display (not shown in Figure 3) and displays moving images on the display by playing the video data that is to be transmitted by the video transmission unit 106. The distribution-side UI control unit 108 displays operation objects and instruction receiving objects on the display and accepts tap input from the broadcaster.

[0027] The viewing unit 200 includes a viewing-side UI control unit 202, a superimposed information generation unit 204, and an input information transmission unit 206. The viewing-side UI control unit 202 controls the UI for the viewer. The viewing-side UI control unit 202 is connected to a display and speaker (not shown in Figure 3) and plays the received video data to display the video on the display and output sound from the speaker. The simultaneous output of an image on the display and sound from the speaker can be said to mean that "video data is being played." The viewing-side UI control unit 202 is connected to input means such as a touch panel, keyboard, and display (not shown in Figure 3) and acquires user input through these input means. The superimposed information generation unit 204 superimposes a predetermined frame image onto the video data image acquired from the server 10. The frame image includes various user interface objects (hereinafter simply referred to as objects) for accepting input from the user, comments entered by the viewer, and information acquired from the server 10. The input information transmission unit 206 transmits the user input acquired by the viewer-side UI control unit 202 to the server 10 via the network NW.

[0028] Figure 4 is a block diagram showing the functions and configuration of the server 10 in Figure 1. The server 10 comprises a distribution information provision unit 302, a relay unit 304, an army management unit 306, a normal gift processing unit 308, a special gift processing unit 310, a gift granting unit 312, a payment processing unit 314, a stream DB 316, an army DB 318, a user DB 320, and a gift DB 322.

[0029] Figure 5 is a data structure diagram showing an example of the Stream DB 316 in Figure 4. The Stream DB 316 holds information about live streaming that is currently taking place. The Stream DB 316 stores the Stream ID, which identifies the live stream on the live streaming platform provided by the Live Streaming System 1, the Streamer ID, which is the user ID that identifies the streamer of the live stream, and the Viewer ID, which is the user ID that identifies the viewers of the live stream, in association with each other.

[0030] Figure 6 is a data structure diagram showing an example of the Army DB318 in Figure 4. The Army DB318 holds information about each streamer's Army. The Army DB318 associates the streamer's ID with the Army ID, which is the user ID of a user who is an Army member of that streamer. An Army member is a user who has subscribed to a subscription service for a streamer, and can also be described as a member of that streamer's fan club. If you are an Army member, you are required to pay a predetermined registration fee to the administrator on a regular basis, such as monthly or quarterly. The administrator grants at least a portion of that registration fee to the streamer. If a viewer is an Army member of a streamer, they can receive special benefits such as special gifts and special entrance animations while watching that streamer's live stream. The Army may be implemented using the technology described in Non-Patent Document 1.

[0031] Figure 7 is a data structure diagram showing an example of the user DB320 in Figure 4. The user DB320 holds information about users. The user DB320 associates a user ID that identifies a user, the points that the user possesses, and information about special gifts given to or given by the user. Points are electronic value that circulates within the live streaming platform. When a streamer receives a gift from a viewer during a live stream, the streamer's points increase by the value corresponding to that gift. Points are used, for example, to determine the amount of compensation or money that a streamer receives from the administrator of the live streaming platform.

[0032] Information about a special gift includes a special gift ID that identifies the special gift, special gift data which is image data of the special gift, a special gift expiration date which is the expiration date of the special gift, a special gift giver ID which is the user ID of the user (viewer) who gave the special gift, and a special gift recipient ID which is the user ID of the user (broadcaster) who received the special gift. Special gifts will be described later. Expired special gifts are deleted from user DB320.

[0033] Figure 8 is a data structure diagram showing an example of the gift DB322 in Figure 4. The gift DB322 holds information about gifts that viewers can use during live streaming. A gift is electronic data with the following characteristics: • Points can be purchased as payment or awarded for free. • Something that viewers can send to streamers. Sending a gift to a streamer is also called using a gift or throwing a gift. Some gifts require both purchase and use to occur simultaneously, while others allow viewers to use them at their own discretion after purchase. When a viewer sends a gift to a streamer, the streamer is awarded points corresponding to the gift, and in some cases, effects associated with the gift occur. For example, an effect corresponding to the gift may appear on the live stream screen.

[0034] Gift DB322 stores a gift ID that identifies a gift, the points awarded to the streamer when the gift is sent to the streamer, whether the gift is a regular gift or a special gift, and a gift algorithm that defines the behavior or function of the gift if it is a special gift, in association with each other. Viewers can send a gift to the streamer during a live stream by paying a price corresponding to the points awarded for the desired gift. This payment may be made by an appropriate electronic payment method, for example, by the viewer paying the administrator points equivalent to the points awarded (for example, the points awarded themselves, or points obtained by multiplying the points awarded by a predetermined coefficient such as 1.2, or points obtained by adding a predetermined fee to the points awarded). Alternatively, payment may be made by bank transfer or credit card.

[0035] The effects of the special gifts registered in the gift DB322 in Figure 8 are listed below. The gift algorithm for each special gift is a software module configured to achieve the corresponding effect when executed by the CPU of server 10, etc. TD01: Allows viewers to take screenshots (capture still images) of live streams at any time, and generates special gifts by embedding the viewer's user ID into the screenshot image. VE01: Allows viewers to take screenshots of live streams at any time, and generates special gifts by converting these screenshots into illustrations. VD01: When the cumulative number of viewers of a streamer's live stream reaches a milestone number (e.g., 1000 people), a screenshot of the live stream is automatically taken, and a special gift is generated from the image of that screenshot. SKK1: Allows streamers to take screenshots of live streams at any time, and by embedding predetermined text into the screenshot images, a special gift can be generated. SKK3: Allows viewers to record live streams for short periods at any time and generate special gifts from those recordings. SKK4: Secret gifts from streamers to viewers SKK5: Public gifts from streamers to viewers SPG01: Special gift given to a specific streamer

[0036] Returning to Figure 4, the Army Management Unit 306 performs processes related to Army management, such as registering and unregistering members, paying periodic points as compensation for being an Army member, and granting special effects to Army members. For example, when the Army Management Unit 306 receives an application from a viewer's user terminal 30 to become an Army member of a specific broadcaster, it updates the Army DB 318 so that the viewer's viewer ID is added to the Army ID corresponding to the broadcaster ID of that specific broadcaster.

[0037] When the distribution information provision unit 302 receives notification from the broadcaster's user terminal 20 via the network NW that a live broadcast will be started, it registers the stream ID that identifies the live broadcast and the broadcaster ID of the broadcaster of the live broadcast in the stream DB 316. When the distribution information provision unit 302 receives a request for information about live broadcasts from the viewer's user terminal 30's viewing unit 200 via the network NW, it refers to the stream DB 316 and generates a list of currently viewable live broadcasts. The distribution information provision unit 302 sends the generated list to the requesting user terminal 30 via the network NW. The viewer-side UI control unit 202 of the requesting user terminal 30 generates a live broadcast selection screen based on the received list and displays it on the user terminal 30's display.

[0038] When the input information transmission unit 206 of the user terminal 30 receives a live stream selection from a viewer on the live stream selection screen, it generates a distribution request including the stream ID of the selected live stream and sends it to the server 10 via the network NW. The distribution information provision unit 302 starts providing the live stream identified by the stream ID included in the received distribution request to the requesting user terminal 30. The distribution information provision unit 302 updates the stream DB 316 so that the viewer ID of the viewer of the requesting user terminal 30 is included in the viewer ID of the stream ID.

[0039] The relay unit 304 relays the transmission of video data from the broadcaster's user terminal 20 to the viewer's user terminal 30 in a live broadcast initiated by the distribution information provision unit 302. The relay unit 304 receives a signal from the input information transmission unit 206 indicating user input by the viewer while the video data is being played on the viewer's user terminal 30. The signal indicating user input may also be a gift usage signal indicating the use of a gift, and this gift usage signal includes the viewer's viewer ID, the broadcaster ID of the recipient broadcaster (=the broadcaster ID of the broadcaster conducting the live broadcast that the viewer who sent the gift is watching), and the gift ID of the gift. The relay unit 304 refers to the gift DB 322 and determines whether the gift identified by the gift ID included in the received gift usage signal is a regular gift or a special gift.

[0040] Normally, the gift processing unit 308 updates the user DB 320 to increase the sender's points according to the points awarded for the gift specified by the gift ID included in the gift usage signal, if the gift is a normal gift. The normal gift processing unit 308 refers to the gift DB 322 and identifies the points awarded corresponding to the gift ID included in the received gift usage signal. The normal gift processing unit 308 updates the user DB 320 to add the identified points awarded to the points corresponding to the sender ID included in the gift usage signal.

[0041] The special gift processing unit 310 generates a special gift based on a portion of the live stream recorded during playback of the video data related to the live stream, if the gift identified by the gift ID included in the gift usage signal is a special gift. In this embodiment, the special gift processing unit 310 is configured to generate the following five types of special gifts. (1) Paid gifts (e.g., TD01, VE01, SKK3) generated based on a portion of the live stream recorded in accordance with the viewer's instructions. (2) Paid gifts (e.g., SKK1) generated based on a portion of a live stream recorded in accordance with the streamer's instructions. (3) Paid gifts (e.g., VD01) that are automatically generated based on a portion of a live stream that has been recorded, provided that the conditions related to the live stream are met. (4) Free gifts generated based on a portion of a live stream recorded in accordance with Army's instructions (Free gifts are gifts that can be generated without payment of any value). (5) Paid gifts from streamers to specific viewers. (Example: SKK4, SKK5) The following sections will explain the special gifts (1) through (4), and the special gift (5) will be explained using a modified version.

[0042] The gift granting unit 312 processes the special gift generated by the special gift processing unit 310 to grant to the live streamer while the video data related to the live stream is being played. If the special gift is a paid gift, the gift granting unit 312 processes the special gift to the streamer when it receives an instruction from a viewer to pay the consideration associated with the generated special gift. The gift granting unit 312 performs the following four processes to grant the special gift to the streamer. (1) Send image data to the broadcaster's user terminal 20 and the viewer's user terminal 30 to display the special gift. (2) Update User DB320 to increase the broadcaster's points according to the points awarded for special gifts. (3) Generate special gift information (special gift ID, special gift data, special gift expiration date, special gift giver ID, special gift recipient ID), and register it in the user DB320, associating it with the giver's viewer and the recipient's broadcaster. (4) Register the special gift ID and awarded points for the special gift in Gift DB322.

[0043] The payment processing unit 314 processes payments from viewers for the consideration associated with the special gifts that are generated. The payment may be a prepayment, where the consideration is received before the special gift is generated, or a postpayment, where the consideration is received after the special gift is generated but before it is given to the broadcaster. When the payment processing unit 314 receives an instruction from a viewer to pay the consideration associated with the special gift, it updates the user DB 320 to deduct the points equivalent to the consideration from the viewer's points.

[0044] The payment processing unit 314 processes payments made by viewers for the consideration associated with a regular gift. If the gift identified by the gift ID included in the gift usage signal is a regular gift, the payment processing unit 314 updates the user DB 320 to deduct the points equivalent to the consideration for that regular gift from the points of the viewer identified by the viewer ID included in the gift usage signal.

[0045] The operation of the live streaming system 1 with the above configuration will now be explained. Figure 9 is a flowchart illustrating the flow of a series of gift usage processes on server 10. This example describes the case where a prepaid or free special gift generated from a screenshot is used. It is also assumed that a viewer accesses the live streaming platform from user terminal 30, selects a desired live stream from the live stream selection screen, and begins watching. While the viewer is watching the live stream, video data is continuously transmitted from the streamer's user terminal 20 to the viewer's user terminal 30 via server 10 (the relay unit 304).

[0046] During playback of this video data, the viewer makes user input via the input means of the user terminal 30 to request the display of a gift. Upon receiving this user input, the input information transmission unit 206 of the user terminal 30 generates a gift information request and sends it to the server 10. Upon receiving the gift information request, the relay unit 304 of the server 10 refers to the gift DB 322 to identify an available gift ID. The relay unit 304 generates a gift information response containing the identified gift ID and sends it to the user terminal 30. The superimposed information generation unit 204 of the user terminal 30 includes an image of available gifts in the frame image, which is a list of the gift icon images (hereinafter referred to as gift icons) identified by the gift ID included in the gift information response. The viewer-side UI control unit 202 displays the video with the frame image superimposed on the display.

[0047] When the viewer-side UI control unit 202 of the user terminal 30 receives a gift selection by the viewer, i.e., the specification of a gift icon, the input information transmission unit 206 generates a gift usage signal including the gift ID of the specified gift, the viewer ID, and the broadcaster ID, and transmits it to the server 10 via the network NW. The relay unit 304 of the server 10 receives the gift usage signal (S502). The relay unit 304 refers to the gift DB 322 and determines whether the gift identified by the gift ID included in the received gift usage signal is a special gift or a regular gift (S504). If it is a regular gift, the payment processing unit 314 processes the payment of the consideration (S506). The regular gift processing unit 308 processes the awarding of points to the broadcaster (S508). After that, the process returns to step S502.

[0048] If it is determined in step S504 that it is a special gift, the payment processing unit 314 processes the payment for the gift (S510). The payment processing unit 314 refers to the gift DB 322 and determines whether the special gift identified by the gift ID included in the gift usage signal received in step S502 is a free special gift exclusively for Army members. If it is a free special gift exclusively for Army members, the payment processing unit 314 refers to the Army DB 318 and determines whether the viewer identified by the viewer ID included in the gift usage signal received in step S502 is an Army member of the broadcaster identified by the broadcaster ID included in the same gift usage signal. If it is determined that the viewer is not an Army member, the payment processing unit 314 generates an error signal and sends it to the user terminal 30. When the viewer-side UI control unit 202 of the user terminal 30 receives the error signal, it displays text on the display indicating that the gift cannot be used unless the viewer is an Army member. If it is determined that the viewer is an Army member, the payment processing unit 314 completes the payment process without changing the viewer's points.

[0049] If the special gift identified by the gift ID included in the gift usage signal received in step S502 is not a free special gift exclusively for Army members, the payment processing unit 314 updates the user DB 320 so that the points equivalent to the price of the special gift are deducted from the points of the viewer identified by the viewer ID included in the gift usage signal. The price of the special gift may be the same as or different from the points awarded.

[0050] If a special gift is manually requested (manual in S512), the special gift processing unit 310 generates a permission signal including the gift ID of the special gift and the portion of the gift algorithm corresponding to the special gift that should be executed on the user terminal, and transmits it via the network NW to the user terminal 30 that sent the gift usage signal (S514). When the viewing unit 200 of the user terminal 30 receives the permission signal, it executes the portion of the gift algorithm included therein, enabling the acquisition of a screenshot of the live stream. The viewer inputs an instruction at the desired timing, and upon receiving the instruction, the viewing unit 200 acquires a screenshot of the live stream at that point. The input information transmission unit 206 transmits the acquired screenshot data to the server 10 via the network NW. The special gift processing unit 310 receives the transmitted data (S516).

[0051] If a special gift is set automatically (automatic in S512), the special gift processing unit 310 determines whether the recording conditions set in association with the special gift have been met (S518). Recording conditions include, for example, the cumulative number of viewers of the broadcaster's live stream reaching a milestone number (e.g., 1000 people), or the cumulative broadcast time of the broadcaster's live stream reaching a threshold. Thus, the recording conditions may be conditions imposed on parameters related to the live stream, conditions imposed on the broadcaster's status (e.g., winning an event), or conditions imposed on viewer behavior (e.g., making more than a certain number of comments). If it is determined that the recording conditions have been met (YES in S518), the special gift processing unit 310 takes a screenshot of the video data being broadcast at that time (S520).

[0052] If illustration is specified (YES in S522), the special gift processing unit 310 creates an illustration from the received or acquired screenshot image (S524). Illustration may be implemented using known image processing techniques such as those described in Non-Patent Literature 2.

[0053] The special gift processing unit 310 generates a special gift based on the received or acquired screenshot image (S526). If the screenshot image has not been illustrated, the special gift processing unit 310 generates a special gift image by embedding the ID of the giver viewer into the screenshot image and assigns a new gift ID to the image. If the screenshot image has been illustrated, the special gift processing unit 310 uses the illustrated image as is for the special gift and assigns a new gift ID to the image.

[0054] The gift granting unit 312 grants the broadcaster the grant points corresponding to the generated special gift (S528). The gift granting unit 312 updates the user DB 320 so that the grant points corresponding to the special gift are added to the points of the broadcaster identified by the broadcaster ID included in the gift usage signal received in step S502. The gift granting unit 312 transmits the image of the special gift generated in step S526 to the broadcaster's user terminal 20 and the viewer's user terminal 30 (S530). The gift granting unit 312 further registers the special gift information in the gift DB 322 and the user DB 320. The user terminals 20 and 30 display the image of the special gift on their displays while playing the video data related to the live broadcast.

[0055] Figure 10 is a representative screen view of the live stream selection screen 602 displayed on the viewer's user terminal 30. The live stream selection screen 602 includes thumbnails 604 representing each live stream in the list of currently viewable live streams. The viewer-side UI control unit 202 generates the live stream selection screen 602 based on the list of live streams obtained from the server 10 and displays it on the screen.

[0056] Figure 11 is a representative screen view of the live streaming room screen 610 displayed on the viewer's user terminal 30. When a viewer taps the thumbnail 604 on the live streaming selection screen 602 in Figure 10, the live streaming room screen 610 in Figure 11 is displayed on the screen. The live streaming room screen 610 includes an image of the broadcaster 612 obtained by playing video data, and an image of the list of available gifts. The image of the list of available gifts includes a gift icon 614 for normal gifts, a gift icon 616 for special gifts identified by the gift ID "TD01" in Figure 8, a gift icon 618 for special gifts identified by the gift ID "VE01" in Figure 8, a gift icon 620 for special gifts identified by the gift ID "VD01" in Figure 8, and a gift icon 622 for special gifts identified by the gift ID "SKK3" in Figure 8.

[0057] In the live streaming room screen 610 of Figure 11, when a viewer taps the gift icon 616 for a special gift, the user terminal 30 accepts the viewer's designation of the special gift. The user terminal 30 generates a gift usage signal including the gift ID of the designated special gift (in this case, "TD01") and sends it to the server 10 via the network NW. The user terminal 30 receives a usage permission signal from the server 10 corresponding to the transmitted gift usage signal. Based on the usage permission signal, the user terminal 30 enables the viewer to take a screenshot. Specifically, the user terminal 30 displays a screenshot waiting screen 624 on its display.

[0058] Figure 12 is a representative screen view of the screenshot waiting screen 624 displayed on the viewer's user terminal 30. The screenshot waiting screen 624 includes an image 612 of the broadcaster obtained by playing video data and a screenshot icon 626. The screenshot waiting screen 624 is a screen for receiving instructions from the user to record a screenshot image that is part of the live stream while the video data related to the live stream is playing. The viewer waits for a moment unique to the live stream while looking at the broadcaster's image 612, and when that moment arrives, taps the screenshot icon 626. When the user terminal 30 detects the tap on the screenshot icon 626, it generates a screenshot of the broadcaster's image 612 at that moment. It may be possible to allow the user to retake the screenshot.

[0059] The user terminal 30 sends the generated screenshot image to the server 10. The server 10 generates a special gift image by embedding the viewer ID of the viewer who took the screenshot image into the screenshot image. The server 10 sends the generated special gift image to the user terminal 30. The user terminal 30 displays the received special gift image on the display by overlaying it on the live stream image.

[0060] Figure 13 is a representative screen view of the live streaming room screen 630 displayed on the viewer's user terminal 30. When a viewer taps the screenshot icon 626 on the screenshot waiting screen 624 in Figure 12, the live streaming room screen 630 in Figure 13 is displayed on the screen. The live streaming room screen 630 includes an image of the broadcaster 612 and an image of a special gift 628 that is displayed in association with it. The special gift image 628 is displayed during the live stream, which has been broadcasting since the creation of the special gift. The special gift image 628 includes an image based on a screenshot taken at the viewer's instruction and the viewer's viewer ID. The special gift image 628 is displayed similarly on the user terminals of other viewers who are watching the same live stream, and on the user terminal of the broadcaster of the same live stream. By displaying the special gift image 628 in the broadcaster's streaming room, the special moment captured there can be shared between the broadcaster and the viewer. In addition, by displaying the viewer ID of the viewer who sent the special gift, it can be shown that the viewer is closer to the broadcaster in relation to other viewers.

[0061] Figure 14 is a representative screen view of the live streaming room screen 632 displayed on the display of the streamer's user terminal 20. The live streaming room screen 632 includes an image of the streamer 634 obtained by playing video data to be sent to the server 10, a gift icon 636 for a special gift identified by the gift ID "SKK1" in Figure 8, a gift icon 638 for a special gift identified by the gift ID "SKK4" in Figure 8, and a gift icon 640 for a special gift identified by the gift ID "SKK5" in Figure 8.

[0062] The gift icon 636 is an object that receives instructions from the broadcaster to record a screenshot image, which is part of the live stream, while the video data related to the live stream is being played back. The broadcaster waits for a moment unique to the live stream while looking at their own image 634, and when that moment arrives, they tap the gift icon 636. When the user terminal 20 detects the tap on the gift icon 636, it generates a screenshot of the broadcaster's image 634 at that moment. The user terminal 20 sends a special gift generation request to the server 10, which includes the generated screenshot image and the gift ID "SKK1". The server 10 obtains and executes the gift algorithm for the special gift identified by the gift ID included in the special gift generation request by referring to the gift DB 322. Specifically, the server 10 generates an image of the special gift by embedding predetermined text specified by the broadcaster into the screenshot image included in the special gift generation request. The server 10 converts the generated special gift image into a gift icon 642. The server 10 sends the gift icon 642 to the viewer's user terminal 30. The user terminal 30 displays the received gift icon 642 on its screen, superimposed on the live streaming image.

[0063] Figure 15 is a representative screen view of the live streaming room screen 644 displayed on the viewer's user terminal 30. The live streaming room screen 644 includes an image of the broadcaster 634 and a gift icon 642 received from the server 10. The broadcaster calls on viewers to purchase a special gift corresponding to the gift icon 642 during the live stream. When a viewer taps the gift icon 642 on the live streaming room screen 644 in Figure 15, the user terminal 30 accepts the viewer's designation of the gift icon 642. The user terminal 30 generates a gift usage signal including the gift ID (in this case, "SKK1") of the special gift corresponding to the designated gift icon 642 and sends it to the server 10 via the network NW. Upon receiving the gift usage signal, the server 10 performs payment processing and point awarding processing. The server 10 embeds the viewer ID included in the gift usage signal into the image of the special gift corresponding to the gift icon 642. The server 10 then sends the processed image 648 of the special gift to the user terminals 20 and 30. User terminals 20 and 30 display the received special gift image 648 on their screens, overlaid on the live stream image.

[0064] Figure 16 is a representative screen view of the live streaming room screen 646 displayed on the viewer's user terminal 30. When a viewer taps the gift icon 642 in the live streaming room screen 644 of Figure 15, the live streaming room screen 646 of Figure 16 is displayed on the screen. The live streaming room screen 646 includes an image of the broadcaster 634 and an image of a special gift 648 that is displayed in association with it.

[0065] In the embodiments described above, examples of the holding portion include a hard disk and a semiconductor memory. Furthermore, it will be understood by those skilled in the art who have read this specification that each portion can be realized based on the description herein by a CPU (not shown), a module of an installed application program, a module of a system program, or a semiconductor memory that temporarily stores the contents of data read from the hard disk.

[0066] According to the live streaming system 1 of this embodiment, during a live stream, gifts based on a part of the live stream can be generated and given to the streamer within the same live stream. This allows unique events and moments of the live stream to be instantly transformed into gifts, making the live stream more exciting and increasing engagement with the live stream by both viewers and streamers. Furthermore, decorating the live streaming room with such gifts allows for further personalization of the live streaming room, contributing to increased diversity in the live streaming room.

[0067] Moments unique to live streaming include, for example, the moment of winning first place in an event held on a live streaming platform, the moment a streamer's performance is decided, the moment the cards are laid out in a tarot reading and the moment the streamer places their hand over the crystal, and the moment of victory in a game stream.

[0068] Furthermore, the live streaming system 1 according to this embodiment enables the automatic generation of special gifts based on predetermined conditions. This allows for more accurate capture and creation of gifts at moments that are difficult to specify manually, such as milestone numbers.

[0069] Furthermore, in the live streaming system 1 according to this embodiment, if a viewer is a member of the streamer's army, they can generate special gifts without paying any compensation. This allows members of the streamer's army to send special gifts freely, promoting the development of a unique live streaming culture, such as "always sending special gifts at certain moments specific to the streamer." Alternatively, for this purpose, special gifts may be made free gifts with no points awarded and no compensation. In this case, although no points are awarded to the streamer, it can greatly enliven the live stream.

[0070] [Example Hardware Configuration] Referring to Figure 17, the hardware configuration of the information processing device according to this embodiment will be described. Figure 17 is a block diagram showing an example of the hardware configuration of the information processing device according to this embodiment. The illustrated information processing device 900 can, for example, realize the server 10 and user terminals 20 and 30 in this embodiment.

[0071] The information processing device 900 includes a CPU 901, a ROM (Read Only Memory) 903, and a RAM (Random Access Memory) 905. The information processing device 900 may also include a host bus 907, a bridge 909, an external bus 911, an interface 913, an input device 915, an output device 917, a storage device 919, a drive 921, a connection port 925, and a communication device 929. Furthermore, the information processing device 900 may include an imaging device such as a camera (not shown). The information processing device 900 may also have a processing circuit such as a DSP (Digital Signal Processor) or an ASIC (Application Specific Integrated Circuit) instead of, or together with, the CPU 901.

[0072] The CPU 901 functions as an arithmetic processing unit and control unit, controlling the overall operation or a part of the operation within the information processing unit 900 according to various programs recorded in the ROM 903, RAM 905, storage device 919, or removable recording medium 923. For example, the CPU 901 controls the overall operation of each functional unit included in the server 10 and user terminals 20 and 30, respectively, in this embodiment. The ROM 903 stores programs and arithmetic parameters used by the CPU 901. The RAM 905 temporarily stores programs used in the execution of the CPU 901 and parameters that change as appropriate during its execution. The CPU 901, ROM 903, and RAM 905 are interconnected by a host bus 907, which is composed of internal buses such as the CPU bus. Furthermore, the host bus 907 is connected to an external bus 911, such as a PCI (Peripheral Component Interconnect / Interface) bus, via a bridge 909.

[0073] The input device 915 may be a device operated by the user, such as a mouse, keyboard, touch panel, buttons, switches, and levers, or it may be a device that converts physical quantities into electrical signals, such as a sound sensor like a microphone, an acceleration sensor, a tilt sensor, an infrared sensor, a depth sensor, a temperature sensor, or a humidity sensor. The input device 915 may also be a remote control device that uses infrared or other radio waves, or it may be an external connection device 927 such as a mobile phone that is compatible with the operation of the information processing device 900. The input device 915 includes an input control circuit that generates an input signal based on information input by the user or a physical quantity sensed and outputs it to the CPU 901. By operating this input device 915, the user inputs various data to the information processing device 900 or instructs it to perform processing operations.

[0074] The output device 917 is comprised of a device capable of notifying the user of acquired information visually or audibly. The output device 917 may be, for example, a display such as an LCD, PDP, or OLED, an audio output device such as a speaker and headphones, or a printer. The output device 917 outputs the results obtained from the processing of the information processing device 900 as text or images, or as sound.

[0075] The storage device 919 is a data storage device configured as an example of the storage unit of the information processing device 900. The storage device 919 is composed of, for example, a magnetic storage device such as an HDD (Hard Disk Drive), a semiconductor storage device, an optical storage device, or a magneto-optical storage device. This storage device 919 stores programs executed by the CPU 901, various data, and various data acquired from external sources.

[0076] The drive 921 is a reader / writer for removable recording media 923, such as magnetic disks, optical disks, magneto-optical disks, or semiconductor memory, and is either built into or external to the information processing device 900. The drive 921 reads information recorded on the installed removable recording media 923 and outputs it to the RAM 905. The drive 921 also writes data to the installed removable recording media 923.

[0077] The connection port 925 is a port for directly connecting equipment to the information processing device 900. The connection port 925 may be, for example, a USB (Universal Serial Bus) port, an IEEE1394 port, or a SCSI (Small Computer System Interface) port. Alternatively, the connection port 925 may be an RS-232C port, an optical audio terminal, or an HDMI (High-Definition Multimedia Interface) port. By connecting an external device 927 to the connection port 925, various types of data can be exchanged between the information processing device 900 and the external device 927.

[0078] The communication device 929 is a communication interface composed of, for example, a communication device for connecting to a network NW. The communication device 929 may be, for example, a communication card for wired or wireless LAN (Local Area Network), Bluetooth®, or WUSB (Wireless USB). Alternatively, the communication device 929 may be a router for optical communication, a router for ADSL (Asymmetric Digital Subscriber Line), or a modem for various types of communication. The communication device 929 sends and receives signals, for example, to the Internet or other communication devices using a predetermined protocol such as TCP / IP. The communication network NW connected to the communication device 929 is a network connected by wire or wireless, and may be, for example, the Internet, a home LAN, infrared communication, radio wave communication, or satellite communication. The communication device 929 performs the function of a communication unit.

[0079] An imaging device such as a camera (not shown) is a device that captures real space and generates an image using various components such as an image sensor, such as a CCD (Charge Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor), and a lens for controlling the imaging of a subject onto the image sensor. The imaging device may capture still images or it may capture moving images.

[0080] The configuration and operation of the live streaming system 1 according to this embodiment have been described above. This embodiment is illustrative, and it will be understood by those skilled in the art that various modifications are possible in combinations of each component and each process, and that such modifications are also within the scope of this disclosure.

[0081] In the embodiment described in Figures 11, 12, and 13, a special gift is generated when a viewer takes a screenshot of the live stream and is given to the streamer, but the embodiment is not limited to this. For example, the server 10 may be configured so that the special gift generated in this way can be repurchased by the viewer or other viewers. In this case, after the live stream room screen 630 in Figure 13 is displayed on the viewer's user terminal 30, the viewer makes a user input via the input means of the user terminal 30 to request the display of the gift. Upon receiving this user input, the input information transmission unit 206 of the user terminal 30 generates a gift information request and sends it to the server 10. Upon receiving the gift information request, the relay unit 304 of the server 10 refers to the gift DB 322 to identify the gift ID of an available gift. At this time, the relay unit 304 refers to the user DB 320 to determine whether the special gift "SPG01", which was generated through the processes in Figures 11, 12, and 13 and registered in the gift DB 322, is available. The relay unit 304 determines that the special gift "SPG01" is usable if it is registered as a special gift given to the broadcaster identified by the broadcaster ID included in the gift information request (the broadcaster of the live stream being watched by the viewer who sent the gift information request), and otherwise determines that it is not usable. The relay unit 304 generates a gift information response containing the gift ID of the gift determined to be usable and sends it to the user terminal 30. The superimposed information generation unit 204 of the user terminal 30 includes a list of usable gifts in the frame image, which is a list of the icon images of the gifts identified by the gift IDs included in the gift information response. The viewer-side UI control unit 202 displays a moving image on the display with the frame image superimposed.

[0082] Figure 18 is a representative screen view of the live streaming room screen 660 displayed on the viewer's user terminal 30. The live streaming room screen 660 includes an image 612 of the broadcaster obtained by playing video data, and an image of the list of available gifts. The image of the list of available gifts includes a gift icon 662 for a special gift identified by the gift ID "SPG01". When a viewer taps the gift icon 662 on the live streaming room screen 660 in Figure 18, the user terminal 30 accepts the viewer's designation of the gift icon 662. The user terminal 30 generates a gift usage signal including the gift ID of the special gift corresponding to the designated gift icon 662 (in this case, "SPG01") and sends it to the server 10 via the network NW. Upon receiving the gift usage signal, the server 10 performs payment processing and point granting processing. The server 10 sends an image 628 of the special gift "SPG01" to the user terminals 20 and 30. User terminals 20 and 30 display the received special gift image 628 on their screens, overlaid on the live stream image.

[0083] Figure 19 is a representative screen view of the live streaming room screen 664 displayed on the viewer's user terminal 30. When a viewer taps the gift icon 662 in the live streaming room screen 660 of Figure 18, the live streaming room screen 664 of Figure 19 is displayed on the screen. The live streaming room screen 664 has an image of the broadcaster 612 and multiple images 628 of special gifts that are displayed in association with it. The live streaming room screen 664 displays the same number of special gift images 628 as the number of gifts sent. This allows other viewers to show their support for a special gift created by a particular viewer. In addition, by purchasing multiple copies of the same special gift, a viewer can show the strength of their feelings towards the moment represented by that special gift.

[0084] Furthermore, in this modified version, not only special gifts generated during the currently streaming live broadcast can be displayed and selected from special gifts generated during other past live broadcasts by the same streamer.

[0085] This section describes a modified example of a streamer sending a paid gift to a specific viewer. In the live streaming room screen 632 of Figure 14, when the streamer taps the gift icon 640 for the special gift "SKK5", the user terminal 20 accepts the streamer's designation of the special gift. The user terminal 20 generates a gift usage signal containing the gift ID of the designated special gift (in this case, "SKK5") and sends it to the server 10 via the network NW. The server 10 retrieves and executes the gift algorithm for the special gift identified by the gift ID contained in the received gift usage signal by referring to the gift DB 322. Specifically, the server 10 identifies the viewer ID of the viewer currently watching the live stream, identified by the stream ID contained in the gift usage signal received (from the streamer), by referring to the stream DB 316. The server 10 retrieves information corresponding to the identified viewer ID by referring to the user DB 320. The server 10 generates viewer list information containing the identified viewer ID and the retrieved information and sends it to the streamer's user terminal 20. In this example, we explain the case where the broadcaster selects the recipient from among the viewers of their current live stream. However, in other examples, the recipient could be selected from all users of the live streaming platform registered in user DB320.

[0086] The user terminal 20 generates a viewer selection screen 666 based on the received viewer list information, allowing the broadcaster to select a viewer to whom a special gift will be sent, and displays it on its screen. Figure 20 is a representative screen diagram of the viewer selection screen 666 displayed on the broadcaster's user terminal 20 screen. The viewer selection screen 666 displays the viewer ID 668 of a viewer currently watching the broadcaster's live stream, along with the viewer's information 670. In the viewer selection screen 666, the viewer information may be sorted and displayed according to predetermined criteria (for example, in descending order of total gifting amount, in descending order of viewing time, etc.). The broadcaster taps the viewer ID 668 or information 670 of the viewer to whom the special gift will be sent. The user terminal 20 determines that the viewer specified by the broadcaster through the tap will be the recipient of the special gift. The user terminal 20 generates a public gift grant request including the viewer ID of the specified viewer and sends it to the server 10. When server 10 receives a public gift grant request, it updates user DB 320 so that the points equivalent to the value of the special gift identified by the gift ID "SKK5" included in the request are deducted from the streamer's points. Server 10 also updates user DB 320 so that the points of the viewer identified by the viewer ID included in the public gift grant request are increased by the amount of points granted for the special gift "SKK5". Server 10 generates text indicating that the streamer has sent a gift to a viewer and sends it to the streamer's user terminal 20 and the viewer's user terminal 30, including the recipient viewer. The viewer's user terminal 30 displays the received text as a comment superimposed on the live stream image.

[0087] Figure 21 is a representative screen view of the live streaming room screen 672 displayed on the viewer's user terminal 30. On the live streaming room screen 672, a comment 674 is superimposed on the broadcaster's image 612. The comment 674 contains text received from the server 10 indicating that the broadcaster has sent a gift to a viewer. This comment 674 is displayed on the user terminals 30 of all viewers watching the live stream.

[0088] In the live streaming room screen 632 of Figure 14, when the streamer taps the gift icon 638 for the special gift "SKK4", the same process as described above for the special gift "SKK5" is executed. The difference is that the text indicating that the streamer has sent a gift to a viewer is sent only to the viewer's user terminal 30 and is displayed only on that user terminal 30.

[0089] By enabling streamers to send gifts to viewers, it is possible to encourage closer interaction between streamers and their audience. For example, it can be used as a tool to help influential viewers get to know them.

[0090] The embodiment described a case where a viewer sends a special gift to a broadcaster while watching a live stream, but it is not limited to this. For example, a viewer who purchased a special gift may become a broadcaster and advertise and sell that special gift in their own live stream. For example, in the example in Figure 7, suppose a user with user ID "SS5" purchased and sent a special gift "SPG01" in a live stream previously broadcast by user ID "001A". Viewers of a live stream broadcast by user ID "SS5" make a user input requesting the display of the gift via the input means of the user terminal 30. Upon receiving this user input, the input information transmission unit 206 of the user terminal 30 generates a gift information request and sends it to the server 10. Upon receiving the gift information request, the relay unit 304 of the server 10 refers to the gift DB 322 to identify an available gift ID. At this time, the relay unit 304 determines whether the special gift "SPG01" is available by referring to the user DB 320. The relay unit 304 determines that the special gift "SPG01" is available if it is registered as a special gift given to another user by the broadcaster identified by the broadcaster ID "SS5" included in the gift information request. The relay unit 304 generates a gift information response containing the gift ID of the gift that has been determined to be available and sends it to the user terminal 30. The superimposed information generation unit 204 of the user terminal 30 includes a list of available gifts in the frame image, which is a list of the icon images of the gifts identified by the gift IDs included in the gift information response. The viewer-side UI control unit 202 displays a moving image on the display with the frame image superimposed.

[0091] Figure 22 is a representative screen view of the live streaming room screen 676 displayed on the viewer's user terminal 30. The live streaming room screen 676 includes an image 678 of the streamer "SS5" obtained by playing video data, and an image of the list of available gifts. The image of the list of available gifts has a gift icon 680 for a special gift identified by the gift ID "SPG01". In the live streaming room screen 676, the streamer "001A" to whom the special gift "SPG01" indicated by the gift icon 680 is sent is different from the streamer "SS5" in the streamer image 678 being played on the live streaming room screen 676. The streamer "SS5" who is the giver of the special gift "SPG01" indicated by the gift icon 680 is the same as the streamer "SS5" in the streamer image 678 being played on the live streaming room screen 676. The streamer "SS5" supports another streamer "001A" and urges his viewers to purchase a special gift "SPG01" for "001A" in the live streaming room screen 676.

[0092] In the live streaming room screen 676 of Figure 22, when a viewer taps the gift icon 680, the user terminal 30 accepts the viewer's designation of the gift icon 680. The user terminal 30 generates a gift usage signal that includes the gift ID of the special gift corresponding to the designated gift icon 680 (in this case, "SPG01") and sends it to the server 10 via the network NW. Upon receiving the gift usage signal, the server 10 updates the user DB 320 so that the points equivalent to the value of the special gift identified by the gift ID "SPG01" included in the gift usage signal are deducted from the viewer's points. The server 10 also updates the user DB 320 so that the points of the recipient user of the special gift "SPG01" (in this case, the user with user ID "001A") increase by the amount of points awarded by the special gift "SPG01". The awarded points may be apportioned between user "001A," the recipient of the special gift "SPG01," and the broadcaster "SS5," the streamer of the live stream in which the special gift "SPG01" was purchased. Server 10 sends text indicating that the special gift "SPG01" was sold in broadcaster "SS5's" live stream, along with an image 628 of the special gift "SPG01," to user terminal 20 of user "001A," the recipient of the special gift "SPG01." The user terminal 20 then displays the received text as a comment superimposed on the image of the live stream.

[0093] Figure 23 is a representative screen view of the live streaming room screen 682 displayed on the display of the streamer's user terminal 20. The live streaming room screen 682 includes an image 684 of the streamer "001A" obtained by playing video data, images 628 of special gifts equal to the number of gifts received, and a comment 686 superimposed on the image 684 of the streamer "001A". The comment 686 includes text received from the server 10 indicating that the special gift "SPG01" was sold in the live stream of streamer "SS5". This comment 686 is displayed on the user terminals 30 of all viewers watching the live stream of streamer "001A". In this way, the giver of a special gift can support the recipient streamer through their own stream, even when they are streaming and cannot participate in the recipient stream.

[0094] In this embodiment, the server 10 may be configured to allow users to view information about special gifts they have sent and / or received, even outside of live streaming, by requesting it from user terminals 20 and 30.

[0095] The conversion rate from the gift price to the gift points in this embodiment is just one example, and these rates may be set as appropriate by, for example, the administrator of the live streaming system 1.

[0096] The technical concept of the embodiment may also be applied to virtual live streaming or live commerce, where an avatar that moves in sync with the streamer's movements is used instead of the streamer's image.

[0097] In the processing procedures described herein, particularly those described using flowcharts, it is possible to omit some of the steps constituting the processing procedure, to add steps not explicitly included as constituting the processing procedure, and / or to change the order of such steps. Processing procedures with such omissions, additions, or changes in order are included within the scope of this disclosure, provided they do not deviate from the spirit of this disclosure.

[0098] At least some of the functions implemented by server 10 may be implemented by devices other than server 10, such as user terminals 20 and 30. At least some of the functions implemented by user terminals 20 and 30 may be implemented by devices other than user terminals 20 and 30, such as server 10. For example, the superposition of a predetermined frame image onto an image of video data performed on the playback-side user terminal may be performed by server 10 or on the generation-side user terminal. Also, at least some of the generation of special gifts may be performed on the user terminal.

Claims

[Claim 1] On the terminal of the live streamer, During the live stream, a function is provided to display an object on the screen for the streamer to send a gift to the viewers of the live stream. When the aforementioned object is specified, it has the function of sending a gift usage signal to the server via the network, A function to receive viewer list information generated and transmitted by the server in response to the gift usage signal via the network, A function to display a viewer selection screen on the display, allowing the broadcaster to select a viewer to whom the gift will be sent, based on the viewer list information received. The system implements a function that transmits the viewer information specified by the broadcaster on the viewer selection screen to the server via the network as the viewer information to which the gift will be sent. The aforementioned viewer selection screen is a computer program that displays the viewer ID of a viewer currently watching the live stream, along with the viewer's viewing time, total gifting amount, or both.

Images