computer program

Abstract

To enable the use of more functional gifts in a live stream while suppressing the resulting increase in the data volume.SOLUTION: A computer program causes a terminal to realize: a function of displaying a first user interface object representing a gift of a first type on a display while video data related to a live stream is reproduced; a function of processing data for realizing an effect corresponding to the gift represented by the first user interface object upon acceptance of designation of the first user interface object by a user of the terminal, the data being held in a holding unit of the terminal; a function of displaying a second user interface object representing a gift of a second type on the display while the video data is reproduced; and a function of starting download of data for realizing an effect corresponding to the gift represented by the second user interface object upon acceptance of designation of the second user interface object by the user.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to a computer program, a terminal and a method. [Background technology]

[0002] With the development of IT technology, the way information is exchanged has also changed. During the Showa era, one-way communication, such as through newspapers and television, was the norm. In the Heisei era, the widespread use of mobile phones and personal computers and significant improvements in internet speeds led to the rise of instant, two-way communication services such as chat services. Furthermore, as storage costs decreased, on-demand video streaming services became more popular. Now, in the Reiwa era, with the increasing functionality of smartphones and further improvements in network speeds, such as those exemplified by 5G, services that enable real-time communication through video, particularly live streaming services, are rapidly gaining popularity. Live streaming services are seeing a rapid increase in users, particularly among young people, as they allow everyone to share the same fun time, even when they are far apart.

[0003] Gift effects such as tipping are an important element in live streaming. If you can offer a wide variety of gifts and put effort into the effects of each gift, you can expect the live streaming to be even more exciting.

[0004] Patent Document 1 discloses a technology for livening up a live broadcast by displaying a coin tip effect image during the live broadcast. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Publication No. 2020-017870 Summary of the Invention [Problem to be solved by the invention]

[0006] Live streaming requires immediate interaction between the streamer and the viewer, so the data that realizes the gift effect is usually downloaded to the user's device in advance so that it can be used immediately upon user instruction.

[0007] However, the more sophisticated the effect, the larger the data size required to realize the gift effect. Furthermore, the more types of gifts there are, the larger the data capacity required to store the gift data. As a result, the data for the live streaming application takes up a large portion of the device's capacity, which can slow down the device's performance and restrict the installation of other applications, potentially reducing user convenience.

[0008] The present disclosure has been made in consideration of these issues, and its purpose is to provide technology that enables the use of more highly functional gifts in live streaming while suppressing the resulting increase in data volume. [Means for solving the problem]

[0009] One aspect of the present disclosure relates to a computer program that causes a terminal to perform the following functions: displaying a first user interface object representing a first type of gift on a display while playing video data related to a live broadcast; processing data stored in a storage unit of the terminal for implementing an effect corresponding to the gift represented by the first user interface object when a user of the terminal designates the first user interface object; displaying a second user interface object representing a second type of gift on the display while playing the video data; and starting downloading data for implementing an effect corresponding to the gift represented by the second user interface object when a user designates the second user interface object.

[0010] In addition, any combination of the above components, or mutual substitution of the components or expressions of the present invention between devices, methods, systems, computer programs, recording media storing computer programs, etc., are also valid aspects of the present invention. [Effects of the Invention]

[0011] According to an aspect of the present disclosure, it is possible to use more sophisticated gifts in live streaming while suppressing the resulting increase in data volume. [Brief explanation of the drawings]

[0012] [Figure 1] 1 is a schematic diagram illustrating a configuration of a live distribution system according to an embodiment of the present disclosure. [Figure 2] FIG. 2 is a schematic diagram showing an example of live streaming achieved by the live streaming system of FIG. 1. [Figure 3] 2 is a block diagram showing the functions and configuration of the user terminal of FIG. 1. [Figure 4] 4 is a data structure diagram showing an example of a terminal-side gift holding unit in FIG. 3. FIG. [Figure 5] 4 is a data structure diagram showing an example of a download queue holding unit in FIG. 3. FIG. [Figure 6] FIG. 2 is a block diagram showing the functions and configuration of the server in FIG. 1. [Figure 7] FIG. 7 is a data structure diagram showing an example of the gift download list of FIG. 6. [Figure 8] FIG. 7 is a data structure diagram showing an example of a stream DB in FIG. 6. [Figure 9] FIG. 7 is a data structure diagram showing an example of a user DB in FIG. 6. [Figure 10] FIG. 7 is a data structure diagram showing an example of the gift DB of FIG. 6. [Figure 11] 10 is a flowchart showing the flow of a series of application startup processes in a user terminal. [Figure 12] 10 is a flowchart showing the flow of a series of download processes in a user terminal. [Figure 13] 10 is a flowchart showing a series of gift usage processing steps in a user terminal. [Figure 14] FIG. 10 is a representative screen diagram of a live streaming selection screen displayed on the display of a viewer's user terminal. [Figure 15] FIG. 10 is a diagram illustrating a representative screen of a live streaming room screen displayed on the display of a viewer's user terminal. [Figure 16] FIG. 10 is a diagram illustrating a representative screen of a live streaming room screen displayed on the display of a viewer's user terminal. [Figure 17] FIG. 10 is a diagram illustrating a representative screen of a live streaming room screen displayed on the display of a viewer's user terminal. [Figure 18] FIG. 10 is a diagram illustrating a representative screen of a live streaming room screen displayed on the display of a viewer's user terminal. [Figure 19] FIG. 10 is a diagram illustrating a representative screen of a live streaming room screen displayed on the display of a viewer's user terminal. [Figure 20] 1 is a block diagram illustrating an example of a hardware configuration of an information processing device according to an embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0013] Hereinafter, the same or equivalent components, parts, processes, and signals shown in each drawing will be denoted by the same reference numerals, and redundant explanations will be omitted where appropriate. In addition, some of the parts that are not important for the explanation will be omitted in each drawing.

[0014] In the live streaming system according to the embodiment, data for realizing effects for all gifts (hereinafter referred to as effect data) is not downloaded to the user terminal, but gifts are divided into pre-loaded types, in which the effect data is downloaded in advance, and load-required types, in which the effect data is not. When a viewer wishes to use a load-required gift, the viewer taps the icon of the gift (hereinafter referred to as gift icon), which first starts downloading the effect data for that gift. Once the download is complete, the viewer can use that gift. Gifts that are used less frequently can be classified as load-required gifts.

[0015] This reduces the time required to preload gifts, even if the size of the effect data for each gift increases, and also reduces the increase in the total size of the preloaded effect data. As a result, it is possible to use large-sized effect data to enable richer animations, sounds, and other expressions, while reducing the increase in communication performance and capacity required of user devices. In addition, because preloaded gifts do not require downloading when used, it is possible to ensure the immediacy of interaction between broadcasters and viewers with these preloaded gifts.

[0016] In this way, this embodiment reduces the download size of gifts by optimizing the gift download process, thereby achieving both a good user experience and a low load on the terminal.

[0017] [Live streaming system configuration] FIG. 1 is a schematic diagram illustrating the configuration of a live streaming system 1 according to an embodiment of the present disclosure. The live streaming system 1 provides an interactive live streaming service that allows real-time interaction between broadcasters (also referred to as live streamers) LV and viewers (also referred to as audiences) AU (AU1, AU2, . . .). As shown in FIG. 1, the live streaming system 1 includes a server 10, a broadcaster-side user terminal 20, and a viewer-side user terminal 30 (30a, 30b, . . .). The broadcaster and the viewers may be collectively referred to as users. The server 10 may be configured with one or more information processing devices connected to a network NW. The user terminals 20 and 30 may be, for example, mobile terminals such as smartphones, tablet terminals, laptop PCs, recorders, portable game consoles, or wearable devices, or may be stationary devices such as desktop PCs. The server 10, the user terminals 20, and the user terminals 30 are connected to each other via various wired or wireless networks NW so that they can communicate with each other.

[0018] The live streaming system 1 involves a broadcaster LV, a viewer AU, and an administrator (not shown) who manages the server 10. The broadcaster LV records and films content such as his or her own singing, talking, performance, fortune telling, or game commentary on his or her own user terminal 20 and uploads it directly to the server 10, thereby transmitting the content in real time. The administrator provides a platform for the live streaming of content on the server 10 and also mediates or manages real-time interactions between the broadcaster LV and the viewer AU. The viewer AU accesses the platform with a user terminal 30, selects desired content, and views it. During the live streaming of this content, the viewer AU performs operations such as commenting or cheering via the user terminal 30, and the broadcaster LV providing the content responds to such comments and cheers, and the response is transmitted to the viewer AU via video and / or audio, thereby establishing two-way communication.

[0019] As used herein, "live streaming" may refer to a data transmission method that enables content recorded on a user terminal 20 of a distributor LV to be played back and viewed on a user terminal 30 of a viewer AU in substantially real time, or may refer to the distribution itself achieved by such a transmission method. Live streaming may be achieved using existing live streaming technologies such as HTTP Live Streaming, Common Media Application Format, Web Real-Time Communications, Real-Time Messaging Protocol, and MPEG DASH. Live streaming includes a transmission method in which a viewer AU can view content with a predetermined delay while the distributor LV is recording the content. The delay is at least long enough to enable communication between the distributor LV and the viewer AU. However, live streaming is distinct from on-demand distribution, in which the entire recorded content is temporarily stored on a server and then provided to users at any time upon request.

[0020] In this specification, "moving image data" refers to data including image data (also called video data) generated by the imaging function of the user terminals 20 and 30, and audio data (also called audio data) generated by the audio input function of the user terminals 20 and 30. The moving image data is played back on the user terminals 20 and 30, allowing users to view content.

[0021] FIG. 2 is a schematic diagram showing an example of live streaming achieved by the live streaming system 1 of FIG. 1. In the example of FIG. 2, a broadcaster LV is live streaming a talk. The user terminal 20 of the broadcaster LV records an image and audio of the broadcaster LV while he or she is talking, generating video data, and transmits the video data to the server 10 (not shown in FIG. 2) via the network NW. The user terminal 20 also displays the recorded video image VD of the broadcaster LV on the display of the user terminal 20, allowing the user to check the content of the broadcast by the broadcaster LV.

[0022] User terminals 30a, 30b, and 30c of viewers AU1, AU2, and AU3 who have requested the platform to watch the live broadcast of broadcaster LV each receive video data related to the live broadcast via network NW and play the received video data to display videos VD1, VD2, and VD3 on their displays and output audio from their speakers. The videos VD1, VD2, and VD3 displayed on each user terminal 30a, 30b, and 30c are substantially identical to the video VD captured by user terminal 20 of broadcaster LV, and the audio output from each user terminal 30a, 30b, and 30c is substantially identical to the audio recorded by user terminal 20 of broadcaster LV.

[0023] Audio and video recording on the user terminal 20 of the broadcaster LV and playback of video data on the user terminals 30a, 30b, and 30c of viewers AU1, AU2, and AU3 are performed substantially simultaneously. When one viewer AU1 inputs a comment on the content of the broadcaster LV's conversation into the user terminal 30a, the server 10 displays the comment in real time on the user terminal 20 of the broadcaster LV and also on the user terminals 30a, 30b, and 30c of each viewer AU1, AU2, and AU3. After reading the comment, the broadcaster LV expands the conversation by overlaying the content. The video and audio of the conversation are output to the user terminals 30a, 30b, and 30c of each viewer AU1, AU2, and AU3, thereby recognizing that a conversation between the broadcaster LV and viewer AU1 has been established. In this way, the live streaming system 1 realizes live streaming that enables two-way communication, not one-way communication.

[0024] Figure 3 is a block diagram showing the functions and configuration of user terminal 20 in Figure 1. User terminal 30 has the same functions and configuration as user terminal 20. Each block shown in Figure 3 and the following block diagrams can be realized in hardware terms by elements and mechanical devices such as a computer CPU, and in software terms by a computer program, etc., but here we depict functional blocks realized by the cooperation of these. Therefore, those skilled in the art who have read this specification will understand that these functional blocks can be realized in various ways by combining hardware and software.

[0025] The distributor LV and the viewer AU download and install a live streaming application program (hereinafter referred to as a live streaming app) according to this embodiment from a download site to the user terminals 20 and 30 via the network NW. Alternatively, the live streaming app may be pre-installed on the user terminals 20 and 30. When the user terminals 20 and 30 execute the live streaming app, the user terminals 20 and 30 communicate with the server 10 via the network NW and realize various functions. Hereinafter, functions realized by the user terminals 20 and 30 (or their processors, such as CPUs) executing the live streaming app will be described as functions of the user terminals 20 and 30. These functions are actually functions realized by the live streaming app on the user terminals 20 and 30. Note that in other embodiments, these functions may be realized by a computer program written in a programming language such as HTML (HyperText Markup Language), which is transmitted from the server 10 to a web browser on the user terminals 20 and 30 via the network NW and executed by the web browser.

[0026] User terminal 20 comprises a distribution unit 100 that generates video data recording the user's image and voice and provides it to server 10, a viewing unit 200 that acquires the video data from server 10 and plays it back, a terminal-side gift storage unit 250 that stores gift information in user terminal 20, and a download queue storage unit 252 that stores a gift download queue. A user activates distribution unit 100 when distributing, and activates viewing unit 200 when viewing. A user terminal on which distribution unit 100 is active is on the distributor side, i.e., the user terminal that generates the video data, and a user terminal on which viewing unit 200 is active is on the viewer side, i.e., the user terminal that plays back the video data.

[0027] The distribution unit 100 includes an imaging control unit 102, an audio control unit 104, a video transmission unit 106, and a distribution-side UI control unit 108. The imaging control unit 102 is connected to a camera (not shown in FIG. 3) and controls imaging by the camera. The imaging control unit 102 acquires image data from the camera. The audio control unit 104 is connected to a microphone (not shown in FIG. 3) and controls audio input via the microphone. The audio control unit 104 acquires audio data from the microphone. The video transmission unit 106 transmits video data including the image data acquired by the imaging control unit 102 and the audio data acquired by the audio control unit 104 to the server 10 via the network NW. The video transmission unit 106 transmits the video data in real time. That is, the generation of video data by the imaging control unit 102 and the audio control unit 104 and the transmission of the generated video data by the video transmission unit 106 are performed substantially simultaneously.

[0028] The distribution-side UI control unit 108 controls the UI for the distributor. The distribution-side UI control unit 108 is connected to a display (not shown in Fig. 3) and displays moving images on the display by playing back the video data to be transmitted by the video transmission unit 106. The distribution-side UI control unit 108 displays operation objects and instruction reception objects on the display and receives tap inputs from the distributor.

[0029] The viewing unit 200 includes a viewing-side UI control unit 202, a superimposition information generation unit 204, a gift information transmission / reception unit 206, a gift determination unit 208, and a queue control unit 210. The viewing-side UI control unit 202 controls the viewer-oriented UI. The viewing-side UI control unit 202 is connected to a display and a speaker (not shown in FIG. 3 ) and plays received video data to display video images on the display and output audio from the speaker. The output of images on the display and audio from the speaker can be collectively referred to as "video data being played." The viewing-side UI control unit 202 is connected to input means (not shown in FIG. 3 ), such as a touch panel, keyboard, or display, and acquires user input via these input means. The superimposition information generation unit 204 superimposes a predetermined frame image on an image of video data acquired from the server 10. The frame image includes various user interface objects (hereinafter simply referred to as "objects") for receiving input from the user, comments entered by the viewer, and information acquired from the server 10.

[0030] The viewer-side UI control unit 202 and the superimposition information generation unit 204 jointly display a gift icon representing a pre-loaded gift and a gift icon representing a gift that requires loading on the display while video data related to live distribution is being played back.

[0031] The gift information transmitting / receiving unit 206 transmits and receives information related to gifts to and from the server 10. The gift determining unit 208 determines the type of gift. The queue control unit 210 controls the download queue holding unit 252.

[0032] Fig. 4 is a data structure diagram showing an example of the terminal-side gift storage unit 250 of Fig. 3. The terminal-side gift storage unit 250 stores information about gifts downloaded by the user terminal 20. A gift is electronic data having the following characteristics. -Can be purchased in exchange for points (see below) or can be given free of charge. - Something that viewers can give to the streamer. Giving a gift to a streamer is called using a gift or throwing a gift. Some gifts are purchased and used at the same time, while others are purchased or given and can be used at any time by the viewer. When a viewer gives a gift to a streamer, the streamer will receive the appropriate points and an effect associated with the gift will be displayed on the live streaming screen.

[0033] The terminal-side gift storage unit 250 stores, in association with each other, a gift ID that identifies a gift, icon data (hereinafter referred to as icon data) that is an object representing the gift, data for realizing an effect corresponding to the gift (hereinafter referred to as effect data), and a last update date that is the date the gift was last used. While watching a live broadcast, a viewer can give a desired gift to a broadcaster by paying a price corresponding to the gift. This payment may be made by an appropriate electronic payment method, such as by the viewer paying points equivalent to the price to the administrator. Alternatively, payment by bank transfer or credit card may be used.

[0034] The effect may be a visual effect, an auditory effect, or a tactile effect (e.g., vibration) that characterizes the gift, or a combination thereof. Visual effects include animation, images, and lighting / flashing. Auditory effects include sound effects and voice. Effect data is data for realizing such effects in the user terminal 20, and the user terminal 20 realizes such effects by processing the effect data. The technology for realizing the effect data itself is well known, and will not be described in detail here.

[0035] The gift IDs and icon data of all gifts are stored in advance in the terminal-side gift storage unit 250. The gift information transmitting / receiving unit 206 downloads gift effect data from the server 10 and stores it in the terminal-side gift storage unit 250. There are some gifts for which the gift information transmitting / receiving unit 206 has not downloaded effect data from the server 10.

[0036] 5 is a data structure diagram showing an example of the download queue holding unit 252 of FIG. 3. The download queue holding unit 252 holds a queue of gift downloads. The download queue holding unit 252 holds the download order and the gift ID in association with each other. The gift information transmitting / receiving unit 206 refers to the download queue holding unit 252, requests the server 10 to download the gift effect data in order from the server 10, and downloads it from the server 10.

[0037] Fig. 6 is a block diagram showing the functions and configuration of server 10 in Fig. 1. Server 10 includes a distribution information providing unit 302, a relay unit 304, a gift information providing unit 306, a gift processing unit 308, a gift download list 310, a stream DB 312, a user DB 314, and a gift DB 316.

[0038] 7 is a data structure diagram showing an example of the gift download list 310 of FIG. 6. The gift download list 310 is a list specifying gifts whose effect data must be downloaded by default to the user terminals 20 and 30. When the live streaming app is launched on the user terminals 20 and 30, the effect data of gifts with gift IDs included in the gift download list 310 is automatically downloaded to the user terminals 20 and 30, i.e., without any user instruction, and stored in the terminal-side gift storage unit 250. Areas are set in the gift download list 310, and gifts to be downloaded are listed for each area to which each user terminal belongs.

[0039] The gift download list 310 stores an area and a gift ID of a gift to be downloaded in association with each other. The gift download list 310 is configured to be updatable. The administrator of the live distribution system can change the contents of the gift download list 310 via the server 10. The administrator can register gifts that are expected to be used frequently (such as event-related gifts) in the gift download list 310 in advance. The administrator can also remove gifts that are used less frequently from the gift download list 310.

[0040] Figure 8 is a data structure diagram showing an example of the stream DB 312 in Figure 6. The stream DB 312 stores information about live streaming currently being performed. The stream DB 312 stores, in association with each other, a stream ID that identifies the live streaming on the live streaming platform provided by the live streaming system 1, a broadcaster ID that identifies the broadcaster of the live streaming, and a viewer ID that identifies the viewer of the live streaming.

[0041] FIG. 9 is a data structure diagram showing an example of the user DB 314 in FIG. 6. The user DB 314 stores information about users. The user DB 314 stores a user ID that identifies a user, points held by the user, and the user's level, in association with each other. Points are electronic value circulated within the live streaming platform. When a streamer receives a gift from a viewer during a live stream, the streamer's points increase by the value corresponding to the gift. Points are used, for example, to determine the amount of compensation or money that the streamer receives from the administrator of the live streaming platform. The level is an indicator of the amount of activity of a user on the live streaming platform. A user's level increases when the user sends a gift as a viewer, broadcasts a live stream as a streamer, participates in an event, etc. The server 10 calculates the user's level based on the user's activity history.

[0042] Figure 10 is a data structure diagram showing an example of gift DB 316 in Figure 6. Gift DB 316 stores icon data and effect data for all gifts. Gift DB 316 stores a gift ID that identifies a gift, points that are awarded to a broadcaster when that gift is given to that broadcaster, icon data for that gift, and effect data for that gift, in association with each other.

[0043] Returning to FIG. 6 , upon receiving a notification from the user terminal 20 on the distributor side via the network NW that a live stream will begin, the distribution information providing unit 302 registers a stream ID identifying the live stream and the distributor ID of the distributor of the live stream in the stream DB 312. Upon receiving a request for information about the live stream from the viewing unit 200 of the user terminal 30 on the viewer side via the network NW, the distribution information providing unit 302 references the stream DB 312 and generates a list of live streams that are currently available for viewing. The distribution information providing unit 302 transmits the generated list to the user terminal 30 that made the request via the network NW. The viewer-side UI control unit 202 of the user terminal 30 that made the request generates a live stream selection screen based on the received list and displays it on the display of the user terminal 30.

[0044] When the viewer-side UI control unit 202 of the user terminal 30 accepts the viewer's selection of a live stream on the live stream selection screen, it generates a delivery request including the stream ID of the selected live stream and transmits it to the server 10 via the network NW. The delivery information providing unit 302 starts providing the live stream identified by the stream ID included in the received delivery request to the requesting user terminal 30. The delivery information providing unit 302 updates the stream DB 312 so that the viewer ID of the stream ID includes the viewer ID of the viewer of the requesting user terminal 30.

[0045] The relay unit 304 relays the transmission of video data from the user terminal 20 on the broadcaster side to the user terminal 30 on the viewer side during live streaming initiated by the streaming information providing unit 302. The relay unit 304 receives from the viewer-side UI control unit 202 a signal indicating a user input by the viewer during playback of the video data on the user terminal 30 on the viewer side. The signal indicating the user input includes a gift download request signal requesting the download of gift effect data and a gift use signal indicating the use of the gift. The gift download request signal includes the gift ID of the gift to be downloaded. The gift use signal includes the viewer ID of the viewer, the broadcaster ID of the broadcaster to whom the gift is being given (= the broadcaster ID of the broadcaster performing the live streaming being watched by the viewer who gave the item), and the gift ID of the gift.

[0046] The gift information providing unit 306 provides information related to gifts to the user terminals 20 and 30. In response to a request from the user terminal, the gift information providing unit 306 transmits a terminal gift download list to the user terminal. The gift information providing unit 306 acquires, from the gift DB 316, effect data corresponding to the gift ID included in the gift DL request signal received by the relay unit 304. The gift information providing unit 306 transmits the acquired effect data to the requesting user terminal as a response to the gift DL request signal.

[0047] The gift processing unit 308 updates the user DB 314 so as to increase the points of the broadcaster according to the points granted for the gift identified by the gift ID included in the gift use signal. The gift processing unit 308 refers to the gift DB 316 and identifies the points granted corresponding to the gift ID included in the received gift use signal. The gift processing unit 308 updates the user DB 314 so as to add the identified points granted to the points corresponding to the broadcaster ID included in the gift use signal.

[0048] The operation of the live distribution system 1 configured as above will now be described. FIG. 11 is a flowchart showing the flow of a series of application startup processes in the user terminals 20 and 30. When a user taps the icon of a live streaming application, the live streaming application starts on the user terminal (S502). The user terminal determines whether the lightweight mode is ON (S504). The lightweight mode is a mode in which, at startup, all gifts for which effect data is not stored in the terminal-side gift storage unit 250 are of the load-required type. The user terminal stores whether the lightweight mode is ON or OFF in a mode storage unit (not shown). The user terminal switches the lightweight mode ON or OFF in response to instructions from the user. If the lightweight mode is ON (YES in S504), the user terminal ends the application startup process without updating the download queue.

[0049] If the lightweight mode is OFF (NO in S504), the gift information transmitting / receiving unit 206 requests a gift download list from the server 10 (S506). The gift information transmitting / receiving unit 206 generates a list request signal including the user ID of the user of the user terminal and the area to which the user terminal belongs, and transmits the list request signal to the server 10 via the network NW. The gift information providing unit 306 determines whether the user attributes of the user ID included in the received list request signal satisfy a predetermined criterion. If the criterion is satisfied, the gift information providing unit 306 generates a gift download list for the terminal so that all gift IDs registered in the gift DB 316 are included. Specifically, the gift information providing unit 306 references the user DB 314 and identifies the level corresponding to the user ID included in the received list request signal. If the identified level exceeds a threshold, the gift information providing unit 306 generates a gift download list for the terminal so that all gift IDs registered in the gift DB 316 are included. If the criteria are not met, the gift information providing unit 306 refers to the gift download list 310 and generates a terminal gift download list that includes a gift ID corresponding to the field included in the received list request signal. The gift information providing unit 306 transmits the generated terminal gift download list to the user terminal via the network NW. The gift information transmitting / receiving unit 206 of the user terminal 20 receives the terminal gift download list (S508).

[0050] The gift determination unit 208 deletes expired effect data from the terminal-side gift storage unit 250 based on the received terminal-specific gift download list and the last update date of each gift (S509). The gift determination unit 208 references the terminal-specific gift storage unit 250 and identifies gift IDs whose difference between the last update date and the current date exceeds a threshold value (e.g., 14 days). The gift determination unit 208 determines whether the identified gift ID is included in the received terminal-specific gift download list. If the identified gift ID is not included in the terminal-specific gift download list, the gift determination unit 208 deletes the effect data corresponding to the gift ID from the terminal-side gift storage unit 250. If the identified gift ID is included in the terminal-specific gift download list, the gift determination unit 208 does not delete the effect data. This means that the gift determination unit 208 deletes effect data for gifts that meet predetermined deletion criteria and are not included in the terminal-specific gift download list. This makes it possible to prevent the size of the terminal-side gift holding unit 250 from increasing while ensuring the immediacy of interaction by maintaining the effect data of preloaded gifts.

[0051] The gift determination unit 208 identifies gifts for which effect data is to be downloaded based on the received terminal-side gift download list and the contents of the terminal-side gift storage unit 250 (S510). For each gift ID included in the terminal-side gift download list, if the terminal-side gift storage unit 250 does not store corresponding effect data, the gift determination unit 208 identifies the gift ID as the gift ID of the gift to be downloaded. The gift determination unit 208 registers the identified gift IDs in the download queue storage unit 252 in an arbitrary order (S512). The gift information transmission / reception unit 206 starts downloading the effect data in the order registered in the download queue storage unit 252 (S514).

[0052] In the above flow, the gift information transmitting / receiving unit 206 starts downloading effect data corresponding to a preloaded gift, i.e., a gift included in the terminal gift download list, without user instruction before the icon of the gift is designated. The gift determining unit 208 identifies a preloaded gift by referring to the terminal gift download list.

[0053] If the user's attributes meet the specified criteria in step S506, the gift download list for the terminal includes the gift IDs of all gifts, and the gift information transmission / reception unit 206 begins downloading the effect data corresponding to the gift, regardless of the type of gift, without any user instruction.

[0054] In the above flow, the gift ID of a gift that requires loading is not included in the device gift download list, so the download of effect data for a gift that requires loading will not begin before the gift is specified by the user, unless the gift is used by another user, as described below.

[0055] 12 is a flowchart showing the flow of a series of download processes in the user terminals 20 and 30. The gift information transmitting / receiving unit 206 of the user terminal starts downloading the effect data of the gift identified by the gift ID at the top of the download queue holding unit 252 (S520). The gift information transmitting / receiving unit 206 generates a gift DL request signal including the highest gift ID, i.e., the first gift ID, among the gift IDs held in the download queue holding unit 252, and transmits this signal to the server 10 via the network NW.

[0056] The queue control unit 210 deletes the gift ID at the top of the download queue holding unit 252 and updates the download queue holding unit 252 so that the order of the remaining gift IDs is decreased by one (S522). For example, in the download queue holding unit 252, the order of a gift ID that was number 2 becomes number 1, and the order of a gift ID that was number 3 becomes number 2.

[0057] The gift information transmitting / receiving unit 206 determines whether the download is complete (S524). If it is complete (YES in S524), the gift information transmitting / receiving unit 206 registers the downloaded effect data in the terminal-side gift storage unit 250 and returns the process to step S520. If it is not complete (NO in S524), the queue control unit 210 determines whether a queue change event has occurred (S526). The queue change event includes at least the following two: (Cause 1) The user has expressed an intention to use a gift that requires loading or a pre-loaded gift that has not yet been downloaded. Specifically, the user has tapped on the icon of such a gift. (Reason 2) A gift that requires loading or a pre-loaded gift that has not yet been downloaded was used by another viewer on another user's device to which the same live streaming video data is being distributed.

[0058] If a queue change event has not occurred (NO in S526), ​​the process returns to step S524. If a queue change event has occurred (YES in S526), ​​the queue control unit 210 updates the download queue holding unit 252 in accordance with the queue change event (S528). Thereafter, the process returns to step S524.

[0059] Step S528 will be described in detail. Circumstance 1 will be described later with reference to FIG. 13. Circumstance 2 will be described using the example of FIG. 2. A broadcaster LV broadcasts a live stream, and viewers AU1 and AU2 are watching the same live stream. When viewer AU2 uses a gift, a gift use signal including a gift ID of the gift is generated by user terminal 30b and transmitted to server 10 via network NW. At the same time, user terminal 30b processes effect data corresponding to the gift to superimpose the effect on video VD2. Server 10 identifies other viewers watching the same live stream as viewer AU2 by referring to stream DB 312. Server 10 generates a gift notification signal including the gift ID included in the received gift use signal and transmits it via network NW to user terminal 30a of the identified other viewer (viewer AU1 in this case). User terminal 30a determines whether effect data corresponding to the gift ID included in the received gift notification signal is stored in terminal-side gift storage unit 250. If the effect data is stored, the user terminal 30a processes the effect data to superimpose the same effect as the effect of the user terminal 30b on the video VD1. If the effect data is not stored, the user terminal 30b determines that the reason 2 has occurred.

[0060] The queue control unit 210 controls the download queue holding unit 252 so that the following priority relationship is established for gift downloads. Priority 1: Downloading effect data corresponding to the gift related to reason 1. Priority 2: Downloading effect data corresponding to the gift related to reason 2. Priority 3: Downloading effect data corresponding to gifts registered in the download queue holding unit 252 when the live streaming app is launched.

[0061] When event 1 occurs, the queue control unit 210 increments the order of all gift IDs stored in the download queue storage unit 252 by one, and inserts the gift ID of the gift related to event 1 into the entry with order 1. That is, the queue control unit 210 inserts the gift ID of the gift related to event 1 into the top of the download queue. For example, in the download queue storage unit 252, the order of the gift ID that was order 1 becomes order 2, the order of the gift ID that was order 2 becomes order 3, and the order of the gift ID of the gift related to event 1 is registered as order 1. As a result, the download of the effect data of the gift related to event 1 starts after the download currently in progress.

[0062] When event 2 occurs, the queue control unit 210 increments the order of all gift IDs stored in the download queue storage unit 252, except for the gift ID of the gift related to event 1, by one, and inserts the gift ID of the gift related to event 2 into the entry immediately below the gift ID of the gift related to event 1. That is, the queue control unit 210 inserts the gift ID of the gift related to event 2 between the gift ID of the gift related to event 1 and the other gift IDs in the download queue. For example, in the download queue storage unit 252, the order of the gift ID related to event 1 that was 1 remains 1, the order of the gift ID that was 2 becomes 3, and the order of the gift ID of the gift related to event 2 is registered as 2.

[0063] 13 is a flowchart showing the flow of a series of gift usage processes in the user terminals 20 and 30. It is assumed that a viewer accesses the live streaming platform from the user terminal 30, selects a desired live streaming from the live streaming selection screen, and starts watching. While the viewer is watching the live streaming, video data is continuously transmitted from the user terminal 20 of the distributor to the viewer's user terminal 30 via the server 10 (relay unit 304).

[0064] While this video data is being played back, the viewer makes a user input via the input means of the user terminal 30 to request the display of items. When the viewer-side UI control unit 202 of the user terminal 30 receives this user input, it references the terminal-side gift storage unit 250 and acquires the download status of each gift (S280). The download status is "downloaded" if the effect data is stored in the terminal-side gift storage unit 250, "not downloaded" if the effect data is not stored in the terminal-side gift storage unit 250, and "downloading" if the download of effect data is currently in progress.

[0065] The viewer-side UI control unit 202 and the superimposition information generation unit 204 display each gift icon in a manner corresponding to the download status acquired in step S280 (S282). The superimposition information generation unit 204 acquires and processes icon data for each gift from the terminal-side gift storage unit 250 to generate a gift icon. The superimposition information generation unit 204 applies a visual effect corresponding to the download status acquired in step S280 to the generated gift icon. For example, if the download status is "downloading," the superimposition information generation unit 204 associates an indicator showing the download status with the corresponding gift icon. For example, the superimposition information generation unit 204 applies a progress bar showing the progress of the download to the gift icon. If the download status is "not downloaded," the superimposition information generation unit 204 determines whether the gift is in the download queue by referring to the download queue storage unit 252. If the gift is in the download queue, the superimposition information generation unit 204 applies a visual effect (such as shading) to the corresponding gift icon indicating that the gift is waiting to be downloaded. If the gift icon is not in the download queue, the superimposition information generation unit 204 marks the corresponding gift icon to indicate that downloading is required. If the download status is "downloaded," the superimposition information generation unit 204 does not add a visual effect. The superimposition information generation unit 204 superimposes the processed or unprocessed gift icon thus generated on the image of the video data acquired from the server 10. The viewer-side UI control unit 202 displays the image on which the gift icon is superimposed on the display.

[0066] The viewer-side UI control unit 202 waits until it detects a tap on the gift icon displayed on the display in step S282 (S284). If the download status changes during this wait time (for example, "Downloading" becomes "Downloaded," or "Not Downloaded" in the queue becomes "Downloading" and then "Downloaded"), the visual effect of the corresponding gift icon also changes in accordance with the change in download status. When a tap on the gift icon is detected (YES in S284), the gift determination unit 208 determines whether the download status of the gift corresponding to the gift icon specified by the tap is "Not Downloaded," "Downloaded," or "Downloading" (S286).

[0067] If the download status is "Not Downloaded," the queue control unit 210 inserts the gift ID of the gift specified by the tap at the top of the download queue holding unit 252 (S288). This corresponds to the occurrence of the above-mentioned event 1. Thereafter, the process returns to step S280. As a result, the download of the effect data of the gift specified by the tap is started with the highest priority.

[0068] If the download status is "downloading," the viewer-side UI control unit 202 displays a pop-up on the display containing text indicating that the effect data for the gift specified by the tap is currently being downloaded. The text may be, for example, "Loading. Once loading is complete, tap to send a gift." Then, the process returns to step S280.

[0069] If the download status is "DL Completed," the gift information transceiver 206 generates a gift use signal including the gift ID of the gift specified by the tap and transmits it to the server 10 via the network NW (S292). The superimposition information generator 204 and the viewer-side UI controller 202 read and process effect data of the gift specified by the tap from the terminal-side gift storage unit 250 to output the gift effect (S294). The gift determination unit 208 accesses the terminal-side gift storage unit 250 and updates the last update date of the gift specified by the tap to the current date (S296). Thereafter, the process returns to step S280.

[0070] 14 is a representative screen diagram of a live streaming selection screen 602 displayed on the display of the viewer's user terminal 30. The live streaming selection screen 602 includes thumbnails 604 showing each live streaming in a list of live streaming that is currently available for viewing. The viewer-side UI control unit 202 generates the live streaming selection screen 602 based on the list of live streaming obtained from the server 10, and displays it on the display.

[0071] Figure 15 is a representative screen diagram of a live streaming room screen 610 displayed on the display of a viewer's user terminal 30. When a viewer taps a thumbnail on the live streaming selection screen 602 of Figure 14 and requests the display of gifts, the live streaming room screen 610 of Figure 15 is displayed on the display. The live streaming room screen 610 includes an image 612 of the broadcaster obtained by playing the video data, and gift icons 614, 616, and 618.

[0072] The gift icon 614 is a gift icon for a gift whose download status is "not downloaded" and which is not registered in the download queue holding unit 252. The gift icon 614 has a mark 620 indicating that download is required. The gift represented by this gift icon 614 is a gift that requires loading.

[0073] The gift icon 616 is a gift icon for a gift whose download status is "Not Downloaded" and which is registered in the download queue holding unit 252. The gift icon 616 is shaded to indicate that it is waiting to be downloaded. The gift represented by this gift icon 616 is basically a preloaded gift that has not yet been downloaded.

[0074] Gift icon 618 is a gift icon for gifts whose download status is "DL Completed." Gifts represented by this gift icon 618 are either (1) preloaded gifts for which the download of effect data has been completed, or (2) gifts that were previously load-required gifts but for which the download of effect data has been completed due to a user's designation or use by another user. Gift (2) has already completed the download of effect data, so it can no longer be considered a load-required gift. However, if the effect data expires and is deleted from the terminal-side gift storage unit 250, the gift reverts to a load-required gift.

[0075] 15, when a viewer taps a gift icon 618, the user terminal 30 accepts the viewer's designation of the gift icon 618. The user terminal 30 realizes the effect corresponding to the gift icon 618 by reading effect data corresponding to the gift represented by the designated gift icon 618 from the terminal-side gift storage unit 250 and processing the data.

[0076] FIG. 16 is a representative screen diagram of a live streaming room screen 622 displayed on the display of a viewer's user terminal 30. When a viewer taps a gift icon 614 on the live streaming room screen 610 of FIG. 15, the user terminal 30 accepts the viewer's designation of the gift icon 614. The user terminal 30 begins downloading the effect data corresponding to the gift represented by the designated gift icon 614 (hereinafter referred to as a user-designated gift). On the live room streaming screen 622 of FIG. 16, the gift icon 614 of FIG. 15 has changed to a gift icon 626 including a progress bar 624 indicating the progress of the download, instead of the mark 620.

[0077] Figure 17 is a representative screen diagram of a live streaming room screen 628 displayed on the display of a viewer's user terminal 30. Time has passed since the state of Figure 15, and the download of the effect data for the user-specified gift has been completed. Therefore, on the live streaming room screen 628 of Figure 16, the gift icon 630 for the user-specified gift is displayed in the display mode of a gift icon with the download status "DL Completed." Since the download of the effect data for the gift represented by gift icon 616 on the live streaming room screen 610 of Figure 15 is now in progress, the gift icon 632 for that gift includes a progress bar.

[0078] Figure 18 is a representative screen diagram of a live streaming room screen 634 displayed on the display of a viewer's user terminal 30. When a viewer taps the gift icon 630 on the live streaming room screen 628 of Figure 17, the user terminal 30 displays on the display a live room streaming screen 634 including an image 636 of the broadcaster with a user-specified gift effect superimposed thereon.

[0079] FIG. 19 is a representative screen diagram of the live streaming room screen 638 displayed on the display of the viewer's user terminal 30. Light mode is ON on the live streaming room screen 638. Since there are no pre-loaded gifts in light mode, the gift icons 640, 642, and 644 displayed on the live streaming room screen 638 are all gift icons for gifts whose download status is "Not Downloaded" and which are not registered in the download queue storage unit 252. Each of these gift icons has a mark indicating that downloading is required. The gifts represented by these gift icons are gifts that require loading.

[0080] In the above-described embodiments, examples of the storage unit are a hard disk and a semiconductor memory. Furthermore, based on the description in this specification, it will be understood by those skilled in the art that each unit can be realized by a CPU (not shown), an installed application program module, a system program module, a semiconductor memory that temporarily stores the contents of data read from a hard disk, or the like.

[0081] In the live streaming system 1 according to the present embodiment, effect data for all gifts is not downloaded in advance, but rather effect data for designated preloaded gifts is downloaded in advance, and downloading of the remaining preloaded gifts is initiated in response to a user specification. This allows for the realization of richer effects using large-sized effect data, while suppressing increases in communication traffic due to downloads and the increase in capacity required to install the live streaming app.

[0082] Furthermore, in the live streaming system 1 according to the present embodiment, when a viewer taps a preloaded gift, an effect is instantly displayed on the screen of the broadcaster, the viewer, and other viewers. This allows for the immediacy of interaction between the broadcaster and viewers to be maintained.

[0083] In one example, the total amount of effect data can be several tens of gigabytes. By applying the technical concept of this embodiment, the amount of effect data held by a user terminal can be reduced to several gigabytes to several hundred megabytes. Furthermore, although it takes several tens of milliseconds to several seconds to download a typical piece of effect data in a typical communication environment, the adverse impact of this level of delay on the user experience is limited. Therefore, in many cases, the advantages of providing a load-required type outweigh the disadvantages.

[0084] Furthermore, in the live streaming system 1 according to this embodiment, downloaded gifts and undownloaded gifts are displayed in different ways. This allows users to understand the download status of each gift at a glance, improving user convenience. In particular, a characteristic of live streaming is that users often want to send a gift on the spot. In such situations, users can easily select downloaded gifts, avoiding undownloaded gifts. This improves user satisfaction.

[0085] Furthermore, in the live distribution system 1 according to this embodiment, downloading effect data for a gift specified by the user takes priority over automatic downloading of preloaded gifts. This reduces the time the user must wait to use the gift, thereby increasing user satisfaction.

[0086] Furthermore, in the live distribution system 1 according to the present embodiment, downloading effect data for gifts used by other users takes priority over automatic downloading of preloaded gifts. This minimizes delays in effect output, and can reduce the sense of incongruity that can arise, for example, from a mismatch between the streamer's words of thanks and the effect output.

[0087] Furthermore, in the live streaming system 1 according to this embodiment, all gifts are preloaded for users whose attributes meet predetermined criteria. For example, by preloading all gifts for users who have been using the live streaming platform for a long time and / or who have paid a large amount of money, the user experience of such users can be maximized. Furthermore, since the user devices of so-called heavy users are likely to have high functionality and large capacity, the user experience can be maximized by preloading all gifts for such users.

[0088] [Hardware configuration example] The hardware configuration of an information processing device according to this embodiment will be described with reference to Fig. 20. Fig. 20 is a block diagram showing an example of the hardware configuration of an information processing device according to this embodiment. The illustrated information processing device 900 can realize, for example, each of the server 10 and the user terminals 20 and 30 according to this embodiment.

[0089] The information processing device 900 includes a CPU 901, a ROM (Read Only Memory) 903, and a RAM (Random Access Memory) 905. The information processing device 900 may also include a host bus 907, a bridge 909, an external bus 911, an interface 913, an input device 915, an output device 917, a storage device 919, a drive 921, a connection port 925, and a communication device 929. The information processing device 900 also includes an imaging device (not shown) such as a camera. The information processing device 900 may also include a processing circuit such as a DSP (Digital Signal Processor) or an ASIC (Application Specific Integrated Circuit) instead of or in addition to the CPU 901.

[0090] The CPU 901 functions as an arithmetic processing unit and control unit, and controls all or part of the operations within the information processing device 900 in accordance with various programs recorded in the ROM 903, the RAM 905, the storage device 919, or the removable recording medium 923. For example, the CPU 901 controls all of the operations of the functional units included in the server 10 and the user terminals 20 and 30 in this embodiment. The ROM 903 stores programs and calculation parameters used by the CPU 901. The RAM 905 temporarily stores programs used in the execution of the CPU 901, as well as parameters that change as appropriate during the execution. The CPU 901, the ROM 903, and the RAM 905 are interconnected by a host bus 907, which is an internal bus such as a CPU bus. The host bus 907 is further connected to an external bus 911, such as a PCI (Peripheral Component Interconnect / Interface) bus, via a bridge 909.

[0091] The input device 915 may be, for example, a device operated by a user, such as a mouse, keyboard, touch panel, button, switch, or lever, or may be a device that converts physical quantities into electrical signals, such as a sound sensor such as a microphone, an acceleration sensor, a tilt sensor, an infrared sensor, a depth sensor, a temperature sensor, or a humidity sensor. The input device 915 may be, for example, a remote control device that uses infrared or other radio waves, or an externally connected device 927 such as a mobile phone that supports operation of the information processing device 900. The input device 915 includes an input control circuit that generates an input signal based on information input by the user or a sensed physical quantity and outputs the signal to the CPU 901. The user operates the input device 915 to input various data to the information processing device 900 or to instruct processing operations.

[0092] The output device 917 is configured by a device that can notify the user of acquired information visually or audibly. The output device 917 can be, for example, a display such as an LCD, PDP, or OELD, an audio output device such as a speaker or headphones, or a printer. The output device 917 outputs the results obtained by processing by the information processing device 900 as video such as text or images, or as sound such as audio.

[0093] The storage device 919 is a data storage device configured as an example of a storage unit of the information processing device 900. The storage device 919 is configured, for example, by a magnetic storage device such as a hard disk drive (HDD), a semiconductor storage device, an optical storage device, or a magneto-optical storage device. The storage device 919 stores programs and various data executed by the CPU 901, as well as various data acquired from the outside.

[0094] The drive 921 is a reader / writer for a removable recording medium 923 such as a magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, and is built into or externally attached to the information processing device 900. The drive 921 reads information recorded on the attached removable recording medium 923 and outputs the information to the RAM 905. The drive 921 also writes information to the attached removable recording medium 923.

[0095] The connection port 925 is a port for directly connecting a device to the information processing device 900. The connection port 925 can be, for example, a Universal Serial Bus (USB) port, an IEEE 1394 port, or a Small Computer System Interface (SCSI) port. The connection port 925 can also be an RS-232C port, an optical audio terminal, or a High-Definition Multimedia Interface (HDMI) (registered trademark) port. By connecting an external device 927 to the connection port 925, various types of data can be exchanged between the information processing device 900 and the external device 927.

[0096] The communication device 929 is, for example, a communication interface configured with a communication device for connecting to a network NW. The communication device 929 can be, for example, a communication card for a wired or wireless LAN (Local Area Network), Bluetooth (registered trademark), or WUSB (Wireless USB). The communication device 929 may also be a router for optical communication, a router for ADSL (Asymmetric Digital Subscriber Line), or a modem for various communications. The communication device 929 transmits and receives signals, for example, between the Internet and other communication devices using a predetermined protocol such as TCP / IP. The communication network NW connected to the communication device 929 is a network connected by wire or wirelessly, such as the Internet, a home LAN, infrared communication, radio wave communication, or satellite communication. The communication device 929 also functions as a communication unit.

[0097] An imaging device (not shown) such as a camera is a device that captures real space and generates a captured image using an imaging element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor), and various components such as a lens for controlling the formation of a subject image on the imaging element. The imaging device may capture still images or moving images.

[0098] The above describes the configuration and operation of the live streaming system 1 according to the embodiment. This embodiment is merely an example, and it will be understood by those skilled in the art that various modifications are possible in the combination of each component and each process, and that such modifications are also within the scope of the present disclosure.

[0099] The technical idea of ​​the embodiment may be applied to virtual live streaming or live commerce, in which an avatar that moves in sync with the streamer's movements is used instead of an image of the streamer.

[0100] In the embodiment, when using a gift that requires loading, the user first taps the gift icon of the gift to start downloading the effect data, and then taps the gift icon again after the download is complete to use the gift. However, this is not limited to this. For example, when the user terminal detects a tap on a gift icon that requires loading, the user terminal may start downloading the effect data of the gift represented by the gift icon, and once the download is complete, the user terminal may automatically perform processing to use the gift without receiving any further instructions from the user. In this case, the number of taps required to use the gift is reduced, thereby reducing the user's effort.

[0101] In the embodiment, the download of effect data for a gift that requires loading is started when a tap on the gift icon of the gift is detected, but this is not limited to this. For example, when the user terminal receives a request from the user via the input means to display the gift icon of a gift that requires loading, the user terminal may start downloading effect data for the gift.

[0102] In an embodiment, when a user changes the area to which the user terminal belongs, the user terminal may delete from the terminal-side gift storage unit 250 the effect data of gifts that are not included in the gift download list of the new area.

[0103] In the embodiment, the user terminal compares the gift download list with the contents of the terminal-side gift storage unit 250, but this is not limited thereto. For example, when a live streaming app is launched, the user terminal references the terminal-side gift storage unit 250 to generate a list of gift IDs of gifts for which effect data exists, and transmits the list to the server 10. The server 10 compares the received list with the gift download list to identify effect data to be downloaded to the user terminal. The server 10 transmits the gift IDs of the identified effect data to the user terminal. The user terminal registers the received gift IDs in the download queue storage unit 252 and starts downloading.

[0104] In the embodiment, when event 1 or event 2 occurs, the download of the effect data for the gift related to that event is started after the download currently in progress is completed, but this is not limited to this. For example, when event 1 or event 2 occurs, the user terminal may pause or cancel the download currently in progress and start downloading the effect data for the gift related to that event.

[0105] In the processing procedures described in this specification, particularly in processing procedures described using flow diagrams and flowcharts, it is possible to omit some of the processes (steps) that make up the processing procedures, to add processes that are not explicitly stated as processes that make up the processing procedures, and / or to change the order of the processes, and processing procedures in which such omissions, additions, or changes in order have been made are also included within the scope of this disclosure as long as they do not deviate from the intent of this disclosure.

[0106] At least some of the functions realized by the server 10 may be realized by a device other than the server 10, such as the user terminals 20 and 30. At least some of the functions realized by the user terminals 20 and 30 may be realized by a device other than the user terminals 20 and 30, such as the server 10. For example, the superimposition of a predetermined frame image onto an image of video data performed at a user terminal on the playback side may be performed at the server 10 or at a user terminal on the generation side.

Claims

[Claim 1] On your device, a function of displaying a user interface object representing a gift on a display while playing video data related to live streaming; a function of starting downloading data for realizing an effect corresponding to the gift without an instruction from the user of the terminal before the user interface object is designated when the predetermined mode is OFF; and a computer program for realizing a function of starting downloading of the data when the specified mode is ON and when the designation of the user interface object is accepted.

Images