Server, method, and computer program

Abstract

To provide a server, a method, and a computer program capable of enhancing user experience and interaction between a live streamer and viewers.SOLUTION: In a live streaming system including a server and a plurality of user terminals, a server 10 includes a circuit, and the circuit includes: a function of receiving a first request regarding generation of a gift item from a first user terminal of a first user; a generation unit for generating the gift item on the basis of the first request; and an evaluation unit for evaluating the value of the gift item on the basis of information of the first request.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present disclosure relates to information and communication technology, and in particular to a server, a method, and a computer program for live streaming. [Background technology]

[0002] Some apps and platforms offer live streaming services that allow live streamers and viewers to interact with each other, with live streamers sometimes performing cheering performances for their viewers, and viewers sometimes sending gifts to support their live streamers.

[0003] App and platform providers often hold events to promote interaction between livestreamers and viewers. A livestreamer may select an event and start broadcasting. In order to win the event and receive rewards, the livestreamer can do his or her best to entertain viewers. Patent Document 1 discloses a scenario in which a livestreamer participates in an event.

[0004] However, if viewers do not support these live streamers, their performances will be ineffective and the interaction between the live streamers and viewers will decrease. This may lead to a poor user experience. Therefore, how to improve the user experience is important. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Patent Publication No. 2021-052374 Summary of the Invention

[0006] A server according to one embodiment of the present disclosure includes circuitry configured to perform the functions of receiving a first request for generation of a gift item from a first user terminal of a first user, generating the gift item based on the first request, and assessing the value of the gift item based on information in the first request.

[0007] Another embodiment of the present disclosure relates to a method, the method including steps of receiving a first request for generation of a gift item from a first user terminal of a first user, generating the gift item based on the first request, and assessing a value of the gift item based on information in the first request.

[0008] Yet another embodiment of the present disclosure relates to a computer program that causes a server to perform the following functions: receive a first request for generation of a gift item from a first user terminal of a first user; generate the gift item based on the first request; and evaluate the value of the gift item based on information in the first request.

[0009] According to the present disclosure, the live streamer can create or invite viewers to create customized gifts, which can assist the live streamer in interacting with viewers, events, etc., thereby improving the user experience and interaction between the live streamer and the viewers. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a schematic diagram illustrating the configuration of a live streaming system 1 based on some embodiments of the present disclosure. [Figure 2] FIG. 2 is a block diagram of a user terminal 20 according to some embodiments of the present disclosure. [Figure 3] 1 is a block diagram of a server 10 according to some embodiments of the present disclosure. [Figure 4] 4 is a table illustrating an exemplary data structure of the stream DB 320 of FIG. 3. [Figure 5] 4 is a table illustrating an exemplary data structure of the user DB 322 of FIG. 3. [Figure 6] 4 is a table illustrating an example data structure of the gift DB 324 of FIG. 3. [Figure 7] 4 is a table illustrating an example data structure of the customized gift DB 326 of FIG. 3. [Figure 8] 4 is a table illustrating an example data structure for an event 328 of FIG. 3. [Figure 9] 1 illustrates an exemplary functional structure of a live streaming system 1 according to some embodiments of the present disclosure. [Figure 10] 6 is an exemplary screen image of a live streaming room screen 600 displayed on the display of a live streamer's user terminal 20 or a viewer's user terminal 30. [Figure 11] 6 is an exemplary screen image of a live streaming room screen 600 displayed on the display of a live streamer's user terminal 20 or a viewer's user terminal 30. [Figure 12] 6 is an exemplary screen image of a live streaming room screen 600 displayed on the display of a live streamer's user terminal 20 or a viewer's user terminal 30. [Figure 13] 6 is an exemplary screen image of a live streaming room screen 600 displayed on the display of a live streamer's user terminal 20 or a viewer's user terminal 30. [Figure 14] 6 is an exemplary screen image of a live streaming room screen 600 displayed on the display of a live streamer's user terminal 20 or a viewer's user terminal 30. [Figure 15] 6 is an exemplary screen image of a live streaming room screen 600 displayed on the display of a live streamer's user terminal 20 or a viewer's user terminal 30. [Figure 16]10 is a flowchart showing the steps of an application startup process in the user terminals 20 and 30. [Figure 17] 1 illustrates an exemplary hardware configuration of an information processing device based on some embodiments of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, the same or similar components, parts, steps, or signals shown in each drawing will be denoted by the same reference numerals in all drawings, and redundant explanations will be omitted as appropriate. In addition, some parts that are not important in the explanation of each drawing will be omitted.

[0012] A live streaming system 1 according to some embodiments of the present disclosure provides enhanced functionality to facilitate communication and interaction between users, and more specifically, to entertain viewers and live streamers in technological ways.

[0013] FIG. 1 is a schematic diagram illustrating the configuration of a live streaming system 1 according to some embodiments of the present disclosure. The live streaming system 1 provides a live streaming service for live streamers (LV) and viewers (AUs) (AU1, AU2, ...) to interact with each other in real time. As shown in FIG. 1, the live streaming system 1 may include a server 10, a user terminal 20, and user terminals 30 (30a, 30b, ...). The user terminal 20 may be a live streamer, and the user terminal 30 may be a viewer. In some embodiments, the live streamer and the viewer may be referred to as users. The server 10 may include one or more information processing devices connected via a network NW. The user terminals 20 and 30 may be, for example, mobile devices such as smartphones, tablets, laptops, recorders, portable game consoles, and wearable devices, or stationary computers such as desktop PCs. The server 10, the user terminal 20, and the user terminal 30 may be communicably connected by any type of wired or wireless network NW.

[0014] The live streaming system 1 involves the live streamer LV, the viewer AU, and an app provider (not shown) that provides the server 10. The live streamer LV can record content such as his / her own singing, talking, performance, game streaming, etc. on his / her user terminal 20 and upload it to the server 10, thereby distributing the content in real time. In some embodiments, the live streamer LV can interact with the viewer AU through the live streaming.

[0015] The app provider may provide a platform for live-streamed content on the server 10. In some embodiments, the app provider may be a mediator or manager that manages real-time communication between the live streamer LV and the viewer AU. The viewer AU can access the platform using the user terminal 30 and select and view the content they want to watch. The viewer AU can use the user terminal 30 to perform operations to interact with the live streamer, such as leaving comments or cheering for the live streamer. The live streamer providing the content can respond to the comments or cheering. The live streamer's response can be transmitted to the viewer AU via video and / or audio. Thus, mutual communication between the live streamer and the viewer can be achieved.

[0016] As used herein, "live streaming" may refer to data transmission that allows the viewer AU to substantially play or view content recorded by the live streamer LV via the user terminal 20 via the user terminal 30. In some embodiments, "live streaming" may also refer to streaming achieved by the above-described data transmission. Live streaming may be achieved using known technologies, such as HTTP live streaming, CMAF (Common Media Application Format), WebRTC (Web Real-Time Communications), RTMP (Real-Time Messaging Protocol), and MPEG DASH. Live streaming may also include an embodiment in which the viewer AU can play or view content with a certain delay while the live streamer is recording the content. It is desirable that the delay be small enough to at least allow communication between the live streamer LV and the viewer AU. However, live streaming differs from so-called on-demand delivery. More specifically, on-demand delivery may refer to storing all recorded data of the content on a server and providing the data to the user from the server at random times in response to user requests.

[0017] As used herein, "streaming data" may refer to data including image data and audio data. More specifically, the image data (which may be referred to as video data) may be generated by an image capture function of the user terminals 20 and 30. The audio data (which may be referred to as audio data) may be generated by an audio input function of the user terminals 20 and 30. The streaming data may be played on the user terminals 20 and 30 to enable viewing of content related to the user. In some embodiments, processing such as compression, expansion, encoding, decoding, and transcoding to change the format, size, or standard of the data may be performed between the time the streaming data is generated on the user terminal of the live streamer and the time it is played on the user terminal of the viewer. The content (video and audio) remains substantially unchanged before and after such processing. Therefore, in the current embodiment of the present disclosure, the streaming data before and after processing are described as being the same. In other words, when the streaming data generated by the user terminal of the live streamer is played on the user terminal of the viewer via the server 10, the streaming data generated by the user terminal of the live streamer, the streaming data that has passed through the server 10, and the streaming data that is received and played by the user terminal of the viewer are all the same streaming data.

[0018] As shown in Figure 1, the live streamer LV provides live streaming. The user terminal 20 of the live streamer generates streaming data by recording the video and / or audio of the streamer and transmits it to the server 10 via the network NW. At the same time, the user terminal 20 displays the video VD on its display, allowing users to check the streaming content of the live streamer LV.

[0019] Viewers AU1 and AU2 of user terminals 30a and 30b that request the platform to provide live streaming from the live streamer receive streaming data corresponding to the live streaming via the network NW, play the received streaming data to display videos VD1 and VD2 on a display, and output audio from speakers, etc. The videos VD1 and VD2 displayed on the user terminals 30a and 30b, respectively, are substantially the same as the videos recorded by the user terminals of the live streamer LV, and the audio output from the user terminals 30a and 30b is substantially the same as the audio recorded by the user terminals of the live streamer LV.

[0020] Recording of the live streamer on the user terminal 20 may be simultaneous with playback of the streaming data on the user terminals 30a and 30b of the viewers AU1 and AU2. When the viewer AU1 inputs a comment about the content of the live streamer LV on the user terminal 30a, the server 10 displays the comment in real time on the user terminal 20 of the live streamer and also on the user terminals 30a and 30b of the viewers AU1 and AU2. If the live streamer LV responds to the comment, the response is output as text, image, video, or audio from the user terminals 30a and 30b of the viewers AU1 and AU2, enabling communication between the live streamer LV and the viewers AU1 and AU2. Therefore, the live streaming system enables two-way live streaming.

[0021] 2 is a block diagram showing the functions and configuration of the user terminal 20 shown in FIG. 1 according to an embodiment of the present disclosure. The user terminal 30 has the same functions and configuration as the user terminal 20. The blocks depicted in the block diagrams in this specification are implemented by hardware, such as devices and mechanical components, such as a computer CPU, and software, such as a computer program, that represents functional blocks implemented by the cooperation of these elements. Therefore, it will be understood by those skilled in the art that the functional blocks can be implemented in various ways using a combination of hardware and software.

[0022] The live streamer LV and the viewer AU can download and install the live streaming application (live streaming app) of the present disclosure to the user terminals 20 and 30 from a download site via the network NW. Alternatively, the live streaming app may be pre-installed on the user terminals 20 and 30. When the user terminals 20 and 30 execute live streaming, the user terminals 20 and 30 communicate with the server 10 via the network NW and can realize multiple functions. The functions realized by the execution of the live streaming app by the user terminals 20 and 30 (more specifically, a processor such as a CPU) are described below as functions of the user terminals 20 and 30. These functions are basically functions that the live streaming app causes the user terminals 20 and 30 to realize. In some embodiments, these functions may be realized by transmitting them from the server 10 to a web browser of the user terminals 20 and 30 via the network NW and executing them as a computer program in the web browser. The computer program may be written in a programming language such as HTML (Hyper Text Markup Language).

[0023] The user terminal 20 includes a streaming unit 100 and a viewing unit 200. In some embodiments, the streaming unit 100 is configured to record a user's audio and / or video data and generate streaming data to transmit to the server 10. The viewing unit 200 is configured to receive and play the streaming data from the server 10. In some embodiments, a user can activate the streaming unit 100 during a broadcast or activate the viewing unit 200 when viewing a stream. In some embodiments, the user terminal that activates the streaming unit 100 can be referred to as a live streamer or the user terminal that generates the streaming data. The user terminal that activates the viewing unit 200 can be referred to as a viewer or the user terminal that plays the streaming data.

[0024] The streaming unit 100 may include a video control unit 102, an audio control unit 104, a distribution unit 106, and a UI control unit 108. The video control unit 102 may be connected to a camera (not shown), and the video is controlled by the camera. The video control unit 102 can acquire the video data from the camera. The audio control unit 104 may be connected to a microphone (not shown), and the audio is controlled by the microphone. The audio control unit 104 can acquire the audio data from the microphone.

[0025] The distribution unit 106 receives streaming data including video data from the video control unit 102 and audio data from the audio control unit 104 and transmits the streaming data to the server 10 over the network NW. In some embodiments, the distribution unit 106 transmits the streaming data in real time, i.e., the generation of the streaming data from the video control unit 102 and the audio control unit 104 and the distribution by the distribution unit 106 are performed simultaneously.

[0026] The UI control unit 108 controls the UI of the live streamer. The UI control unit 108 is connected to a display (not shown) and is configured to generate the streaming data for the distribution unit 106 to transmit, play, and display on the display. The UI control unit 108 is configured to display an object to be operated or an object to be instructed on the display and to receive tap input from the live streamer.

[0027] The viewing unit 200 may include a UI control unit 202, a rendering unit 204, and an input sending unit 206. The viewing unit 200 is configured to receive streaming data from the server 10 via a network NW. The UI control unit 202 controls the UI of the viewer. The UI control unit 202 is connected to a display (not shown) and / or a speaker (not shown) and configured to display video on the display and output audio from the speaker by playing the streaming data. In some embodiments, outputting video on the display and outputting audio from the speaker may be referred to as "playing streaming data." The UI control unit 202 is connected to an input unit such as a touch panel, a keyboard, or a display, and can obtain input from a user.

[0028] The rendering unit 204 may be configured to render streaming data from the server 10 and frame images. The frame images may include user interface objects for accepting input from a user, comments entered by a viewer, and data received from the server 10. The input sending unit 206 is configured to receive the user input from the UI control unit 202 and send it to the server 10 via the network NW.

[0029] In some embodiments, the user input may be clicking an object on the screen of the user terminal, such as selecting a live stream, entering a comment, sending a gift, following or unfollowing a user, voting in an event, playing a game, etc. For example, when the user terminal of a viewer clicks a gift object on the screen to send a gift to the live streamer, the input sending unit 206 may generate gift information and send it to the server 10 via the Internet NW.

[0030] In some embodiments, the user terminal 20 may include a terminal-side gift DB (not shown). The terminal-side gift DB is configured to store the gift information of the user terminal 20 or 30. The terminal-side gift DB may include a gift ID, an icon ID, an effect data ID, and a last update date. The gift ID may identify the gift. The icon ID may be icon data of the gift object. The effect data ID may identify data that realizes an effect corresponding to the gift. The last update date may identify the date the gift was last updated.

[0031] In some embodiments, the viewer may download the gift in advance or download the gift when sending the gift. In some embodiments, gift information may be downloaded in advance and stored in a terminal-side gift DB. In some embodiments, the terminal-side gift DB may include a gift list corresponding to the gift list provided by the server 10. In some embodiments, the gift list in the terminal-side gift DB may be synchronized with the server 10 periodically or upon user input.

[0032] 3 is a block diagram of the server 10 according to some embodiments of the present disclosure. The server 10 may include a streaming information unit 302, a relay unit 304, a generating unit 306, an evaluating unit 308, a publishing unit 310, a processing unit 312, a stream DB 320, a user DB 322, a gift DB 324, a customized gift DB 326, and an event DB 328.

[0033] The streaming information unit 302 receives a request for live streaming from the user terminal 20 of the live streamer via the network NW. Upon receiving the request, the streaming information unit 302 registers information about the live streaming in the stream DB 320. In some embodiments, the information about the live streaming may be a stream ID of the live streaming and / or a live streamer ID of the live streamer corresponding to the live streaming.

[0034] When a request for providing information about the live streaming is received from the viewer via the network NW from the viewing unit 200 of the user terminal 30, the streaming information unit 302 refers to the stream DB 320 and generates a list of available live streaming.

[0035] The streaming information unit 302 then transmits the list to the user terminal 30 via the network NW. The UI control unit 202 of the user terminal 30 generates a live streaming selection screen based on the list and displays the list on the display of the user terminal 30.

[0036] When the input sending unit 206 of the user terminal 30 receives the selection of live streaming by the viewer on the live streaming selection screen, it generates a delivery request including the stream ID of the selected live streaming and sends it to the server 10 via the network. The streaming information unit 302 can start providing the live streaming specified by the stream ID in the delivery request to the user terminal 30. The streaming information unit 302 can update the stream DB 320 and add the viewer ID of the viewer of the user terminal 30 to the live streamer ID of the stream ID.

[0037] The relay unit 304 can relay the transmission of the live streaming from the user terminal 20 of the live streamer to the user terminal 30 of the viewer in the live streaming started by the streaming information unit 302. The relay unit 304 can receive a signal indicating a user input from the viewer from the input transmission unit 206 during playback of the streaming data. The signal indicating the user input may be an object designation signal indicating designation of an object to be displayed on the display of the user terminal 30. The object designation signal may include the viewer ID of the viewer, the live streamer ID of the live streamer transmitting the live streaming being watched by the viewer, and an object ID designated by the object. If the object is a gift, the object ID may be a gift ID, etc. Similarly, the relay unit 304 can receive a signal indicating a user input from the live streamer, such as the object designation signal, from the streaming unit 100 of the user terminal 20 during playback of the streaming data.

[0038] The generation unit 306 may be configured to generate the gift based on input from the user. In some embodiments, the gift may be an event gift for an event in which the live streamer is participating. In some embodiments, the gift may be a standard gift, a limited-time gift, a game gift, etc. In some embodiments, the viewer may generate the gift in response to an invitation from the live streamer. In some embodiments, the viewer or the live streamer may generate the gift independently. The gift may be generated through text data, audio data, video data, etc. For example, the viewer may generate the gift by entering descriptive text or by audio input of a sentence.

[0039] In some embodiments, the viewer may determine the gift information. More specifically, the viewer may determine the gift's icon, value, category, duration, etc. For example, the viewer may input "Create a luxury event gift" to generate an event gift worth over 1 million points. In some embodiments, the gift information may be determined based on input from the viewer. For example, the viewer may say, "I want a standard value event gift with a dragon icon," and an event gift based on this input may be generated.

[0040] In some embodiments, the gift generation may be an internal service or a third-party service. In some embodiments, the event gift generation may be generated by a machine learning model or the like. For example, the gift may be generated by Generator AI, ChatGPT, Midjourney, etc.

[0041] The evaluation unit 308 may be configured to evaluate the value of the gift. In some embodiments, the value of the gift may be evaluated during the creation of the gift. More specifically, the evaluation unit 308 may evaluate the value of the gift based on input from the viewer. For example, the evaluation unit 308 may determine the value of the gift based on the value input by the viewer. In some embodiments, the evaluation unit 308 may extract keywords such as luxury, standard, cheap, etc., to determine the value of the gift. In some embodiments, the evaluation of the value may be achieved through machine learning techniques such as language models.

[0042] In some embodiments, the value of the gift may be assessed after the gift is created. In some embodiments, the assessment unit 308 may assess the value of the gift based on interactions between the viewer and the live streamer in the live streaming room. That is, the value of the customized gift may vary based on interactions in the live streaming room. For example, the value of the gift may increase based on an increase in comments or popularity in the live streaming room.

[0043] In some embodiments, the value of the gift may increase based on the number of times the gift is sent in the live streaming room. For example, the value of the gift may increase proportionally according to the number of times the gift is sent in the live streaming room. In some embodiments, every interaction in the live streaming room may contribute to increasing or decreasing the value of the gift. In some embodiments, the function of increasing or decreasing the value may be flexibly determined according to actual needs.

[0044] The publishing unit 310 may be configured to publish the gift to the live streamer or the viewer in the live streaming room. More specifically, after the gift is generated and evaluated, the viewer may publish information about the gift to the live streamer. The publishing unit 310 may receive a request from the viewer to publish the gift to the live streamer, and then send the information about the gift to the live streamer.

[0045] Once the live streamer receives the information about the gift generated by the viewer, the live streamer may decide whether to publish the gift in the live streaming room. For example, if the gift is an event gift in the event the live streamer is participating in, the live streamer may decide whether to display or make the gift available to other viewers in the live streaming room.

[0046] In some embodiments, the live streamer may perform an operation to publish the gift within the live streaming room. For example, the live streamer may be presented with a switch or toggle to turn on / off publishing the gift to the viewers within the live streaming room. In some embodiments, the way in which the live streamer publishes the gift may be flexibly determined according to actual needs.

[0047] When the live streamer switches on the gift, the publishing unit 310 may receive a publishing request for the gift from the live streamer in the live streaming room, and the publishing unit 310 may change the status of the gift in the customized gift DB 326 and then publish the gift in the live streaming room. For example, the publishing unit 310 may set the status of the customized gift to ON, and then send information about the gift to all viewers in the live streaming room, allowing the viewers to send the customized gift to the live streamer.

[0048] In some embodiments, the gift may be generated based on the invitation from the livestreamer or independently by the viewer, livestreamer, etc. In some embodiments, the gift may be published in the livestreaming room only by the livestreamer, or the viewer may also be able to publish the gift to the livestreaming room without permission from the livestreamer. In some embodiments, the design and function of the customized gift may be flexibly determined according to actual needs.

[0049] The processing unit 312 may be configured to handle a leaderboard for an event. More specifically, the processing unit 312 may determine whether the gift contributes to the leaderboard for the event. The processing unit 312 may further calculate the leaderboard based on contributions from the viewers, etc. In some embodiments, the processing unit 312 may further update the leaderboard based on the calculation of the leaderboard.

[0050] In some embodiments, the method for determining whether the customized gift contributes to the leaderboard may be flexible. In some embodiments, the method may be based on input from the creator when creating the customized gift. For example, the viewer may determine whether the gift is an event gift, which event and livestreamer the gift is associated with, etc. In some embodiments, the method may be based on the livestreamer's selection. In some embodiments, the method may be based on the rules of the event, etc.

[0051] In some embodiments, if the customized gift is an event gift for the event in which the livestreamer is participating, the processing unit 312 may calculate a leaderboard for the event when a viewer sends the customized gift to the livestreamer. In some embodiments, the processing unit 312 may also update the leaderboard based on the calculation. These embodiments may allow the livestreamer and viewers to stay up-to-date on the status of the event and make it easier for them to support their favorite livestreamers.

[0052] In some embodiments, the server 10 may further include a gift information unit (not shown) and a gift processing unit (not shown). The gift information unit provides gift information to corresponding streamers and viewers. The gift information unit transmits gift information for the user terminal to the streamer in response to a request from the user terminal. The gift information unit obtains effect data corresponding to the gift ID included in the gift information signal received by the relay unit 304 from the gift DB 324. The gift information unit transmits the obtained effect data to other user terminals 20, 30 in response to a gift transmission request signal.

[0053] The gift processing unit updates the user DB 322 to update the points of the streamer and the viewer according to the points of the gift identified by the gift ID included in the gift use signal. Specifically, the gift processing unit references the gift DB 324 to identify the points to be awarded for the gift ID included in the received gift use signal. The gift processing unit then updates the user DB 322 to add the determined points to the points of the streamer ID included in the gift use signal. In some embodiments, the gift processing unit may update the user DB 322 to subtract the determined points from the points of the viewer ID included in the gift use signal.

[0054] Figure 4 is a table showing an example data structure of the stream DB 320 in Figure 3. The stream DB 320 holds information about currently running live streams. The stream DB 320 stores a stream ID for identifying a live stream on a live streaming platform provided by the live streaming system 1, a live streamer ID for identifying a live streamer providing the live stream, and a viewer ID for identifying a viewer of the live stream, in association with one another.

[0055] FIG. 5 is a table illustrating an exemplary data structure of the user DB 322 of FIG. 3. The user DB 322 holds information about users. The user DB 322 stores a user ID for identifying a user, points for specifying points accumulated by the user, a level for identifying the user's level, and a status for identifying the user's status, all of which are associated with one another. The points are electronic value circulated within the live streaming platform. The level may be an indicator of the amount of activity or engagement of the user on the live streaming platform. The status may be the user's identity or membership status on the live streaming platform.

[0056] 6 shows a table illustrating an example data structure of the gift DB 324 in FIG. 3. The gift DB 324 stores information about gifts that viewers can use during live streaming. The gift DB 324 stores a gift ID for identifying the gift, the number of points a viewer can spend to send the gift to the streamer, an event ID for identifying the event the gift corresponds to, and effect data for the gift, all of which are associated with one another.

[0057] While watching the live stream, viewers can give gifts to streamers by paying points of an equivalent value for the desired gift. Payment of such points of an equivalent value can be made by any suitable electronic means. For example, viewers can pay points of an equivalent value to the administrator. Alternatively, payment by bank transfer or credit card may be used. The administrator can arbitrarily set the relationship between the awarded points and points of an equivalent value.

[0058] A gift is electronic data that has the following characteristics: - They can be purchased in exchange for points (more on this later) or given as free gifts. - Viewers can give gifts to streamers. - Giving gifts to streamers is called using a gift, throwing a gift, etc. - Some gifts can be used immediately upon purchase, while others can be used at any time after purchase or gifting by the purchaser or recipient. - When a viewer gives a gift to a streamer, the streamer will receive the corresponding number of points and will be given an effect related to the gift, such as an effect displayed on the live stream screen.

[0059] The effect may be a visual effect, an auditory effect, a tactile effect (e.g., vibration), or a combination thereof that characterizes the gift. Examples of visual effects include animation, images, and flashing. Examples of auditory effects include sound effects and voice. The effect data is data for realizing such effects on the user terminal 20, and the user terminal 20 realizes such effects by processing the effect data. Note that the technology for realizing effect data is itself well known, and therefore a detailed description thereof will be omitted below.

[0060] 7 shows an exemplary data structure of the customized gift DB 326 in Fig. 3. The customized gift DB 326 holds information about the customized gift. The customized gift DB 326 stores, in association with one another, a customized item ID that identifies the customized gift, points that identify the points of the customized gift, a value that identifies the value of the customized gift, an event ID that identifies the event to which the gift corresponds, a creator ID that identifies the user who created the customized gift, an invitee ID that identifies the user who sent the invitation to the creator, a status that identifies the publication of the customized gift, and an effect that identifies effect data for the customized gift.

[0061] In some embodiments, if the gift type of the customized gift is an event gift, the event ID may store corresponding event information. Otherwise, the event ID may be blank, for example. In some embodiments, the gift type information may also be stored in the gift DB 324, the customized gift DB 326, etc. In some embodiments, the invitee ID may be blank, for example, if the customized gift was created independently by the creator without an invitation. In some embodiments, the customized gift may be stored separately in a separate DB, such as the gift DB 324 or the customized gift DB 326. In some embodiments, the information in the customized gift DB 326 may be flexibly determined.

[0062] 8 shows a table illustrating an example data structure of the event DB 328 in FIG. 3. The event DB 324 stores information about events held by app or platform providers. The event DB 324 stores an event ID for identifying the event, an event gift ID for identifying gifts at the event, and a start time and an end time for identifying the start time and the end time of the event.

[0063] Here, "event" may refer to an event in which streamers compete for points received. The event may be hosted by an app or platform provider. Viewers may send virtual items, such as gifts, to streamers, and each virtual item may correspond to a certain amount of points. Streamers may interact with viewers to collect points. In the event, streamers may be ranked based on the points received. Streamers who earn relatively high points may receive rewards. In some embodiments, each event may include a specific gift, and only the specific gift may contribute to the points received by the streamer. In some embodiments, the gift may be common to all events. In some embodiments, the rules of the event may be designed according to actual needs.

[0064] The event may begin at a start time and end by an end time. Streamers participating in the event may compete against each other to collect the most event gifts from viewers within a specific time period from the start time to the end time. The streamer who collects the most event gifts may be the winner and may receive a specific reward. In some embodiments, the rules of the event and the criteria for determining the winner may be flexibly designed.

[0065] FIG. 9 is a schematic diagram illustrating an example functional configuration of a live streaming system 1 according to some embodiments of the present disclosure. As shown in FIG. 9, the live streamer may send an invitation to the viewer to create a gift. In some embodiments, the live streamer may create the gift themselves, or the viewer may create the gift without the live streamer's invitation. In some embodiments, the viewer may create the gift by uploading text, audio, video, a file, or the like. For example, the viewer may enter a description, speak a sentence, or upload information about the gift, such as an image or animation.

[0066] In some embodiments, the input from the viewer or the live streamer may be transmitted to the server 10. After generating the gift, the server 10 may evaluate the value of the gift. For example, the generation unit 306 and the evaluation unit 308 may generate the gift and evaluate the value of the gift based on the input from the viewer.

[0067] Once the customized gift has been created and rated, the viewer may publish the gift to the live streamer. In some embodiments, the viewer may modify, change, update, or delete the gift during or after the gift is created. For example, the viewer may associate the customized gift with a particular type, such as an event gift, associate the customized gift with a particular live streamer, a particular live streaming room, a particular time period, etc. In some embodiments, the viewer may publish the customized gift directly to the live streaming room without publishing it to the live streamer.

[0068] In some embodiments, upon receiving the customized gift from the viewer, the live streamer may decide whether to publish the customized gift to the live streaming room. For example, a UI interface of a switch or toggle may be displayed on the screen 600 to allow the live streamer to decide whether to publish the customized gift.

[0069] Meanwhile, the customized gift may also be sent to a customized gift exchange service in the server 10 to determine whether the gift is related to an event in the live streaming platform. The customized gift exchange service may be a service of an event management system in the server 10, which may be responsible for event management, such as event generation, rule determination, leaderboard calculation, etc., according to actual needs.

[0070] In some embodiments, the customized gift exchange service may determine whether the customized gift contributes to a leaderboard. For example, if the customized gift is an event gift within an event in which the live streamer is participating, when the viewer sends the customized gift to the live streamer, the value of the customized gift may contribute to the leaderboard for the event. In some embodiments, the rules of the event may be flexibly configured to determine whether the customized gift contributes to the leaderboard for the event.

[0071] Once the customized gift is published to the live streaming room, the viewers in the live streaming room may send the customized gift to the live streamer. For example, the viewers may click on a gift icon to open a gift list, and the customized gift may appear in a tab of the gift list, such as "Event," "Customized," or "Luxury."

[0072] In some embodiments, the value of the customized gift may vary based on interactions within the live streaming room. In some embodiments, the interactions may be any interactions possible within the live streaming room. For example, the value of the customized gift may be determined based on the number of viewers who send the customized gift to the live streamer. More specifically, the value of the gift may increase or decrease depending on an increase or decrease in the number of viewers who send the gift. In some embodiments, the value may be determined based on the number of times the gift is sent, etc.

[0073] In some embodiments, the gift evaluation procedures during the generation of the gift and the interaction between the live streamer and the viewer may be performed by the same evaluation unit 308 or by different evaluation units 308. That is, the evaluation of the value of the gift may be performed by the same unit or by different units. In some embodiments, the evaluation of the interaction and the value of the gift may be reflected on the leaderboard during the calculation of the leaderboard. For example, the interaction and the evaluation may be sent to the leaderboard in the form of raw data, and may be further decoded based on the rules of the event before being reflected on the leaderboard.

[0074] When the gift is sent to the livestreamer, the livestreamer may receive points corresponding to the value of the gift. If the customized gift is an event gift, the value of the customized gift may contribute to a leaderboard for the event. For example, if the livestreamer is participating in an event and a customized event gift is sent to the livestreamer, the livestreamer's score or ranking may change based on the livestreamer's receipt of the gift.

[0075] According to these embodiments, the live streamer can create or invite viewers to create customized gifts, which can assist the live streamer in interactions with viewers, events, etc., thereby improving the user experience and interaction between the live streamer and the viewers.

[0076] 10 to 15 are exemplary screen images of a live streaming room screen 600 displayed on the display of a live streamer's user terminal 20 or a viewer's user terminal 30. As shown in FIG. 10, the viewer may receive an invitation 602 for gift generation from the live streamer. In some embodiments, the invitation may be from another viewer or the server 10. For example, the server 10 may automatically send an invitation to the viewer during the event, just before the event, or at the end of the event to make the event more exciting. In some embodiments, the invitation may be triggered by the viewer. For example, the viewer may send a specific number of gifts to trigger an invitation for customized gift generation. In some embodiments, the design of the invitation may be flexible.

[0077] In some embodiments, the viewer may enter a description for the gift, as shown in Figure 11. In some embodiments, the viewer may enter a description using a microphone, uploading a file, filling out a form, etc., as shown in Figure 11. In some embodiments, the method for generating the customized gift may be flexible.

[0078] Once the gift has been created and evaluated, information about the customized gift may be sent to the live streamer via server 10 or the like. In some embodiments, as shown in FIG. 12 , a list 604 for managing the customized gifts may be provided to the live streamer. In some embodiments, the list 604 may include the customized gifts received or created by the live streamer. In some embodiments, each customized gift may include an information icon 606, which, when clicked, may display information about the customized gift.

[0079] In some embodiments, each customized gift may have a status 608. The status 608 may indicate the publishing status of the gift in the live streaming room. For example, as shown in FIG. 12, a switch 610 indicating whether to publish the gift may be displayed. The live streamer may click the switch to decide whether to publish the customized gift in the live streaming room.

[0080] When the switch is turned on, the publishing unit 310 may transmit information about the customized gift to the viewers in the live streaming room. As shown in FIG. 13 , the customized gift may be displayed in the gift list 612. In some embodiments, the customized gift may be displayed in a corresponding tab for the gift. For example, if the customized gift is an event gift, the customized gift may be displayed in the event list tab. In some embodiments, a separate customized gift tab may be provided to display the customized gift in the live streaming room.

[0081] In some embodiments, the value of the customized gift may change based on interactions within the live streaming room. As shown in FIG. 14 , information about the customized gift may be provided to the viewer for confirmation, such as a pop-up message 614 that may appear on the customized gift automatically or in response to an action from the viewer. In some embodiments, the information may include, for example, the gift's current points, the gift's current value, the creator of the customized gift, the number of times the gift has been sent, etc.

[0082] In some embodiments, the current points may be the number of points the viewer spent to send the customized gift to the livestreamer, and the value of the current gift may be the number of points contributed to a leaderboard for the livestreamer or the event. For example, the viewer may spend 30,000 points to send the sun to the livestreamer, and the livestreamer may receive 35,000 points, or the livestreamer's score on the leaderboard may increase by 35,000 points, etc.

[0083] FIG. 15 illustrates an exemplary leaderboard page 616. In some embodiments, the leaderboard page 616 may display the user's ranking and corresponding score S. In some embodiments, detailed information DI for the score S may be displayed below each user, detailing information about the score. For example, the detailed information DI may include score bonuses, score combinations, and other relevant information. In some embodiments, if the customized gift is an event gift, the value of the customized gift may contribute to the score in the leaderboard. As shown in FIG. 15, the score for the livestreamer Tanaka is increased by 35,000 points, the value of the customized gift.

[0084] In some embodiments, the method for determining whether the customized gift contributes to a leaderboard within an event may be flexible. For example, when setting up the event, staff may set up the customized gift as an event gift. In some embodiments, the customized gift may be associated with a particular event, a particular live streamer, a particular live streaming room, a particular time period, a particular geographic location, etc.

[0085] In some embodiments, the gifts may be categorized into multiple types, such as event gifts, voting gifts, and filtering gifts. In some embodiments, the customized gifts may also be a type of gift. The type of customized gifts may include gifts created by the user. In some embodiments, the customized gifts may be placed in a separate tab within the gift list or in a corresponding tab based on detailed information about the customized gifts.

[0086] In some embodiments, interactions during the live streaming may increase or decrease the value of the customized gift. For example, an increase or decrease in the number of participants or popularity in the live streaming room may increase or decrease the value of the customized gift. In some embodiments, if the creator of the customized gift is in the live streaming room, the value of the customized gift may increase. In some embodiments, if the creator submits the customized gift, additional bonus value may further contribute to the leaderboard. In some embodiments, the detailed design of the customized gift may be flexibly determined.

[0087] In some embodiments, the livestreamer may determine the value of the customized gift. In some embodiments, the livestreamer may determine the value based on the viewers' interactions. For example, the livestreamer may initiate a poll among the viewers to determine whether to increase or decrease the value of the customized gift.

[0088] In some embodiments, a special item may be provided by the server 10 to determine the value of the customized gift. For example, an item may be provided to increase or decrease the value of the customized gift. In some embodiments, the item to increase or decrease the value of the gift may be decoration. For example, a diamond item may be added to a customized ring gift to increase the value of the customized gift. An ink item may be added to a customized gift to decrease the value of the customized gift. In some embodiments, an item may be provided to make the customized gift invisible, thereby preventing the viewer from sending the customized gift to a rival live streamer by other viewers. In some embodiments, an item may be provided to prevent the value of the customized gift from being increased or decreased.

[0089] In some embodiments, the creator or livestreamer may place the customized gift in a specific location. For example, the livestreamer may place the customized gift in a prominent location. The location may be the center of the livestreaming room, the first location where the listed gift appears, an in-app promotional message, etc. In some embodiments, the detailed design of the customized gift may be flexibly determined.

[0090] Next, the operation of the live streaming system 1 having the above configuration will be described. FIG. 16 is a flowchart showing the steps of an application startup process on the user terminal 20, 30. When a user enters a live streaming room, the user may perform operations on the user terminal to interact with the live streamer. In some embodiments, the operations may include commenting, sending gifts, following, unfollowing, voting, playing games, etc.

[0091] In some embodiments, the live streamer may be participating in an event in the live streaming room and may want to be supported by viewers in the live streaming room. As shown in FIG. 16 , the live streamer may send an invitation to viewers to generate a gift (S502). In some embodiments, the viewers may be present or absent in the live streaming room. When the viewers receive the invitation, the viewers may generate the gift (S504), for example, by setting information for the gift.

[0092] After the customized gift is configured, the customized gift may be generated by the server 10 or the like (S506). Furthermore, the value of the customized gift may also be evaluated by the server 10 or the like (S508). In some embodiments, the generation and evaluation of the customized gift may be realized on the terminal side or the like. Once the generation and evaluation are complete, the viewer may further publish the gift to the live streamer (S510).

[0093] In some embodiments, the live streamer may review the gift and further publish it to the live streaming room (S512). Once the customized gift is published to the live streaming room, viewers in the live streaming room may send the customized gift to the live streamer to support the live streamer (S514). In some embodiments, if the live streamer is participating in an event, the customized gift may be an event gift. When the live streamer receives the event gift, it may contribute to a leaderboard within the event.

[0094] In some embodiments, the value of the customized gift may be determined based on interactions within the live streaming room (S516). The interactions may be any possible interactions within the live streaming room or may be flexibly determined. In some embodiments, the points of the gift may be the number of points consumed by the viewer, and the value of the gift may be the number of points received by the live streamer. In some embodiments, the points or the value of the gift may increase or decrease based on the interactions. In some embodiments, the difference between the points and the value of the gift may increase or decrease based on the interactions.

[0095] In some embodiments, a leaderboard within the event may be calculated based on the gifts received by the livestreamer (S518). Once the leaderboard calculation is complete, the results may be updated on the leaderboard (S520). Thus, the viewers and the livestreamer may keep track of the status of the event and may help themselves or their favorite livestreamer win the event.

[0096] According to the present disclosure, the live streamer can create or invite viewers to create customized gifts, which can assist the live streamer in interacting with viewers, events, etc., thereby improving the user experience and interaction between the live streamer and the viewers.

[0097] 17 is a schematic block diagram of a system configuration and computer hardware for executing processing according to some embodiments of the present disclosure. The information processing device 900 in FIG. 17 is configured to realize, for example, the server 10 and the user terminals 20 and 30 according to some embodiments of the present disclosure.

[0098] The information processing device 900 includes a CPU 901, a read-only memory (ROM) 903, and a random access memory (RAM) 905. The information processing device 900 may further include a host bus 907, a bridge 909, an external bus 911, an interface 913, an input unit 915, an output unit 917, a storage unit 919, a drive 921, a connection port 925, and a communication unit 929. The information processing device 900 may also include an imaging device (not shown), such as a camera. The CPU 901 is an example of a hardware configuration for implementing functions realized by components described herein. The functions described herein may be implemented by a circuit programmed to implement the described functions. The circuit programmed to implement the functions described herein may include a CPU (Central Processing Unit), a DSP (Digital Signal Processor), a general-purpose processor, an application-specific processor, an integrated circuit, an ASIC (Application Specific Integrated Circuit), and / or a combination thereof. In this specification, a unit for realizing a specific function may be realized as a circuit programmed to realize the function, including, but not limited to, the streaming unit 100, the video control unit 102, the audio control unit 104, the delivery unit 106, the UI control unit 108, the viewing unit 200, the UI control unit 202, the rendering unit 204, the input sending unit 206, the streaming information unit 302, the relay unit 304, the generating unit 306, the evaluating unit 308, the publishing unit 310, the processing unit 312, the stream DB 320, the user DB 322, the gift DB 324, the customized gift DB 326, and the event DB 328.

[0099] The CPU 901 functions as an arithmetic processing unit and control device, controlling the overall operation of the information processing device 900 or a portion of the operation thereof in accordance with various programs stored in the ROM 903, RAM 905, storage unit 919, or removable recording medium 923. For example, the CPU 901 controls the overall operation of each functional unit included in the server 10 and the user terminals 20 and 30 of the above-described embodiments. The ROM 903 stores programs and operating parameters used by the CPU 901. The RAM 905 transiently stores programs used by the CPU 901 when executing the programs and parameters that change as appropriate when the programs are executed. The CPU 901, the ROM 903, and the RAM 905 are connected to one another via a host bus 907, which is an internal bus such as a CPU bus. The host bus 907 is connected to an external bus 911, such as a Peripheral Component Interconnect / Interface (PCI) bus, via the bridge 909.

[0100] The input unit 915 is a device operated by a user, such as a mouse, keyboard, touch panel, button, switch, or lever. The input unit 915 may be a device that converts a physical quantity into an electrical signal, such as an audio sensor (such as a microphone), an acceleration sensor, a tilt sensor, an infrared sensor, a depth sensor, a temperature sensor, or a humidity sensor. The input unit 915 may be, for example, a remote control device that uses infrared or another type of radio wave. Alternatively, the input unit 915 may be an external connection terminal 927, such as a mobile phone, that supports the operation of the information processing device 900. The input unit 915 includes an input control circuit that generates an input signal based on information input by a user and outputs the generated input signal to the CPU 901. The user operates the input unit 915 to input various data and instruct the information processing device 900 to perform processing operations.

[0101] The output unit 917 includes a device that can visually or audibly notify the user of the acquired information. The output unit 917 may be, for example, a display device such as an LCD, PDP, or OLED, an audio output device such as a speaker or headphones, a printer, etc. The output unit 917 outputs the results obtained by the processing performed by the information processing device 900 in the form of text, video such as an image, or sound such as voice.

[0102] The storage unit 919 is a data storage device and is an example of a storage unit of the information processing device 900. The storage unit 919 includes, for example, a magnetic storage device such as a hard disk drive (HDD), a semiconductor storage device, an optical storage device, a magneto-optical storage device, etc. The storage unit 919 stores programs and various data executed by the CPU 901, as well as various data acquired from the outside.

[0103] The drive 921 is a reader / writer of a removable recording medium 923 such as a magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, and is built into or externally attached to the information processing device 900. The drive 921 reads information recorded on the attached removable recording medium 923 and outputs the information to the RAM 905. The drive 921 writes information to the attached removable recording medium 923.

[0104] The connection port 925 is a port used to directly connect a device to the information processing device 900. The connection port 925 may be, for example, a USB (Universal Serial Bus) port, an IEEE 1394 port, or a SCSI (Small Computer System Interface) port. The connection port 925 may also be an RS-232C port, an optical audio terminal, an HDMI (High-Definition Multimedia Interface (registered trademark)) port, or the like. Connecting an external connection terminal 927 to the connection port 925 enables the exchange of various data between the information processing device 900 and the external connection terminal 927.

[0105] The communication unit 929 is, for example, a communication interface including a communication device for connecting to a communication network NW. The communication unit 929 may be, for example, a communication card for a wired or wireless local area network (LAN), Bluetooth (registered trademark), or wireless USB (WUSB). The communication unit 929 may be, for example, a router for optical communication, a router for ADSL (asymmetric digital subscriber line), or a modem for various communication purposes. For example, the communication unit 929 uses a predetermined protocol such as TCP / IP to transmit and receive signals over the Internet or with other communication devices. The communication network NW to which the communication unit 929 connects is a network established by a wired or wireless connection. The communication network NW may be, for example, the Internet, a home LAN, infrared communication, radio wave communication, or satellite communication.

[0106] The imaging device (not shown) is a device that captures real space and generates a captured image using an imaging element such as a CCD (charge-coupled device) or a CMOS (complementary metal-oxide semiconductor), and various components such as a lens for controlling the formation of a subject image on the imaging element. The imaging device may capture either still images or moving images.

[0107] The live streaming system 1 of the present disclosure has been described above with reference to the embodiments. The above-described embodiments have been described merely for the purpose of explanation. Rather, those skilled in the art will readily appreciate that the above-described components and processes of the embodiments can be combined in various ways and modified in various ways, and these are also within the technical scope of the present disclosure.

[0108] The steps described in this specification, particularly the steps described using flowcharts or flow charts, may include some of the steps constituting the steps, may include steps not explicitly included in the steps constituting the steps, and / or may be rearranged in order. Steps that are the subject of such omission, addition, or rearrangement are also included within the scope of the present disclosure as long as they do not deviate from the gist of the present disclosure.

[0109] In some embodiments, at least a portion of the functions performed by the server 10 may be performed by a device other than the server 10, for example, by the user terminal 20 or 30. In some embodiments, at least a portion of the functions performed by the user terminal 20 or 30 may be performed by a device other than the user terminal 20 or 30, for example, by the server 10. In some embodiments, rendering of frame images may be performed by the user terminal of a viewer, server, live streamer, or the like.

[0110] Furthermore, the system or method described in the above embodiments may be provided in a non-transitory computer-readable storage device such as a solid-state storage device, an optical disk storage device, or a magnetic disk storage device, or in a computer program product, etc. Alternatively, the program may be downloaded from a server via the Internet.

[0111] Although the technical contents and features of the present disclosure have been described above, those skilled in the art can still make many variations and modifications without departing from the teachings and disclosure of the present disclosure. Therefore, the scope of the present disclosure is not limited to the embodiments already disclosed, but is within the scope of the appended claims, including other variations and modifications that do not depart from the present disclosure. [Explanation of symbols]

[0112] 1. Live Streaming System 10 Servers 20 User terminal 100 Streaming Units 102 Video control unit 104 Audio control unit 106 Delivery Unit 108 UI control unit 200 viewing units 202 UI control unit 204 rendering units 206 Input Unit 30, 30a, 30b User terminal 302 Streaming Information Unit 304 Relay unit 306 Generating Units 308 evaluation units 310 Publishing Unit 312 Processing Unit 320 Stream DB 322 User DB 324 Gift DB 326 Customized Gift DB 328 Event DB 600 screens 602 Invitation 604 List 606 Icons 608 Status 610 Switch 654 Gift Objects 656 Gift List 900 Information Processing Equipment 901 CPU 903 ROM 905 RAM 907 Host Bus 909 Bridge 911 External Bus 913 Interface 915 Input Unit 917 Output Unit 919 Storage Unit 921 Drive 923 Removable Recording Media 925 connection port 927 External connection terminal 929 Communication Unit LS Live Streaming LV Live Streamer NW Network SP Specific part AU1, AU2 viewers S502~S520 process VD, VD1, VD2 video

Claims

1. 1. A server including circuitry, the circuitry comprising: receiving a first request for creation of a gift item from a first user terminal of a first user; generating the gift item based on the first request; assessing the value of the gift item based on information in the first request; A server configured to execute the

2. receiving an invitation to create the gift item from a second user terminal of a second user; sending the invitation to the first user terminal of the first user; The server of claim 1 further comprising:

3. A function of receiving information about the gift item generated by the first user terminal of the first user; a function of transmitting the information about the generated gift to a second user terminal of a second user; The server of claim 1 further comprising:

4. receiving a second request from the second user terminal of the second user for publishing the generated gift item in a live streaming room; transmitting the information about the generated gift item to viewers in the live streaming room; The server of claim 3 further comprising:

5. Further comprising a function of determining the value of the gift item based on interactions within the live streaming room; the interactions include a number of times the gift item is sent within the live streaming room; 2. The server according to claim 1, wherein:

6. receiving a second request from the first user terminal of the first user for publishing the generated gift item in a live streaming room; transmitting the information about the generated gift item to viewers in the live streaming room; The server of claim 1 further comprising:

7. determining whether the gift item is associated with an event; responsive to the gift item being associated with the event, calculating a leaderboard for the event; updating said leaderboard; The server of claim 1 further comprising:

8. The gift item is an event gift item in an event in which the live streamer is participating; and The event gift items, when received by the live streamer from viewers in a live streaming room, contribute to a leaderboard within the event.

2. The server according to claim 1, wherein:

9. 1. A method comprising: receiving a first request for creation of a gift item from a first user terminal of a first user; generating the gift item based on the first request; assessing the value of the gift item based on the information in the first request; A method comprising:

10. A computer program, comprising: receiving a first request for creation of a gift item from a first user terminal of a first user; generating the gift item based on the first request; assessing the value of the gift item based on information in the first request; A computer program characterized by causing a computer to execute the following.

Images