Server, method, and computer program

Abstract

To provide a server, a method, and a computer program for live streaming in which viewers support live streamers.SOLUTION: In a live streaming system, a server circuit performs a function of receiving instructions to use a gift to a streamer from a user before the streamer's live streaming, and a function of causing an output unit to output effects and points corresponding to the user's use of the gift while the streamer is in the live streaming. This allows viewers to have more options to support the live streamer, and the live streamer may feel surprise and joy when receiving a scheduled gift during the live streaming.SELECTED DRAWING: Figure 17

Description

[Technical Field]

[0001] The present disclosure relates to information and communication technology, and in particular to a server, a method, and a computer program for live streaming. [Background technology]

[0002] Some apps and platforms offer live streaming services that allow live streamers and viewers to interact with each other, with live streamers sometimes performing cheering performances for their viewers, and viewers sometimes sending gifts to support their live streamers.

[0003] If viewers want to support the live streamer, they need to watch the live stream and send gifts to the live streamer, so the live streamer needs to broadcast at an appropriate time so that viewers can support the live streamer.

[0004] However, if viewers are unable to catch the live stream in time, they will miss the opportunity to enjoy the live stream, and the live streamer may not be able to receive support from the viewers. This can lead to a poor user experience. Therefore, it is important to find ways to improve the user experience. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Patent No. 7272570 Summary of the Invention

[0006] One embodiment of the present disclosure relates to a server including a circuit configured to perform the following functions: receive instructions from a user for a streamer to use a gift before the streamer's live streaming; and, while the streamer is in the live streaming, cause an output unit to output effects and points corresponding to the user's use of the gift.

[0007] Another embodiment of the present disclosure relates to a method, the method including receiving instructions from a user for a streamer to use a gift prior to the streamer's live streaming, and causing an output unit to output effects and points corresponding to the user's use of the gift while the streamer is in the live streaming.

[0008] Yet another embodiment of the present disclosure relates to a computer program that causes a server to receive instructions from a user to a streamer to use a gift before the streamer's live streaming, and causes an output unit to output effects and points corresponding to the user's use of the gift while the streamer is in the live streaming.

[0009] These embodiments may provide viewers with more options for supporting the live streamer. Furthermore, the live streamer may be surprised and delighted when receiving a schedule gift during a live stream. Therefore, the user experience may be improved. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a schematic diagram illustrating the configuration of a live streaming system 1 based on some embodiments of the present disclosure. [Figure 2] FIG. 2 is a block diagram of a user terminal 20 according to some embodiments of the present disclosure. [Figure 3] 1 is a block diagram of a server 10 according to some embodiments of the present disclosure. [Figure 4] 4 is a table illustrating an exemplary data structure of the stream DB 320 of FIG. 3. [Figure 5] 4 is a table illustrating an exemplary data structure of the user DB 322 of FIG. 3. [Figure 6] 4 is a table illustrating an exemplary data structure of the schedule DB 324 of FIG. 3. [Figure 7] 4 is a table illustrating an example data structure of the gift DB 326 of FIG. 3. [Figure 8] 4 is a table illustrating an example data structure of the subscription DB 328 of FIG. 3. [Figure 9] 4 is a table illustrating an example data structure for the subscription lookup table 330 of FIG. 3. [Figure 10] 6 is an exemplary screen image of a live streaming room screen 600 displayed on the display of a live streamer's user terminal 20 or a viewer's user terminal 30. [Figure 11] 6 is an exemplary screen image of a live streaming room screen 600 displayed on the display of a live streamer's user terminal 20 or a viewer's user terminal 30. [Figure 12] 6 is an exemplary screen image of a live streaming room screen 600 displayed on the display of a live streamer's user terminal 20 or a viewer's user terminal 30. [Figure 13] 6 is an exemplary screen image of a live streaming room screen 600 displayed on the display of a live streamer's user terminal 20 or a viewer's user terminal 30. [Figure 14] 6 is an exemplary screen image of a live streaming room screen 600 displayed on the display of a live streamer's user terminal 20 or a viewer's user terminal 30. [Figure 15]6 is an exemplary screen image of a live streaming room screen 600 displayed on the display of a live streamer's user terminal 20 or a viewer's user terminal 30. [Figure 16] 10 is a flowchart showing the steps of an application startup process in the user terminals 20 and 30. [Figure 17] 1 illustrates an exemplary functional structure of a live streaming system 1 according to some embodiments of the present disclosure. [Figure 18] 1 illustrates an exemplary hardware configuration of an information processing device based on some embodiments of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, the same or similar components, parts, steps, or signals shown in each drawing will be denoted by the same reference numerals in all drawings, and redundant explanations will be omitted as appropriate. In addition, some parts that are not important in the explanation of each drawing will be omitted.

[0012] A live streaming system 1 according to some embodiments of the present disclosure provides enhanced functionality to facilitate communication and interaction between users, and more specifically, to entertain viewers and live streamers in technological ways.

[0013] FIG. 1 is a schematic diagram illustrating the configuration of a live streaming system 1 according to some embodiments of the present disclosure. The live streaming system 1 provides a live streaming service for live streamers (LV) and viewers (AUs) (AU1, AU2, ...) to interact with each other in real time. As shown in FIG. 1, the live streaming system 1 may include a server 10, a user terminal 20, and user terminals 30 (30a, 30b, ...). The user terminal 20 may be a live streamer, and the user terminal 30 may be a viewer. In some embodiments, the live streamer and the viewer may be referred to as users. The server 10 may include one or more information processing devices connected via a network NW. The user terminals 20 and 30 may be, for example, mobile devices such as smartphones, tablets, laptops, recorders, portable game consoles, and wearable devices, or stationary computers such as desktop PCs. The server 10, the user terminal 20, and the user terminal 30 may be communicably connected by any type of wired or wireless network NW.

[0014] The live streaming system 1 involves the live streamer LV, the viewer AU, and an app provider (not shown) that provides the server 10. The live streamer LV can record content such as his / her own singing, talking, performance, game streaming, etc. on his / her user terminal 20 and upload it to the server 10, thereby distributing the content in real time. In some embodiments, the live streamer LV can interact with the viewer AU through the live streaming.

[0015] The app provider may provide a platform for live-streamed content on the server 10. In some embodiments, the app provider may be a mediator or manager that manages real-time communication between the live streamer LV and the viewer AU. The viewer AU can access the platform using the user terminal 30 and select and view the content they want to watch. The viewer AU can use the user terminal 30 to perform operations to interact with the live streamer, such as leaving comments or cheering for the live streamer. The live streamer providing the content can respond to the comments or cheering. The live streamer's response can be transmitted to the viewer AU via video and / or audio. Thus, mutual communication between the live streamer and the viewer can be achieved.

[0016] As used herein, "live streaming" may refer to data transmission that allows the viewer AU to substantially play or view content recorded by the live streamer LV via the user terminal 20 via the user terminal 30. In some embodiments, "live streaming" may also refer to streaming achieved by the above-described data transmission. Live streaming may be achieved using known technologies, such as HTTP live streaming, CMAF (Common Media Application Format), WebRTC (Web Real-Time Communications), RTMP (Real-Time Messaging Protocol), and MPEG DASH. Live streaming may also include an embodiment in which the viewer AU can play or view content with a certain delay while the live streamer is recording the content. It is desirable that the delay be small enough to at least allow communication between the live streamer LV and the viewer AU. However, live streaming differs from so-called on-demand delivery. More specifically, on-demand delivery may refer to storing all recorded data of the content on a server and providing the data to the user from the server at random times in response to user requests.

[0017] As used herein, "streaming data" may refer to data including image data and audio data. More specifically, the image data (which may be referred to as video data) may be generated by an image capture function of the user terminals 20 and 30. The audio data (which may be referred to as audio data) may be generated by an audio input function of the user terminals 20 and 30. The streaming data may be played on the user terminals 20 and 30 to enable viewing of content related to the user. In some embodiments, processing such as compression, expansion, encoding, decoding, and transcoding to change the format, size, or standard of the data may be performed between the time the streaming data is generated on the user terminal of the live streamer and the time it is played on the user terminal of the viewer. The content (video and audio) remains substantially unchanged before and after such processing. Therefore, in the current embodiment of the present disclosure, the streaming data before and after processing are described as being the same. In other words, when the streaming data generated by the user terminal of the live streamer is played on the user terminal of the viewer via the server 10, the streaming data generated by the user terminal of the live streamer, the streaming data that has passed through the server 10, and the streaming data that is received and played by the user terminal of the viewer are all the same streaming data.

[0018] As shown in Figure 1, the live streamer LV provides live streaming. The user terminal 20 of the live streamer generates streaming data by recording the video and / or audio of the streamer and transmits it to the server 10 via the network NW. At the same time, the user terminal 20 displays the video VD on its display, allowing users to check the streaming content of the live streamer LV.

[0019] Viewers AU1 and AU2 of user terminals 30a and 30b that request the platform to provide live streaming from the live streamer receive streaming data corresponding to the live streaming via the network NW, play the received streaming data to display videos VD1 and VD2 on a display, and output audio from speakers, etc. The videos VD1 and VD2 displayed on the user terminals 30a and 30b, respectively, are substantially the same as the videos recorded by the user terminals of the live streamer LV, and the audio output from the user terminals 30a and 30b is substantially the same as the audio recorded by the user terminals of the live streamer LV.

[0020] Recording of the live streamer on the user terminal 20 may be simultaneous with playback of the streaming data on the user terminals 30a and 30b of the viewers AU1 and AU2. When the viewer AU1 inputs a comment about the content of the live streamer LV on the user terminal 30a, the server 10 displays the comment in real time on the user terminal 20 of the live streamer and also on the user terminals 30a and 30b of the viewers AU1 and AU2. If the live streamer LV responds to the comment, the response is output as text, image, video, or audio from the user terminals 30a and 30b of the viewers AU1 and AU2, enabling communication between the live streamer LV and the viewers AU1 and AU2. Therefore, the live streaming system enables two-way live streaming.

[0021] 2 is a block diagram showing the functions and configuration of the user terminal 20 shown in FIG. 1 according to an embodiment of the present disclosure. The user terminal 30 has the same functions and configuration as the user terminal 20. The blocks depicted in the block diagrams in this specification are implemented by hardware, such as devices and mechanical components, such as a computer CPU, and software, such as a computer program, that represents functional blocks implemented by the cooperation of these elements. Therefore, it will be understood by those skilled in the art that the functional blocks can be implemented in various ways using a combination of hardware and software.

[0022] The live streamer LV and the viewer AU can download and install the live streaming application (live streaming app) of the present disclosure to the user terminals 20 and 30 from a download site via the network NW. Alternatively, the live streaming app may be pre-installed on the user terminals 20 and 30. When the user terminals 20 and 30 execute live streaming, the user terminals 20 and 30 communicate with the server 10 via the network NW and can realize multiple functions. The functions realized by the execution of the live streaming app by the user terminals 20 and 30 (more specifically, a processor such as a CPU) are described below as functions of the user terminals 20 and 30. These functions are basically functions that the live streaming app causes the user terminals 20 and 30 to realize. In some embodiments, these functions may be realized by transmitting them from the server 10 to a web browser of the user terminals 20 and 30 via the network NW and executing them as a computer program in the web browser. The computer program may be written in a programming language such as HTML (Hyper Text Markup Language).

[0023] The user terminal 20 includes a streaming unit 100 and a viewing unit 200. In some embodiments, the streaming unit 100 is configured to record a user's audio and / or video data and generate streaming data to transmit to the server 10. The viewing unit 200 is configured to receive and play the streaming data from the server 10. In some embodiments, a user can activate the streaming unit 100 during a broadcast or activate the viewing unit 200 when viewing a stream. In some embodiments, the user terminal that activates the streaming unit 100 can be referred to as a live streamer or the user terminal that generates the streaming data. The user terminal that activates the viewing unit 200 can be referred to as a viewer or the user terminal that plays the streaming data.

[0024] The streaming unit 100 may include a video control unit 102, an audio control unit 104, a distribution unit 106, and a UI control unit 108. The video control unit 102 may be connected to a camera (not shown), and the video is controlled by the camera. The video control unit 102 can acquire the video data from the camera. The audio control unit 104 may be connected to a microphone (not shown), and the audio is controlled by the microphone. The audio control unit 104 can acquire the audio data from the microphone.

[0025] The distribution unit 106 receives streaming data including video data from the video control unit 102 and audio data from the audio control unit 104 and transmits the streaming data to the server 10 over the network NW. In some embodiments, the distribution unit 106 transmits the streaming data in real time, i.e., the generation of the streaming data from the video control unit 102 and the audio control unit 104 and the distribution by the distribution unit 106 are performed simultaneously.

[0026] The UI control unit 108 controls the UI of the live streamer. The UI control unit 108 is connected to a display (not shown) and is configured to generate the streaming data for the distribution unit 106 to transmit, play, and display on the display. The UI control unit 108 is configured to display an object to be operated or an object to be instructed on the display and to receive tap input from the live streamer.

[0027] The viewing unit 200 may include a UI control unit 202, a rendering unit 204, and an input sending unit 206. The viewing unit 200 is configured to receive streaming data from the server 10 via a network NW. The UI control unit 202 controls the UI of the viewer. The UI control unit 202 is connected to a display (not shown) and / or a speaker (not shown) and configured to display video on the display and output audio from the speaker by playing the streaming data. In some embodiments, outputting video on the display and outputting audio from the speaker may be referred to as "playing streaming data." The UI control unit 202 is connected to an input unit such as a touch panel, a keyboard, or a display, and can obtain input from a user.

[0028] The rendering unit 204 may be configured to render streaming data from the server 10 and frame images. The frame images may include user interface objects for accepting input from a user, comments entered by a viewer, and data received from the server 10. The input sending unit 206 is configured to receive the user input from the UI control unit 202 and send it to the server 10 via the network NW.

[0029] In some embodiments, the user input may be clicking an object on the screen of the user terminal, such as selecting a live stream, entering a comment, sending a gift, following or unfollowing a user, voting in an event, playing a game, etc. For example, when the user terminal of a viewer clicks a gift object on the screen to send a gift to the live streamer, the input sending unit 206 may generate gift information and send it to the server 10 via the Internet NW.

[0030] In some embodiments, the user terminal 20 may include a terminal-side gift DB (not shown). The terminal-side gift DB is configured to store the gift information of the user terminal 20 or 30. The terminal-side gift DB may include a gift ID, an icon ID, an effect data ID, and a last update date. The gift ID may identify the gift. The icon ID may be icon data of the gift object. The effect data ID may identify data that realizes an effect corresponding to the gift. The last update date may identify the date the gift was last updated.

[0031] In some embodiments, the viewer may download the gift in advance or download the gift when sending the gift. In some embodiments, gift information may be downloaded in advance and stored in the terminal-side gift DB. In some embodiments, the terminal-side gift DB may include a gift list corresponding to the gift list provided by the server 10. In some embodiments, the gift list in the terminal-side gift DB may be synchronized with the server 10 periodically or upon user input.

[0032] 3 is a block diagram of the server 10 according to some embodiments of the present disclosure. The server 10 may include a streaming information unit 302, a relay unit 304, a processing unit 306, a clip unit 308, a stream DB 320, a user DB 322, a schedule DB 324, a gift DB 326, a subscription DB 328, and a subscription lookup table 330.

[0033] The streaming information unit 302 receives a request for live streaming from the user terminal 20 of the live streamer via the network NW. Upon receiving the request, the streaming information unit 302 registers information about the live streaming in the stream DB 320. In some embodiments, the information about the live streaming may be a stream ID of the live streaming and / or a live streamer ID of the live streamer corresponding to the live streaming.

[0034] When a request for providing information about the live streaming is received from the viewer via the network NW from the viewing unit 200 of the user terminal 30, the streaming information unit 302 refers to the stream DB 320 and generates a list of available live streaming.

[0035] The streaming information unit 302 then transmits the list to the user terminal 30 via the network NW. The UI control unit 202 of the user terminal 30 generates a live streaming selection screen based on the list and displays the list on the display of the user terminal 30.

[0036] When the input sending unit 206 of the user terminal 30 receives the selection of live streaming by the viewer on the live streaming selection screen, it generates a delivery request including the stream ID of the selected live streaming and sends it to the server 10 via the network. The streaming information unit 302 can start providing the live streaming specified by the stream ID in the delivery request to the user terminal 30. The streaming information unit 302 can update the stream DB 320 and add the viewer ID of the viewer of the user terminal 30 to the live streamer ID of the stream ID.

[0037] The relay unit 304 can relay the transmission of the live streaming from the user terminal 20 of the live streamer to the user terminal 30 of the viewer in the live streaming started by the streaming information unit 302. The relay unit 304 can receive a signal indicating a user input from the viewer from the input transmission unit 206 during playback of the streaming data. The signal indicating the user input may be an object designation signal indicating designation of an object to be displayed on the display of the user terminal 30. The object designation signal may include the viewer ID of the viewer, the live streamer ID of the live streamer transmitting the live streaming being watched by the viewer, and an object ID designated by the object. If the object is a gift, the object ID may be a gift ID, etc. Similarly, the relay unit 304 can receive a signal indicating a user input from the live streamer, such as the object designation signal, from the streaming unit 100 of the user terminal 20 during playback of the streaming data.

[0038] In some embodiments, the server 10 may further include a gift information unit (not shown) and a gift processing unit (not shown). The gift information unit provides gift information to corresponding streamers and viewers. The gift information unit transmits gift information for the user terminal to the streamer in response to a request from the user terminal. The gift information unit obtains effect data corresponding to the gift ID included in the gift information signal received by the relay unit 304 from the gift DB 324. The gift information unit transmits the obtained effect data to other user terminals 20, 30 in response to a gift transmission request signal.

[0039] The gift processing unit updates the user DB 322 to update the points of the streamer and the viewer according to the points of the gift identified by the gift ID included in the gift use signal. Specifically, the gift processing unit references the gift DB 324 to identify the points to be awarded for the gift ID included in the received gift use signal. The gift processing unit then updates the user DB 322 to add the determined points to the points of the streamer ID included in the gift use signal. In some embodiments, the gift processing unit may update the user DB 322 to subtract the determined points from the points of the viewer ID included in the gift use signal.

[0040] The clip unit 308 may be configured to process the clip content. In some embodiments, the clip unit 308 may obtain streaming data and interaction data for rendering and recording, where the interaction data may be any possible interaction information in the live streaming room, such as messages, comments, gifts, follows, games, VIP online notifications, entrance animations, etc.

[0041] In some embodiments, the clip unit 308 may store the clip content in a storage and a database. In some embodiments, the clip unit 308 may generate a link to the clip content. In some embodiments, the clip content may be stored permanently or deleted after a specific period of time, such as 7 days, 14 days, etc. In some embodiments, the settings of the clip content may be flexibly determined according to actual needs.

[0042] Figure 4 is a table showing an example data structure of the stream DB 320 in Figure 3. The stream DB 320 holds information about currently running live streams. The stream DB 320 stores a stream ID for identifying a live stream on a live streaming platform provided by the live streaming system 1, a live streamer ID for identifying a live streamer providing the live stream, and a viewer ID for identifying a viewer of the live stream, in association with one another.

[0043] FIG. 5 is a table illustrating an exemplary data structure of the user DB 322 of FIG. 3. The user DB 322 holds information about users. The user DB 322 stores a user ID for identifying a user, points for specifying points accumulated by the user, a level for identifying the user's level, and a status for identifying the user's status, all of which are associated with one another. The points are electronic value circulated within the live streaming platform. The level may be an indicator of the amount of activity or engagement of the user on the live streaming platform. The status may be the user's identity or membership status on the live streaming platform.

[0044] Fig. 6 is a table showing an example data structure of the schedule DB 324 of Fig. 3. The schedule DB 324 holds information about distribution schedules. The schedule DB 324 stores, in mutually associated fashion, a schedule ID that identifies a distribution schedule, a live streamer ID that identifies the live streamer who generates or starts the distribution, time information that identifies time information related to the distribution schedule, and schedule gift information that identifies information about the schedule gift corresponding to the distribution schedule.

[0045] In some embodiments, the schedule may be generated by the live streamer, viewers, the server 10, etc. For example, the live streamer may generate a broadcast schedule by themselves or with the assistance of other users, etc. The server 10 may also generate a broadcast schedule based on events held on the live streaming platform. In some embodiments, the schedule gift information may include, for example, the schedule gift ID, the sender, the number of gifts, etc. In some embodiments, the schedule gift may be a specific type of gift or any possible general gift. In some embodiments, the schedule gift information may be the type of subscription for the live streamer, as described below.

[0046] 7 shows a table illustrating an example data structure of the gift DB 324 in FIG. 3. The gift DB 324 stores information about gifts that viewers can use during live streaming. The gift DB 324 stores a gift ID for identifying a gift, a point amount that a viewer can spend to send a gift to a streamer, an event ID for identifying an event that the gift corresponds to, and gift effect data, all of which are associated with one another.

[0047] While watching the live stream, viewers can give gifts to streamers by paying points of an equivalent value for the desired gift. Payment of such points of an equivalent value can be made by any suitable electronic means. For example, viewers can pay points of an equivalent value to the administrator. Alternatively, payment by bank transfer or credit card may be used. The administrator can arbitrarily set the relationship between the awarded points and points of an equivalent value.

[0048] A gift is electronic data that has the following characteristics: - They can be purchased in exchange for points (more on this later) or given as free gifts. - Viewers can give gifts to streamers. - Giving gifts to streamers is called using a gift, throwing a gift, etc. - Some gifts can be used immediately upon purchase, while others can be used at any time after purchase or gifting by the purchaser or recipient. - When a viewer gives a gift to a streamer, the streamer will receive the corresponding number of points and will receive an effect related to the gift, such as an effect displayed on the live stream screen.

[0049] The effect may be a visual effect, an auditory effect, a tactile effect (e.g., vibration), or a combination thereof that characterizes the gift. Examples of visual effects include animation, images, and flashing. Examples of auditory effects include sound effects and voice. The effect data is data for realizing such effects on the user terminal 20, and the user terminal 20 realizes such effects by processing the effect data. Note that the technology for realizing effect data is itself well known, and therefore a detailed description thereof will be omitted below.

[0050] Figure 8 is a table showing an example data structure of the subscription DB 328 of Figure 3. The subscription DB 328 holds information about subscriptions to the schedule gift. The subscription DB 328 stores, in correlation with one another, a subscription ID that identifies the subscription of the schedule gift to the live streamer, a live streamer ID that identifies the live streamer that receives the schedule gift, a sender that identifies the user that sends the schedule gift, a subscription type that identifies the type of subscription, and subscription information that identifies information about the subscription.

[0051] In some embodiments, a lookup table such as the subscription lookup table 330 shown in FIG. 9 may be provided. The subscription may include subscription settings for the schedule gift for the live stream of the live streamer. The subscription may include default settings for the schedule gift. In some embodiments, the settings may include, for example, time, number of times, duration, timing, etc. For example, the subscription may be for 20 times the next available broadcast. Alternatively, the subscription may be for one week of available broadcast, etc. In some embodiments, the subscription may be designed or determined according to actual needs.

[0052] In some embodiments, the timing for reflecting the schedule gift in the live streaming room may also be flexibly determined. For example, the timing may be the beginning of the live streaming, the point at which effective distribution is achieved, the end of the live streaming, or randomly during the live streaming. In some embodiments, the subscription may be customized by the user. For example, the user may input their subscription through any input unit, such as typing, speaking, or uploading. The conversion of the input into a customized subscription may be achieved using machine learning techniques such as LLM and ChatGPT.

[0053] 9 is a table illustrating an example data structure of the subscription lookup table 330 of FIG. 3. The subscription lookup table 330 may be configured to store subscriptions for the scheduled gift available to the live streamer. As illustrated in FIG. 9, the subscription lookup table 330 may include a description of the subscription. The description may be a default setting for the subscription determined by an app provider or a customized setting for the subscription determined by the user.

[0054] 10 to 15 are exemplary screen images of a live streaming room screen 600 displayed on the display of the live streamer's user terminal 20 or the viewer's user terminal 30. FIG. 10 shows an exemplary profile page of the live streamer. As shown in FIG. 10, the profile page may include information about the live streamer, such as their name, a display image, follower information, and posts.

[0055] In some embodiments, the live streamer may create a broadcast schedule on the profile page. For example, the live streamer may set the next broadcast schedule on the profile page. Once the broadcast schedule is created, viewers may view information about the broadcast schedule. The viewers may view the broadcast schedule through push notifications from the live streamer's posts or by checking the live streamer's profile page. As shown in the example of FIG. 10, a calendar object 652 may be provided for the live streamer to create the broadcast schedule or for the viewer to access the broadcast schedule.

[0056] The viewer may check the live streamer's next scheduled broadcast on the calendar. If the viewer cannot attend the live streamer's next live stream, the viewer may send a schedule gift to the live streamer in advance. As shown in FIGS. 10 and 11, a gift object 654 may be displayed on the broadcast schedule. The viewer may click the gift object 654 to send the schedule gift to the live streamer.

[0057] When the gift object 654 is clicked, a gift list 656 is displayed to the viewer, allowing the viewer to select and send the scheduled gift. In some embodiments, the gift object 654 and gift list 656 may be the same as or different from those in the live streaming room, and may be flexibly determined. In some embodiments, the gift items in the gift list 656 may also be the same as those in the live streaming room, or some special scheduled gift may be provided in the gift list 656.

[0058] In some embodiments, the viewer may click on the gift item in the gift list 656 to send a schedule gift to the live streamer. The server 10 receives information about the schedule gift and stores it in a corresponding database, such as the schedule DB 324. In some embodiments, any possible gift may be sent to the live streamer in advance. For example, an event gift, a customized gift, a regular gift, a lucky bag gift, etc. may be sent.

[0059] Here, the lucky bag gift may be a gift that distributes points to the live streamer and viewers in the live streaming room. The viewers and live streamer may receive a specific number of points by clicking the lucky bag effect. The number of points may be distributed randomly or based on the timing of clicking the effect. For example, the first person to click the effect may receive half of the points, and the next nine people may share the remaining points. In some embodiments, the mechanism of the lucky bag gift may be flexibly determined.

[0060] In some embodiments, the lucky bag gift may include a mechanism for attracting viewers to a target live streaming room to increase the number of viewers in the live streaming room. For example, a marquee saying "Lucky Bag Available in Live Streaming Room" may be displayed, and viewers may click on the marquee to access the live streaming room. In some embodiments, if the viewer sends the lucky bag gift to the live streamer in advance, the lucky bag gift may be reflected in the live streamer's next broadcast. According to these embodiments, a certain number of viewers can be directed to the live streaming room at the beginning of a broadcast, quickly increasing the popularity of the live streaming room.

[0061] 12, when the live streamer starts broadcasting or when the viewer enters the live streaming room, a live streaming room screen 600 of the live streamer may be displayed on the display. The live streaming room screen 600 may include a live streamer information object 602, a live streamer image 604, a message zone 606, a message input box 608, a gift object 610, a sharing object 612, etc.

[0062] In some embodiments, when the live streamer starts broadcasting, the schedule gift may be reflected in the live streaming room. In some embodiments, the popularity of the live streaming room may be calculated based on interactions within the live streaming room. In some embodiments, the interactions may include the schedule gift, etc. According to these embodiments, support from the viewer can be received during the broadcast even if the viewer cannot join the live streaming room.

[0063] In some embodiments, the popularity may be displayed on a thumbnail of the live streaming. As shown in Fig. 13, the user may request the server 10 to provide information about live streaming, and the server 10 may generate a list of available live streaming. Upon receiving the list, the UI control unit 202 of the user terminal 30 may generate a live streaming selection screen 622 based on the list and display it on the display of the user terminal 30. In some embodiments, the live streaming selection screen 622 may include a thumbnail TN of each live streaming for the user to select.

[0064] In some embodiments, the thumbnail TN of the live stream may include a popularity mark 624 indicating the popularity of the live stream. In some embodiments, the order of the live stream thumbnails on the live streaming page may be determined based on the popularity of the live streaming room. As shown in FIG. 13 , if the live streamer receives many schedule gifts at the beginning of a stream, the live streaming room may be promoted to a higher or more prominent location within the live streaming page 622. According to these embodiments, the live streamer may have the opportunity to be exposed to more different viewers, and the live streamer may not feel lonely or ignored at the beginning of a stream.

[0065] In some embodiments, the schedule gift may be a subscription for a specific period or periodic period for the live streamer. In addition to the distribution schedule, a subscription object 658 for the schedule gift, which the viewer can use to subscribe to receive the schedule gift from the live streamer, may also be displayed on the profile page PR, as shown in FIG. 14. In some embodiments, the subscription object 658 for the schedule gift may be displayed on a distribution settings page or the like, or may be flexibly determined.

[0066] When the subscription object 658 of the schedule gift is clicked, a list of the subscriptions may be displayed on the screen 600. More specifically, the server 10 may obtain available subscriptions, for example, from the subscription DB 300, and transmit them to the viewer's user terminal for display. The viewer may select a subscription they like and send a schedule gift to the live streamer. These embodiments may provide the viewer with more options for supporting the live streamer, potentially improving the user experience.

[0067] In some embodiments, the subscription may be customized by the viewer. For example, the viewer may determine the live streamer, the type of gift, the number of times, the duration, etc. FIG. 15 shows an example of a customized subscription. As shown in FIG. 15, an input field may be provided for the viewer to input the customized subscription. In some embodiments, the input may be fed into a machine learning model or the like to generate the subscription. In some embodiments, any possible means may be flexibly provided, such as a form, a microphone, an upload button, etc.

[0068] FIG. 16 is a flowchart showing the steps of an application launch process on the user terminal 20, 30. As shown in FIG. 16, the viewer sends a schedule gift to the live streamer (S502). In some embodiments, the schedule gift may be sent via, for example, the live streamer's broadcast schedule, the live streamer's personal profile, etc. In some embodiments, the schedule gift may be provided by the server 10 or customized by the viewer.

[0069] The server 10 processes the schedule gift based on the request from the viewer (S504). In some embodiments, the server 10 may refer to the schedule DB, gift DB, subscription lookup table 330, etc. For example, the server 10 may refer to the schedule DB 324 and gift DB 326 to send the schedule gift, and if the schedule gift is a subscription to the live streamer, may further refer to the schedule gift lookup table 330.

[0070] In some embodiments, if the live streamer has not yet started streaming ("No" in S506), the schedule gift and / or points may be reserved within the server 10 until a stream is streamed by the live streamer. In some embodiments, the live streamer may delete the streaming schedule, in which case the server 10 may cancel the schedule gift or move the schedule gift to the next streaming schedule, etc. In some embodiments, if the streaming schedule is deleted, the viewer may also cancel the schedule gift.

[0071] When the live streamer broadcasts ("Yes" in S506), the server 10 may reflect the schedule gift in the live streaming room of the live streamer based on the setting of the schedule gift (S508). For example, the server 10 may send the schedule gift in the live streaming room when the live streamer starts broadcasting. According to these embodiments, the popularity of the live streaming room may be quickly boosted at the start of the live streaming room, and more viewers may be attracted to enter the live streaming room and interact with the live streamer.

[0072] In some embodiments, the schedule gift may be reflected in the livestreaming room once the livestreamer achieves a valid broadcast. For example, the livestreamer may receive the schedule gift if the broadcast length exceeds a certain period (e.g., 30 minutes). These embodiments may motivate the livestreamer to maintain a broadcast for a longer period of time, which may improve interaction between the livestreamer and the viewers.

[0073] 17 is a schematic diagram illustrating an example functional configuration of a live streaming system 1 according to some embodiments of the present disclosure. In some embodiments, the viewer may select the timing to send the gift. In some embodiments, the timing may be at a certain point during the live stream from the live streamer or may be flexibly determined by the viewer. For example, the timing may be at a certain point in the beginning, middle, or end of the event. In some embodiments, the timing may be at a random point during the stream, which may surprise and uplift the live streamer.

[0074] In some embodiments, once the gift and the timing for sending the gift are determined, points for the gift may be reserved within server 10. In some embodiments, there may be a corresponding database for recording or storing the points. In some embodiments, the points and related information such as gift information may also be stored or recorded as needed.

[0075] In some embodiments, once the gift is sent and the timing of the gift is determined, relevant information may be synchronized with a gift timing unit and a gift sending unit, which may be the processing unit 306, a gift information unit, a gift processing unit, etc. in the server 10.

[0076] When the live streamer starts the live streaming, the status in the live streaming room may be synchronized with the gift timing execution unit. If a timing is triggered, the gift timing execution unit may synchronize the information with the gift sending unit. After obtaining the reserved points, the gift sending unit may send the gift item and the points to the live streamer. That is, the gift sending unit may consume the reserved points in the corresponding database to send the gift and the points to the live streamer.

[0077] In some embodiments, when the gift is sent to the live streamer at the time of the gift, an effect corresponding to the gift may be displayed on the screen 600 of the live streaming room. The live streamer may express gratitude when noticing the gift animation. However, if the sender is not in the live streaming room during that time, the live streamer's gratitude may not be conveyed to the viewer.

[0078] In some embodiments, if a timing is triggered, the gift timing execution unit may synchronize the information with the best moment clip unit, which may be the clip unit 308 in the server 10, etc. In some embodiments, when the gift timing is triggered, the best moment clip unit may also be triggered and activated. For example, in response to the timing to send the schedule gift being triggered, the moment when the live streamer receives the schedule gift may be recorded and clipped.

[0079] In some embodiments, the Best Moment clip may be triggered automatically, manually, etc. In some embodiments, the Best Moment highlight may be saved by the live streamer or shared with the sender of the scheduled gift. In these embodiments, the viewer may receive gratitude from the live streamer even if the viewer was not present in the live streaming room during the broadcast.

[0080] In some embodiments, if the sender of the scheduled gift is in the live streaming room, a special animation or marquee may appear on the screen to notify the live streamer and other viewers. In some embodiments, if the sender arrives in time and enters the live streaming room before the end of the stream, a special entrance animation may be displayed to welcome the sender the moment the viewer enters the live streaming room. These embodiments allow the live streamer to notice the sender and personally thank the viewer.

[0081] In some embodiments, the gift may include different types of gifts that the viewer can select and send. In some embodiments, random gifts may be provided. Here, a random gift may refer to a gift that has the potential to generate a random number of points compared to the original number of points of the random gift. For example, a random gift of 1,000 points may have the potential to generate 100, 500, 1,000, 5,000, 10,000, etc., depending on a random algorithm. These embodiments may enhance the enjoyment of sending gifts to the live streamer.

[0082] In some embodiments, the gift may be displayed and interactable on the livestreamer's screen 600. For example, the gift may be displayed as a scratch card that the livestreamer can scratch to open the gift. In some embodiments, the gift may be a series of gifts from which the livestreamer can choose. For example, two or more boxes may be displayed on the livestreamer's screen 600 from which the livestreamer can choose one. In some embodiments, the gift may be a game that the livestreamer can play. For example, the gift may be a simple game such as whack-a-mole or NS-SHAFT.

[0083] In some embodiments, a schedule gift effect may be displayed for each schedule gift. In some embodiments, the effect may be integrated into one or more effects displayed on the screen 600. For example, if the live streamer receives three schedule gifts, the three schedule gift effects may be displayed in sequence, or a single effect indicating the receipt of the schedule gifts may be displayed. These embodiments may prevent the screen from being overwhelmed with effects, potentially improving the user experience.

[0084] In some embodiments, the entry animation when the sender enters the live streaming room may be displayed every time the sender enters the live streaming room, or once, for example, the first time the sender enters the live streaming. These embodiments may improve the user experience by not cluttering the screen with entry animations.

[0085] In some embodiments, the entry animation may be triggered when the sender of the schedule gift enters the live streaming room. In some embodiments, the entry animation may be triggered by a person who sends the schedule gift exceeding a certain amount or number. In some embodiments, the trigger of the entry animation may be flexibly determined according to actual needs.

[0086] In some embodiments, if the sender joins the live streaming room after sending the schedule gift, the sender or the live streamer may receive an additional reward. The sender may send the schedule gift to the live streamer if they are unable to make the scheduled broadcast. However, if the sender is able to join the live streaming, the sender or the live streamer may receive an additional reward. For example, the value of some or all of the schedule gift may be increased by 1.2 times. These embodiments may motivate the viewer to send the schedule gift to the live streamer and support the live streaming, and may also improve the user experience.

[0087] In some embodiments, if the scheduled broadcast is canceled or changed by the live streamer, the schedule gift may be returned to the viewer. In some embodiments, when the live streamer changes or cancels the scheduled broadcast, a message may be displayed notifying the live streamer, stating, "You have received a schedule gift. Are you sure you want to cancel your scheduled broadcast?"

[0088] In some embodiments, instead of returning the schedule gift to the viewer, the schedule gift may be kept in the server 10, and the viewer may then be notified whether to return the schedule gift or move it to the next scheduled broadcast. In some embodiments, an in-app message or a push notification may be sent to the sender to notify the sender of the change in the broadcast schedule. In some embodiments, the server 10 may randomly or flexibly determine how to handle the schedule gift for the viewer. In some embodiments, the mechanism of the schedule gift may be flexibly determined according to actual needs.

[0089] In some embodiments, the schedule gift information may be displayed in the broadcast schedule, personal profile, etc. In some embodiments, the schedule gift information may be hidden or made invisible to the live streamer and other viewers, i.e., only the sender can see the schedule gift information. These embodiments may surprise and delight the live streamer when they receive the schedule gift within the live stream, and may also improve the user experience.

[0090] In some embodiments, the broadcast schedule may be flexibly determined by the live streamer. For example, the live streamer may set a description of the live stream, the number of points required to participate in the live stream, etc. The live streamer may also add a guest list to the broadcast schedule. For example, if the live streamer broadcasts with another live streamer or a group broadcast with other viewers, information about the live streamer and the viewers may also be included in the guest list.

[0091] In some embodiments, a product listing may be added to the scheduled stream. For example, the live streamer may add a product to the scheduled stream, which may be featured and sold within the live stream. In some embodiments, the live streamer may upload a file, such as a video, to promote the scheduled stream. In some embodiments, the promotional materials generated by an AI or machine learning model may be provided automatically or manually to promote the scheduled stream. In some embodiments, the live streamer may add another scheduled stream to the current stream. Two or more scheduled streams may be from the same or different live streamers. For example, the live streamer may add another scheduled stream from another live streamer with whom they stream.

[0092] In some embodiments, the viewer may send a schedule gift to the live streamer in advance via the broadcast schedule. In some embodiments, the viewer may subscribe to the broadcast schedule and indicate whether or not they will attend the live stream. In some embodiments, the viewer may share, bookmark, or favorite the broadcast schedule. In some embodiments, the viewer may comment on the broadcast schedule. For example, the viewer may ask a question, support the live streamer, or add information to the broadcast schedule.

[0093] 18 is a schematic block diagram of a system configuration and computer hardware for executing processing according to some embodiments of the present disclosure. The information processing device 900 in FIG. 18 is configured to realize, for example, the server 10 and the user terminals 20 and 30 according to some embodiments of the present disclosure.

[0094] The information processing device 900 includes a CPU 901, a read-only memory (ROM) 903, and a random access memory (RAM) 905. The information processing device 900 may further include a host bus 907, a bridge 909, an external bus 911, an interface 913, an input unit 915, an output unit 917, a storage unit 919, a drive 921, a connection port 925, and a communication unit 929. The information processing device 900 may also include an imaging device (not shown), such as a camera. The CPU 901 is an example of a hardware configuration for implementing functions realized by the components described herein. The functions described herein may be implemented by a circuit programmed to implement the described functions. The circuit programmed to implement the functions described herein may include a CPU (Central Processing Unit), a DSP (Digital Signal Processor), a general-purpose processor, an application-specific processor, an integrated circuit, an ASIC (Application Specific Integrated Circuit), and / or a combination thereof. In this specification, a unit that realizes a specific function may be realized as a circuit programmed to realize the function, including, but not limited to, the streaming unit 100, the video control unit 102, the audio control unit 104, the delivery unit 106, the UI control unit 108, the viewing unit 200, the UI control unit 202, the rendering unit 204, the input sending unit 206, the streaming information unit 302, the relay unit 304, the processing unit 306, the clip unit 308, the stream DB 320, the user DB 322, the schedule DB 324, the gift DB 326, the subscription DB 328, and the subscription lookup table 330.

[0095] The CPU 901 functions as an arithmetic processing unit and control device, controlling the overall operation of the information processing device 900 or a portion of the operation thereof in accordance with various programs stored in the ROM 903, RAM 905, storage unit 919, or removable recording medium 923. For example, the CPU 901 controls the overall operation of each functional unit included in the server 10 and the user terminals 20 and 30 of the above-described embodiments. The ROM 903 stores programs and operating parameters used by the CPU 901. The RAM 905 transiently stores programs used by the CPU 901 when executing the programs and parameters that change as appropriate when the programs are executed. The CPU 901, the ROM 903, and the RAM 905 are connected to one another via a host bus 907, which is an internal bus such as a CPU bus. The host bus 907 is connected to an external bus 911, such as a Peripheral Component Interconnect / Interface (PCI) bus, via the bridge 909.

[0096] The input unit 915 is a device operated by a user, such as a mouse, keyboard, touch panel, button, switch, or lever. The input unit 915 may be a device that converts a physical quantity into an electrical signal, such as an audio sensor (such as a microphone), an acceleration sensor, a tilt sensor, an infrared sensor, a depth sensor, a temperature sensor, or a humidity sensor. The input unit 915 may be, for example, a remote control device that uses infrared or another type of radio wave. Alternatively, the input unit 915 may be an external connection terminal 927, such as a mobile phone, that supports the operation of the information processing device 900. The input unit 915 includes an input control circuit that generates an input signal based on information input by a user and outputs the generated input signal to the CPU 901. The user operates the input unit 915 to input various data and instruct the information processing device 900 to perform processing operations.

[0097] The output unit 917 includes a device that can visually or audibly notify the user of the acquired information. The output unit 917 may be, for example, a display device such as an LCD, PDP, or OLED, an audio output device such as a speaker or headphones, a printer, etc. The output unit 917 outputs the results obtained by the processing performed by the information processing device 900 in the form of text, video such as an image, or sound such as voice.

[0098] The storage unit 919 is a data storage device and is an example of a storage unit of the information processing device 900. The storage unit 919 includes, for example, a magnetic storage device such as a hard disk drive (HDD), a semiconductor storage device, an optical storage device, a magneto-optical storage device, etc. The storage unit 919 stores programs and various data executed by the CPU 901, as well as various data acquired from the outside.

[0099] The drive 921 is a reader / writer of a removable recording medium 923 such as a magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, and is built into or externally attached to the information processing device 900. The drive 921 reads information recorded on the attached removable recording medium 923 and outputs the information to the RAM 905. The drive 921 writes information to the attached removable recording medium 923.

[0100] The connection port 925 is a port used to directly connect a device to the information processing device 900. The connection port 925 may be, for example, a USB (Universal Serial Bus) port, an IEEE 1394 port, or a SCSI (Small Computer System Interface) port. The connection port 925 may also be an RS-232C port, an optical audio terminal, an HDMI (High-Definition Multimedia Interface (registered trademark)) port, or the like. Connecting an external connection terminal 927 to the connection port 925 enables the exchange of various data between the information processing device 900 and the external connection terminal 927.

[0101] The communication unit 929 is, for example, a communication interface including a communication device for connecting to a communication network NW, and may be, for example, a communication card for a wired or wireless local area network (LAN), Bluetooth (registered trademark), or Wireless USB (WUSB).

[0102] The communication unit 929 may be, for example, a router for optical communication, a router for ADSL (Asymmetric Digital Subscriber Line), or a modem for various communication purposes. For example, the communication unit 929 uses a predetermined protocol such as TCP / IP to transmit and receive signals over the Internet or with other communication devices. The communication network NW to which the communication unit 929 connects is a network established by a wired or wireless connection. The communication network NW is, for example, the Internet, a home LAN, infrared communication, radio wave communication, or satellite communication.

[0103] The imaging device (not shown) is a device that captures real space and generates a captured image using an imaging element such as a CCD (charge-coupled device) or a CMOS (complementary metal-oxide semiconductor), and various components such as a lens for controlling the formation of a subject image on the imaging element. The imaging device may capture either still images or moving images.

[0104] The live streaming system 1 of the present disclosure has been described above with reference to the embodiments. The above-described embodiments have been described merely for the purpose of explanation. Rather, those skilled in the art will readily appreciate that the above-described components and processes of the embodiments can be combined in various ways and modified in various ways, and these are also within the technical scope of the present disclosure.

[0105] The steps described in this specification, particularly the steps described using flowcharts or flow charts, may include some of the steps constituting the steps, may include steps not explicitly included in the steps constituting the steps, and / or may be rearranged in order. Steps that are the subject of such omission, addition, or rearrangement are also included within the scope of the present disclosure as long as they do not deviate from the gist of the present disclosure.

[0106] In some embodiments, at least a portion of the functions performed by the server 10 may be performed by a device other than the server 10, for example, by the user terminal 20 or 30. In some embodiments, at least a portion of the functions performed by the user terminal 20 or 30 may be performed by a device other than the user terminal 20 or 30, for example, by the server 10. In some embodiments, rendering of frame images may be performed by the user terminal of a viewer, server, live streamer, or the like.

[0107] Furthermore, the system or method described in the above embodiments may be provided in a non-transitory computer-readable storage device such as a solid-state storage device, an optical disk storage device, or a magnetic disk storage device, or in a computer program product, etc. Alternatively, the program may be downloaded from a server via the Internet.

[0108] Although the technical contents and features of the present disclosure have been described above, those skilled in the art can still make many variations and modifications without departing from the teachings and disclosure of the present disclosure. Therefore, the scope of the present disclosure is not limited to the embodiments already disclosed, but is within the scope of the appended claims, including other variations and modifications that do not depart from the present disclosure. [Explanation of symbols]

[0109] 1. Live Streaming System 10 Servers 20 User terminal 100 Streaming Units 102 Video control unit 104 Audio control unit 106 Delivery Unit 108 UI control unit 200 viewing units 202 UI control unit 204 rendering units 206 Input Unit 30, 30a, 30b User terminal 302 Streaming Information Unit 304 Relay unit 306 Processing Unit 308 Clip Unit 320 Stream DB 322 User DB 324 Schedule DB 326 Gift DB 328 Subscription DB 330 Subscription Lookup Table 600 screens 602 objects 604 images 606 Message Zone 608 Message input box 610 Gift Object 612 Shared Objects 622 Live Streaming Page 624 Popularity Mark 654 Gift Objects 656 Gift List 658 Subscription Objects 900 Information Processing Equipment 901 CPU 903 ROM 905 RAM 907 Host Bus 909 Bridge 911 External Bus 913 Interface 915 Input Unit 917 Output Unit 919 Storage Unit 921 Drive 923 Removable Recording Media 925 connection port 927 External connection terminal 929 Communication Unit LS Live Streaming LV Live Streamer NW Network SP Specific part AU1, AU2 viewers S502~S508 Process VD, VD1, VD2 video

Claims

1. 1. A server including circuitry, the circuitry comprising: receiving instructions from a user to the streamer to use the gift before the streamer's live streaming; and causing an output unit to output effects and points corresponding to the user's use of the gift while the streamer is in the live streaming. A server configured to execute the

2. 2. The server of claim 1, wherein the output unit outputs the effect and the point in response to the start of the live streaming from the streamer or at a timing during the live streaming predetermined by the user.

3. The server of claim 1 , wherein the receiving includes receiving instructions to use the gift while the user is viewing the streamer's broadcast schedule or profile page.

4. The server of claim 1 , wherein a popularity of the live streaming is calculated based on the gifts, and an order of the live streaming on a live streaming page is determined based on the popularity.

5. a function to clip the highlights of said effect output; forwarding the highlights to the user automatically or in response to a request from the streamer; The server of claim 1 further comprising:

6. The server of claim 1 , wherein the use of the gift is configured by the user to be sent to the streamer during a specific period or a specific number of times during live streaming.

7. The server of claim 1 , wherein the output unit further outputs an animation corresponding to the user in response to the user participating in the live streaming of the streamer.

8. Further comprising a function of displaying a ranking on a display during the live streaming of the streamer; The server of claim 1 , wherein the ranking is based on the amount or number of gift points used by users for the streamer prior to the live streaming of the streamer.

9. 1. A method comprising: receiving instructions from a user for the streamer to use the gift prior to the streamer's live streaming; causing an output unit to output effects and points corresponding to the user's use of the gift while the streamer is in the live streaming; A method comprising:

10. A computer program, comprising: receiving instructions from a user to the streamer to use the gift before the streamer's live streaming; and causing an output unit to output effects and points corresponding to the user's use of the gift while the streamer is in the live streaming. A computer program characterized by realizing the above.

Images