Terminals, servers, and methods

Abstract

This invention provides terminals, servers, and methods for live streaming that reduce server load and improve user experience. [Solution] In a live streaming system, the broadcaster terminal 20 performs the following steps: receiving operation information from the viewer terminal 30; detecting a trigger event from the operation information; obtaining a first script based on the detection of the trigger event from the operation information; and displaying a trigger action based on the first script. This allows the broadcaster terminal 20 to process and display various gift animations without the need for complicated coding or updates, and furthermore, to apply scripts to diverse scenarios based on different trigger events. Consequently, the load on the server 10 is reduced, and the user experience may be improved.

Description

Technical Field

[0001] The present disclosure relates to information and communication technologies, and particularly to terminals, servers, and methods in live streaming.

Background Art

[0002] Some applications and platforms provide live streaming services that allow live streamers and viewers to interact. A live streamer may perform a performance to cheer for viewers, or a viewer may donate or send a gift to support the live streamer.

[0003] To implement a mechanism for sending gifts, the server processes a decision-making process for animation display. Patent Document 1 provides a technique that enables the use of elaborate gifts in live streaming while reducing the resulting increase in data volume.

[0004] However, the load on the server side is increasing. This may cause the processing of gift animations to slow down, leading to a potential decline in the user experience. Therefore, it is important to reduce the server load and improve the user experience.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

[0006] One embodiment of the present disclosure relates to a terminal including a circuit, which is configured to perform the steps of: receiving operation information from a first user; detecting a trigger event from the operation information; obtaining a first script based on the detection of the trigger event from the operation information; and displaying a trigger action based on the first script.

[0007] Another embodiment of the present disclosure relates to a server including a circuit, which is configured to perform the steps of: receiving first operation information from a first user terminal of a first user; receiving second operation information from a second user terminal of a second user; obtaining a first script from a database based on the first and second operation information; and transmitting the first script to the first and second user terminals.

[0008] Another embodiment of the present disclosure is a method, which includes the steps of: receiving operation information from a first user; detecting a trigger event from the operation information; obtaining a first script based on the detection of the trigger event from the operation information; and displaying a trigger action based on the first script.

[0009] According to this disclosure, various gift animations can be processed and displayed without the need for cumbersome coding or updates. Furthermore, scripts can be applied to diverse scenarios based on different trigger events. Consequently, server load can be reduced and the user experience can be improved. [Brief explanation of the drawing]

[0010] [Figure 1] This is a schematic diagram showing the configuration of a live streaming system 1 based on some embodiments of the present disclosure. [Figure 2]This is a block diagram of a user terminal 20 based on some embodiments of the present disclosure. [Figure 3] This is a block diagram of server 10 based on some embodiments of the present disclosure. [Figure 4] Figure 3 is a table showing an example data structure for the stream DB320. [Figure 5] Figure 3 is a table showing an example data structure for user DB322. [Figure 6] Figure 3 is a table showing an example data structure for the gift DB324. [Figure 7] Figure 2 is a table showing an example data structure for the terminal gift DB212. [Figure 8] This table shows an example data structure for script DB214 or 326 in Figure 2 or Figure 3. [Figure 9] This is a schematic diagram showing an example of the functional configuration of a live streaming system 1 based on some embodiments of the present disclosure. [Figure 10] This is an exemplary screen image of the live streaming room screen 600 displayed on the display of the live streamer's user terminal 20 or the viewer's user terminal 30. [Figure 11] This is an exemplary screen image of the live streaming room screen 600 displayed on the display of the live streamer's user terminal 20 or the viewer's user terminal 30. [Figure 12] This is an exemplary screen image of the live streaming room screen 600 displayed on the display of the live streamer's user terminal 20 or the viewer's user terminal 30. [Figure 13] This is an exemplary screen image of the live streaming room screen 600 displayed on the display of the live streamer's user terminal 20 or the viewer's user terminal 30. [Figure 14] This is an exemplary screen image of the live streaming room screen 600 displayed on the display of the live streamer's user terminal 20 or the viewer's user terminal 30. [Figure 15]An exemplary screen image of a live streaming room screen 600 displayed on a display of the user terminal 20 of a live streamer or the user terminal 30 of a viewer. [Figure 16] An exemplary sequence diagram showing the operation of the configuration of the live streaming system 1 based on some embodiments of the present disclosure. [Figure 17] An exemplary sequence diagram showing the operation of the configuration of the live streaming system 1 based on some embodiments of the present disclosure. [Figure 18] An exemplary hardware configuration of an information processing apparatus based on some embodiments of the present disclosure.

Mode for Carrying Out the Invention

[0011] Hereinafter, the same or similar components, members, procedures, or signals shown in each drawing are all assigned the same reference numerals in all drawings, and redundant descriptions are accordingly omitted as appropriate. Also, some members that are not important in the description of each drawing are omitted.

[0012] The live streaming system 1 based on some embodiments of the present disclosure provides an enhanced function for smoothly communicating and interacting between users. More specifically, it is something that makes viewers and live streamers enjoy themselves in a technical way.

[0013] Figure 1 shows a schematic diagram illustrating the configuration of a live streaming system 1 based on some embodiments of the present disclosure. The live streaming system 1 provides a live streaming service for real-time interaction between live streamers (also called live broadcasters, streamers, or broadcasters) LV and viewers (also called audiences) AU (AU1, AU2...). As shown in Figure 1, the live streaming system 1 may include a server 10, user terminals 20 and 30 (30a, 30b...). The user terminals 20 may be live streamers, and the user terminals 30 may be viewers. In some embodiments, the live streamers and viewers may be referred to as users. The server 10 may include one or more information processing devices connected via a network NW. The user terminals 20 and 30 may be, for example, mobile devices such as smartphones, tablets, laptops, recorders, portable game consoles, and wearable devices, or stationary computers such as desktop PCs. The server 10, user terminal 20, and user terminal 30 may be connected to each other via any type of wired or wireless network NW.

[0014] The live streaming system 1 involves a live streamer (LV), a viewer (AU), and an application provider (not shown) that provides the server 10. The live streamer (LV) can record their own content, such as singing, talking, performing, or game streaming, on their user terminal (20), upload it to the server 10, and distribute the content in real time. In some embodiments, the live streamer (LV) can interact with the viewer (AU) through the live stream.

[0015] The app provider can provide a platform for the content to be live-streamed on the server 10. In some embodiments, the app provider may be a media or manager that manages the real-time communication between the live streamer LV and the viewer AU. The viewer AU can access the platform through the user terminal 30 and select and view the content that the viewer wants to watch. The viewer AU can perform operations for communicating with the live streamer through the user terminal 30, such as commenting on or cheering for the live streamer. The live streamer who provides the content can respond to the comments and cheers. The response of the live streamer can be transmitted to the viewer AU by video and / or audio, etc. Therefore, the mutual communication between the live streamer and the viewer can be achieved.

[0016] As used herein, "live streaming" may refer to data transmission that enables a viewer AU to substantially play and view content recorded by a live streamer LV on a user terminal 20 via a user terminal 30. In some embodiments, "live streaming" may also refer to the distribution achieved by the above-described data transmission. Such live streaming can be implemented using known technologies such as HTTP live streaming, CMAF (Common Media Application Format), WebRTC (Web Real-Time Communications), RTMP (Real-Time Messaging Protocol), and MPEG DASH. Such live streaming may further include embodiments in which the viewer AU can play or view the content with a certain delay while the live streamer is recording the content. The degree of such delay should preferably be small enough to allow the live streamer LV and the viewer AU to communicate. However, live streaming is different from so-called on-demand streaming. More specifically, such on-demand streaming may refer to storing all the data of the recorded content on a server and providing the data to the user from the server at random timings in response to the user's request.

[0017] In this specification, “distribution data” may refer to data including image data and audio data. More specifically, the image data (which may also be called video data) may be generated by the image capture function of the user terminals 20 and 30. The audio data (which may also be called audio data) may be generated by the audio input function of the user terminals 20 and 30. The distribution data may be played back on the user terminals 20 and 30 to allow the user to view content related to the user. In some embodiments, processing such as compression, expansion, encoding, decoding, and transcoding is envisioned to change the format, size, and specifications of the data between the time the distribution data is generated on the live streamer's user terminal and the time it is played back on the viewer's user terminal. Before and after such processing, the content (video and audio) is substantially unchanged, and for this reason, in the current embodiments of this disclosure, the distribution data before processing and the distribution data after processing are described as being the same. In other words, when the streaming data generated by the user terminal of the live streamer is played back on the viewer's user terminal via the server 10, the streaming data generated by the user terminal of the live streamer, the streaming data that has passed through the server 10, and the streaming data received and played back by the viewer's user terminal are all the same streaming data.

[0018] As shown in Figure 1, the live streamer LV provides a live stream. The user terminal 20 of the live streamer generates streaming data by recording the streamer's video and / or audio, and transmits it to the server 10 via the network NW. At the same time, the user terminal 20 can display the video VD on its display and check the streaming content of the live streamer LV.

[0019] Viewers AU1 and AU2 of user terminals 30a and 30b, which request the platform to provide the live stream from the live streamer, receive the distribution data corresponding to the live stream via the network NW, play the received distribution data to display the video VD1 and VD2 on a display, and output audio from speakers or the like. The video VD1 and VD2 displayed on user terminals 30a and 30b are substantially the same as the video recorded by the user terminal of the live streamer LV, and the audio output from user terminals 30a and 30b is substantially the same as the audio recorded by the user terminal of the live streamer LV.

[0020] The recording on the user terminal 20 of the live streamer may occur simultaneously with the playback of the streamed data on the user terminals 30a and 30b of the viewers AU1 and AU2. When viewer AU1 inputs a comment regarding the content of the live streamer LV into its user terminal 30a, the server 10 displays the comment in real time on the live streamer's user terminal 20, and also on the user terminals 30a and 30b of viewers AU1 and AU2, respectively. If the live streamer LV responds to the comment, the response is output as text, image, video, or audio from the user terminals 30a and 30b of viewers AU1 and AU2, thereby enabling communication between the live streamer LV and viewers AU1 and AU2. Thus, the live streaming system can realize two-way live streaming.

[0021] Figure 2 is a block diagram showing the functions and configuration of the user terminal 20 shown in Figure 1, based on an embodiment of the present disclosure. The user terminal 30 has the same functions and configuration as the user terminal 20. The blocks depicted in the block diagrams of this specification are implemented by hardware such as a computer CPU or mechanical parts, and software such as a computer program that represents a functional block performed by the cooperation of these elements. Therefore, it will be understood by those skilled in the art that functional blocks can be implemented in various ways through combinations of hardware and software.

[0022] The live streamer (LV) and viewer (AU) can download and install the live streaming application (live streaming app) described herein from a download site to their user terminals 20 and 30 via the network (NW). Alternatively, the live streaming app may be pre-installed on the user terminals 20 and 30. By performing live streaming on the user terminals 20 and 30, they can communicate with the server 10 via the network (NW) and implement multiple functions. These functions, implemented by the execution of the live streaming app by the user terminals 20 and 30 (more specifically, by the processor such as the CPU), are described below as functions of the user terminals 20 and 30. These functions are basically functions that the live streaming app enables the user terminals 20 and 30 to implement. In some embodiments, these functions may be implemented by sending them from the server 10 to the web browser of the user terminals 20 and 30 via the network (NW) and executing them by a computer program in the web browser. This computer program may be written in a programming language such as HTML (Hyper Text Markup Language).

[0023] The user terminal 20 includes a streaming unit 100 and a viewing unit 200. In some embodiments, the streaming unit 100 is configured to record the user's audio and / or video data and generate distribution data to be sent to the server 10. The viewing unit 200 is configured to receive and play the distribution data from the server 10. In some embodiments, the user can activate the streaming unit 100 when broadcasting or when viewing the distribution. In some embodiments, the user terminal activating the streaming unit 100 may be referred to as the live broadcaster or the user terminal generating the distribution data. The user terminal activating the viewing unit 200 may be referred to as the viewer or the user terminal playing the distribution data.

[0024] The streaming unit 100 may include a video control unit 102, an audio control unit 104, a distribution unit 106, and a UI control unit 108. The video control unit 102 may be connected to a camera (not shown), and the video is controlled by the camera. The video control unit 102 can acquire video data from the camera. The audio control unit 104 may be connected to a microphone (not shown), and the audio is controlled by the microphone. The audio control unit 104 can acquire audio data from the microphone.

[0025] The distribution unit 106 receives distribution data, which includes video data from the video control unit 102 and audio data from the audio control unit 104, and transmits it to the server 10 via the network NW. In some embodiments, the distribution unit 106 transmits the distribution data in real time. That is, the generation of the distribution data from the video control unit 102 and the audio control unit 104 and the distribution by the distribution unit 106 are performed simultaneously.

[0026] The UI control unit 108 controls the UI of the live streamer. The UI control unit 108 is connected to a display (not shown) and is configured to generate the streaming data for the recipient to whom the streaming unit 106 transmits, plays back, and displays on the display. The UI control unit 108 is configured to display an object to be manipulated or an object to receive instructions on the display and to accept tap input from the live streamer.

[0027] The viewing unit 200 may include a UI control unit 202, a rendering unit 204, an input transmission unit 206, a processing unit 210, a terminal gift DB 212, and a script DB 214. The viewing unit 200 is configured to receive streaming data from the server 10 via a network NW. The UI control unit 202 controls the viewer's UI. The UI control unit 202 is connected to a display (not shown) and / or a speaker (not shown) and is configured to display video on the display and output audio from the speaker by playing the streaming data. In some embodiments, outputting video on the display and outputting audio from the speaker may be referred to as "playing streaming data". The UI control unit 202 is connected to an input unit such as a touch panel, keyboard, or display and can acquire user input.

[0028] The rendering unit 204 may be configured to render the data distributed from the server 10 and a frame image. The frame image may include user interface objects for receiving user input, comments entered by viewers, and data received from the server 10. The input transmission unit 206 is configured to receive the user input from the UI control unit 202 and transmit it to the server 10 via the network NW.

[0029] In some embodiments, the user input may be clicking on an object on the user's terminal screen, such as selecting a live stream, entering a comment, sending a gift, following or unfollowing a user, voting in an event, or playing a game. For example, the input transmission unit 206 may generate gift information and send it to the server 10 via the Internet network when the viewer's terminal clicks on a gift object on the screen to send a gift to the live streamer.

[0030] Figure 3 is a block diagram of the server 10 based on some embodiments of the present disclosure. The server 10 may include a distribution information unit 302, a relay unit 304, a processing unit 306, a stream DB 320, a user DB 322, and a gift DB 324.

[0031] The distribution information unit 302 receives a live streaming request from the live streamer's user terminal 20 via the network NW. Upon receiving the request, the distribution information unit 302 registers the live streaming information in the stream DB 320. In some embodiments, the live streaming information may consist of the stream ID of the live streaming and / or the live streamer ID of the live streamer corresponding to the live streaming.

[0032] When the distribution information unit 302 receives a request for information about the live stream from the viewer via the network NW to the viewing unit 200 of the user terminal 30, it refers to the stream DB 320 and generates a list of available live streams.

[0033] Subsequently, the distribution information unit 302 transmits the list to the user terminal 30 via the network NW. The UI control unit 202 of the user terminal 30 generates a live streaming selection screen based on the list and displays the list on the user terminal 30's display.

[0034] When the input transmission unit 206 of the user terminal 30 receives a live stream selection by the viewer on the live stream selection screen, it generates a distribution request including the stream ID of the selected live stream and sends it to the server 10 via the network. The distribution information unit 302 can then begin providing the live stream specified by the stream ID in the distribution request to the user terminal 30. The distribution information unit 302 can update the stream DB 320 and add the viewer ID of the viewer on the user terminal 30 to the live streamer ID of the stream ID.

[0035] The relay unit 304 can relay the transmission of the live stream from the live streamer's user terminal 20 to the viewer's user terminal 30 in the live stream initiated by the distribution information unit 302. The relay unit 304 can receive a signal indicating user input from the viewer from the input transmission unit 206 while the distribution data is being played back. The signal indicating user input may be an object designation signal indicating the designation of an object displayed on the user terminal 30's screen. The object designation signal may include the viewer's viewer ID, the live streamer ID of the live streamer broadcasting the live stream the viewer is watching, and the object ID designated by the object. If the object is a gift, the object ID may be a gift ID, etc. Similarly, the relay unit 304 can receive a signal indicating user input from the live streamer, such as the object designation signal, from the streaming unit 100 of the user terminal 20 while the distribution data is being played back.

[0036] In some embodiments, the server 10 may further include a gift information unit (not shown) and a gift processing unit (not shown). The gift information unit provides gift information to the corresponding broadcaster and viewer. The gift information unit sends gift information for the user terminal to the broadcaster in response to a request from the user terminal. The gift information unit obtains effect data from the gift DB corresponding to the gift ID included in the gift information signal received by the relay unit 304. The gift information unit sends the obtained effect data to other user terminals 20, 30 as a response to the gift transmission request signal.

[0037] The gift processing unit updates the user database 322 to update the points of the broadcaster and the viewer according to the points of the gift identified by the gift ID included in the gift redemption signal. Specifically, the gift processing unit refers to the gift database and identifies the points to be awarded for the gift ID included in the received gift redemption signal. The gift processing unit then updates the user database 322 and adds the determined points to the points of the broadcaster ID included in the gift redemption signal. In some embodiments, the gift processing unit may update the user database 322 and subtract the determined points from the points of the viewer ID included in the gift redemption signal.

[0038] Figure 4 is a table showing an exemplary data structure of the Stream DB 320 in Figure 3. The Stream DB 320 holds information about the live stream currently in progress. The Stream DB 320 stores, in association with each other, a Stream ID for identifying the live stream on the live streaming platform provided by the Live Streaming System 1, a Live Streamer ID for identifying the live stream provider, and a Viewer ID for identifying the viewers of the live stream.

[0039] Figure 5 is a table showing an exemplary data structure of the user DB322 in Figure 3. The user DB322 holds information about users. The user DB322 stores, in relation to each other, a user ID to identify the user, points to identify the points accumulated by the user, a level to identify the user's level, and a status to identify the user's status. The points are electronic value that circulates within the live streaming platform. The level may be an indicator of the amount of activity or engagement of the user on the live streaming platform. The status may be the user's identity or membership status on the live streaming platform.

[0040] Figure 6 shows a table illustrating the exemplary data structure of the Gift DB324 in Figure 3. The Gift DB324 holds information about gifts that viewers can use during a live stream. The Gift DB324 stores, in association with each other, a Gift ID to identify the gift, the amount of points that viewers spend to send a gift to the streamer, an Event ID to identify the event to which the gift corresponds, and gift effect data.

[0041] Viewers can send gifts to broadcasters by paying equivalent value points for their desired gifts while watching the live stream. Such equivalent value point payments can be made by appropriate electronic means; for example, viewers can pay equivalent value points to the administrator. Alternatively, bank transfers or credit card payments may be used. The relationship between awarded points and equivalent value points can be set at the administrator's discretion.

[0042] A gift is electronic data with the following characteristics: - It can be purchased in exchange for points (explained in detail later), or it may be given away for free. - Viewers can send gifts to the streamer. - Sending gifts to streamers is referred to as using gifts or throwing gifts. - Some gifts can be used immediately upon purchase, while others can be used later at any time by the purchaser or recipient after the gift has been given. - When a viewer sends a gift to a streamer, the streamer is awarded points corresponding to the gift, and an effect related to the gift is applied. For example, the effect corresponding to the gift is displayed on the live stream screen.

[0043] The effect in question is a visual, auditory, or tactile effect (e.g., vibration) that characterizes the gift, or a combination thereof. Examples of visual effects include animation, images, and flashing lights. Examples of auditory effects include sound effects and voices. The effect data is data that enables such effects to be implemented on the user terminal 20, and the user terminal 20 implements such effects by processing the effect data. Since the technology for implementing the effect data is publicly known, a detailed explanation thereof is omitted below.

[0044] Figure 7 is a table showing an exemplary data structure of the terminal gift DB 212 in Figure 2. The terminal gift DB 212 is configured to store the gift information of the user terminal 20 or 30. The terminal gift DB 212 may include a gift ID, an icon ID, an effect data ID, and a last updated date. The gift ID may identify the gift. The icon ID may be the icon data of the gift object. The effect data ID may identify the data that implements the effect corresponding to the gift. The last updated date may identify the last updated date of the gift.

[0045] In some embodiments, the viewer may download the gift in advance, or download the gift when sending it. In some embodiments, the gift information may be downloaded and stored in the terminal gift DB 212 in advance. In some embodiments, the terminal gift DB 212 may include a gift list corresponding to the gift list provided by the server 10. In some embodiments, the gift list in the terminal gift DB 212 may be synchronized with the server 10 periodically or by user operation.

[0046] Figure 8 is a table showing an exemplary data structure of the script DB214 in Figure 3. The script DB214 holds information about the scripts of trigger events related to trigger actions. The script DB214 stores, in relation to each other, a script ID that identifies the script, a trigger ID that identifies the trigger event, a condition that identifies the conditions in the trigger event, and a trigger action that identifies the action triggered in response to the trigger event.

[0047] In some embodiments, the trigger ID may be a gift ID, which indicates a trigger action in which a user sends a gift of that gift ID to the live streamer. In some embodiments, the trigger ID may be any possible event within the live streaming room, such as an audio message or body gesture from the live streamer, or a text comment from a viewer. In some embodiments, the trigger ID may be an event from a user or from server 10. For example, a Halloween event may be pre-configured on server 10 to be triggered on Halloween.

[0048] In some embodiments, the condition may include detailed information about the trigger event. For example, if the trigger event is a gift with a specific gift ID, the condition may include the number of gifts being sent. In some embodiments, the condition may include attributes of the trigger event, such as the number and content of the gifts, votes, comments, and followers. As illustrated in Figure 8, the condition may include a range for the number of gifts, such as 1, 2-20, 21-40, or more than 40, or specific conditions such as more than 1, more than 20, or more than 40.

[0049] In some embodiments, the trigger action may be an action triggered within the live streaming room. For example, the trigger action may be an effect generated or displayed within the live streaming room. The effect may be an effect corresponding to the trigger event or condition, such as a gift or a comment. As shown in Figure 8, when a user sends a gift with gift ID "GT010" to a live streamer, the corresponding effect may be triggered and displayed within the live streaming room. More specifically, when 1, 2-20, 21-40, or more than 40 "GT010" gifts are sent, the corresponding effects "ET010", "ET011", "ET012", and "CB001" may be displayed on screen 600 within the live streaming room. In some embodiments, the trigger action may not only be the display of an animation, but also include gaming or winning an award.

[0050] In some embodiments, the condition may be various gift sending conditions, as shown in Figure 8. In some embodiments, the condition may be a condition clause such as "sending more than 1 gift", "sending more than 20 gifts", "sending more than 40 gifts", or "sending more than N gifts". In some embodiments, each script may be independent or related. In some embodiments, the trigger of one script may be a prerequisite for another script. For example, script ST05-01 may be triggered based on the trigger of ST02-02. More specifically, the trigger for script ST05-01 may require that a condition such as sending 2 to 20 gifts be met.

[0051] In some embodiments, each script may be flexibly combined to form a story within the live streaming room. For example, a scenario within the live streaming room may include sending gifts, voting, voice and text messages, events, virtual streamer interactions, AI streamer interactions, etc. Each scenario may be a trigger event within a single script, and multiple scripts having multiple scenarios may be combined within the live streaming room to form a story. For example, the scenarios of sending gifts and voice comments within a script may be an example of a related form of script. In some embodiments, the mechanism of the scripts and story may be flexibly determined according to the actual needs.

[0052] In some embodiments, the processing unit 306 may provide the corresponding live streamer and viewer with information such as the gift DB 324 and script DB 326. In some embodiments, the processing unit 306 transmits the information from the gift DB 324 and script DB 326 to the user terminal either spontaneously or in response to an update request from the user terminal. In some embodiments, the processing unit 306 retrieves information about the gift item or script from the gift DB 324 and script DB 326 and transmits the retrieved information to the user terminals 20 and 30 either spontaneously or in response to an update request signal from the user terminal.

[0053] In some embodiments, the processing unit 210 may decide to update by checking whether the gift item or script is the latest version. In some embodiments, the processing unit 210 may decide to update by checking whether the gift item or script can realize a trigger event and a trigger action. In some embodiments, the processing unit 210 may update or synchronize periodically, or when a user logs in and enters a live streaming room, or when a user sends a gift item to a live streamer in a live streaming room. In some embodiments, the processing unit 306 and the processing unit 210 may coordinate the updating and synchronization of the database between the user terminal and the server 10. In some embodiments, the updating of the database may be flexibly decided according to the actual need.

[0054] Previously, in the backend, Server 10 handled the decision-making process of which animations and illustrations to display and when, based on the number of times a gift was clicked or sent, and also handled sending necessary instructions and information to live streamers and viewers. In this situation, whenever a new gift was created and introduced, a new display method (such as a combo effect) was added, or an outdated gift was deleted, the code on Server 10 needed to be updated each time. In some embodiments, updating Server 10 could lead to serious problems if there were coding errors.

[0055] In some embodiments, the gift processing logic may be embedded as a script within the app on the device side. This approach allows server 10 to introduce new gift item effects and animations simply by updating the script, without requiring any code changes on server 10. Server 10 may continue to receive in-call messages regarding gift usage, issue method tokens to participating devices such as viewers, live streamers, and other viewers in the live streaming room, and count usage frequency without requiring any complex updates.

[0056] Furthermore, by implementing combo tables, scripts, and reward combo tables to control the types and variations of effects and animations based on combo counts (combo models), complex gift behavior can be introduced more easily and accurately. This approach also avoids major changes to the server.

[0057] Figure 9 is a schematic diagram showing an example of the functional configuration of a live streaming system 1 based on some embodiments of the present disclosure. As shown in Figure 9, viewers may perform operations such as sending a gift 502 to the live streamer. In some embodiments, the processing unit 210 may refer to the gift ID of the gift item in a database such as the script DB 214. In some embodiments, if the gift ID of the gift satisfies the conditions for triggering an event, the mechanism shown in Figure 9 (such as initiation 504) may be initiated.

[0058] In some embodiments, validation 506 may be performed to check whether an event has been triggered. For example, the processing unit 210 may check whether the gift information matches the triggered parameters, such as the gift ID or any other possible parameters that may act as a trigger event.

[0059] In some embodiments, the processing unit 210 may check whether the script DB or the gift DB is the most up-to-date database, or whether there is a script or gift sufficient to perform its execution. In some embodiments, if the script is not played, the execution process may be terminated 580. In some embodiments, if the script is played, the processing unit 210 may further detect the execution from the user's user terminal.

[0060] Here, we will describe in detail the case where a viewer touches the gift on the screen 600 in order to send the gift. In some embodiments, the viewer may perform an operation 508, such as touching the gift on the screen 600, to determine the type and number of gifts. Individually, an AI platform SDK 510 may be incorporated to realize the execution. In some embodiments, if the time between the viewer clicking one gift and the next gift is within a threshold, the combo gift calculation 516 may be triggered in the combo module. Otherwise, the execution 508 may time out 512 and end on the ground 514, and the execution process may end 580.

[0061] When the calculation 516 for the combo gift in the combo module is triggered, the processing unit 210 may determine operation information, such as the gift ID and the number of gifts to be clicked by the viewer. In some embodiments, the processing unit 210 may further refer to the script DB 214 or a combo lookup table 520, such as a separate database or lookup table. In some embodiments, the processing unit 210 may execute the script based on the calculation 516. For example, the processing unit 210 may play the combo animation 522 or the gift animation 524.

[0062] Once the calculation and execution of the combo gift processing logic are complete, the operation information may be sent to the live streamer or viewers in the live streaming room. In some embodiments, the user terminals of the live streamer and viewers may retrieve the script, perform processing to display effects accordingly, and play the gift animation related to the combo gift. In some embodiments, the effects may be rendered on the streaming data from the live streamer and may be requested by other viewers. According to these embodiments, the viewer, the live streamer, or other viewers can enjoy the corresponding gift animation in response to the combo gift sent by the viewer.

[0063] In some embodiments, the operation 508, such as the combo gift, may be performed within a specific period, such as one minute, otherwise the operation 508 may time out 512 and end on the ground 514. In some embodiments, a UI interface may be provided for the viewer to select the type of gift and input the number of gifts to send. In some embodiments, the mechanism of the combo gift may be flexibly determined according to the actual needs.

[0064] In some embodiments, the script obtained from the script DB214 may be executed based on the trigger actions described in the script. For example, script ST02-02 corresponds to effect ET011, and the processing unit 210 may display effect ET011 in response to the trigger event of the script being triggered. In some embodiments, one or more scripts may be triggered individually or in a related manner. More specifically, when one script is triggered, another script may be triggered. For example, the script ST05-01 for the trigger event "Audio or comment saying 'I love you'" and the trigger action for the effect "ET025+ET030" may be triggered in response to the triggering of script ST02-02, for example.

[0065] In some embodiments, the triggered script may include one or more scripts. In some embodiments, the processing unit 210 may further process the next script 526 if the execution by the viewer includes one or more scripts. In some embodiments, when the current script is triggered, the processing unit 210 may proceed to check whether there is a next script to be triggered. In some embodiments, if there is a next script to be triggered, the processing unit 210 may proceed to process the next script as described above. In some embodiments, if there is no next script to be triggered, the execution 508 may time out 512 and be terminated at ground 514, and the processing of the execution may be terminated 580.

[0066] The right side of Figure 9 shows an example of a visualization of the combo gift processing logic. As shown in Figure 9, the combo table 550 may include, for example, the number of combo gifts and the corresponding effects to be played on the screen 600 within the live streaming room. In some embodiments, if the number of combo gifts is 1, an animation such as the gift animation (552) for the combo gift may be played based on that. In some embodiments, if the number of combo gifts is 2 or more, a combo animation (554) may be played based on that.

[0067] In some embodiments, the logic described above may be applied to all combo gifts or general gifts as general logic for handling one or more gift sending scenarios. In some embodiments, a combo gift list may be provided to indicate that the logic for the displayed gift animation is for a particular gift, as shown in the combo table 560 and combo gift list 570 in Figure 9. In some embodiments, if the number of combo gifts is 1, 2-20, 21-40, or greater than 40, the gift animation (562), specific animation 1 (564), specific animation 2 (566), or combo animation (568) may be played accordingly. In some embodiments, the combo gift list 570 may also list the gift IDs of the gifts that satisfy the gift processing logic, so that the processing unit 210 can further check the combo gift list 570 to determine the gift processing logic.

[0068] These embodiments allow for the processing and display of various gift animations without the need for cumbersome coding or updates. Furthermore, scripts can be applied to diverse scenarios based on different trigger events. Consequently, server load can be reduced and the user experience can be improved.

[0069] In some embodiments, the trigger event may be an audio or visual interaction from the user, such as a voice, facial expression, gesture, or body movement. For example, the live streamer may make a heart shape with their fingers, and the trigger action may be the display of a large heart falling from the top of the live streaming room. The present disclosure makes it possible to implement any possible trigger event and the corresponding effect in a simpler way.

[0070] In some embodiments, a reward module may be included, as shown in Figure 9. The reward module may include a reward processing unit (not shown) and a reward lookup table. In some embodiments, the reward processing unit and the reward lookup table are configured to process reward logic. In some embodiments, the reward processing unit may retrieve combo gift information and then determine the reward by referring to the reward lookup table. In some embodiments, the reward may be sent to the sender, live streamer, or other viewers in the live streaming room, and the reward processing unit may further dispatch the corresponding reward to the corresponding user, etc.

[0071] More specifically, the reward module may receive combo gift information, for example, from the combo module, and trigger the reward acquisition 530 function based on the reward lookup table. In some embodiments, when the reward acquisition 530 function is triggered, the reward processing unit may dispatch the reward to the user. In some embodiments, the reward may be, for example, a fancy animation based on the original animation, additional points, or any other reward possible within the live streaming platform.

[0072] In some embodiments, the trigger event may be the perception within the live streaming room, or the emotions of the virtual live streamer, particularly the AI ​​virtual live streamer. The perception or emotions may be determined based on, for example, conversations within the live streaming room, daily news, or the stock market. For example, if the stock market is performing well, the perception within the live streaming room on that day may be positive. If a viewer sends a cockroach gift to the AI ​​virtual live streamer, the emotions of the AI ​​virtual live streamer may be fear, for example.

[0073] In some embodiments, the trigger action may be, for example, a change in the background within the live streaming room, or a change in the voice, facial expressions, gestures, or body movements of the virtual live streamer, particularly the AI ​​virtual live streamer. For example, if the perception within the live streaming room is good, the background may be replaced with a brightly colored background. If the AI ​​virtual live streamer's emotion is anger, the AI ​​virtual live streamer's face may be replaced with an angry face. In some embodiments, the settings for the trigger event and trigger action may be flexibly configured according to actual needs.

[0074] Figures 10 to 15 are illustrative screen images of a live streaming room screen 600 displayed on the display of the live streamer's user terminal 20 or the viewer's user terminal 30. When a viewer selects a live streaming room and enters it, the live streamer's live streaming room screen 600 may be displayed on the display. The live streaming room screen 600 may include a live streamer information object 602, a live streamer image 604, a message zone 606, a message input box 608, a gift object 610, a shared object (not shown), etc.

[0075] The live streamer information object 602 displays information about the streamer. The live streamer image zone 604 displays an image or video of the streamer, which may be obtained by playing video data. The message zone 606 displays messages from viewers, the streamer, or the server 10. The message input zone 608 indicates an input zone for the streamer or viewer to enter messages, etc. The gift object 610 provides the user with the ability to send gifts to the live streamer, and the share object provides the user with the ability to share the live streaming room. In some embodiments, the UI and related functions within the live streaming room may be flexibly designed.

[0076] In some embodiments, the viewer and other viewers may send a gift to the live streamer by clicking the gift object 610. When the gift object 610 is clicked, a gift list page 614 may be displayed on screen 600. The viewer may select a gift to send to the live streamer by clicking the gift object on the gift list page 614. In some embodiments, the gift objects on the gift list page 614 may be listed on the gift list 614, or they may be listed based on category tabs, as shown in Figure 11. In some embodiments, there may be various category tabs such as "Backpack," "Luxury," "Entertainment," "Combo," and "Standard."

[0077] In some embodiments, a “backpack” may include gifts currently owned by the user. A “fun” may include fun bag gifts that may generate points equal to or higher / lower than the original value for the live streamer. A “standard” may include gifts classified as standard, and a “luxury” may include gifts classified as luxurious, such as those worth over 1 million points. In some embodiments, a “combo” may include gifts that can be sent in combination with other gifts or multiple other gifts. In some embodiments, the classification of gifts may be flexibly determined according to the actual needs.

[0078] When a viewer clicks on the diamond gift object to send the gift object to the live streamer, gift sending information 616 and a corresponding effect 618 may be displayed on the screen 600 of the live streaming room, as shown in Figure 11. In some embodiments, the gift sending information 616 may include the sender, a description or name of the gift object, etc. In some embodiments, the effect 618 may be an animation related to the gift object, such as a large diamond falling from above the live streamer, as shown in Figure 11.

[0079] In some embodiments, if the viewer sends one gift object, the information 616 and effect 618 may be displayed once. In some embodiments, if the viewer sends two or more gift objects, the information 616 and effect 618 may be displayed two or more times based on the gift sending mechanism. In some embodiments, if the viewer sends two or more gift objects, the information 616 and effect 618 as shown in Figure 11 may be displayed once, and a combo animation 620 may be displayed based on the number of gift objects sent by the viewer. According to these embodiments, it may be possible to reduce the load on the user's terminal when there are many gift animations in the live streaming room.

[0080] In some embodiments, if the gift or the number of gifts satisfies a trigger event from a script in the script DB214, a corresponding trigger action, such as the effect, may be executed. For example, if a viewer sends a diamond gift, the effect 618 of a large falling diamond, as shown in Figure 11, may be displayed, and if a viewer sends 20 or more (e.g., 25) diamond gifts, the effect 622 of a diamond rain, as shown in Figure 12, may be displayed. More specifically, the processing unit 210 may retrieve a script from the script DB214 and display the corresponding effect based on that script.

[0081] As an example of referencing the script DB214, effect 618 may be referred to as ET001, effect 620 as CB001, and so on. As another example of referencing the script DB214, effect 618 may be referred to as ET010, effect 622 as ET011, and so on. In some embodiments, the number of combo gifts may be related to the effect, such as one large diamond or a shower of diamonds. In some embodiments, the number of combo gifts may be different to the effect, such as a wooden house or a castle. In some embodiments, the trigger action, such as the trigger event, condition, or effect, may be flexibly determined according to actual needs.

[0082] In some embodiments, the combo gift may be sent by the same viewer or different viewers. In some embodiments, if the combo gift is sent by the same viewer, a combo period may be set to trigger the combo gift. For example, if the time between a viewer clicking the current gift and the next gift is shorter than a threshold such as one second, the action may be considered a combo gift. In some embodiments, the combo period may be a visualized object such as a countdown circle 624 as shown in Figure 12.

[0083] In some embodiments, if the combo gift is triggered by different viewers, a longer combo period may be set for those viewers to realize the combo gift. As shown in Figure 13, a viewer may send a balloon 626 gift to trigger a combo gift from a different viewer. When the combo gift is triggered, a combo period 628, such as 60 seconds, may be displayed on the screen 600. During the countdown of the combo period 628, the viewer themselves or other viewers may send specific combo gifts, such as balloons 626 or air inflators 630, to realize the mechanism of the combo gift, as shown in Figure 14.

[0084] When the gift information and the number of gifts are sent by the viewer, the server 10 may calculate the number of combo gifts and determine a script from the script DB 326 based on that. As shown in Figure 14, if the total number of combo gifts is within a first threshold, such as 20 to 40, a first effect 634, such as a balloon inflating, may be displayed based on that. As shown in Figure 15, if the total number of combo gifts is within a second threshold, such as more than 40, a second effect 636, such as a balloon bursting, may be displayed based on that.

[0085] In some embodiments, additional rewards may be offered to the viewer, the live streamer, or the senders of the combo gifts within the live streaming room, for example, when the combo gifts reach a threshold. For example, if a viewer sends more than 100 combo gifts, the viewer may receive additional gifts for free, the live streamer may receive additional points, or a surprise bag containing a small amount of points may be distributed to share with other viewers within the live streaming room. These embodiments may incentivize viewers to send combo gifts to the live streamer and may improve the user experience.

[0086] Figure 16 is an exemplary sequence diagram illustrating the operation of a configuration of a live streaming system 1 based on some embodiments of the present disclosure. In some embodiments, the server 10 may maintain up-to-date databases such as the gift DB 324 and the script DB 326 and transmit necessary information to the live streamer and the viewers as needed. In some embodiments, the viewers, the live streamer and other viewers may have synchronized databases such as the gift DBs 212 and 324 and the script DBs 214 and 326.

[0087] As shown in Figure 16, the live streamer and the viewer may update their respective databases on their user terminals (S302). When a user terminal requests an update to the database, the processing unit 306 may retrieve the latest database from, for example, the gift DB 324 and the script DB 326 (S304). The processing unit 306 may then send the latest database to the user terminal (S306). For example, the live streamer or viewer may download or update to the latest version of the application when logging in, broadcasting, entering the live streaming room, or sending a gift.

[0088] Once the setup is complete, the live streamer may start live streaming by pushing the streaming data to the streaming source (S308). The viewer and other viewers may access the streaming data by tapping on the streamer they wish to watch (S310). During the live stream, the viewer may interact with the streamer by sending interaction information such as messages, gifts, or animations (S312). In some embodiments, the relay unit 304 may forward the interaction data to the live streamer and other viewers to enable real-time interaction within the live streaming room (S314).

[0089] In some embodiments, the viewer may send a gift to the live streamer to support the live streamer's performance (S320). In some embodiments, the viewer may send one or more identical gifts or combinations of different gifts. When a gift is clicked and sent, the corresponding gift ID and the number of gifts being sent may be sent to the server 10 (S322). At the same time, the processing unit 210 may refer to the script DB 214 and retrieve the script from the script DB 214 (S324). For example, the processing unit 210 may determine the gift ID of the gift, calculate the number of gifts being sent, and then refer to the script DB 214 to check whether a trigger event is triggered.

[0090] In some embodiments, the server 10 may forward the corresponding gift ID and the number of gifts to the live streamer and other viewers in the live streaming room (S326). In some embodiments, the live streamer and the other viewers may obtain the script from the script DB 214 based on the corresponding gift ID and the number of gifts (S328). Once the script with the corresponding script ID is obtained from the script DB 214, the viewer, the live streamer, and the other viewers may display the gift information and play the gift animation on their respective user terminals based on the script (S380).

[0091] In some embodiments, the gift information may be displayed as a text message in the comment zone, for example, the sender, number, or value of the gift. In some embodiments, if there is no corresponding script, the gift animation may be displayed in a general manner, for example, playing the animation 10 times if 10 gifts are sent. In some embodiments, a script that defines the gift sending logic for general gifts may also be stored in the script DB214 or the like.

[0092] In some embodiments, all gift animations may be played on all user devices of the live streamer and / or viewers. In some embodiments, playback of the gift animations may be performed only on the user devices of the live streamer and / or viewers, and the viewers or other viewers may receive the stream data, including the rendered gift animations, from the live streamer. In some embodiments, the settings for the gift animations may be flexibly determined according to actual needs.

[0093] Figure 17 is an exemplary sequence diagram showing the operation of the configuration of a live streaming system 1 based on some embodiments of the present disclosure. In some embodiments, the viewer may send gifts to the live streamer to support the live streamer's performance (S340). When a gift is clicked and sent, the corresponding gift ID and the number of gifts sent may be sent to the server 10 (S342). In some embodiments, the processing unit 306 may determine the gift ID of the gift, calculate the number of gifts sent, and then refer to the script DB 326 to check whether a trigger event is triggered (S344). Furthermore, the processing unit 306 may retrieve the script from the script DB 326 based on the corresponding gift ID and the number of gifts, etc. (S346).

[0094] In some embodiments, the server 10 may, for example, forward the script ID to the viewer, the live streamer, and other viewers in the live streaming room (S348). In some embodiments, the live streamer and other viewers may obtain the script from the script DB 214 based on the corresponding script ID (S350). Once the script with the corresponding script ID is obtained from the script DB 214, the viewer, the live streamer, and the other viewers may display the gift information and play the gift animation on their respective user terminals based on the script (S380).

[0095] In some embodiments, the server 10 may automatically trigger an action based on a pre-configured trigger event (S360). For example, a staff member may set Halloween as the trigger event, and the server 10 may automatically trigger the action as Halloween approaches. When an action is triggered, the processing unit 306 may retrieve script information from the script DB 326 based on the trigger event (S362).

[0096] In some embodiments, the server 10 may, for example, forward the script ID to the viewer, the live streamer, and other viewers in the live streaming room (S364). In some embodiments, the live streamer and other viewers may obtain the script from the script DB 214 based on the corresponding script ID (S350). Once the script with the corresponding script ID is obtained from the script DB 214, the viewer, the live streamer, and the other viewers may display the gift information and play the gift animation on their respective user terminals based on the script (S380).

[0097] Figure 18 is a schematic block diagram of computer hardware for executing a system configuration and processing based on certain embodiments of the present disclosure. The information processing device 900 in Figure 18 is configured, for example, to realize the server 10 and the user terminals 20 and 30, respectively, based on certain embodiments of the present disclosure.

[0098] The information processing device 900 includes a CPU 901, read-only memory (ROM) 903, and random access memory (RAM) 905. Furthermore, the information processing device 900 may also include a host bus 907, a bridge 909, an external bus 911, an interface 913, an input unit 915, an output unit 917, a storage unit 919, a drive 921, a connection port 925, and a communication unit 929. The information processing device 900 may also include an imaging device (not shown), such as a camera. The CPU 901 is an example of a hardware configuration for realizing the functions realized by the components described herein. The functions described herein may also be realized by circuits programmed to realize such functions. Circuits programmed to realize the functions described herein include a CPU (Central Processing Unit), a DSP (Digital Signal Processor), a general-purpose processor, an application-specific processor, an integrated circuit, an ASIC (Application Specific Integrated Circuit), and / or a combination thereof. In this specification, a unit that implements a particular function may be implemented as a circuit programmed to implement that function. This unit includes, but is not limited to, a streaming unit 100, a video control unit 102, an audio control unit 104, a distribution unit 106, a UI control unit 108, a viewing unit 200, a UI control unit 202, a rendering unit 204, an input transmission unit 206, a streaming information unit 302, a relay unit 304, a processing unit 306, a stream DB 320, a user DB 322, a gift DB 324, a script DB 326, a gift DB 212, a script DB 214, and the like.

[0099] The CPU 901 functions as an arithmetic processing unit and control unit, and controls the overall operation or a part of the operation of the information processing unit 900 according to various programs recorded in the ROM 903, RAM 905, storage unit 919, or removable recording medium 923. For example, the CPU 901 controls the overall operation of each functional unit included in the server 10 and the user terminals 20 and 30 in the above-described embodiment. The ROM 903 stores programs and operating parameters used by the CPU 901. The RAM 905 transiently stores programs used when the CPU 901 is executed and parameters that change as appropriate when executing those programs. The CPU 901, ROM 903, and RAM 905 are connected to each other via a host bus 907, which is composed of internal buses such as a CPU bus. The host bus 907 is connected to an external bus 911, such as a peripheral component interconnect / interface (PCI) bus, via a bridge 909.

[0100] The input unit 915 is a device operated by the user, such as a mouse, keyboard, touch panel, button, switch, or lever. The input unit 915 may also be a device that converts physical quantities into electrical signals, such as an audio sensor (microphone, etc.), acceleration sensor, tilt sensor, infrared sensor, depth sensor, temperature sensor, or humidity sensor. The input unit 915 may also be a remote control device that uses infrared rays or other types of radio waves. Alternatively, the input unit 915 may be an external connection terminal 927, such as a mobile phone, that is compatible with the operation of the information processing device 900. The input unit 915 includes an input control circuit that generates an input signal based on information input from the user and outputs the generated input signal to the CPU 901. The user inputs various data and gives instructions to the information processing device 900 for processing operations by operating the input unit 915.

[0101] The output unit 917 includes a device that can visually or audibly notify the user of the acquired information. The output unit 917 may be, for example, a display device such as an LCD, PDP, or OLED, an audio output device such as a speaker or headphones, or a printer. The output unit 917 outputs the results obtained by the processing performed by the information processing device 900 in the form of text, images or other visuals, or audio or other sounds.

[0102] The storage unit 919 is a data storage device and is an example of a storage unit of the information processing device 900. The storage unit 919 includes, for example, magnetic storage devices such as hard disk drives (HDDs), semiconductor storage devices, optical storage devices, magneto-optical storage devices, etc. The storage unit 919 stores programs and various data executed by the CPU 901, as well as various data acquired from external sources.

[0103] The drive 921 is a reader / writer for removable recording media 923 such as magnetic disks, optical disks, magneto-optical disks, and semiconductor memory, and is built into or attached to the information processing device 900. The drive 921 reads information recorded on the installed removable recording media 923 and outputs it to the RAM 905. The drive 921 also writes data to the installed removable recording media 923.

[0104] The connection port 925 is a port used to directly connect equipment to the information processing device 900. The connection port 925 may be, for example, a USB (Universal Serial Bus) port, an IEEE 1394 port, or a SCSI (Small Computer System Interface) port. The connection port 925 may also be an RS-232C port, an optical audio terminal, an HDMI (High-Definition Multimedia Interface®) port, etc. By connecting an external connection terminal 927 to the connection port 925, various types of data can be exchanged between the information processing device 900 and the external connection terminal 927.

[0105] The communication unit 929 is, for example, a communication interface that includes a communication device for connecting to a communication network NW. The communication unit 929 may also be, for example, a communication card for a wired or wireless local area network (LAN), Bluetooth®, or wireless USB (WUSB).

[0106] The communication unit 929 may be, for example, a router for optical communication, a router for ADSL (asymmetric digital subscriber line), or a modem for various types of communication. For example, the communication unit 929 uses a predetermined protocol such as TCP / IP to send and receive signals over the Internet or to other communication devices. The communication network NW to which the communication unit 929 is connected is a network established by a wired or wireless connection. The communication network NW may be, for example, the Internet, a home LAN, infrared communication, radio communication, or satellite communication.

[0107] The imaging device (not shown) is a device that captures real space and generates an image using an image sensor such as a CCD (charge-coupled device) or CMOS (complementary metal-oxide-semiconductor) and various components such as a lens for controlling the imaging of a subject on the image sensor. The imaging device may capture still images or moving images.

[0108] The live streaming system 1 of this disclosure has been described above with reference to embodiments. The embodiments described above are for illustrative purposes only. Rather, it is readily apparent to those skilled in the art that various combinations and modifications of the components and processes of the embodiments can be made, and these are also included within the technical scope of this disclosure.

[0109] The processes described herein, particularly those described using flowcharts, may be modified by omitting some of the processes, adding processes not explicitly included in the processes, and / or rearranging the order of the processes. Such modifications, including omissions, additions, and rearrangements, are still included within the scope of this disclosure, provided they do not deviate from the essence of this disclosure.

[0110] In some embodiments, at least a portion of the functions performed by the server 10 may be performed by an entity other than the server 10, for example, by the user terminal 20 or 30. In some embodiments, at least a portion of the functions performed by the user terminal 20 or 30 may be performed by an entity other than the user terminal 20 or 30, for example, by the server 10. In some embodiments, the rendering of frame images may be performed by the user terminal, such as a viewer, server, or live streamer.

[0111] Furthermore, the system or method described in the above embodiments may be provided as a non-transient computer-readable storage device such as a solid-state memory device, optical disk memory device, or magnetic disk memory device, or as a computer program product. Alternatively, the program may be downloaded from a server via the Internet.

[0112] While the technical content and features of this disclosure have been described above, any person with ordinary skill in the art to which this disclosure pertains can make many further modifications and alterations without departing from the teachings and disclosures of this disclosure. Therefore, the scope of this disclosure is not limited to the embodiments already disclosed, but is also included in the scope of any subsequent claims, including other modifications and alterations that do not depart from this disclosure. [Explanation of Symbols]

[0113] 1. Live Streaming System 10 servers 20 User Terminals 100 Streaming Units 102 Video Control Unit 104 Audio Control Unit 106 distribution units 108 UI Control Unit 200 viewing units 202 UI Control Unit 204 rendering units 206 Input Units 210 Processing Units 212 Terminal Gift Database 214 Script DB 30, 30a, 30b User terminals 302 Distribution Information Unit 304 Relay Unit 306 Processing Units 320 Stream DB 322 User DB 324 Gift DB 326 Script DB 600 screens 602 Object 604 images 606 Message Zone 608 Message Input Box 610 Gift Objects 614 Gift List Page 616 Information 900 Information Processing Equipment 901 CPU 903 ROM 905 RAM 907 Host Bus 909 Bridge 911 External bus 913 Interface 915 Input Unit 917 Output Unit 919 Storage Units 921 Drive 923 Removable recording media 925 connection ports 927 External connection terminal 929 Communication Unit LS Live Streaming LV Live Streamer NW Network SP specific part AU1, AU2 viewers S302~S380 process VD, VD1, VD2 video

Claims

1. A terminal including a circuit, wherein the circuit is A step of receiving operation information from the first user, A step of detecting a trigger event from the aforementioned operation information, In response to the detection of the trigger event from the operation information, the steps include obtaining a first script based on the operation information, A step of displaying a trigger action based on the first script, It is configured to perform, The operation information includes the operation of the gift item by the first user, The operation includes the number of clicks on the gift item sent to the broadcaster in the live streaming room within a specific period of time. A terminal characterized in that the first script is determined based on the number of times.

2. A terminal including a circuit, wherein the circuit is A step of receiving operation information from the first user, A step of detecting a trigger event from the aforementioned operation information, In response to the detection of the trigger event from the operation information, the steps include obtaining a first script based on the operation information, A step of displaying a trigger action based on the first script, The process includes transmitting the aforementioned operation information or the first script to the second user terminal of the second user via the server, The process involves displaying the trigger action on the second user's second user terminal based on the operation information or the first script, A terminal characterized by being configured to perform a certain action.

3. A terminal including a circuit, wherein the circuit is A step of receiving operation information from the first user, A step of detecting a trigger event from the aforementioned operation information, In response to the detection of the trigger event from the operation information, the steps include obtaining a first script based on the operation information, A step of displaying a trigger action based on the first script, It is configured to perform, The first script is obtained from a local database that stores the correspondence between the trigger event and the trigger action as a list. A terminal characterized in that the database is synchronized periodically via a server, or when the first user logs in, or enters a live streaming room, or when the first user sends a gift item to a broadcaster within the live streaming room.

4. A terminal including a circuit, wherein the circuit is A step of receiving operation information from the first user, A step of detecting a trigger event from the aforementioned operation information, In response to the detection of the trigger event from the operation information, the steps include obtaining a first script based on the operation information, A step of displaying a trigger action based on the first script, A step of detecting a second trigger event from the aforementioned operation information, In response to the detection of the second trigger event from the operation information, the process includes obtaining a second script based on the operation information, A step of displaying a second trigger action based on the second script, It is configured to perform, A terminal characterized in that the second script is triggered in response to the trigger of the first script.

5. A terminal including a circuit, wherein the circuit is A step of receiving operation information from the first user, A step of detecting a trigger event from the aforementioned operation information, In response to the detection of the trigger event from the operation information, the steps include obtaining a first script based on the operation information, A step of displaying a trigger action based on the first script, It is configured to perform, A terminal characterized in that a reward is generated in response to the operation information reaching a threshold, and the reward includes additional points awarded in addition to the points generated by the operation information, or an effect that is an upgraded version of the effect generated by the trigger action.

6. A server including a circuit, wherein the circuit is A step of receiving first operation information from the first user terminal of the first user, The process includes receiving second operation information from a second user terminal of a second user, A step of obtaining a first script from the database based on the first operation information and the second operation information, The steps include sending the first script to the first user terminal and the second user terminal, A server characterized by being configured to perform the following.

7. At least one of the first operation information and the second operation information includes an operation on a gift item performed by the corresponding user, The operation includes the number of clicks on the gift item sent to the broadcaster in the live streaming room within a specific period of time. The first script is determined based on the number of times. The server according to claim 6, characterized in that

8. The server according to claim 6, characterized in that a reward is generated in response to at least one of the first operation information and the second operation information reaching a threshold, and the reward includes additional points that are greater than the points generated by the at least one operation information, or an effect that is an upgraded version of the effect generated by the trigger action.

9. It is a method, A step of receiving operation information from the first user, A step of detecting a trigger event from the aforementioned operation information, In response to the detection of the trigger event from the operation information, the steps include obtaining a first script based on the operation information, A step of displaying a trigger action based on the first script, Includes, The operation information includes the operation of the gift item by the first user, The operation includes the number of clicks on the gift item sent to the broadcaster in the live streaming room within a specific period of time. A method characterized in that the first script is determined based on the number of times.

Images