Servers, methods, and computer programs
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- 17LIVE JAPAN INC
- Filing Date
- 2025-01-22
- Publication Date
- 2026-08-03
Smart Images
Figure 2026125442000001_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to information and communication technologies, and more particularly, to a server, a method, and a computer program in live streaming.
Background Art
[0002] Some applications and platforms provide live streaming services that enable interaction between live streamers and viewers. Live streamers may perform performances to cheer up viewers, or viewers may donate or send gifts to support live streamers.
[0003] Interaction between viewers and live streamers plays an important role in a live streaming room. Patent Document 1 discloses a method for improving the interaction between live streamers and viewers in a live streaming room.
[0004] However, current technologies cannot fully meet the needs of viewers and live streamers, which may lead to a decline in the user experience. Therefore, it is important to improve the user experience.
Prior Art Documents
Patent Documents
[0005]
Patent Document 1
Summary of the Invention
[0006] One embodiment of the present disclosure relates to a server including a circuit, which is configured to perform the steps of: detecting a first trigger point in a live streaming room;, in response to the detection of the first trigger point in the live streaming room, extracting a first portion of a broadcaster from streaming data provided by the broadcaster; performing image editing processing on the first portion; and rendering the first portion edited in the streaming data.
[0007] Another embodiment of the present disclosure is a method, the method comprising the steps of detecting a first trigger point in a live streaming room; extracting a first portion of a broadcaster from broadcast data provided by the broadcaster in response to the detection of the first trigger point in the live streaming room; performing image editing processing with respect to the first portion; and rendering the edited first portion of the broadcast data.
[0008] Another embodiment of the present disclosure relates to a computer program that enables a server to perform the following functions: to detect a first trigger point in a live streaming room; to extract a first portion of a broadcaster from streaming data provided by the broadcaster in response to the detection of the first trigger point in the live streaming room; to perform image editing processing on the first portion; and to render the edited first portion of the streaming data.
[0009] According to this disclosure, viewers can be motivated to interact more with live streamers. Furthermore, it can make the live streaming room more enjoyable and facilitate smoother interaction within the live streaming room. Therefore, the user experience may be improved. [Brief explanation of the drawing]
[0010] [Figure 1] This is a schematic diagram showing the configuration of a live streaming system 1 based on some embodiments of the present disclosure. [Figure 2] This is a block diagram of a user terminal 20 based on some embodiments of the present disclosure. [Figure 3] This is a block diagram of server 10 based on some embodiments of the present disclosure. [Figure 4] Figure 3 is a table showing an example data structure for the stream DB320. [Figure 5] Figure 3 is a table showing an example data structure for user DB322. [Figure 6] Figure 3 is a table showing an example data structure for the gift DB324. [Figure 7] Figure 3 is a table showing an example data structure for the event DB326. [Figure 8] Figure 3 is a table showing an example data structure for the context DB328. [Figure 9] This is an exemplary functional structure of a live streaming system 1 based on certain embodiments of the present disclosure. [Figure 10] This is an exemplary screen image of the live streaming room screen 600 displayed on the display of the live streamer's user terminal 20 or the viewer's user terminal 30. [Figure 11] This is an exemplary screen image of the live streaming room screen 600 displayed on the display of the live streamer's user terminal 20 or the viewer's user terminal 30. [Figure 12] This is an exemplary screen image of the live streaming room screen 600 displayed on the display of the live streamer's user terminal 20 or the viewer's user terminal 30. [Figure 13] This is an exemplary screen image of the live streaming room screen 600 displayed on the display of the live streamer's user terminal 20 or the viewer's user terminal 30. [Figure 14]This is an exemplary screen image of a live streaming room screen 600 displayed on the display of the user terminal 20 of a live streamer or the user terminal 30 of a viewer. [Figure 15] This is an exemplary screen image of a live streaming room screen 600 displayed on the display of the user terminal 20 of a live streamer or the user terminal 30 of a viewer. [Figure 16] This is an exemplary screen image of a live streaming room screen 600 displayed on the display of the user terminal 20 of a live streamer or the user terminal 30 of a viewer. [Figure 17] This is an exemplary screen image of a live streaming room screen 600 displayed on the display of the user terminal 20 of a live streamer or the user terminal 30 of a viewer. [Figure 18] This is an exemplary hardware configuration of an information processing apparatus according to some embodiments of the present disclosure.
Mode for Carrying Out the Invention
[0011] Hereinafter, the same or similar components, members, procedures, or signals shown in each drawing are denoted by the same reference numerals in all the drawings, and redundant descriptions are omitted as appropriate. Also, some members that are not important in the description of each drawing are omitted.
[0012] The live streaming system 1 according to some embodiments of the present disclosure provides an enhanced function for smoothly facilitating communication and interaction between users. More specifically, it is something that makes viewers and live streamers enjoy themselves in a technical way.
[0013] <00OO090>Figure 1 shows a schematic diagram illustrating the configuration of a live streaming system 1 based on some embodiments of the present disclosure. The live streaming system 1 provides a live streaming service for real-time interaction between live streamers (also called live broadcasters, streamers, or broadcasters) LV and viewers (also called audiences) AU (AU1, AU2...). As shown in Figure 1, the live streaming system 1 may include a server 10, user terminals 20 and 30 (30a, 30b...). The user terminals 20 may be live streamers, and the user terminals 30 may be viewers. In some embodiments, the live streamers and viewers may be referred to as users. The server 10 may include one or more information processing devices connected via a network NW. The user terminals 20 and 30 may be, for example, mobile devices such as smartphones, tablets, laptops, recorders, portable game consoles, and wearable devices, or stationary computers such as desktop PCs. The server 10, user terminal 20, and user terminal 30 may be connected to each other via any type of wired or wireless network NW.
[0014] The live streaming system 1 involves a live streamer (LV), a viewer (AU), and an application provider (not shown) that provides the server 10. The live streamer (LV) can record their own content, such as singing, talking, performing, or game streaming, on their user terminal (20), upload it to the server 10, and distribute the content in real time. In some embodiments, the live streamer (LV) can interact with the viewer (AU) through the live stream.
[0015] The app provider can provide a platform for the content to be live-streamed on the server 10. In some embodiments, the app provider may be a media or manager that manages the real-time communication between the live-streamer LV and the viewer AU. The viewer AU can access the platform through the user terminal 30, select the content they want to view, and view it. The viewer AU can perform operations for interacting with the live-streamer, such as commenting on or cheering for the live-streamer, through the user terminal 30. The live-streamer who provides the content can respond to the comments and cheers. The response of the live-streamer can be sent to the viewer AU by means of video and / or audio, etc. Therefore, the mutual communication between the live-streamer and the viewer can be achieved.
[0016] As used herein, "live streaming" may refer to data transmission that enables a viewer AU to substantially play and view content recorded by a live streamer LV on a user terminal 20 via a user terminal 30. In some embodiments, "live streaming" may also refer to the distribution achieved by the above-described data transmission. Such live streaming can be implemented using known technologies such as HTTP live streaming, CMAF (Common Media Application Format), WebRTC (Web Real-Time Communications), RTMP (Real-Time Messaging Protocol), and MPEG DASH. Such live streaming may further include embodiments in which the viewer AU can play or view the content with a certain delay while the live streamer is recording the content. The degree of such delay should preferably be small enough to allow the live streamer LV and the viewer AU to communicate. However, live streaming is different from so-called on-demand streaming. More specifically, such on-demand streaming may refer to storing all the data of the recorded content on a server and providing the data to the user from the server at random timings in response to the user's request.
[0017] In this specification, “distribution data” may refer to data including image data and audio data. More specifically, the image data (which may also be called video data) may be generated by the image capture function of the user terminals 20 and 30. The audio data (which may also be called audio data) may be generated by the audio input function of the user terminals 20 and 30. The distribution data may be played back on the user terminals 20 and 30 to allow the user to view content related to the user. In some embodiments, processing such as compression, expansion, encoding, decoding, and transcoding is envisioned to change the format, size, and specifications of the data between the time the distribution data is generated on the live streamer's user terminal and the time it is played back on the viewer's user terminal. Before and after such processing, the content (video and audio) is substantially unchanged, and for this reason, in the current embodiments of this disclosure, the distribution data before processing and the distribution data after processing are described as being the same. In other words, when the streaming data generated by the user terminal of the live streamer is played back on the viewer's user terminal via the server 10, the streaming data generated by the user terminal of the live streamer, the streaming data that has passed through the server 10, and the streaming data received and played back by the viewer's user terminal are all the same streaming data.
[0018] As shown in Figure 1, the live streamer LV provides a live stream. The user terminal 20 of the live streamer generates streaming data by recording the streamer's video and / or audio, and transmits it to the server 10 via the network NW. At the same time, the user terminal 20 can display the video VD on its display and check the streaming content of the live streamer LV.
[0019] Viewers AU1 and AU2 of user terminals 30a and 30b, which request the platform to provide the live stream from the live streamer, receive the distribution data corresponding to the live stream via the network NW, play the received distribution data to display the video VD1 and VD2 on a display, and output audio from speakers or the like. The video VD1 and VD2 displayed on user terminals 30a and 30b are substantially the same as the video recorded by the user terminal of the live streamer LV, and the audio output from user terminals 30a and 30b is substantially the same as the audio recorded by the user terminal of the live streamer LV.
[0020] The recording on the user terminal 20 of the live streamer may occur simultaneously with the playback of the streamed data on the user terminals 30a and 30b of the viewers AU1 and AU2. When viewer AU1 inputs a comment regarding the content of the live streamer LV into its user terminal 30a, the server 10 displays the comment in real time on the live streamer's user terminal 20, and also on the user terminals 30a and 30b of viewers AU1 and AU2, respectively. If the live streamer LV responds to the comment, the response is output as text, image, video, or audio from the user terminals 30a and 30b of viewers AU1 and AU2, thereby enabling communication between the live streamer LV and viewers AU1 and AU2. Thus, the live streaming system can realize two-way live streaming.
[0021] Figure 2 is a block diagram showing the functions and configuration of the user terminal 20 shown in Figure 1, based on an embodiment of the present disclosure. The user terminal 30 has the same functions and configuration as the user terminal 20. The blocks depicted in the block diagrams of this specification are implemented by hardware such as a computer CPU or mechanical parts, and software such as a computer program that represents a functional block performed by the cooperation of these elements. Therefore, it will be understood by those skilled in the art that functional blocks can be implemented in various ways through combinations of hardware and software.
[0022] The live streamer (LV) and viewer (AU) can download and install the live streaming application (live streaming app) described herein from a download site to their user terminals 20 and 30 via the network (NW). Alternatively, the live streaming app may be pre-installed on the user terminals 20 and 30. By performing live streaming on the user terminals 20 and 30, they can communicate with the server 10 via the network (NW) and implement multiple functions. These functions, implemented by the execution of the live streaming app by the user terminals 20 and 30 (more specifically, by the processor such as the CPU), are described below as functions of the user terminals 20 and 30. These functions are basically functions that the live streaming app enables the user terminals 20 and 30 to implement. In some embodiments, these functions may be implemented by sending them from the server 10 to the web browser of the user terminals 20 and 30 via the network (NW) and executing them by a computer program in the web browser. This computer program may be written in a programming language such as HTML (Hyper Text Markup Language).
[0023] The user terminal 20 includes a streaming unit 100 and a viewing unit 200. In some embodiments, the streaming unit 100 is configured to record the user's audio and / or video data and generate distribution data to be sent to the server 10. The viewing unit 200 is configured to receive and play the distribution data from the server 10. In some embodiments, the user can activate the streaming unit 100 when broadcasting or when viewing the distribution. In some embodiments, the user terminal activating the streaming unit 100 may be referred to as the live broadcaster or the user terminal generating the distribution data. The user terminal activating the viewing unit 200 may be referred to as the viewer or the user terminal playing the distribution data.
[0024] The streaming unit 100 may include a video control unit 102, an audio control unit 104, a distribution unit 106, and a UI control unit 108. The video control unit 102 may be connected to a camera (not shown), and the video is controlled by the camera. The video control unit 102 can acquire video data from the camera. The audio control unit 104 may be connected to a microphone (not shown), and the audio is controlled by the microphone. The audio control unit 104 can acquire audio data from the microphone.
[0025] The distribution unit 106 receives distribution data, which includes video data from the video control unit 102 and audio data from the audio control unit 104, and transmits it to the server 10 via the network NW. In some embodiments, the distribution unit 106 transmits the distribution data in real time. That is, the generation of the distribution data from the video control unit 102 and the audio control unit 104 and the distribution by the distribution unit 106 are performed simultaneously.
[0026] The UI control unit 108 controls the UI of the live streamer. The UI control unit 108 is connected to a display (not shown) and is configured to generate the streaming data for the recipient to whom the streaming unit 106 transmits, plays back, and displays on the display. The UI control unit 108 is configured to display an object to be manipulated or an object to receive instructions on the display and to accept tap input from the live streamer.
[0027] The viewing unit 200 may include a UI control unit 202, a rendering unit 204, and an input transmission unit 206. The viewing unit 200 is configured to receive distribution data from the server 10 via a network NW. The UI control unit 202 controls the viewer's UI. The UI control unit 202 is connected to a display (not shown) and / or a speaker (not shown) and is configured to display video on the display and output audio from the speaker by playing the distribution data. In some embodiments, outputting video on the display and outputting audio from the speaker may be referred to as "playing the distribution data". The UI control unit 202 is connected to an input unit such as a touch panel, keyboard, or display and can acquire user input.
[0028] The rendering unit 204 may be configured to render the data distributed from the server 10 and a frame image. The frame image may include user interface objects for receiving user input, comments entered by viewers, and data received from the server 10. The input transmission unit 206 is configured to receive the user input from the UI control unit 202 and transmit it to the server 10 via the network NW.
[0029] In some embodiments, the user input may be clicking on an object on the user's terminal screen, such as selecting a live stream, entering a comment, sending a gift, following or unfollowing a user, voting in an event, or playing a game. For example, the input transmission unit 206 may generate gift information and send it to the server 10 via the Internet network when the viewer's terminal clicks on a gift object on the screen to send a gift to the live streamer.
[0030] In some embodiments, the user terminal 20 may include a terminal-side gift database (not shown). The terminal-side gift database is configured to store the gift information of the user terminal 20 or 30. The terminal-side gift database may include a gift ID, an icon ID, an effect data ID, and a last updated date. The gift ID may identify the gift. The icon ID may be the icon data of the gift object. The effect data ID may identify the data that implements the effect corresponding to the gift. The last updated date may identify the last updated date of the gift.
[0031] In some embodiments, the viewer may download the gift in advance, or download the gift when sending it. In some embodiments, the gift information may be downloaded and stored in the terminal-side gift database in advance. In some embodiments, the terminal-side gift database may include the gift list corresponding to the gift list provided by the server 10. In some embodiments, the gift list in the terminal-side gift database may be synchronized with the server 10 periodically or by user operation.
[0032] Figure 3 is a block diagram of the server 10 based on some embodiments of the present disclosure. The server 10 may include a distribution information unit 302, a relay unit 304, a processing unit 306, a stream DB 320, a user DB 322, a gift DB 324, an event DB 326, a context DB 328, and a device learning model 330.
[0033] The distribution information unit 302 receives a live streaming request from the live streamer's user terminal 20 via the network NW. Upon receiving the request, the distribution information unit 302 registers the live streaming information in the stream DB 320. In some embodiments, the live streaming information may consist of the stream ID of the live streaming and / or the live streamer ID of the live streamer corresponding to the live streaming.
[0034] When the distribution information unit 302 receives a request for information about the live stream from the viewer via the network NW to the viewing unit 200 of the user terminal 30, it refers to the stream DB 320 and generates a list of available live streams.
[0035] Subsequently, the distribution information unit 302 transmits the list to the user terminal 30 via the network NW. The UI control unit 202 of the user terminal 30 generates a live streaming selection screen based on the list and displays the list on the user terminal 30's display.
[0036] When the input transmission unit 206 of the user terminal 30 receives a live stream selection by the viewer on the live stream selection screen, it generates a distribution request including the stream ID of the selected live stream and sends it to the server 10 via the network. The distribution information unit 302 can then begin providing the live stream specified by the stream ID in the distribution request to the user terminal 30. The distribution information unit 302 can update the stream DB 320 and add the viewer ID of the viewer on the user terminal 30 to the live streamer ID of the stream ID.
[0037] The relay unit 304 can relay the transmission of the live stream from the live streamer's user terminal 20 to the viewer's user terminal 30 in the live stream initiated by the distribution information unit 302. The relay unit 304 can receive a signal indicating user input from the viewer from the input transmission unit 206 while the distribution data is being played back. The signal indicating user input may be an object designation signal indicating the designation of an object displayed on the user terminal 30's screen. The object designation signal may include the viewer's viewer ID, the live streamer ID of the live streamer broadcasting the live stream the viewer is watching, and the object ID designated by the object. If the object is a gift, the object ID may be a gift ID, etc. Similarly, the relay unit 304 can receive a signal indicating user input from the live streamer, such as the object designation signal, from the streaming unit 100 of the user terminal 20 while the distribution data is being played back.
[0038] The processing unit 306 is configured to process interaction data within the live streaming room. This interaction data may include any parameters available within the live streaming room, such as comments from viewers, the number of gifts from each viewer or all viewers individually or in total, the number of points received by the streamer, events or campaigns in which the streamer is participating, votes, purchases, game scores, and PK status. The processing unit 306 may also detect specific conditions from the interaction data. These conditions may include, for example, a specific number of gifts from each viewer or all viewers to the live streamer, sales figures, revenue from each or all products, wins and losses in penalty shootouts, and the number of points received by individuals or groups or their ranking achievements.
[0039] In some embodiments, the processing unit 306 may detect a trigger point within the live streaming room. In some embodiments, in response to the detection of the trigger point within the live streaming room, the processing unit 306 may extract a portion of the broadcaster from the broadcast data provided by the broadcaster. In some embodiments, the processing unit 306 may perform image editing on the portion. In some embodiments, the processing unit 306 may render the edited portion onto the broadcast data.
[0040] In some embodiments, the processing unit 306 may monitor the status of the live streaming room. For example, the processing unit 306 may monitor the status of the broadcaster's received points or ranking over time during the event. This status may include, for example, the live broadcaster's ranking over time, the reward threshold, the end time of the event, etc. In some embodiments, the processing unit 306 may monitor the status and extract a portion of the broadcaster, which is then input into the language model 330. The language model 330 may further generate edited portions flexibly or based on pre-configured prompts, etc.
[0041] In some embodiments, the portion extracted from the broadcaster may be a portion of the broadcaster's face or body. In some embodiments, the extracted portion may be processed or edited into another portion that differs from the original portion in terms of size, age, facial expression, or movement. For example, the differences may be a cute version, a chibi version, or an older version of the broadcaster's face or body.
[0042] In some embodiments, the edited portion may have a larger head size than the original head. In some embodiments, the edited portion may include a process of transition from or to another status. For example, the edited portion may include a transformation from an egg to a human, or a transformation from a small chibi version to a realistic appearance. In some embodiments, the style of the edited portion may be line art or exaggerated. For example, the size of the head, eyes, and mouth may be much larger than usual. In some embodiments, the edited portion may be flexibly adjusted according to actual needs.
[0043] In some embodiments, the edited portion may remain rendered on the streamer for a specific period of time. For example, this period may be 5 seconds. In some embodiments, this period may be determined by another trigger point. For example, if the trigger point is dropping out of the top 10 on the leaderboard, the effect (edited portion) may be removed when the streamer's ranking returns to the top 10. In some embodiments, this period may be determined by the streamer or the viewer, and may be removed directly by the streamer or by the viewer through gift sending. In some embodiments, the duration for which the edited portion remains rendered on the streamer may be flexibly determined according to actual needs.
[0044] In some embodiments, the condition may be greater than, less than, or equal to a specific parameter, such as points received or sales revenue. In some embodiments, the condition may be a dynamic combination of the conditions described above. For example, the condition may be two thresholds: receiving 500,000 points or more and receiving 1,000,000 points or more. Another example is that the condition may be that the number of viewers is 1,000 or more, less than 1,000, and then 1,000 or more again. Here, the condition may be the number of viewers in the live streaming room, and the number being greater than, less than, and then greater than or equal to the conditions described above is an example of a combination of the conditions described above. In some embodiments, the condition may be determined flexibly.
[0045] In some embodiments, the processing unit 306 may be flexibly installed inside the terminal or server 10. More specifically, the detection of specific conditions and the triggering of special effects may be performed from the server 10 or the terminal. In some embodiments, the server 10 may automatically trigger the special effects within the live streaming room.
[0046] Figure 4 is a table showing an exemplary data structure of the Stream DB 320 in Figure 3. The Stream DB 320 holds information about the live stream currently in progress. The Stream DB 320 stores, in association with each other, a Stream ID for identifying the live stream on the live streaming platform provided by the Live Streaming System 1, a Live Streamer ID for identifying the live stream provider, and a Viewer ID for identifying the viewers of the live stream.
[0047] Figure 5 is a table showing an exemplary data structure of the user DB322 in Figure 3. The user DB322 holds information about users. The user DB322 stores, in relation to each other, a user ID to identify the user, points to identify the points accumulated by the user, a level to identify the user's level, and a status to identify the user's status. The points are electronic value that circulates within the live streaming platform. The level may be an indicator of the amount of activity or engagement of the user on the live streaming platform. The status may be the user's identity or membership status on the live streaming platform.
[0048] Figure 6 shows a table illustrating the exemplary data structure of the Gift DB324 in Figure 3. The Gift DB324 holds information about gifts that viewers can use during a live stream. The Gift DB324 stores, in association with each other, a Gift ID to identify the gift, the amount of points that viewers spend to send a gift to the streamer, an Event ID to identify the event to which the gift corresponds, and gift effect data.
[0049] Viewers can send gifts to broadcasters by paying equivalent value points for their desired gifts while watching the live stream. Such equivalent value point payments can be made by appropriate electronic means; for example, viewers can pay equivalent value points to the administrator. Alternatively, bank transfers or credit card payments may be used. The relationship between awarded points and equivalent value points can be set at the administrator's discretion.
[0050] A gift is electronic data with the following characteristics: - It can be purchased in exchange for points (explained in detail later), or it may be given away for free. - Viewers can send gifts to the streamer. - Sending gifts to streamers is referred to as using gifts or throwing gifts. - Some gifts can be used immediately upon purchase, while others can be used later at any time by the purchaser or recipient after the gift has been given. - When a viewer sends a gift to a streamer, the streamer is awarded points corresponding to the gift, and an effect related to the gift is displayed. For example, the effect corresponding to the gift is displayed on the live stream screen.
[0051] The effect in question is a visual, auditory, or tactile effect (e.g., vibration) that characterizes the gift, or a combination thereof. Examples of visual effects include animation, images, and flashing lights. Examples of auditory effects include sound effects and voices. The effect data is data that enables such effects to be implemented on the user terminal 20, and the user terminal 20 implements such effects by processing the effect data. Since the technology for implementing the effect data is publicly known, a detailed explanation thereof is omitted below.
[0052] Figure 7 is a table showing an exemplary data structure of the event DB326 in Figure 3. The event DB326 stores information about events hosted by app or platform providers. The event DB326 stores an event ID to identify the event, an event gift ID to identify the gifts in the event, and a start time and end time to identify the start and end times of the event. In some embodiments, the event DB326 may also store a title to identify the event's title, tags to identify the event's category or topic, and an event URL to identify the location of the event page, all in relation to each other.
[0053] Here, “event” may refer to an event in which streamers compete for points they receive. Such events may be hosted by the app or platform provider. Viewers may send virtual items, such as gifts, to streamers, each virtual item may correspond to a specific amount of points. Streamers may interact with viewers to collect points. In such events, streamers may be ranked based on the points they receive. Streamers who earn relatively high points may receive rewards. In some embodiments, each event may include a specific gift, and only that specific gift may contribute to the points received by the streamer. In some embodiments, such gifts may be common to all events. In some embodiments, the rules of such events may be designed according to the actual needs.
[0054] The event may start at a designated start time and end at a designated end time. Streamers participating in the event may compete with each other based on the amount of event gifts they collect from viewers within a specific time frame, from the start time to the end time. The streamer who collects the most event gifts may be declared the winner and receive a specific reward. In some embodiments, the rules of the event and the criteria for determining the winner can be flexibly designed.
[0055] In some embodiments, the server 10 may further include a gift information unit (not shown) and a gift processing unit (not shown). The gift information unit provides gift information to the corresponding broadcaster and viewer. The gift information unit sends gift information for the user terminal to the broadcaster in response to a request from the user terminal. The gift information unit obtains effect data from the gift DB corresponding to the gift ID included in the gift information signal received by the relay unit 304. The gift information unit sends the obtained effect data to other user terminals 20, 30 as a response to the gift transmission request signal.
[0056] The gift processing unit updates the user database 322 to update the points of the broadcaster and the viewer according to the points of the gift identified by the gift ID included in the gift redemption signal. Specifically, the gift processing unit refers to the gift database and identifies the points to be awarded for the gift ID included in the received gift redemption signal. The gift processing unit then updates the user database 322 and adds the determined points to the points of the broadcaster ID included in the gift redemption signal. In some embodiments, the gift processing unit may update the user database 322 and subtract the determined points from the points of the viewer ID included in the gift redemption signal.
[0057] Figure 8 shows an exemplary data structure of the context DB 328 in Figure 3. The context DB 328 holds information about context data. The context DB 328 stores a context ID that identifies the context data, a description that identifies the description of the context data, and a URL that identifies the location of the context data, in relation to each other. In some embodiments, the context may be a text object, image object, video object, etc., provided by the live streaming system 1 or uploaded by the user.
[0058] In some embodiments, the context data in the context DB328 may be background or decorative material for the part being edited. In some embodiments, the context may be an image or video of the live streamer or viewer, and such image or video may be obtained from live streaming data, archived streaming data of the live streamer, etc. In some embodiments, the context may be a context uploaded by the user, provided by the live streaming system 1, or obtained from the internet, etc. In some embodiments, the context may be flexibly determined according to the actual needs.
[0059] In some embodiments, the machine learning model 330 may be any possible machine learning model, such as a content-based model, an action-based model, a language model like ChatGPT, or an image generation model like MidJourney. In some embodiments, the machine learning model may infer possible outputs based on the input, and the summarization step may refer to providing the user with the inference from the model. In some embodiments, the machine learning model may generate images or videos based on the input from the live streaming room or the like.
[0060] Figure 9 is a schematic diagram showing an example of the functional configuration of a live streaming system 1 based on some embodiments of the present disclosure. As shown in Figure 9, the live streamer may interact with the viewer within the live streaming room (S502). In some embodiments, there may be one or more trigger points from the interaction between the live streamer and the viewer. When a trigger point is detected within the live streaming room (S504), a portion of the live streamer may be extracted from the live stream provided by the live streamer (S506).
[0061] Furthermore, image processing may be performed on the extracted portion (S508). In some embodiments, the image processing may be performed based on a pre-established database, SDK, or machine learning model having pre-configured rules and prompts to implement the processing (S510). For example, a chibi version of a person may refer to a style or depiction in which a character is drawn in a small, exaggerated, stereotypical style, generally with a large head and a small body. To implement the image processing, chibi versions of live streamers may be stored in a corresponding database or generated by a machine learning model.
[0062] In some embodiments, once the image processing is performed on the extracted portion, the processed portion may be rendered again into the distribution data (S512). Once the rendering is complete (S514), the rendered distribution data may be distributed to the live streamer and viewers for display (S516). When the live streamer or viewers receive the distribution data on their respective terminals, it may be reproduced on the terminal screen 600, thereby realizing the function (S518).
[0063] Figures 10 to 17 are illustrative screen images of a live streaming room screen 600 displayed on the display of the live streamer's user terminal 20 or the viewer's user terminal 30. When a viewer selects a live streaming room and enters it, the live streamer's live streaming room screen 600 may be displayed on the display. The live streaming room screen 600 may include a live streamer information object 602, a live streamer image 604, a message zone 606, a message input box 608, a gift object 610, a shared object (not shown), etc.
[0064] The live streamer information object 602 displays information about the streamer. The live streamer image zone 604 displays an image or video of the streamer, which may be obtained by playing video data. The message zone 606 displays messages from viewers, the streamer, or the server 10. The message input zone 608 indicates an input zone for the streamer or viewer to enter messages, etc. The gift object 610 provides the user with the ability to send gifts to the live streamer, and the share object 612 provides the user with the ability to share the live streaming room. In some embodiments, the UI and related functions within the live streaming room may be flexibly designed.
[0065] In some embodiments, the trigger point may correspond to an event in which the broadcaster is participating. In some embodiments, any parameter related to the event may be a trigger point. For example, the trigger point may include the start of the event, the end of the event, a specific period just before the end of the event, or a change in the broadcaster's ranking on the leaderboard from the event. In some embodiments, sending or receiving gift items related to the event may also be a trigger point.
[0066] In some embodiments, the live streaming room screen 600 may include an event icon 614 as shown in Figure 10. The event icon 614 may display the event the live streamer is currently participating in, as well as the remaining time for the event, the current ranking, etc. In some embodiments, the live streamer and viewers may click the event icon 614 to receive a description of the event and the current ranking. In some embodiments, when the event icon 614 is clicked, the corresponding event gift for the event may be displayed. For example, when a viewer clicks the event icon 614, an event gift tab in the gift list may pop up, making it easier for the viewer to send an event gift to support the live streamer.
[0067] As shown in Figure 10, an event sticker 616 may be provided on the screen 600 to display the current status of the live streamer in the event. The event sticker 616 may include information such as the event name, the remaining time in the event, the current rank, and the current number of points. In some embodiments, the event sticker 616 may include the point difference between the live streamer and the previous or next live streamer on the leaderboard. For example, if the live streamer is in 11th place, the point difference between the 12th and 10th place live streamers may be displayed so that the live streamer and viewers can understand their current status on the leaderboard. In some embodiments, the event sticker 616 may include any information that helps the live streamer and viewers understand the current status of the event.
[0068] In some embodiments, the conditions for triggering a trigger point during the event may be any of the possible parameters described above. More specifically, the event is always held for a specific period of time, and the streamer's ranking on the leaderboard fluctuates based on viewer support (e.g., points received). As shown in Figure 11, if there are less than 5 minutes remaining in the event and the streamer is still behind in ranking, an angry face 618 or the like may be generated and rendered on the streamer to indicate this fact. According to these embodiments, viewers may be more inclined to support the streamer because they understand that the event is entering its final stages.
[0069] In some embodiments, the event may state that if the live streamer achieves a threshold, such as ranking within the top 10, they can earn additional rewards. If the streamer's ranking falls outside the top 10, an angry face 618 or the like may be generated and rendered on the streamer to indicate this fact, as shown in Figure 11. In some embodiments, the angry face 618 may be of a standard size or an exaggerated size compared to the size of the streamer's original face. In some embodiments, decorative objects such as veins 620 bulging with anger may be added to further emphasize the anger.
[0070] In some embodiments, the end of the event may serve as the trigger point. Competition intensifies, especially towards the end of an event, and many viewers tend to make large donations to support their favorite streamers and help them win. As shown in Figure 12, when the event ends and the streamer comes in first place, a joyful face or a face shedding tears of joy 622 may be generated and rendered on the streamer to indicate this fact. Furthermore, decorative objects such as a celebratory ball 624 may be added to further emphasize the victory. Conversely, if the event ends and the streamer does not come in first place, a crying face may be generated and rendered on the streamer. According to these embodiments, viewers can understand whether their favorite streamer won the event from the rendered facial expressions, etc.
[0071] In some embodiments, the trigger point may correspond to points received by the broadcaster from interaction with viewers within the live streaming room. In some embodiments, the trigger point may include reaching an integer value that terminates at zero. In some embodiments, the trigger point may include reaching a threshold determined by the broadcaster, viewers, server 10, etc. In some embodiments, the mechanism of the trigger point may be flexibly determined.
[0072] In some embodiments, the broadcaster may set thresholds before or during a live broadcast. In some embodiments, the broadcaster may set thresholds in a broadcast schedule (referring to a future live broadcast schedule). Figure 13 shows an example of thresholds determined by the broadcaster. As shown in Figure 13, the live broadcast settings screen 600 may include pre-configuration buttons 634, a broadcaster image 604, a broadcast button 636, etc. The pre-configuration buttons 634 may include any pre-configuration buttons related to live broadcasting, such as setting tags, selecting events, changing thumbnails, setting filters, etc. The broadcaster image 604 may be obtained by playing video data. The broadcast button 636 may be a button that is clicked to start a live broadcast.
[0073] In some embodiments, the broadcaster may set a threshold using a pre-configured button 634, such as a target button 638. When the target button 638 is clicked, a UI interface 640 may be displayed for the broadcaster to set the threshold. As shown in the UI interface 640 in Figure 13, the broadcaster can select a default goal, a goal of their own choosing, or a goal suggested by an AI model. In some embodiments, the goal may be achieving earned points, achieving a ranking on a leaderboard, or any possible goal that can be set within the live streaming room. Once the goal is set, the broadcaster may click the set button to finalize the goal setting.
[0074] In some embodiments, the trigger point corresponding to the recipient's points may be automatically triggered by the server 10. As shown in Figure 14, based on the recipient points object 642, the recipient may receive a gift corresponding to a total of 98,000 points. In some embodiments, since the zero-terminated integer closest to 98,000 is, for example, 100,000, the recipient points of 100,000 may be automatically set as a threshold by the recipient or by the server 10, etc.
[0075] As shown in Figures 13 and 14, a goal sticker 644 may be provided on the screen 600 to display the status of the live streamer's goal. The goal sticker 644 may include information such as a description of the goal, the number of points remaining to reach the goal, and the current number of points received. In some embodiments, the goal sticker 644 may also include a visualized UI status for the user to check the progress of the goal and reward. Once the goal is reached, the streamer may claim the reward by clicking or other means. In some embodiments, the mechanism of the goal sticker may be determined flexibly.
[0076] In some embodiments, the conditions for triggering a trigger point while receiving points from the viewer may be any of the possible parameters described above. As shown in Figure 15, when the threshold of 100,000 is reached, a chibi version of the streamer may be generated and rendered on the streamer to indicate this fact. According to these embodiments, viewers may be motivated to support the streamer in achieving the goal in order to see the special effect rendered on the streamer, potentially improving interaction within the live streaming room.
[0077] In some embodiments, the live streamer may engage in group calls or player killing (PK) with other live streamers and perform multi-user interactions. Figure 16 shows an example of PK with other live streamers within a live streaming room. In some embodiments, the conditions may be any possible trigger point within the live streaming room, such as the start or end of PK, the outcome of PK, or the difference in PK scores reaching a threshold.
[0078] As shown on the left side of Figure 16, one live streamer may initiate a player-kill (PK) with another live streamer, and viewers may send gifts to support their favorite live streamer. In some embodiments, when the PK time ends and one live streamer has received more gifts than the other live streamer, it may be understood that the live streamer has defeated the other live streamer and won the PK. As shown on the right side of Figure 16, special effects may be generated and rendered on the live streamer in question or on other live streamers to indicate the result of the PK, for example.
[0079] More specifically, when a multi-user interaction such as PK is initiated, the distribution data may be rendered including the distributionr 660 and another distributionr 662, as shown in Figure 16. In some embodiments, the distributionr 660 may be displayed in the first frame 664 and the other distributionr 662 in the second frame 666. In some embodiments, edited portions of the distributionr 660, such as a large head 668, may be rendered overlapping the first frame 664 and the second frame 666. In some embodiments, edited portions of the other distributionr 662, such as a size 670, may be reduced and gradually made smaller, for example, to create the impression that the other distributionr 662 has lost the PK. This embodiment may bring more enjoyment and excitement to PK participants and improve the user experience.
[0080] In some embodiments, the broadcaster may be a real person. The real person may provide the broadcast data by acquiring video and audio data using a camera and microphone on the user terminal. In some embodiments, the broadcaster may be a virtual avatar controlled by a real person. The real person may set up a virtual avatar or virtual skin representing the broadcaster and provide audio data using only a microphone on the user terminal.
[0081] In some embodiments, the streamer may be a virtual avatar generated by an AI machine learning model, which may be called an AI virtual live streamer. The virtual avatar may be pre-configured or generated by the AI machine learning model, and interactions within the live streaming room may be realized based on the machine learning model. For example, comments from viewers may be obtained from the live streaming room, input into the machine learning model to generate a response to the comment, and the response may be sent to the live streaming room. These embodiments enable smooth interaction between the AI virtual live streamer and the viewers.
[0082] Figure 17 shows an example of a streamer with a virtual avatar. In some embodiments, the streamer with a virtual avatar may be a real person or an AI virtual live streamer. In some embodiments, the appearance of the virtual avatar may be a human-like image or other possible object, such as the doll 680 shown in Figure 17. In some embodiments, when a trigger point is triggered, a portion of the streamer may be extracted, and image processing may be performed on the extracted portion. In some embodiments, as shown in Figure 17, body movements such as arm swings 681 or facial expressions may also be trigger points.
[0083] In some embodiments, the extracted portion may be processed based on a pre-configured database, image editing software, or an AI machine learning model. As shown in Figure 17, when a trigger point is triggered, a strong arm 682, etc., may be generated and rendered onto the arm 681 of the AI virtual live streamer. According to this embodiment, the enjoyment within the live streaming room can be enhanced.
[0084] Furthermore, the position and cover area of the edited portion may be detected. In some embodiments, if the position and cover area of the edited portion overlap with any UI object on screen 600, the position or cover area of the UI object may be changed. As shown in Figure 17, if the position of the strong arm 682 overlaps with the sticker 684, the position of the sticker 684 may be shifted upward to create the sensation that the sticker has been moved or struck. According to this embodiment, the enjoyment within the live streaming room can be enhanced.
[0085] In some embodiments, a gift item for general use or for a specific scenario such as an event or PK may trigger when a viewer sends the gift item. For example, a special gift item used in PK may trigger a face size increase for a predetermined period. In some embodiments, such a trigger point may apply to a live commerce event. For example, the condition may be any possible trigger point within the live commerce event, such as the number of sales per product type or for all products, sales revenue per product type or for all products, the number of viewers in the live streaming room, or the number of likes from viewers.
[0086] In some embodiments, the edited portion rendered on the broadcaster may vary based on its proximity to the target or trigger point. For example, as the receiving point approaches the target point, the face rendered on the broadcaster may become progressively larger. In some embodiments, the changes on the broadcaster may include not only the edited portion but also the process of change. In some embodiments, the trigger point and the corresponding effect mechanism on the broadcaster or other objects on screen 600 may be flexibly determined according to actual needs.
[0087] In some embodiments, the trigger point may be any parameter possible within the live streaming room. In some embodiments, the trigger point may be a specific facial expression or body movement from the streamer. More specifically, a specific facial expression or body movement from the streamer may be detected periodically, and when such a facial expression or body movement is detected, edited portions, such as an exaggerated or enlarged face, may be generated and rendered on the streamer.
[0088] In some embodiments, a detection unit (not shown) may be provided to detect the broadcaster image 604 region, and the edited portion may be rendered in response to the detection of a specific facial expression or body movement from the broadcaster. In some embodiments, the broadcaster may frown, smile, or wave to indicate the trigger point. In some embodiments, the voice input or image input such as facial features or gestures may be predetermined or determined in real time. That is, the app or platform provider may set up rules or lookup tables for how to generate the edited portion based on the voice input or image input. In some embodiments, the user may set it up themselves.
[0089] In some embodiments, the trigger point may be a specific number of comments from viewers or keywords within comments. In some embodiments, the trigger point may be flexibly determined according to actual needs. In some embodiments, the timing of the trigger point, the generation of the edited portion, and the rendering of the edited portion may be flexibly determined or designed.
[0090] According to this disclosure, viewers can be motivated to interact more with live streamers. Furthermore, it can make the live streaming room more enjoyable and facilitate smoother interaction within the live streaming room. Therefore, the user experience may be improved.
[0091] Figure 18 is a schematic block diagram of computer hardware for executing a system configuration and processing based on certain embodiments of the present disclosure. The information processing device 900 in Figure 18 is configured, for example, to realize the server 10 and the user terminals 20 and 30, respectively, based on certain embodiments of the present disclosure.
[0092] The information processing device 900 includes a CPU 901, read-only memory (ROM) 903, and random access memory (RAM) 905. Furthermore, the information processing device 900 may also include a host bus 907, a bridge 909, an external bus 911, an interface 913, an input unit 915, an output unit 917, a storage unit 919, a drive 921, a connection port 925, and a communication unit 929. The information processing device 900 may also include an imaging device (not shown), such as a camera. The CPU 901 is an example of a hardware configuration for realizing the functions realized by the components described herein. The functions described herein may also be realized by circuits programmed to realize such functions. Circuits programmed to realize the functions described herein include a CPU (Central Processing Unit), a DSP (Digital Signal Processor), a general-purpose processor, an application-specific processor, an integrated circuit, an ASIC (Application Specific Integrated Circuit), and / or a combination thereof. In this specification, a unit that implements a particular function may be implemented as a circuit programmed to implement that function. This unit includes, but is not limited to, a streaming unit 100, a video control unit 102, an audio control unit 104, a distribution unit 106, a UI control unit 108, a viewing unit 200, a UI control unit 202, a rendering unit 204, an input transmission unit 206, a distribution information unit 302, a relay unit 304, a processing unit 306, a stream DB 320, a user DB 322, a gift DB 324, an event DB 326, a context DB 328, and a device learning model 330.
[0093] The CPU 901 functions as an arithmetic processing unit and control unit, and controls the overall operation or a part of the operation of the information processing unit 900 according to various programs recorded in the ROM 903, RAM 905, storage unit 919, or removable recording medium 923. For example, the CPU 901 controls the overall operation of each functional unit included in the server 10 and the user terminals 20 and 30 in the above-described embodiment. The ROM 903 stores programs and operating parameters used by the CPU 901. The RAM 905 transiently stores programs used when the CPU 901 is executed and parameters that change as appropriate when executing those programs. The CPU 901, ROM 903, and RAM 905 are connected to each other via a host bus 907, which is composed of internal buses such as a CPU bus. The host bus 907 is connected to an external bus 911, such as a peripheral component interconnect / interface (PCI) bus, via a bridge 909.
[0094] The input unit 915 is a device operated by the user, such as a mouse, keyboard, touch panel, button, switch, or lever. The input unit 915 may also be a device that converts physical quantities into electrical signals, such as an audio sensor (microphone, etc.), acceleration sensor, tilt sensor, infrared sensor, depth sensor, temperature sensor, or humidity sensor. The input unit 915 may also be a remote control device that uses infrared rays or other types of radio waves. Alternatively, the input unit 915 may be an external connection terminal 927, such as a mobile phone, that is compatible with the operation of the information processing device 900. The input unit 915 includes an input control circuit that generates an input signal based on information input from the user and outputs the generated input signal to the CPU 901. The user inputs various data and gives instructions to the information processing device 900 for processing operations by operating the input unit 915.
[0095] The output unit 917 includes a device that can visually or audibly notify the user of the acquired information. The output unit 917 may be, for example, a display device such as an LCD, PDP, or OLED, an audio output device such as a speaker or headphones, or a printer. The output unit 917 outputs the results obtained by the processing performed by the information processing device 900 in the form of text, images or other visuals, or audio or other sounds.
[0096] The storage unit 919 is a data storage device and is an example of a storage unit of the information processing device 900. The storage unit 919 includes, for example, magnetic storage devices such as hard disk drives (HDDs), semiconductor storage devices, optical storage devices, magneto-optical storage devices, etc. The storage unit 919 stores programs and various data executed by the CPU 901, as well as various data acquired from external sources.
[0097] The drive 921 is a reader / writer for removable recording media 923 such as magnetic disks, optical disks, magneto-optical disks, and semiconductor memory, and is built into or attached to the information processing device 900. The drive 921 reads information recorded on the installed removable recording media 923 and outputs it to the RAM 905. The drive 921 also writes data to the installed removable recording media 923.
[0098] The connection port 925 is a port used to directly connect equipment to the information processing device 900. The connection port 925 may be, for example, a USB (Universal Serial Bus) port, an IEEE 1394 port, or a SCSI (Small Computer System Interface) port. The connection port 925 may also be an RS-232C port, an optical audio terminal, an HDMI (High-Definition Multimedia Interface®) port, etc. By connecting an external connection terminal 927 to the connection port 925, various types of data can be exchanged between the information processing device 900 and the external connection terminal 927.
[0099] The communication unit 929 is, for example, a communication interface that includes a communication device for connecting to a communication network NW. The communication unit 929 may also be, for example, a communication card for a wired or wireless local area network (LAN), Bluetooth®, or wireless USB (WUSB).
[0100] The communication unit 929 may be, for example, a router for optical communication, a router for ADSL (asymmetric digital subscriber line), or a modem for various types of communication. For example, the communication unit 929 uses a predetermined protocol such as TCP / IP to send and receive signals over the Internet or to other communication devices. The communication network NW to which the communication unit 929 is connected is a network established by a wired or wireless connection. The communication network NW may be, for example, the Internet, a home LAN, infrared communication, radio communication, or satellite communication.
[0101] The imaging device (not shown) is a device that captures real space and generates an image using an image sensor such as a CCD (charge-coupled device) or CMOS (complementary metal-oxide-semiconductor) and various components such as a lens for controlling the imaging of a subject on the image sensor. The imaging device may capture still images or moving images.
[0102] The live streaming system 1 of this disclosure has been described above with reference to embodiments. The embodiments described above are for illustrative purposes only. Rather, it is readily apparent to those skilled in the art that various combinations and modifications of the components and processes of the embodiments can be made, and these are also included within the technical scope of this disclosure.
[0103] The processes described herein, particularly those described using flowcharts, may be modified by omitting some of the processes, adding processes not explicitly included in the processes, and / or rearranging the order of the processes. Such modifications, including omissions, additions, and rearrangements, are still included within the scope of this disclosure, provided they do not deviate from the essence of this disclosure.
[0104] In some embodiments, at least a portion of the functions performed by the server 10 may be performed by an entity other than the server 10, for example, by the user terminal 20 or 30. In some embodiments, at least a portion of the functions performed by the user terminal 20 or 30 may be performed by an entity other than the user terminal 20 or 30, for example, by the server 10. In some embodiments, the rendering of frame images may be performed by the user terminal, such as a viewer, server, or live streamer.
[0105] Furthermore, the system or method described in the above embodiments may be provided as a non-transient computer-readable storage device such as a solid-state memory device, optical disk memory device, or magnetic disk memory device, or as a computer program product. Alternatively, the program may be downloaded from a server via the Internet.
[0106] While the technical content and features of this disclosure have been described above, any person with ordinary skill in the art to which this disclosure pertains can make many further modifications and alterations without departing from the teachings and disclosures of this disclosure. Therefore, the scope of this disclosure is not limited to the embodiments already disclosed, but is also included in the scope of any subsequent claims, including other modifications and alterations that do not depart from this disclosure. [Explanation of Symbols]
[0107] 1. Live Streaming System 10 servers 20 User Terminals 100 Streaming Units 102 Video Control Unit 104 Audio Control Unit 106 distribution units 108 UI Control Unit 200 viewing units 202 UI Control Unit 204 rendering units 206 Input Units 30, 30a, 30b User terminals 302 Distribution Information Unit 304 Relay Unit 306 Processing Units 320 Stream DB 322 User DB 324 Gift DB 326 Event DB 328 Context DB 330 Machine Learning Models 600 screens 602 Object 604 images 606 Message Zone 608 Message Input Box 610 Gift Objects 614 Event Icons 616 Event Stickers 900 Information Processing Equipment 901 CPU 903 ROM 905 RAM 907 Host Bus 909 Bridge 911 External bus 913 Interface 915 Input Unit 917 Output Unit 919 Storage Units 921 Drive 923 Removable recording media 925 connection ports 927 External connection terminal 929 Communication Unit LS Live Streaming LV Live Streamer NW Network SP specific part AU1, AU2 viewers S502~S518 Process VD, VD1, VD2 video
Claims
1. A server including a circuit, wherein the circuit is The process of detecting a first trigger point within the live streaming room, In response to the detection of the first trigger point within the live streaming room, the process involves extracting a first portion of the broadcaster from the broadcast data provided by the broadcaster. The process of performing image editing processing with respect to the first part, A step of rendering the first portion edited into the distribution data, A server characterized by being configured to perform the following.
2. The aforementioned trigger point corresponds to an event in which the streamer is participating, and The trigger point includes the start of the event, the end of the event, a specific period immediately before the end of the event, and the broadcaster's ranking on the leaderboard from the event. The server according to claim 1, characterized in that
3. The trigger point corresponds to a point received by the broadcaster from interaction with viewers within the live streaming room, and The trigger point includes reaching an integer value where the receiving point ends in zero, or reaching a threshold determined by the distributor. The server according to claim 1, characterized in that
4. The first part corresponds to a part of the broadcaster's face or a part of their body, and The edited first portion is one in which the size, age, facial expression, or movement has been altered. The server according to claim 1, characterized in that
5. This process includes generating interaction distributions for multiple users, including the aforementioned distributor and other distributors. The aforementioned broadcaster is displayed in the first frame, the other broadcaster is displayed in the second frame, and The edited first portion is superimposed on the first frame and the second frame. The server according to claim 1, characterized in that
6. A step of detecting the position of the first object, A step of changing the position of the first object in response to the edited first portion overlapping with the first object, The server according to claim 1, characterized by including
7. The trigger point responds to receiving a signal from the viewer's terminal indicating the viewer's use of a gift item, and corresponds to the gift item sent by the viewer, The aforementioned gift item is a general-purpose gift item, a gift item for interaction between multiple users, a gift item for an event in which the streamer is participating, or a gift item for a game that the streamer is playing. The server according to claim 1, characterized in that
8. The edited first portion is processed by a pre-configured database, image editing software, or an AI machine learning model, and The broadcaster is a real person, or a virtual avatar of the real person, or the virtual avatar of the AI machine learning model. The server according to claim 1, characterized in that
9. It is a method, The process of detecting a first trigger point within the live streaming room, In response to the detection of the first trigger point within the live streaming room, the process involves extracting a first portion of the broadcaster from the broadcast data provided by the broadcaster. The process of performing image editing processing with respect to the first part, A step of rendering the first portion edited into the distribution data, A method characterized by including
10. A computer program, which is on a server, A function to detect the first trigger point within the live streaming room, A function to extract a first portion of the broadcaster from the broadcast data provided by the broadcaster in response to the detection of the first trigger point within the live streaming room, A function to perform image editing processing with respect to the first part mentioned above, A function to render the first portion edited in the aforementioned distribution data, A computer program characterized by achieving the following.