System and method for displaying content

Abstract

This invention provides a system and method for displaying content that can provide the services desired by the user. [Solution] A method for displaying content includes the steps of: obtaining first broadcaster identification data relating to a broadcaster on a live streaming platform and first environment identification data relating to a first environment; generating first content based on the broadcaster's database and the first environment; and providing the first content to the first environment.

Description

Technical Field

[0001] The present invention relates to content display, and particularly to content display for live distribution.

Background Art

[0002] As represented by live distribution services, real-time communication on the Internet has penetrated into daily life. Various platforms and providers offer live distribution services, and the competition is fierce. For a platform, it is important to provide the services desired by users.

[0003] U.S. Patent Application Publication No. 2024 / 0064343 discloses a system for live distribution data search.

Summary of the Invention

[0004] A method for content display according to an embodiment of the present invention is executed by one or more computers, and includes a step of obtaining first distributor identification data regarding a distributor of a live distribution platform and first environment identification data regarding a first environment, a step of generating first content based on the distributor's database and the first environment, and a step of providing the first content to the first environment.

[0005] A system according to an embodiment of the present invention is a system for content display, includes one or more processors, and the one or more processors execute machine-readable instructions to perform a step of obtaining first distributor identification data regarding a distributor of a live distribution platform and first environment identification data regarding a first environment, a step of generating first content based on the distributor's database and the first environment, and a step of providing the first content to the first environment.

[0006] A non-temporary computer-readable medium including a program for displaying content, wherein the program causes one or more computers to perform the steps of: acquiring first broadcaster identification data relating to broadcasters of a live streaming platform and first environment identification data relating to a first environment; generating first content based on the broadcaster's database and the first environment; and providing the first content to the first environment. [Brief explanation of the drawing]

[0007] [Figure 1] This is a schematic diagram showing the configuration of a live streaming system 1 based on some embodiments of the present invention. [Figure 2] This block diagram shows the functions and configuration of the user terminal 30 in Figure 1, based on some embodiments of the present invention. [Figure 3] This block diagram shows the functions and configuration of the server in Figure 1, based on some embodiments of the present invention. [Figure 4] Figure 3 is a table showing an example data structure for the stream DB310. [Figure 5] Figure 3 is a table showing an example data structure for user DB312. [Figure 6] Figure 3 is a table showing an example data structure for the gift DB314. [Figure 7] This table shows an example data structure for user DB312. [Figure 8] This table shows an example data structure for user DB312. [Figure 9] This table shows an example data structure for the requested DB332. [Figure 10] This table shows the example data structure of content DB334. [Figure 11] This table shows the example data structure of content DB334. [Figure 12] This flowchart shows an exemplary flow based on some embodiments of the present invention. [Figure 13]This is a schematic diagram showing an example of content display based on some embodiments of the present invention. [Figure 14] This is a schematic diagram showing an example of content display based on some embodiments of the present invention. [Figure 15] This flowchart shows an exemplary flow based on some embodiments of the present invention. [Figure 16] This is a schematic diagram showing an example of content display based on some embodiments of the present invention. [Figure 17] This flowchart shows an exemplary flow based on some embodiments of the present invention. [Figure 18] This is a schematic diagram showing an example of content display based on some embodiments of the present invention. [Figure 19] This is an example of a notification to a distributor based on some embodiments of the present invention. [Figure 20] This is a block diagram showing an example of the hardware configuration of an information processing device based on some embodiments of the present invention. [Modes for carrying out the invention]

[0008] In the following drawings, identical or similar components, members, procedures, or signals are denoted by the same reference numerals, and redundant explanations are omitted where appropriate. Furthermore, some components that are not essential to the description of each drawing are omitted.

[0009] Attracting or absorbing users from various channels is crucial for the expansion of a distribution platform. Ideally, a distribution platform should be able to provide content that can drive users to its platform across diverse environments and platforms.

[0010] Figure 1 is a schematic diagram showing the configuration of a live streaming system 1 based on some embodiments of the present invention. The live streaming system 1 provides a live streaming service for real-time interaction or communication between streaming broadcasters (also called live streamers, anchors, or live broadcasters) LV and viewers (also called audiences) AU (AU1, AU2...). As shown in Figure 1, the live streaming system 1 includes a server 10, user terminals 20 and 30 (30a, 30b...). In some embodiments, the broadcasters and viewers may be collectively referred to as users. The server 10 may include one or more information processing devices connected to a network NW. The user terminals 20 and 30 may be mobile devices such as smartphones, tablets, notebook PCs, recorders, portable game consoles, or wearable devices, or stationary devices such as desktop PCs. The server 10, user terminals 20 and 30 are connected to each other so as to be able to communicate with each other via various wired or wireless networks NW.

[0011] The live streaming system 1 includes a broadcaster (LV), a viewer (AU), and an administrator (or application provider, not shown) who manages the server 10. The broadcaster (LV) is a person who broadcasts content in real time by recording content on their user terminal 20 and uploading it directly or indirectly to the server 10. Examples of such content may include the broadcaster's own songs, talks, performances, gameplay, or any other content. The administrator provides a platform for live streaming the content on the server 10 and mediates or manages real-time interaction between the broadcaster (LV) and the viewer (AU). The viewer (AU) accesses the platform on their user terminal 30 and selects and watches the desired content. While the selected content is being live-streamed, the viewer (AU) performs actions such as sending comments, cheers, and gifts via their user terminal 30. The broadcaster (LV) broadcasting the content may respond to these comments, cheers, or gifts. Such responses are sent to the viewer (AU) via video and / or audio, establishing two-way communication.

[0012] The term "live streaming" may refer to a data transmission mode that enables content recorded on the user terminal 20 of the broadcaster LV to be played back and viewed substantially in real time on the user terminal 30 of the viewer AU, or it may refer to a live broadcast realized by such a transmission mode. Such live streaming may be realized using existing live streaming technologies such as HTTP live streaming, CMAF (Common Media Application Format), WebRTC (Web Real-Time Communications), RTMP (Real-Time Messaging Protocol), etc. Live streaming includes a transmission mode that allows the viewer AU to view the content with a predetermined delay, simultaneously with the recording of the content by the broadcaster LV. The length of this delay may be such that communication between the broadcaster LV and the viewer AU can be established. Such live streaming is distinguished from so-called on-demand streaming, where all recorded data of the content is stored on a server and then provided to the user from the server upon user request.

[0013] As used herein, the "video data" refers to data including the image data (also referred to as video data) generated using the imaging function of the user terminal 20 or 30, and the audio data generated using the voice input function of the user terminal 20 or 30. The video data is played back on the user terminals 20 and 30 so that the user can view the content. In some embodiments, it is assumed that between the generation of the video data on the user terminal of the distributor and the playback of the video data on the user terminal of the viewer, processes such as compressing, decompressing, encoding, decoding, transcoding, etc. are performed to change the format, size, or data specifications of the video data. However, since the content (e.g., video and audio) represented by the video data does not substantially change before and after such processes, in this specification, the video data after such processes is expressed as the same as the video data before such processes. That is, when the video data is generated on the user terminal of the distributor and then played back on the user terminal of the viewer via the server 10, the video data generated on the user terminal of the distributor, the video data passing through the server 10, and the video data received and played back on the user terminal of the viewer are all the same video data.

[0014] In the example shown in FIG. 1, the distributor LV provides live distribution data. The user terminal 20 of the distributor LV records the video and audio of the distributor LV to generate the distribution data, and the generated data is transmitted to the server 10 via the network NW. At the same time, the user terminal 20 displays the recorded video VD of the distributor LV on the display of the user terminal 20 so that the user can confirm the live distribution content currently being performed by the distributor LV.

[0015] Each of the user terminals 30a and 30b of the viewers AU1 and AU2 who requested to watch the live broadcast of the distributor LV on the platform receives video data related to the live broadcast (hereinafter may be referred to as "video data of the live broadcast") via the network NW, plays back the received video data, displays the videos VD1 and VD2 on the display, and outputs sound from the speaker. The videos VD1 and VD2 displayed on the user terminals 30a and 30b are substantially the same as the video VD captured by the user terminal 20 of the distributor LV, and the sound output from the user terminals 30a and 30b is substantially the same as the sound recorded by the user terminal 20 of the distributor LV.

[0016] The recording of video and audio on the user terminal 20 of the distributor LV and the playback of video data on the user terminals 30a and 30b of the viewers AU1 and AU2 are performed substantially simultaneously. When the viewer AU1 inputs a comment regarding the content provided by the distributor LV into the user terminal 30a, the server 10 displays the comment in real time on the user terminal 20 of the distributor LV and also displays the comment on the user terminals 30a and 30b of the viewers AU1 and AU2 respectively. When the distributor LV reads the comment and develops a talk corresponding to the comment, the video and audio of the talk are displayed on the user terminals 30a and 30b of the viewers AU1 and AU2 respectively. This interactive operation is recognized as a conversation being established between the distributor LV and the viewer AU1. Thereby, the live streaming system 1 realizes a live broadcast that enables two-way communication instead of one-way communication.

[0017] Figure 2 is a block diagram showing the functions and configuration of the user terminal 30 in Figure 1, based on some embodiments of the present invention. The user terminal 20 has the same or similar functions and configuration as the user terminal 30. Each block in Figure 2 and subsequent block diagrams may be implemented by hardware elements such as a computer CPU or mechanical devices, and by software such as computer programs. Functional blocks may be implemented by the coordinated operation of these elements. Therefore, it will be understood by those skilled in the art that these functional blocks can be implemented in various forms by combinations of hardware and software.

[0018] The broadcaster (LV) and the viewer (AU) may download a live streaming application program (hereinafter referred to as the live streaming application) from a download site via the network (NW) and install it on the user terminals 20 and 30. Alternatively, the live streaming application may be pre-installed on the user terminals 20 and 30. When the live streaming application is executed on the user terminals 20 and 30, the user terminals 20 and 30 communicate with the server 10 via the network (NW) and implement or execute various functions. Hereinafter, the functions implemented by the user terminals 20 and 30 (processors such as CPUs) on which the live streaming application is executed will be described as the functions of the user terminals 20 and 30. These functions are actually realized by the live streaming application on the user terminals 20 and 30. In some embodiments, these functions may be written in a programming language such as HTML (HyperText Markup Language), sent from the server 10 via the network (NW) to the web browser of the user terminals 20 and 30, and implemented by a computer program executed by the web browser.

[0019] The user terminal 30 includes a distribution unit 100 and a viewing unit 200. The distribution unit 100 generates video data in which the video and audio of the user (or the user's side) are recorded, and provides the video data to the server 10. The viewing unit 200 receives the video data from the server 10 and plays the video data. The user activates the distribution unit 100 when performing a live stream, and activates the viewing unit 200 when viewing the video. The user terminal on which the distribution unit 100 is activated is the streamer's terminal, i.e., the user terminal that generates the video data. The user terminal on which the viewing unit 200 is activated is the viewer's terminal, i.e., the user terminal on which the video data is reproduced and played.

[0020] The distribution unit 100 includes an imaging control unit 102, an audio control unit 104, a video transmission unit 106, and a broadcaster-side UI control unit 108. The imaging control unit 102 is connected to a camera (not shown in Figure 2) and controls the imaging performed by the camera. The imaging control unit 102 acquires image data from the camera. The audio control unit 104 is connected to a microphone (not shown in Figure 2) and controls the audio input from the microphone. The audio control unit 104 acquires audio data from the microphone. The video transmission unit 106 transmits video data, including the image data acquired by the imaging control unit 102 and the audio data acquired by the audio control unit 104, to the server 10 via the network NW. The video data is transmitted in real time by the video transmission unit 106. In other words, the generation of the video data by the imaging control unit 102 and the audio control unit 104, and the transmission of the generated video data by the video transmission unit 106, are performed substantially simultaneously. The broadcaster-side UI control unit 108 controls the broadcaster's UI (user interface). The broadcaster-side UI control unit 108 may be connected to a display (not shown in Figure 2), and by playing the video data transmitted by the video transmission unit 106, it displays video on the display. The broadcaster-side UI control unit 108 may display operation objects and instruction permission objects on the display and accept input from the broadcaster by tapping these objects.

[0021] The viewing unit 200 includes a viewer-side UI control unit 202, an overlay information generation unit 204, and an input information transmission unit 206. The viewing unit 200 receives video data related to live streaming from the server 10 via the network NW, in which the broadcaster, the viewer (a user of the user terminal 30), and other viewers participate. The viewer-side UI control unit 202 controls the viewer's UI. The viewer-side UI control unit 202 is connected to a display and a speaker (not shown in Figure 2), and plays the received video data to display the video on the display and output sound from the speaker. The state in which the video is output to the display and the sound is output from the speaker can be called the state in which "video data is being played". The viewer-side UI control unit 202 is also connected to input means such as a touch panel, keyboard, and display (not shown in Figure 2), and acquires user input via these input means. The overlay information generation unit 204 overlays a predetermined frame image onto the image generated from the video data from the server 10. The frame image includes various user interface objects (hereinafter simply referred to as "objects") for receiving input from the user, comments entered by the viewer, and / or information obtained from the server 10. The input information transmission unit 206 transmits the user input obtained by the viewer-side UI control unit 202 to the server 10 via the network NW.

[0022] Figure 3 shows a block diagram illustrating the functions and configuration of the server 10 in Figure 1, based on some embodiments of the present invention. The server 10 includes a distribution information provision unit 302, a relay unit 304, a gift processing unit 306, a payment processing unit 308, a stream DB 310, a user DB 312, a gift DB 314, an acquisition unit 320, a processing unit 322, a request DB 332, a content DB 334, and a machine learning DB 336. The server 10 communicates with one or more platform servers.

[0023] When the broadcaster receives a notification or request to start a live stream from the user terminal 20 via the network NW, the broadcast information provision unit 302 registers the stream ID for identifying the live stream and the broadcaster ID of the broadcaster performing the live stream in the stream DB 310.

[0024] When the distribution information provision unit 302 receives a request for information regarding live streaming from the viewing unit 200 of the user terminal 30 on the viewer side via the network NW, the distribution information provision unit 302 retrieves or checks currently available live streaming from the stream DB 310 and creates a list of available live streaming. The distribution information provision unit 302 sends the created list to the requesting user terminal 30 via the network NW. The viewer-side UI control unit 202 of the requesting user terminal 30 generates a live streaming selection screen based on the received list and displays it on the user terminal 30's display.

[0025] When the input information transmission unit 206 of the user terminal 30 receives the viewer's selection result on the live streaming selection screen, the input information transmission unit 206 generates a distribution request including the stream ID of the selected live streaming and sends the request to the server 10 via the network NW. The distribution information provision unit 302 starts providing the live streaming specified by the stream ID included in the received distribution request to the requesting user terminal 30. The distribution information provision unit 302 updates the stream DB 310 to include the user ID of the viewer of the requesting user terminal 30 in the viewer ID of the stream ID (or the corresponding viewer ID).

[0026] The relay unit 304 relays the video data from the broadcaster's user terminal 20 to the viewer's user terminal 30 in the live stream initiated by the distribution information provision unit 302. During the live stream or playback of the video data, the relay unit 304 receives a signal from the input information transmission unit 206 representing user input from the viewer. The signal representing user input may be an object designation signal that specifies an object displayed on the user terminal 30's display. The object designation signal may include the viewer's viewer ID, the broadcaster ID of the broadcaster of the live stream being viewed by the viewer, and an object ID that identifies the object. If the object is a gift, the object ID is the gift ID. Similarly, the relay unit 304 receives a signal from the distribution unit 100 of the user terminal 20 representing user input made by the broadcaster during playback of the video data (or during the live stream). This signal may be an object designation signal.

[0027] Furthermore, the signal representing the user input may also be a comment input signal that includes a comment entered by the viewer into the user terminal 30 and the viewer's viewer ID. Upon receiving the comment input signal, the relay unit 304 transmits the comment and the viewer ID included in the signal to the broadcaster's user terminal 20 and to the user terminals 30 of other viewers. In these user terminals 20 and 30, the viewer-side UI control unit 202 and the overlay information generation unit 204 display the received comment on a display associated with the viewer ID that was also received.

[0028] The gift processing unit 306 updates the user database 312 by increasing the points of the sender based on the points of the gift identified by the gift ID included in the object designation signal. Specifically, the gift processing unit 306 refers to the gift database 314 to identify the points to be awarded for the gift ID included in the received object designation signal. Subsequently, the gift processing unit 306 updates the user database 312 and adds the identified points to the points of the sender ID (or the points corresponding to the sender ID) included in the object designation signal.

[0029] The payment processing unit 308 processes payment for a gift from a viewer in response to receiving the object designation signal. Specifically, the payment processing unit 308 refers to the gift database 314 to identify the price points of the gift, which are identified by the gift ID included in the object designation signal. The payment processing unit 308 then updates the user database 312 and subtracts the identified price points from the points of the viewer, which are identified by the viewer ID included in the object designation signal.

[0030] Figure 4 is a table showing an exemplary data structure of the Stream DB 310 in Figure 3. The Stream DB 310 holds information about the live stream currently in progress. The Stream DB 310 stores the Stream ID, Streamer ID, and Viewer ID in relation to each other. The Stream ID is an ID used to identify a live stream on the live streaming platform provided by the Live Streaming System 1. The Streamer ID is a user ID used to identify the streamer providing the live stream. The Viewer ID is a user ID used to identify the viewer of the live stream. In some embodiments of the Live Streaming System 1, when a user starts a live stream, that user becomes a streamer, and when the same user watches a live stream broadcast by another user, that user also becomes a viewer. Therefore, the distinction between streamer and viewer is not fixed, and a user ID that is registered as a streamer ID at one time may be registered as a viewer ID at another time.

[0031] Figure 5 is a table showing an exemplary data structure of the user DB 312 in Figure 3. The user DB 312 holds information about users. The user DB 312 stores the user ID and the points in relation to each other. The user ID identifies the user. The points correspond to the points held by the corresponding user. The points are electronic value that circulates within the live streaming platform. In some embodiments, when a streamer receives a gift from a viewer during a live stream, the streamer's points increase by the value corresponding to the gift. The points are used, for example, to determine the amount of compensation (such as money) that the streamer receives from the administrator of the live streaming platform. In some embodiments, when the streamer receives a gift from a viewer, the amount corresponding to the gift may be awarded instead of points.

[0032] Figure 6 is a table showing an exemplary data structure of the gift DB314 in Figure 3. The gift DB314 holds information about gifts that viewers can use during the live stream. Gifts are electronic data. Gifts may be purchased with points or money, or they may be provided free of charge. Viewers can send gifts to the streamer. Sending a gift to a streamer is also called using a gift, sending a gift, or throwing a gift. Some gifts can be used immediately after purchase, while others can be used later by the viewer at any time after purchase. When a viewer sends a gift to a streamer, the streamer is awarded a corresponding amount of points. When a gift is used, an effect related to that gift may occur. For example, an effect (such as a visual or auditory effect) corresponding to the gift may be displayed on the live stream screen.

[0033] The gift database 314 stores the gift ID, awarded points, and price points in an associated manner. The gift ID is used to identify the gift. The awarded points are the amount of points awarded to the streamer when a gift is sent to them. The price points are the amount of points paid for the use (purchase) of the gift. Viewers can send a desired gift to a streamer by paying the price points for the desired gift while watching a live stream. Payment of the price points can be made by any appropriate electronic payment method. For example, payment may be made by the viewer paying the price points to the administrator. Alternatively, payment may be made by bank transfer or credit card. The administrator can arbitrarily set the relationship between the awarded points and the price points. For example, it may be set so that awarded points = price points. Alternatively, the price points may be set by multiplying the awarded points by a predetermined coefficient such as 1.2, or by adding a predetermined fee point to the awarded points.

[0034] The machine learning database 336 may store various machine learning models and / or AI models. For example, one or more large language models (LLMs) or generative AI models may be included in the machine learning database 336. The machine learning database 336 may also include video / speech recognition models. In some embodiments, the machine learning database 336 may be implemented outside of the server 10.

[0035] The platform server 350 may include servers that support platforms such as social media platforms (Facebook, Instagram, TikTok, etc.), e-commerce or live commerce platforms, messaging platforms (LINE, WhatsApp, Messenger, etc.), and search platforms (search engines such as Google Search).

[0036] Figure 7 is a table showing an exemplary data structure of User DB312. User DB312 stores User ID, preference data / tags, feature data / tags, and registration environment / platform in an interconnected manner.

[0037] The user ID identifies the user, such as a broadcaster or viewer on a live streaming platform. The preference data / tags store the user's favorite and least favorite items. For example, if the user is a viewer, it could be their favorite and least favorite topics within a live stream room. These items may be determined based on the user's past commenting behavior, gifting behavior, input behavior (such as when they registered on the streaming platform), and topics from past streams. For example, user V1, as a viewer, likes topics about singing, dancing, and hiking, and dislikes topics about cats.

[0038] The feature data / tags store the user's strengths and advantages. For example, these might be topics the user excels at as a streamer. These feature tags may be determined in conjunction with past interaction data such as viewer comment data, gift data, follow data, and share data within the streaming room, based on the user's past performance topics. For example, user D1 excels as a streamer on topics related to singing, cats, workouts, travel, and politics. These preference data and feature data may be determined by the machine learning DB336.

[0039] The registration environment / platform stores the environment or platform to which the user is registered. For example, user V1 is also registered as a user on Facebook, Instagram, and LINE. In some embodiments, the acquisition unit 320 may communicate with the platform server 350 to acquire the registration data. The user's identification data may be used in this communication. In some embodiments, the acquisition unit 320 may communicate with each user's user terminal to acquire the registration data. In some embodiments, related login data (or identification data) may be used between the distribution platform and other platforms. In some embodiments, the user's account used on any of those environment platforms may be used for registration on the live distribution platform.

[0040] Figure 8 is a table showing an exemplary data structure of user DB312. User DB312 stores user ID, profile data, posted data, video clip data, distribution room data, and feature data in an interconnected manner.

[0041] The profile data stores the URL of each user's profile page. The profile page is a space on the distribution platform containing profile information about the user. The post data stores the URL of each user's post page (or database). The post page is a space on the distribution platform containing posts from the user and other users. The video clip data stores the URL of each user's video clip page (or database). The video clip page is a space on the distribution platform containing video clips from the user's distribution. These clips may be generated and / or updated by the user or other users.

[0042] The streaming room data stores the URL of the space where past and / or real-time streaming room data is stored. The streaming room data may store all records related to the streaming room performed by the user as a streamer. For example, this may include performance topics, and video and audio data of the performance. For example, audience interactions and feedback (such as comments, gifts, shares, follows, retention rates, and retention times) may also be included in the streaming room data.

[0043] The processing unit 322 may then use the machine learning database 336 to analyze the data described above and generate the feature data of the user. The streaming room data (or other data) may be real-time changing data, and the feature data may change in real time. For example, suppose D2 has just added a post about working out at the gym. Feature data including "gym" is generated to reflect the latest post. For example, based on video analysis and gift / comment behavior from viewers, the machine learning database 336 detects from the streaming room data that "long legs" is an attractive feature of D2 and includes "long legs" as a feature tag. For example, suppose D3 is streaming while hiking. The machine learning database 336 analyzes the real-time video and generates a feature tag "hiking now" to attract relevant viewers.

[0044] Figure 9 is a table illustrating the exemplary data structure of the request DB332. The request DB332 stores the request ID, publisher ID, recipient ID, distributor ID, target data, environment or platform, and content format in relation to each other.

[0045] The request ID identifies the request to display content in the corresponding environment (or platform). The publisher ID identifies the publisher that initiates or triggers the request in that environment. The recipient ID identifies the user who receives or can access the requested content in that environment. In some embodiments, the publisher and recipient are users registered in both the live streaming platform and the environment (or environment platform). The publisher ID and recipient ID are identifiers used in the streaming platform and / or the environment. In some embodiments, the publisher does not have to be a user registered in the streaming platform. In that case, the publisher does not have identifiers in the streaming platform.

[0046] The streamer ID identifies the streamer on the streaming platform whose data was requested by the request in that environment. The target data identifies which data (or data type) about the streamer was requested by the request, which may be the data from which the displayed content is generated. For example, the data type "Live Stream" indicates that the requested content will be generated based on the streamer's live stream data. For example, the data type "Profile Page" indicates that the requested content will be generated based on the streamer's profile page or profile database. For example, the data type "Clip Archive" indicates that the requested content will be generated based on the streamer's clip archive page or clip database.

[0047] The environment (or environment identification data) indicates the environment or environment platform from which the request was initiated. The content format indicates the format in which the requested content will be displayed. For example, “Post content” may indicate that the requested content will be displayed as post content along with a post (posted by the publisher) on Facebook. For example, “Search results” may indicate that the requested content will be displayed as search results or SEO metadata related to a search operation (by the publisher) on Google Search. For example, “Preview with shared link” may indicate that the requested content will be displayed as preview content along with a link shared (by the publisher) within a LINE chat room.

[0048] For example, request rq1 is initiated by a posting operation by user V1 on Facebook. V1 may post the URL of broadcaster D1's live streaming room on Facebook. To display the content (such as preview content or SEO metadata for search operations) related to that URL, Facebook sends request rq1 to server 10 (or retrieval unit 320) and requests the content to be displayed. The request may include data in the request DB 332 as described above so that server 10 can generate the requested content.

[0049] In some embodiments, the environment platform may not need to know the recipient's identity, and the request may not need to include the recipient ID. The acquisition unit 320 may refer to the user DB 312 and obtain the recipient ID based on the environment.

[0050] In some embodiments, the request from the environment platform may include the recipient's identification information. For example, when a request is initiated on the environment platform, the environment platform may first access the recipient's user terminal to obtain identification information (such as cookies, tokens, or sessions) that the distribution platform can recognize, and then send this identification information along with the request to the distribution platform. For example, when V2 shares a link about broadcaster D1's live stream on the LINE chat platform (V4 and V7 are members of the chat room), request rq4 is initiated. Subsequently, the LINE server accesses the user terminals of V4 and V7 to obtain their respective identification information and then sends it to server 10 so that the distribution platform can identify the recipient.

[0051] In some embodiments, the environment platform and the distribution platform may share the same or related user identification information. For example, a user may register with the distribution platform using an account on the environment platform (such as a Google account, Facebook account, or LINE account). In this case, the environment platform can include each recipient's identification information in the requests sent to the distribution platform without needing to access the recipient's user terminal.

[0052] Figure 10 is a table showing an example of the content data structure of Content DB334. Content DB334 stores the request ID, recipient, distributor ID, target data, environment, collective preference data, and collective display content (SEO data) in an interrelated manner.

[0053] The collective preference data may be generated, for example, by the machine learning DB336 based on the preference data of each recipient. In some embodiments, the favorite items in the collective preference data may be the set of favorite items among the recipients minus the set of disliked items among the recipients. In some embodiments, the disliked items in the collective preference data may be the set of disliked items among the recipients.

[0054] The aggregate display content (SEO metadata) may be generated, for example, by the machine learning DB336, based on the aggregate preference data and the distributor's data (such as feature data and other data as described with reference to Figure 8). Similarity matching processes and similarity processes may be included to generate content that is more likely to attract the aggregate audience that can access the content. The audience may then select / click the content / URL (which may be a post, a shared link, a search result, etc.) to access targeted data (which may be a live stream, a profile page, a clip archive, a live sales page, etc.).

[0055] The collective display content may conform to the “content format” specified in the request (see Figure 9) and may include various tags such as “title,” “description,” and “keywords.” This content may be used, for example, as SEO metadata in search operations related to the distributor in Google Search. This content may also be used, for example, as preview / recommendation data in posting / sharing operations related to the distributor on social media platforms, messaging platforms, and e-commerce platforms.

[0056] In some embodiments, different data (see, for example, Figure 8) may be weighted differently in the generation of feature data about the broadcaster based on the target data of the request. For example, if the target data of the request is about live streaming, live streaming data may be assigned a higher weight in the generation of the broadcaster's feature data.

[0057] For example, as shown in Figure 8, if a user posts / shares the URL of a live stream by broadcaster D1 on Facebook, the data for that stream room may be given higher weight in generating feature data about that broadcaster. This feature data may then be used together with the collective preference data of the viewer on Facebook to generate content that appears in (or with) the post. The viewer may be attracted to this content and be more likely to click and enter the stream room. The weighting mechanism can improve the correlation between the generated content and the purpose of the publisher's posting operation. The weighting mechanism can improve the correlation between the generated content and the actual data that the recipient sees after clicking.

[0058] As shown in Figures 9 and 10, request rq1 is initiated by a posting operation by V1 on Facebook. The recipients on Facebook are V1, V4, and V7. Based on their respective preference data (Figure 7), the collective preference data is determined to be [Likes: Singing, Dancing, Hiking, Traveling, Sports; Dislikes: Cats, Politics]. In this embodiment, the set of collective likes is [Set of each recipient's likes] - [Set of each recipient's dislikes]. The set of collective dislikes is determined to be [Set of each recipient's dislikes]. Subsequently, the collective display content is generated based on the recipient's collective preference data and the characteristic data of distributor D1. In this embodiment, the intersection or overlap between the favorite items [Singing, Traveling, Workouts (similar to Sports)] in the characteristic data and the preference data is used to generate the collective display content. The disliked items [Cats, Politics] are excluded from the generation of the collective display content, even if some of the items are present in the distributor's characteristic data.

[0059] As shown in Figures 9 and 10, request rq4 is initiated by a sharing operation by V2 in a LINE chat room. The recipients in the chat room are V4 and V7. Based on their respective preference data (Figure 7), the collective preference data is determined to be [likes: singing, travel, sports, cats; dislikes: politics]. In this embodiment, the set of collective favorite items is [set of each recipient's favorite items] - [set of each recipient's disliked items]. The set of collective disliked items is determined to be [set of each recipient's disliked items]. Subsequently, the collective display content is generated based on the recipient's collective preference data and the characteristic data of the broadcaster D1. In this embodiment, the intersection or overlap between the characteristic data and the favorite items [cats, singing, travel, workouts (similar to sports)] in the preference data is used to generate the collective display content. The disliked item [politics] is excluded from the generation of the collective display content.

[0060] As explained, for requests rq1 and rq4, the target data is the same (live stream from broadcaster D1), but the environment and recipients are different, so the aggregated display content may differ. This mechanism can maximize the aggregate click-through rate of recipients.

[0061] Figure 11 is a table showing an example of the content data structure of Content DB334. Content DB334 stores the request ID, recipient, distributor ID, target data, environment, personal preference data, and individual display content (SEO data) in an interrelated manner.

[0062] Unlike the embodiment shown in Figure 10, the embodiment shown in Figure 11 utilizes personal preference data (e.g., by machine learning DB336) to generate individual display content for each recipient. The content displayed to each recipient is more customized and may be more appealing to each recipient. For example, V4's favorite item [cats] will not be excluded from the preference data because V1 dislikes [cats]. Therefore, the characteristic [cats] of streamer D1 may be used to generate content [D1 and her cats are streaming!], which may increase the likelihood of it being clicked by V4. For example, V7's favorite item [politics] will not be excluded from the preference data because V4 dislikes [politics]. Therefore, the characteristic [politics] of streamer D1 may be used to generate content [Listen to her songs and talk about politics!], which may increase the likelihood of it being clicked by V7.

[0063] Figure 12 is a flowchart illustrating an exemplary flow based on some embodiments of the present invention.

[0064] In step S1200, viewer V1 posts the URL of broadcaster D1's live stream on a social media page (such as Facebook, Instagram, or LINE).

[0065] In step S1202, the social media server sends the request rq1 to the server 10 of the distribution platform. The request and data are stored in the request DB332.

[0066] In step S1204, the server 10 identifies the recipient (by using the identification information included in the request or by checking the environment platform), generates the aggregate display content (SEO metadata), and sends the aggregate display content to the social media server. The processing unit 322 may use the machine learning DB 336 to generate the display content based on the recipient's data and the distributor's data.

[0067] In step S1206, the social media server displays the collective display content to the recipient on the social media page, either along with or as part of the post.

[0068] Figure 13 is a schematic diagram showing an example of content display based on a partial embodiment of the present invention.

[0069] At timing t1, V2 posts the URL of broadcaster D1's live stream to Facebook. At timing t2, recipients V1, V4, and V7 can view the collective display content provided by server 10 on Facebook. The collective display content is generated based on the collective preference data of V1, V4, and V7 and the feature data of D1 (see Figure 10, particularly as described in rq1). Therefore, the collective display content includes elements such as songs, travel, and workouts. The display content also includes a preview section. The preview may include images and video clips from the live stream related to the aforementioned elements, such as songs. The processing unit 322 may use the machine learning DB 336 to analyze the live video and determine the images and video clips. The processing unit 322 may use the machine learning DB 336 to generate visual objects related to the aforementioned elements. These visual objects may be included in the images and video clips.

[0070] Figure 14 is a schematic diagram showing an example of content display based on some embodiments of the present invention.

[0071] Figure 14 differs from Figure 13 in that V2 shares the URL of broadcaster D1's live stream in a LINE chat room, and V4 and V7 are recipients (other members in the LINE chat room). Because the recipients are different, even if the shared URL is the same as the URL posted on Facebook in Figure 13, the collective display content will be different from that in Figure 13. As explained with reference to Figure 10 (particularly rq4), the element of "cat" is included as a characteristic feature of the collective display content. The image or video clip in the preview may include a cat. A visual object of a cat may be generated and included in the preview.

[0072] As shown in Figures 13 and 14, both the Facebook and LINE environments send requests to the server 10 that include the identification data of the distributor D1. Because the identification data (included in each request) differs for each environment, the recipients of the requested content differ, and therefore the collective displayed content differs. In some embodiments, the same shared / posted link in different environments may result in different images / video clips in the preview portion due to different recipient profiles / configurations. In some embodiments, the same link shared in different chat rooms / groups on the same social media platform / messaging platform may also result in different preview content due to different members in each chat room / group.

[0073] Figure 15 is a flowchart illustrating an exemplary flow based on some embodiments of the present invention. These embodiments are similar to those described in Figure 11 with reference to rq4.

[0074] In step S1500, V2 posts / shares the URL of broadcaster D1's live stream within a chat room on a messaging platform (such as LINE, WhatsApp, or Messenger).

[0075] In step S1502, the server of the messaging platform sends request rq4 to server 10 along with the personal identification information of each recipient. As described above, this identification information may be data that is mutually recognizable between the distribution platform (server 10) and the messaging platform.

[0076] In step S1504, the server 10 verifies each individual recipient, generates individual display content (SEO metadata) corresponding to the recipient's identification information, and then sends it to the messaging platform server.

[0077] In step S1506, the messaging platform's server displays the individual content for each recipient to each recipient.

[0078] Figure 16 is a schematic diagram showing an example of content display based on some embodiments of the present invention.

[0079] At timing t1, V2 posts a live stream link in the LINE chat room, and V4 and V7 are other chat room members.

[0080] At timing t2, V4 and V7 can see V2's post in the chat room. Note that the content V4 sees (including descriptions and previews) will be different from the content V7 sees, as illustrated with reference to rq4 in Figure 11. This individual (or customized) displayed content (even if the shared link is the same) may increase the click-through rate for each recipient.

[0081] Figure 17 is a flowchart illustrating an exemplary flow based on some embodiments of the present invention.

[0082] In step S1700, V1 searches for broadcaster D1 on the search platform.

[0083] In step S1702, the search server sends request rq3 to server 10 along with the identification information of V1. As described above, this identification information may be data that is mutually recognizable between the distribution platform (server 10) and the search platform.

[0084] In step S1704, server 10 confirms the recipient, generates individual display content (SEO metadata) corresponding to that recipient (V1), and then sends it to the search server.

[0085] In step S1706, the search server displays the individual content on V1 on the search page.

[0086] Figure 18 is a schematic diagram showing an example of content display based on some embodiments of the present invention.

[0087] Both V4 and V7 search for streamer D1 on the search platform.

[0088] The search server (the server of the search platform) sends each request to server 10 along with its respective identification information. This identification information may be data that is mutually recognizable between the distribution platform (server 10) and the search platform, such as an account on the search platform.

[0089] Server 10 verifies each recipient, generates individual display content (SEO metadata) for each, and sends it to the relevant search server.

[0090] Subsequently, V4 and V7 will see their respective search results, customized based on their individual preference data.

[0091] In some embodiments, after a recipient clicks or selects a link to a live streaming room (such as a link shared on a social media platform or a search result on a search platform), they join the streaming room (on the live streaming platform). The processing unit 322 may notify the broadcaster of the content that is displayed to the recipient before the recipient enters the streaming room, i.e., the content that attracted the recipient and led them to join the streaming room. The processing unit 322 may use the user ID (or recipient ID) to refer to the content DB 334 and determine the content to be displayed.

[0092] Figure 19 shows an example of a notification to a broadcaster based on some embodiments of the present invention. Viewers V4 and V7 enter broadcaster D1's live streaming room. A notification message is displayed to broadcaster D1 that includes the content displayed to V4 (before V4 enters the streaming room) and the content displayed to V7 (before V7 enters the streaming room). In some embodiments, this notification message is only visible to D1.

[0093] As mentioned above, different users will see customized content as search results or preview content with shared links. Streamers may try to meet each viewer's expectations by tailoring their performance topics based on the exact content (or reasons) that will attract each viewer and encourage them to join the stream. For example, when V4 enters the stream, D1 might want to show more of their cat in the stream. For example, when V7 enters the stream, D1 might want to share more of their political opinions.

[0094] In some embodiments, the live streaming platform includes live sales or live e-commerce services. The SEO metadata for the live sales program may be optimized or customized based on the audience profile / configuration in a manner similar to that described above.

[0095] The hardware configuration of the information processing device will be described with reference to Figure 20. Figure 20 is a block diagram showing an example of the hardware configuration of an information processing device based on some embodiments of the present invention. The information processing device 900 shown in the figure can, for example, realize the server 10 and / or the user terminals 20, 30 in some embodiments.

[0096] The information processing device 900 includes a CPU 901, a ROM (read-only memory) 903, and a RAM (random access memory) 905. The information processing device 900 may also include a host bus 907, a bridge 909, an external bus 911, an interface 913, an input device 915, an output device 917, a storage device 919, a drive 921, a connection port 925, and a communication device 929. Furthermore, the information processing device 900 may include an imaging device such as a camera (not shown). In addition to the CPU 901, or in place of the CPU 901, the information processing device 900 may include a DSP (digital signal processor) or an ASIC (application-specific integrated circuit).

[0097] The CPU 901 functions as an arithmetic processing unit and control unit, and controls the operation of all or part of the information processing unit 900 according to various programs stored in the ROM 903, RAM 905, storage device 919, or removable recording medium 923. For example, the CPU 901 controls the overall operation of each functional unit included in the server 10 and the user terminals 20 and 30 in some embodiments. The ROM 903 stores programs and arithmetic parameters used by the CPU 901. The RAM 905 functions as main memory, storing programs used when the CPU 901 is running and parameters that change as appropriate during execution. The CPU 901, ROM 903, and RAM 905 are interconnected by a host bus 907, which may be an internal bus such as a CPU bus. Furthermore, the host bus 907 is connected to an external bus 911 such as a PCI (Peripheral Component Interconnect / Interface) bus via a bridge 909.

[0098] The input device 915 may be a user-operated device such as a mouse, keyboard, touch panel, button, switch, or lever, or a device that converts physical quantities into electrical signals, such as a sound sensor represented by a microphone, an acceleration sensor, a tilt sensor, an infrared sensor, a depth sensor, a temperature sensor, or a humidity sensor. The input device 915 may also be, for example, a remote control device that uses radio waves such as infrared rays, or an external connection device 927 such as a mobile phone that is compatible with the operation of the information processing device 900. The input device 915 includes an input control circuit that generates an input signal based on the information entered by the user or the detected physical quantity and outputs it to the CPU 901. The user inputs various data to the information processing device 900 and instructs its operation by operating the input device 915.

[0099] The output device 917 is a device that can notify the user of acquired information visually or audibly. The output device 917 may be, for example, a display such as an LCD, PDP, or OLED, an audio output device such as a speaker or headphones, or a printer. The output device 917 outputs the processing results from the information processing device 900 as text, images or other visual content, or audio such as sound.

[0100] The storage device 919 is a data storage device and is configured as an example of a storage unit of the information processing device 900. The storage device 919 is, for example, a magnetic storage device such as a hard disk drive (HDD), a semiconductor storage device, an optical storage device, or a magneto-optical storage device. This storage device 919 stores programs executed by the CPU 901, various data, and various data acquired from external sources.

[0101] The drive 921 is a reader / writer for removable recording media 923 such as magnetic disks, optical disks, magneto-optical disks, and semiconductor memory, and is built into or attached to the information processing device 900. The drive 921 reads information recorded on the installed removable recording media 923 and outputs it to the RAM 905. Furthermore, the drive 921 writes data to the installed removable recording media 923.

[0102] The connection port 925 is a port for directly connecting equipment to the information processing device 900. The connection port 925 may be, for example, a USB (Universal Serial Bus) port, an IEEE 1394 port, or a SCSI (Small Computer System Interface) port. Furthermore, the connection port 925 may be an RS-232C port, an optical audio terminal, or an HDMI (High-Definition Multimedia Interface) port. By connecting the external connection device 927 to the connection port 925, various types of data can be exchanged between the information processing device 900 and the external connection device 927.

[0103] The communication device 929 is, for example, a communication interface formed by a communication device for connecting to the network NW. The communication device 929 may be, for example, a communication card for a wired or wireless local area network (LAN), Bluetooth (trademark), or wireless USB (WUSB). Furthermore, the communication device 929 may be a router for optical communication, a router for ADSL (asymmetric digital subscriber line), or a modem for various types of communication. The communication device 929 transmits and receives signals, etc., to and from the Internet or other communication devices using a predetermined protocol such as TCP / IP. The communication network NW connected to the communication device 929 is a network connected by wire or wireless, and may be, for example, the Internet, a home LAN, infrared communication, radio communication, satellite communication, etc. The communication device 929 realizes the function of a communication device.

[0104] The imaging device (not shown) is a device that captures images of real space and generates captured images using an image sensor such as a CCD (charge-coupled device) or CMOS (complementary metal-oxide-semiconductor) and various components such as lenses for controlling the imaging of a subject on the image sensor. The imaging device may capture still images or moving images.

[0105] The configuration and operation of the live streaming system 1 according to this embodiment have been described above. This embodiment is merely one example, and various changes can be made to the combination of each component and each process, and it will be understood by those skilled in the art that such changes are also within the scope of the present invention.

[0106] The processes and procedures described herein can be implemented by software, hardware, or any combination thereof, in addition to those explicitly described. For example, the processes and procedures described herein can be implemented by implementing the logic corresponding to those processes and procedures on a medium such as an integrated circuit, volatile memory, non-volatile memory, non-temporary computer-readable media, or magnetic disk. Furthermore, the processes and procedures described herein can be implemented as computer programs corresponding to those processes and procedures and can be executed by various types of computers.

[0107] Furthermore, the systems or methods described in the above embodiments may be integrated into a program stored on a non-temporary computer-readable medium such as a solid-state memory device, optical disk memory device, or magnetic disk memory device. Alternatively, the program may be downloaded from a server via the Internet and executed by a processor.

[0108] Although the technical content and features of the present invention have been described above, any person with ordinary skill in the art to which the present invention pertains can make many further modifications and alterations without departing from the teachings and disclosures of the present invention. Therefore, the scope of the present invention is not limited to the embodiments already disclosed, but is the scope of the claims, including other modifications and alterations that do not depart from the present invention. [Explanation of Symbols]

[0109] 1. Communication System 10 servers 20 User Terminals 30, 30a, 30b User terminals LV streamer AU1, AU2 viewers VD, VD1, VD2 video NW Network 30 User terminals 100 distribution units 102 Imaging control unit 104 Audio Control Unit 106 Video transmission unit 108 Streamer-side UI control unit 200 viewing units 202 Viewer-side UI control unit 204 Superposition Information Generation Unit 206 Input Information Transmission Unit 302 Distribution Information Provision Unit 304 Relay Unit 306 Gift Processing Unit 308 Payment Processing Unit 310 Stream DB 312 User DB 314 Gift DB 320 units acquired 322 Processing Units 332 Request DB 334 Content Database 336 Machine Learning Database 900 Information Processing Equipment 901 CPU 903 ROM 905 RAM 907 Host Bus 909 Bridge 911 External bus 913 Interface 915 Input device 917 Output device 919 Storage devices 921 Drive 923 Removable recording media 925 connection ports 927 External connection device 929 Communication equipment

Claims

1. A method for displaying content, which is performed by a server, A step of obtaining first streamer identification data relating to a streamer on a live streaming platform and first environment identification data relating to a first environment, A step of generating first content based on the distributor's database and the first environment, A step of providing the first content to the first environment, A method for displaying content, characterized by including the following:

2. Furthermore, the process includes a step of acquiring first recipient identification data for a first recipient corresponding to the first environment described above. The method for displaying content according to claim 1, characterized in that the first content is further generated based on the database of the first recipient.

3. The method for displaying content according to claim 2, characterized in that the first recipient identification data is a registered account, cookie, or session corresponding to the first recipient.

4. The method for displaying content according to claim 2, characterized in that the first environment is a social media platform, the first recipient is a viewer of the live streaming platform and a user of the social media platform, a link corresponding to the broadcaster is shared with the first recipient on the social media platform, and the first content is provided to the first recipient together with the link.

5. moreover, A step of obtaining second recipient identification data for a second recipient corresponding to the first environment described above, A step of generating second content based on the database of the distributor and the database of the second recipient, A step of providing the second content to the first environment, A method for displaying content according to claim 2, comprising the following characteristics: the database of the first recipient is different from the database of the second recipient, and the first content is different from the second content.

6. The first environment described above is a search platform, The aforementioned distributor's database includes characteristic data of the aforementioned distributor. The database of the first recipient includes the preference data of the first recipient, The first content is generated by a machine learning model based on the characteristic data of the distributor and the preference data of the first recipient. The method for displaying content according to claim 2, characterized in that the first content is provided as SEO metadata for search results in response to a search operation performed by the first recipient on the search platform regarding the distributor.

7. The first environment described above is a social media platform, The aforementioned distributor's database includes characteristic data of the aforementioned distributor. The database of the first recipient includes the preference data of the first recipient, The first content is generated by a machine learning model based on the characteristic data of the distributor and the preference data of the first recipient. The method for displaying content according to claim 2, characterized in that the first content is provided as preview data in response to a sharing link relating to the distributor, which is shared with the first recipient on the social media platform.

8. The first environment described above is a live commerce platform, The first content is generated by a machine learning model, The method for displaying content according to claim 1, characterized in that the first content is provided as SEO metadata for preview results in response to a sharing operation about the broadcaster by a user of the live commerce platform.

9. The generation of the first content based on the distributor's database and the first environment is A step of acquiring collective preference data of users registered in both the live streaming platform and the first environment, A step of generating the first content based on the matching result between the distributor's database and the collective preference data, A method for displaying content according to claim 1, characterized by including the following:

10. moreover, A step of obtaining second broadcaster identification data relating to the broadcaster of the live streaming platform and second environment identification data relating to the second environment, A step of generating second content based on the aforementioned distributor's database and the second environment, A step of providing the second content to the second environment, A method for displaying content according to claim 1, characterized in that the first environment is different from the second environment, and the first content is different from the second content.

11. A method for displaying content according to claim 10, characterized in that the first content is generated based on user preference data in the first environment, and the second content is generated based on user preference data in the second environment.

12. The method for displaying content according to claim 11, characterized in that the first content and the second content include different clip data of the broadcaster's live stream.

13. A method for displaying content according to claim 11, characterized in that the first content includes a first visual object corresponding to user preference data in the first environment, and the second content includes a second visual object corresponding to user matter data in the second environment, wherein the first visual object is different from the second visual object.

14. The method for displaying content according to claim 1, characterized in that the distributor's database includes data within the distributor's distribution room.

15. The method for displaying content according to claim 14, characterized in that the distribution room is a live distribution room, the data is real-time changing data, and the first content changes in real time.

16. moreover, A step of obtaining a selection signal relating to the first content from the first receiver, The process of providing the broadcaster's live stream to the first recipient, The process of notifying the broadcaster of the first recipient and the first content within the live broadcast, A method for displaying content according to claim 2, characterized by including the following:

17. A system for displaying content, comprising one or more processors, wherein one or more processors execute machine-readable instructions. A step of obtaining first streamer identification data relating to a streamer on a live streaming platform and first environment identification data relating to a first environment, A step of generating first content based on the distributor's database and the first environment, A step of providing the first content to the first environment, A system for displaying content, characterized by performing the following:

18. A non-temporary computer-readable medium containing a program for displaying content, wherein the program is installed on one or more computers. A step of obtaining first streamer identification data relating to a streamer on a live streaming platform and first environment identification data relating to a first environment, A step of generating first content based on the distributor's database and the first environment, A step of providing the first content to the first environment, A computer-readable medium characterized by causing the execution of a certain action.

Images