Server, method and computer program

The server system efficiently manages stream categories in live streaming platforms by dynamically adding, updating, or deleting them, addressing the complexity of managing increasing stream numbers.

JP2024162965AInactive Publication Date: 2024-11-2117LIVE JAPAN INC
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023178575
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-10-17
Publication Date
2024-11-21
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Managing stream categories in live streaming platforms becomes complex as the number of streams increases, requiring complicated procedures for updates and cancellations.

Method used

A server system that includes processors to manage streams by determining and adding them to categories based on matching criteria, allowing dynamic addition, update, or deletion of categories without complex procedures.

Benefits of technology

Facilitates efficient and dynamic management of stream categories, improving the quality of live streaming platforms by simplifying category maintenance.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024162965000001_ABST
    Figure 2024162965000001_ABST
Patent Text Reader

Abstract

To provide a server, a method and a computer program for efficiently and effectively managing categories of streams in a live streaming platform.SOLUTION: In a live streaming system to provide a live streamer and a viewer with a live streaming service to interact mutually in real time, a server has: a function of receiving a first stream from a user terminal of a user; a function of determining whether the first stream satisfies a first category; and a function of adding the first stream to the first category in response to the first stream matching the first category. The invention facilitates generating and maintaining a category of streams, and further makes it possible to dynamically add, update, modify or delete the category of the streams without any complicated procedure.SELECTED DRAWING: Figure 8
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to information and communication technology, and in particular to a server, a method, and a computer program for live streaming. [Background technology]

[0002] Some apps and platforms offer live streaming services that allow streamers and viewers to interact with each other, with streamers sometimes performing cheerleading routines for their viewers and viewers sometimes sending gifts to show their support for streamers.

[0003] In order to allow viewers to access streamers that interest them, streams are always classified into different categories, allowing viewers to focus on the categories they are interested in. Patent Document 1 discloses a method for classifying streams into categories according to feature indexes.

[0004] However, as the number of streams increases, it is becoming difficult to maintain stream categories. In addition, managing categories while responding to stream updates and discontinuations always requires complex procedures. For this reason, how to manage stream categories more efficiently and effectively has become a very important issue. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] China Patent Application Publication No. 114268839 Summary of the Invention

[0006] A server for managing streams in a live streaming platform according to one embodiment of the present disclosure includes one or more processors, the one or more processors executing machine-readable instructions to perform functions of receiving a first stream from a user terminal of a user, determining whether the first stream satisfies a first category, and adding the first stream to the first category in response to the first stream matching the first category.

[0007] A method for managing streams in a live streaming platform according to another embodiment of the present disclosure includes receiving a first stream from a user terminal of a user, determining whether the first stream satisfies a first category, and adding the first stream to the first category in response to the first stream matching the first category.

[0008] A computer program according to yet another embodiment of the present disclosure causes a server to perform the following functions: receiving a first stream from a user terminal of a user; determining whether the first stream satisfies a first category; and adding the first stream to the first category in response to the first stream matching the first category. Effect of the Invention

[0009] According to the embodiment of the present disclosure, the categories of the streams are easily generated and maintained, and the categories of the streams can be dynamically added, updated, modified or deleted without complicated procedures, thus improving the quality of the streams on the live streaming platform. [Brief description of the drawings]

[0010] [Figure 1] 1 is a schematic diagram showing a configuration of a live streaming system 1 based on some embodiments of the present disclosure. [Diagram 2] FIG. 2 is a block diagram of a user terminal 20 according to some embodiments of the present disclosure. [Diagram 3] FIG. 1 is a block diagram of a server 10 according to some embodiments of the present disclosure. [Figure 4] 4 is a table showing an example data structure of the stream DB 320 of FIG. 3. [Diagram 5] 4 is a table showing an example data structure of the user DB 322 of FIG. 3. [Figure 6] 4 is a table illustrating an example data structure of the filter DB 324 of FIG. 3. [Figure 7] 4 is a table showing an example data structure of the category DB 326 of FIG. 3. [Figure 8] 1 is a schematic diagram showing an example of a functional configuration of a live streaming system 1 based on some embodiments of the present disclosure. [Figure 9] 6 is an exemplary screen image of a live streaming room screen 600 displayed on the display of a viewer's user terminal 30. [Figure 10] 6 is an exemplary screen image of a live streaming room screen 600 displayed on the display of a viewer's user terminal 30. [Figure 11] 1 is an exemplary sequence diagram showing the operation of a configuration of a live streaming system 1 based on some embodiments of the present disclosure. [Figure 12] 1 is an exemplary sequence diagram showing the operation of a configuration of a live streaming system 1 based on some embodiments of the present disclosure. [Figure 13] 1 is an exemplary sequence diagram showing the operation of a configuration of a live streaming system 1 based on some embodiments of the present disclosure. [Figure 14] 1 illustrates an exemplary hardware configuration of an information processing device based on some embodiments of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, the same or similar components, parts, steps, or signals shown in each drawing will be denoted by the same reference numerals in all drawings, and duplicated explanations will be omitted as appropriate. In addition, some parts that are not important in the explanation of each drawing will be omitted.

[0012] The live streaming system 1 according to some embodiments of the present disclosure provides enhanced functionality to facilitate communication and interaction between users, and more specifically, to entertain viewers and streamers in a technological manner.

[0013] FIG. 1 is a schematic diagram showing a configuration of a live streaming system 1 according to some embodiments of the present disclosure. The live streaming system 1 provides a live streaming service for streaming streamers (also called live distributors or streamers) LV and viewers (also called audiences) AU (AU1, AU2...) to interact with each other in real time. As shown in FIG. 1, the live streaming system 1 may include a server 10, a user terminal 20, and a user terminal 30 (30a, 30b...). The user terminal 20 may be a streamer, and the user terminal 30 may be a viewer. In some embodiments, the streamer and the viewer may be called users.

[0014] The server 10 may include one or more information processing devices connected via a network NW. The user terminals 20 and 30 may be, for example, mobile terminals such as smartphones, tablets, notebook PCs, recorders, portable game consoles, and wearable terminals, or stationary computers such as desktop PCs. The server 10, the user terminals 20, and the user terminals 30 may be communicatively connected via any type of wired or wireless network NW.

[0015] The live streaming system 1 involves the streamer LV, the viewer AU, and an app provider (not shown) that provides the server 10. The streamer LV can record content such as his / her own singing, talking, performance, game streaming, etc. on his / her user terminal 20 and upload it to the server 10, thereby distributing the content in real time. In some embodiments, the streamer LV can interact with the viewer AU through the live streaming.

[0016] The app provider may provide a platform for content to be live streamed on the server 10. In some embodiments, the app provider may be a media or manager that manages real-time communication between the streamer LV and the viewer AU. The viewer AU may access the platform through the user terminal 30 and select and view the content that the viewer AU wants to view. The viewer AU may perform operations to interact with the streamer, such as commenting on the streamer or cheering on the streamer, through the user terminal 30. The streamer providing the content may respond to the comments or cheers. The streamer's response may be transmitted to the viewer AU by video and / or audio. Thus, mutual communication between the streamer and the viewer may be achieved.

[0017] As used herein, "live streaming" may refer to data transmission that enables the viewer AU to substantially play and view the content recorded by the streamer LV via the user terminal 20 via the user terminal 30. In some embodiments, "live streaming" may refer to streaming realized by the above-mentioned data transmission. The live streaming may be realized by known technologies such as HTTP live streaming, CMAF (Common Media Application Format), WebRTC (Web Real-Time Communications), RTMP (Real-Time Messaging Protocol), and MPEG DASH.

[0018] The live streaming may further include an embodiment in which the viewer AU can play or watch the content with a certain delay while the streamer is recording the content. The degree of the delay is preferably small enough to at least allow the streamer LV and the viewer AU to communicate with each other. However, live streaming is different from so-called on-demand delivery. More specifically, the on-demand delivery may refer to storing all data of the recorded content in a server and providing the data to the user from the server at random times in response to a user's request.

[0019] In this specification, "streaming data" may refer to data including image data and audio data. More specifically, the image data (which may be referred to as video data) may be generated by an image capture function of the user terminals 20 and 30. The audio data (which may be referred to as audio data) may be generated by an audio input function of the user terminals 20 and 30. The streaming data may be played on the user terminals 20 and 30 to enable viewing of content related to the user. In some embodiments, processing such as compression, expansion, encoding, decoding, transcoding, and the like to change the format, size, and standard of data is assumed between the time when the streaming data is generated on the user terminal of the streamer and the time when it is played on the user terminal of the viewer. Before and after such processing, the content (video and audio) is not substantially changed, and therefore, in the current embodiment of the present disclosure, the streaming data before processing and the streaming data after processing are described as being the same. In other words, when the streaming data generated by the user terminal of the streamer is played back on the user terminal of the viewer via the server 10, the streaming data generated by the user terminal of the streamer, the streaming data that has passed through the server 10, and the streaming data received and played back by the user terminal of the viewer are all the same streaming data.

[0020] As shown in Fig. 1, a streamer LV provides live streaming. A user terminal 20 of the streamer generates streaming data by recording the video and / or audio of the streamer, and transmits the streaming data to a server 10 via a network NW. At the same time, the user terminal 20 displays the video VD on the display of the user terminal 20, so that the user can check the streaming content of the streamer LV.

[0021] The viewers AU1, AU2 of the user terminals 30a, 30b that request the platform to provide live streaming of the streamer can receive streaming data corresponding to the live streaming via the network NW, play the received streaming data to display the videos VD1, VD2 on a display, and output the audio from a speaker, etc. The videos VD1, VD2 displayed on the user terminals 30a, 30b, respectively, are substantially the same as the videos recorded by the user terminals of the streamer LV, and the audio output from the user terminals 30a, 30b is substantially the same as the audio recorded by the user terminals of the streamer LV.

[0022] The recording at the user terminal 20 of the streamer may be simultaneous with the playback of the streaming data at the user terminals 30a, 30b of the viewers AU1, AU2. When the viewer AU1 inputs a comment on the content of the streamer LV to the user terminal 30a, the server 10 displays the comment in real time on the user terminal 20 of the streamer, and also on the user terminals 30a, 30b of the viewers AU1, AU2. When the streamer LV responds to the comment, the response is output as text, image, video, or audio from the user terminals 30a, 30b of the viewers AU1, AU2, thereby realizing communication between the streamer LV and the viewers AU1, AU2. Thus, the live streaming system can realize two-way live streaming.

[0023] 2 is a block diagram showing the functions and configuration of the user terminal 20 shown in FIG. 1 according to an embodiment of the present disclosure. The user terminal 30 has the same functions and configuration as the user terminal 20. The blocks depicted in the block diagrams in this specification are implemented by hardware such as a device or mechanical part, such as a computer CPU, and software such as a computer program that represents functional blocks implemented by the cooperation of these elements. Therefore, it will be understood by those skilled in the art that the functional blocks can be implemented in various ways by combining hardware and software.

[0024] The streamer LV and the viewer AU can download and install the live streaming application (live streaming app) of the present disclosure from a download site to the user terminals 20 and 30 via the network NW. Alternatively, the live streaming app may be pre-installed in the user terminals 20 and 30. By executing live streaming by the user terminals 20 and 30, the user terminals 20 and 30 can communicate with the server 10 via the network NW and realize a plurality of functions. The functions realized by executing the live streaming app by the user terminals 20 and 30 (more specifically, a processor such as a CPU) are described below as functions of the user terminals 20 and 30. The functions are basically functions that the live streaming app causes the user terminals 20 and 30 to realize. In some embodiments, these functions may be realized by transmitting them from the server 10 to the web browsers of the user terminals 20 and 30 via the network NW and executing them by a computer program of the web browser. The computer program may be written in a programming language such as HTML (Hyper Text Markup Language).

[0025] The user terminal 20 includes a streaming unit 100 and a viewing unit 200. In some embodiments, the streaming unit 100 is configured to record a user's audio and / or video data and generate streaming data to send to the server 10. The viewing unit 200 is configured to receive and play streaming data from the server 10. In some embodiments, a user can activate the streaming unit 100 at the time of a broadcast or activate the viewing unit 200 when viewing a stream. In some embodiments, the user terminal that activates the streaming unit 100 can be referred to as a streamer or the user terminal that generates streaming data. The user terminal that activates the viewing unit 200 can be referred to as a viewer or the user terminal that plays the streaming data.

[0026] The streaming unit 100 may include a video control unit 102, an audio control unit 104, a distribution unit 106, and a UI control unit 108. The video control unit 102 may be connected to a camera (not shown), and the video is controlled by the camera. The video control unit 102 can obtain the video data from the camera. The audio control unit 104 may be connected to a microphone (not shown), and the audio is controlled by the microphone. The audio control unit 104 can obtain the audio data from the microphone.

[0027] The delivery unit 106 receives streaming data including video data from the video control unit 102 and audio data from the audio control unit 104 and transmits the streaming data to the server 10 via the network NW. In some embodiments, the delivery unit 106 transmits the streaming data in real time, i.e., the generation of the streaming data from the video control unit 102 and the audio control unit 104 and the delivery by the delivery unit 106 are performed simultaneously.

[0028] The UI control unit 108 controls the UI of the streamer. The UI control unit 108 is connected to a display (not shown) and configured to generate the streaming data for the distribution unit 106 to transmit, play and display on the display. The UI control unit 108 is configured to display an object to be operated or to receive an instruction on the display and to receive a tap input from the streamer.

[0029] The viewing unit 200 may include a UI control unit 202, a rendering unit 204, and an input sending unit 206. The viewing unit 200 is configured to receive streaming data from the server 10 via a network NW. The UI control unit 202 controls the UI of the viewer. The UI control unit 202 is connected to a display (not shown) and / or a speaker (not shown) and configured to display a video on the display and output a sound from the speaker by playing the streaming data. In some embodiments, outputting a video on the display and outputting a sound from the speaker may be referred to as "playing streaming data". The UI control unit 202 is connected to an input unit such as a touch panel, a keyboard, a display, etc., and can obtain input from a user.

[0030] The rendering unit 204 may be configured to render streaming data from the server 10 and frame images. The frame images may include user interface objects for accepting input from a user, comments entered by a viewer, and data received from the server 10. The input sending unit 206 is configured to receive the user input from the UI control unit 202 and send it to the server 10 via the network NW.

[0031] In some embodiments, the user input may be clicking an object on the screen of the user terminal, such as selecting a live broadcast, entering a comment, sending a gift, following or unfollowing a user, voting in an event, playing a game, etc. For example, the input sending unit 206 may generate gift information and send it to the server 10 via the Internet NW when the user terminal of a viewer clicks a gift object on the screen to send a gift to a streamer.

[0032] 3 is a block diagram of the server 10 according to some embodiments of the present disclosure. The server 10 may include a streaming information unit 302, a relay unit 304, a filtering unit 306, a matching unit 308, a processing unit 310, a stream DB 320, a user DB 322, a filter DB 324, and a category DB 326.

[0033] The streaming information unit 302 receives a request for live streaming from the user terminal 20 of the streamer via the network NW. Upon receiving the request, the streaming information unit 302 registers information of the live streaming in the stream DB 320. In some embodiments, the information of the live streaming may be a stream ID of the live streaming and / or a streamer ID of the streamer corresponding to the live streaming.

[0034] When a request for the information of the live streaming is received from the viewer via the network NW from the viewing unit 200 of the user terminal 30, the streaming information unit 302 refers to the stream DB 320 and generates a list of available live streaming.

[0035] Then, the streaming information unit 302 transmits the list to the user terminal 30 via the network NW. The UI control unit 202 of the user terminal 30 generates a live streaming selection screen based on the list, and displays the list on the display of the user terminal 30.

[0036] When the input sending unit 206 of the user terminal 30 receives the selection of live streaming by the viewer on the live streaming selection screen, it generates a delivery request including the stream ID of the selected live streaming and sends it to the server 10 via the network. The streaming information unit 302 can start providing the live streaming specified by the stream ID in the delivery request to the user terminal 30. The streaming information unit 302 can update the stream DB 320 and add the viewer ID of the viewer of the user terminal 30 to the streamer ID of the stream ID.

[0037] The relay unit 304 can relay the transmission of live streaming from the user terminal 20 of the streamer to the user terminal 30 of the viewer in the live streaming started by the streaming information unit 302. The relay unit 304 can receive a signal indicating a user input from the viewer from the input transmission unit 206 during playback of streaming data. The signal indicating the user input may be an object designation signal indicating designation of an object to be displayed on the display of the user terminal 30. The object designation signal may include a viewer ID of the viewer, a streamer ID of a streamer distributing the live streaming that the viewer is watching, and an object ID designated by the object. If the object is a gift or the like, the object ID may be a gift ID or the like. Similarly, the relay unit 304 can receive a signal indicating a user input of the streamer, such as the object designation signal, from the streaming unit 100 of the user terminal 20 during playback of streaming data.

[0038] The filtering unit 306 is configured to filter the raw stream by category. More specifically, the filtering unit 306 may determine whether the raw stream matches a category, etc. The filtering unit 306 may include multiple filters. Each filter F may, for example, include a category and a mapping function for mapping the raw stream to the corresponding category.

[0039] The matching unit 308 is configured to match the raw stream to a corresponding category in the category DB 326. The matching unit 308 may add, update, modify or delete the raw stream from the category in the category DB 326 based on the output from the filtering unit 306. In some embodiments, the output may be a match list, etc. Once the raw stream is filtered by the corresponding category, the filtering unit 306 may obtain information of a filter F, such as “category” and “filter ID”, and generate a matching between the raw stream and the category. The matching unit 308 may further generate a corresponding category and add the raw stream to the category based on the matching between the raw stream and the category.

[0040] The processing unit 310 is configured to provide the streams to the user based on the category of the streams. In response to a request for a stream from a viewer, the processing unit 310 may retrieve the streams, aggregate the streams of a particular category, and dynamically provide them to the user.

[0041] Fig. 4 is a table showing an example data structure of the stream DB 320 in Fig. 3. The stream DB 320 holds information about a live stream currently being performed. The stream DB 320 stores a stream ID for identifying a live broadcast on a live streaming platform provided by the live streaming system 1, a streamer ID for identifying a streamer providing the live broadcast, and a viewer ID for identifying a viewer of the live broadcast, in association with each other.

[0042] In some embodiments, the stream DB 320 may store a "BeginTime" that identifies the time when the streamer started the stream, a "region" that identifies the region to which the stream belongs, a "hashtag" that identifies the category of the stream, and "subtabs" that identify the subcategory of the stream, in association with each other. In some embodiments, the hashtag and subtabs may be determined manually or automatically by the user or the server 10. The server 10 may determine the hashtag and the subtabs by any possible technique, such as machine learning, AI tagging, etc.

[0043] In some embodiments, the stream DB 320 may also store a "Category link" that identifies a raw stream with its corresponding category. More specifically, the category link may be a parameter that indicates a raw stream in the stream DB 320 and its category in the category DB 326. The category link may be in the form of a linked list that includes a sequence of nodes that are linked together. In some embodiments, the category link may be a data structure that links the stream to the category by parameters such as stream ID, category ID, etc.

[0044] In some embodiments, the stream of the stream ID may refer to the category of the category ID in the category DB 326 based on the category link. In some embodiments, the category link may include information of the order of the stream in the category of the category DB 326. For example, the category link may indicate that the stream is the first or second in the category. In some embodiments, the order of the streams in each category may be rearranged, reordered, or inserted with other streams based on the category link. In embodiments, the category, order, or layout of the streams in each category can be easily maintained.

[0045] The category link may be any kind of linked list object, such as a unidirectional linked list, a bidirectional linked list, a multidirectional linked list, etc. For example, the category link may unidirectionally link a stream ID to a category ID. The category link may bidirectionally link a stream ID to a category ID, and a category ID to a stream ID. In an embodiment, the category link may multidirectionally link a stream ID to different nodes in the same category or different categories, etc. In some embodiments, the configuration of the category link may be designed and configured according to actual needs.

[0046] Once the matching unit 308 matches a raw stream with a corresponding category in the category DB 326, the filtering unit 306 may generate a category link based on the match between the stream in the stream DB 320 and the category DB 326. The filtering unit 306 may further store the category link with the stream in the stream DB 320. In some embodiments, the filtering unit 306 or the matching unit 308 may reference the category of the stream based on the category link.

[0047] In some embodiments, if a stream belongs to multiple categories, the stream may include one category link connecting to multiple categories or multiple category links, each connecting to a different category, In some embodiments, the category of a stream may be identified, determined, or referenced based on the category links.

[0048] 5 is a table showing an exemplary data structure of the user DB 322 of FIG. 3. The user DB 322 holds information about users. The user DB 322 stores a user ID for identifying a user, points owned by the user, a level of the user, and a status of the user in a correlated manner. The points are electronic values ​​circulating within the live streaming platform. The level is an indicator of the amount of activity or engagement of the user on the live streaming platform. The status is the identity or membership status of the user on the live streaming platform.

[0049] In some embodiments, the user DB may store a "gender" that identifies the user's gender, a "firstLiveStreamTime" that identifies the start time of the user's first live stream, and a "region" that identifies the user's region, in association with one another. In some embodiments, each parameter of the user may be used to classify the stream based on the attribute of the parameter. For example, a "female" category may be used to store the stream as a "female" gender, and a "level 80 or above" category may be used to store the stream as a level 80 or above.

[0050] Fig. 6 is a table showing an exemplary data structure of the filter DB 324 of Fig. 3. The filter DB 324 holds information about a filter F in the server 10. The filter DB 324 stores a "filter ID" for identifying a filter in the server 10, a "category" for identifying a category of the filter, an "isEnable" parameter for identifying whether the filter is enabled, and a "mappingFunc" function for identifying a function for mapping a stream to a corresponding category, in association with one another.

[0051] In some embodiments, the "mappingFunc" parameter may be used to define a stream with a particular characteristic, which may be realized by coding a function in the server 10. The characteristic may be a particular category, a particular list of users, a particular time period, a particular region, etc. For example, a list of users including user IDs may be generated. In the mapping function, a "user ID" parameter may be used as an indicator to determine whether the user in the stream matches the user ID in the list. In some embodiments, other parameters such as hashtags, user information, time information, region information, etc. may be used as parameters to determine whether the stream matches the category.

[0052] In some embodiments, the filter function may be realized by a service or framework, such as a RESTful API or a gRPC framework, or may be coded by a programming language, such as Golang. The programming logic may, for example, enable the server 10 to register a filter or obtain a list of filters available on the server 10. In some embodiments, the filter function may be realized by any possible means according to actual needs.

[0053] Fig. 7 is a table showing an exemplary data structure of the category DB 326 of Fig. 3. The category DB 326 holds information on the category of the stream in the server 10. In the category, a category ID for identifying the category, a category for identifying the category in the server 10, and a stream ID for identifying the stream belonging to the category are stored in association with each other.

[0054] In some embodiments, the category DB 326 may also store a time to live (TTL) that specifies the life or remaining duration of the stream in a category in the category DB 326. For example, if there is a category called "latest" that contains streams delivered within the last six hours, a "TTL" may be set for the streams such that they will be removed from the category if their delivery time exceeds six hours.

[0055] In some embodiments, the TTL may be in the form of a timestamp indicating the point in time to remove the stream from the category, or a duration indicating the remaining time for the stream to reside in the category, etc. In some embodiments, when a stream is removed from a category based on the TTL, the stream's category link may also be dynamically updated, e.g., removed, from the stream.

[0056] 8 is a schematic diagram showing an example of a functional configuration of a live streaming system 1 according to some embodiments of the present disclosure. As shown in FIG. 8, there may be multiple live streams (R1, R2...) generated in the server 10. Each live stream may include information such as a stream ID, a user ID, a stream start time, a region, and other metadata. In some embodiments, the metadata may include data set by the streamer before or during streaming. For example, the metadata may include military stream settings, topics in a streaming room, and the like.

[0057] The filtering unit 306 may filter each raw stream with each filter F and determine whether the raw stream matches a category of the filter F. In some embodiments, the filtering unit 306 may refer to information related to the stream. For example, the filtering unit 306 may refer to the user DB 322 to obtain a profile of the streamer based on the user ID (or streamer ID) included in the stream information. The filtering unit 306 may obtain information such as the streamer's gender and region from the user DB 322. The information may be further used to filter the stream and match it to a corresponding category.

[0058] When the stream is generated by a streamer, an event checkpoint may be embedded, where information of the raw stream may be recorded and sent to the filtering unit 306. The filtering unit 306 may include one or more filters F that may be used to filter streams by category. The filters F may be generated in advance or in real-time. For example, there may be a default filter for the category "female," and the streams of female streamers may be filtered to be classified as female streams. In some embodiments, a filter for "v-liver" may be generated in real-time when a user wants to add the category "v-liver" to the category page.

[0059] In some embodiments, as a raw stream is generated, the raw stream may be hooked to the filter function such that the filter F filters the raw stream. Here, "hooking" may refer to a method for dynamically receiving or being notified of changes in the status of an API. This may be achieved by any possible method, such as web hooks, polling, long polling, real-time streaming, etc. In some embodiments, the method for hooking the raw stream to the filtering function may be achieved, for example, by a gRPC framework and long polling method, or any other possible means.

[0060] According to this embodiment, after a filter F is newly created, there is no need to restart, reboot, or reconfigure the server 10. That is, when a filter F of a certain category is newly created, the filter can operate without additional configuration or settings. Furthermore, the long polling method can also reduce the load on the API server, since the API only needs to respond to a client request when the resource state changes.

[0061] 8, the filter function may include multiple filters (F1, F2, ...). After the raw stream R1 is generated, the filtering unit 306 may filter the raw stream R1 with the filters F one by one. If the raw stream R1 matches a category, the matching unit 308 may add the raw stream R1 to the corresponding category in the category DB 326.

[0062] In some embodiments, one raw stream may match one or more categories. As shown in Fig. 8, the raw stream R1 with stream ID "100001" matches the categories "latest stream" and "female stream". Therefore, the matching unit 308 may add information of the raw stream R1 to the matched categories, respectively.

[0063] In some embodiments, the matching unit 308 may not add the raw stream to any category if the raw stream does not match any category. In some embodiments, the matching unit 308 may add the raw stream to an "other category" if the raw stream does not match any category. In some embodiments, a filter F for the "other" category may be created to filter out streams that do not match any category. This embodiment allows streams to be managed and maintained in an appropriate manner.

[0064] 9 and 10 are exemplary screen images of a live streaming selection screen 600 displayed on the display of a viewer's user terminal 30. The server 10 may provide the live streaming selection screen 600 for the viewer to select a streamer to watch. The live streaming selection screen 600 may include tab objects 602 for the viewer to adjust the arrangement and layout of streams. The live streaming selection screen 600 may also include a display area 604 for displaying the streams for the viewer.

[0065] In some embodiments, the tab object 602 may include an "all" tab, a "category" tab, etc. for the viewer. The "all" tab may be used to display all streams, and the "category" tab may be used to display streams classified by category. In some embodiments, the categories of streams may include "latest," "female," "v-liver," "singer," etc., and the categories may be flexibly added, deleted, updated, and changed by the server 10 according to actual needs.

[0066] 9, the live streaming selection screen 600 has categories of "latest" and "dance." The "latest" category has at least two streams, stream R1 and stream R2. The "dance" category has at least three streams, stream R1, stream R3, and stream R4. The viewer may swipe right or left to see other available streams.

[0067] In some embodiments, the filtering unit 306 and matching unit 308 may dynamically update the category DB 326. An update request may be based on detection from the server 10, detection by management staff, detection from streamers or viewers, etc. As shown in Fig. 9, streamer "Ben" is classified into the "dance" category. If the streamer wants to change the performance from dance to singing, the streamer may, for example, change the hashtag of the streaming room and update the topic of the streaming room.

[0068] As updates occur in the raw stream, the filtering unit 306 and matching unit 308 may dynamically update the category DB 326. In some embodiments, the updates may be, for example, changing the category name, removing the stream from one category, adding the stream to another category, deleting the stream, etc. As shown in Figure 10, the stream of the streamer "Ben" may be removed from the "dance" category and added to a new "Singer" category.

[0069] 11 to 13 are exemplary sequence diagrams illustrating the operation of a configuration of a live streaming system 1 according to some embodiments of the present disclosure.

[0070] In some embodiments, the server 10 may include a stream DB 320 that stores currently running live streams. As shown in FIG. 11, when a streamer starts live streaming, information of the stream may be stored in a database such as the stream DB 320 (S302). In some embodiments, the database may be an internal database of the server 10 or a third-party database such as YAML, MangoDB, MySQL, etc. The viewer may access the stream category page via the user terminal 30 and select the live streaming (S304). The processing unit 310 may collect streams from the stream DB 320 (S306). If the viewer accesses the category page and requests, for example, streams in the music category, the processing unit 310 may provide the streams in the music category to the viewer (S308).

[0071] In some embodiments, if the viewer requests streams in a new category, the processing unit 310 may provide the viewer with streams in the new category (S310). In some embodiments, if the viewer requests streams in a female category, the processing unit 310 may provide the viewer with streams in the female category (S312). According to this embodiment, the processing unit 310 may provide the viewer with the streams by category, allowing the viewer to focus on the streams in the category that interest them.

[0072] In some embodiments, the streams may be stored in the same database or different databases according to actual needs. The processing unit 310 may need to access different databases to collect information of streams. As shown in FIG. 11, another database, such as a stream DB 320', may be used to store the streams (S302'). If a stream is stored in the stream DB 320', the processing unit 310 may collect the stream from the stream DB 320' (S306'). In some embodiments, each database has its technical logic, and the procedure by which the processing unit 310 collects streams and provides them to the viewer may be different for each database.

[0073] FIG. 12 is a diagram illustrating the operation of the configuration of the live streaming system 1 compared with that shown in FIG. 11 as the related art. As shown in FIG. 12, the filtering unit 306 may initialize a list of filters in the server 10 (S322). In some embodiments, there may be some default or newly generated, enabled or disabled filters F in the server 10, and the filtering unit 306 may obtain available filters by initializing the list of filters in the server 10. In some embodiments, the filtering unit 306 may register all filters in the server 10 and provide a filter list for processing the filter function.

[0074] In some embodiments, the stream DB 320 may be hooked to the filtering unit 306 (S324). By hooking the stream DB 320 to the filtering unit 306, a live stream may be filtered and matched to a corresponding category when it is generated or updated. When a streamer starts live streaming, the information of the stream may be stored in the stream DB 320 (S326). Furthermore, the information of the stream may be sent to the filtering unit 306 for category filtering (S328).

[0075] The filtering unit 306 may generate a category for the stream, e.g., by filtering the stream into the category (S330). In some embodiments, the filtering unit 306 may filter the stream S with a filter F. In some embodiments, the filtering unit 306 may filter each stream S with each filter F in a loop. For example, if there are three filters F1, F2, F3, the filtering unit 306 may filter the raw stream with each filter F1, F2, F3, respectively. The filtering unit 306 may filter each stream with each filter F, respectively, to determine whether the stream matches the category of each filter F.

[0076] In some embodiments, if the streamer's gender in stream R1 is female and the category of the filter F2 is female, the filtering unit 306 may match the stream R1 to the category of female through the filter F2. More specifically, the filter F2 may include a mapping function indicating to find the streams in which the streamer's gender is female. Since the streamer's gender in stream R1 is female, the stream R1 may match the category of the filter F2. The filtering unit 306 may further obtain, for example, a category name and a filter ID in the filter F2 to generate a match between the stream R1 and the filter F2.

[0077] After filtering all the streams with each filter F respectively, the filtering unit 306 may generate a match list and send the match list to the matching unit 308 (S332). In some embodiments, the match list may be an output from the filtering unit 306, such as a table indicating the matching results between the raw streams and the filters F. The matching unit 308 may further match the raw streams against the category DB 324 based on the match list (S334). For example, if the stream R1 matches the categories of "latest" and "female", the matching unit 308 may add the stream R1 to the categories of "latest" and "female" in the category DB 324, respectively. In some embodiments, information of the stream R1, such as a stream ID, may be added to the category DB 324 as a reference. In some embodiments, if there is no corresponding category in the category DB 324, the matching unit 308 may generate a new category and add the stream to the newly generated category.

[0078] In some embodiments, a stream may not match any category or may match more than one category. In some embodiments, if a stream does not match any category, the matching unit 308 may not add the stream to the category DB 324. In some embodiments, if a stream does not match any category, the matching unit 308 may add the stream to an "other" category in the category DB 324 (S336).

[0079] In some embodiments, the filtering unit 306 may send information of the matched categories to the stream DB 320 for reference (S338). Further, a category link may be generated and stored for the stream in the stream DB 320 (S340). The category link may be generated based on information in the match list. For example, the category of the stream may be stored as a link to the stream in the stream DB 320. The link may be in the form of a linked list, connecting the stream in the stream DB 320 and the category in the category DB 324.

[0080] In some embodiments, when there are multiple databases for storing streams, each database may be linked to the category DB 324 and dynamically updated in real time according to the above procedure. The user may access the category DB 324 for the category of a stream (S342). Furthermore, the update of the category may be triggered or driven by events such as stream start, stream update, stream end, etc. Thus, the generation and maintenance of the category of the stream is facilitated.

[0081] FIG. 13 illustrates an operation of updating or terminating the stream in the live streaming system 1. As shown in FIG. 13, the filtering unit 306 may initialize a list of filters in the server 10 (S352). The stream DB 320 may further be hooked to the filtering unit 306 (S354). In some embodiments, an operator may update the information of the stream (S356). In some embodiments, the operator may be the server 10 itself, management staff, the streamer, a viewer, etc. The update may be performed manually or automatically.

[0082] When an update is made to stream R1 by the operator, the category links of stream R1 are checked and referenced (S358), and the filtering unit 306 may further update the categories based on the category links (S360). The filtering unit 306 may further compare the information of the update with the category links and identify differences therebetween (S362). In some embodiments, the differences may indicate whether to update a category, add to another category, remove from one category, etc.

[0083] In some embodiments, the filtering unit 306 may generate a match list based on the comparison and difference. If there is a new match between the stream and a category, the matching unit 308 may receive the match list (S364) and add the updated stream to the updated category in the category DB 324 accordingly (S366). In some embodiments, if the original category is lost, i.e., the updated stream does not match the original category, the matching unit 308 may remove the updated stream from the original category in the category DB 324 (S368).

[0084] After the updates are reflected in the stream and its corresponding category, the filtering unit 306 may send the match list information to the stream DB 320 (S370). Furthermore, an updated category link may be generated and stored for the stream in the stream DB 320 (S372).

[0085] For example, if a streamer changes a hashtag of a streaming room from "dance" to "singer," an event may be triggered to update the streaming room. The filtering unit 306 may identify a corresponding category of the streaming room based on a category link. The filtering unit 306 may compare the difference between the original category and the new category of the stream, and further determine whether to change the category of the stream. The matching unit 308 may further update the category of the stream based on the difference. For example, the matching unit 308 may remove the stream from the category of "dance" and add the stream to the category of "singer."

[0086] Furthermore, the operator may close the stream (S374). For example, the streamer may voluntarily end the stream, or the server 10 may end the stream due to a violation or the like. When the operator closes the stream, the category link of the stream R1 is referenced (S376), and the filtering unit 306 may obtain the category link of the stream for deleting the category (S378). Furthermore, the filtering unit 306 may delete the stream from the category in the category DB 324 based on the category link (S380). When the procedure is completed, the filtering unit 306 may echo to the stream DB 320 and end the process (S382).

[0087] According to the embodiment of the present disclosure, the categories of the streams are easily generated and maintained, and the categories of the streams can be dynamically added, updated, modified or deleted without complicated procedures, thus improving the quality of the streams on the live streaming platform.

[0088] Fig. 14 is a schematic block diagram of a system configuration and computer hardware for executing processing according to some embodiments of the present disclosure. The information processing device 900 shown in Fig. 14 is configured to realize, for example, the server 10 and the user terminals 20 and 30 according to some embodiments of the present disclosure.

[0089] The information processing device 900 includes a CPU 901, a read-only memory (ROM) 903, and a random access memory (RAM) 905. Furthermore, the information processing device 900 may include a host bus 907, a bridge 909, an external bus 911, an interface 913, an input unit 915, an output unit 917, a storage unit 919, a drive 921, a connection port 925, and a communication unit 929. The information processing device 900 may include an imaging device (not shown) such as a camera. The information processing device 900 may include a processing circuit such as a digital signal processor (DSP) or an application specific integrated circuit (ASIC) instead of or in addition to the CPU 901.

[0090] The CPU 901 functions as an arithmetic processing device and a control device, and controls the overall operation of the information processing device 900 or a part of the operation according to various programs recorded in the ROM 903, the RAM 905, the storage unit 919, or the removable recording medium 923. For example, the CPU 901 controls the overall operation of each functional unit included in the server 10 and the user terminals 20 and 30 of the above-mentioned embodiment. The ROM 903 stores programs and operation parameters used by the CPU 901. The RAM 905 transiently stores programs used when the CPU 901 executes programs and parameters that change appropriately when the programs are executed. The CPU 901, the ROM 903, and the RAM 905 are connected to each other via a host bus 907 consisting of an internal bus such as a CPU bus. The host bus 907 is connected to an external bus 911 such as a peripheral component interconnect / interface (PCI) bus via the bridge 909.

[0091] The input unit 915 is a device operated by a user, such as a mouse, a keyboard, a touch panel, a button, a switch, or a lever. The input unit 915 may be a device that converts a physical quantity into an electric signal, such as an audio sensor (such as a microphone), an acceleration sensor, a tilt sensor, an infrared sensor, a depth sensor, a temperature sensor, or a humidity sensor. The input unit 915 may be, for example, a remote control device that uses infrared rays or another type of radio wave. Alternatively, the input unit 915 may be an external connection terminal 927 such as a mobile phone that supports the operation of the information processing device 900. The input unit 915 includes an input control circuit that generates an input signal based on information input by a user and outputs the generated input signal to the CPU 901. The user operates the input unit 915 to input various data and instruct the information processing device 900 to perform a processing operation.

[0092] The output unit 917 includes a device that can visually or audibly notify the user of the acquired information. The output unit 917 may be, for example, a display device such as an LCD, a PDP, or an OLED, an audio output device such as a speaker or a headphone, a printer, etc. The output unit 917 outputs the results obtained by the processing executed by the information processing device 900 in the form of text, video such as an image, or sound such as voice.

[0093] The storage unit 919 is a data storage device and is an example of a storage unit of the information processing device 900. The storage unit 919 includes, for example, a magnetic storage device such as a hard disk drive (HDD), a semiconductor storage device, an optical storage device, a magneto-optical storage device, etc. The storage unit 919 stores programs and various data executed by the CPU 901, and various data acquired from the outside.

[0094] The drive 921 is a reader / writer of a removable recording medium 923 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and is built into or externally attached to the information processing device 900. The drive 921 reads out information recorded on the attached removable recording medium 923, and outputs it to the RAM 905. The drive 921 writes information to the attached removable recording medium 923.

[0095] The connection port 925 is a port used for directly connecting a device to the information processing device 900. The connection port 925 may be, for example, a USB (Universal Serial Bus) port, an IEEE1394 port, or a SCSI (Small Computer System Interface) port. The connection port 925 may be an RS-232C port, an optical audio terminal, an HDMI (High Definition Multimedia Interface (registered trademark)) port, or the like. By connecting an external connection terminal 927 to the connection port 925, various data can be exchanged between the information processing device 900 and the external connection terminal 927.

[0096] The communication unit 929 is, for example, a communication interface including a communication device for connecting to a communication network NW. The communication unit 929 may be, for example, a communication card for a wired or wireless local area network (LAN), Bluetooth (registered trademark), or Wireless USB (WUSB).

[0097] The communication unit 929 may be, for example, a router for optical communication, a router for ADSL (asymmetric digital subscriber line), or a modem for various types of communication. For example, the communication unit 929 transmits and receives signals on the Internet and transmits and receives signals with other communication devices using a predetermined protocol such as TCP / IP. The communication network NW to which the communication unit 929 is connected is a network established by a wired connection or a wireless connection. The communication network NW is, for example, the Internet, a home LAN, infrared communication, radio wave communication, or satellite communication.

[0098] The imaging device (not shown) is a device that captures real space and generates a captured image using an imaging element such as a CCD (charge-coupled device) or a CMOS (complementary metal-oxide semiconductor) and various members such as a lens for controlling the formation of a subject image on the imaging element. The imaging device may capture still images or moving images.

[0099] The live streaming system 1 of the present disclosure has been described above with reference to the embodiments. The above-mentioned embodiments are described merely for the purpose of explanation. Rather, those skilled in the art can easily conceive of various combinations of the above-mentioned components and processes of the embodiments and various modifications, which are also included in the technical scope of the present disclosure.

[0100] The steps described in this specification, particularly the steps described using flow charts or flow charts, may include some of the steps constituting the steps, may include steps not explicitly included in the steps constituting the steps, and / or may rearrange the order of the steps. Such omissions, additions, and rearrangements of steps are also included in the scope of the present disclosure as long as they do not deviate from the gist of the present disclosure.

[0101] In some embodiments, at least a portion of the functions performed by the server 10 may be performed by a device other than the server 10, for example, the user terminal 20 or 30. In some embodiments, at least a portion of the functions performed by the user terminal 20 or 30 may be performed by a device other than the user terminal 20 or 30, for example, the server 10. In some embodiments, rendering of frame images may be performed by the user terminal of a viewer, server, streamer, etc.

[0102] Furthermore, the system or method described in the above embodiments may be provided in a non-transitory computer-readable storage device such as a solid-state storage device, an optical disk storage device, a magnetic disk storage device, or a computer program product. Alternatively, the program may be downloaded from a server via the Internet.

[0103] Although the technical contents and features of the present disclosure have been described above, those skilled in the art can still make many variations and modifications without departing from the teachings and disclosure of the present disclosure. Therefore, the scope of the present disclosure is not limited to the embodiments already disclosed, but is within the scope of the following claims, including other variations and modifications that do not depart from the present disclosure. [Explanation of symbols]

[0104] 1. Live Streaming System 10 Server 20 User terminal 100 Streaming Units 102 Video control unit 104 Audio control unit 106 Delivery Unit 108 UI control unit 200 viewing units 202 UI control unit 204 Rendering Units 206 Input Unit 30, 30a, 30b User terminal 302 Streaming Information Unit 304 Relay unit 306 Filtering Unit 308 Matching Unit 310 Processing Unit 320 Stream DB 322 User DB 324 Filter DB 326 Category DB 600 screens 602 Tab Object 604 Display area 900 Information processing device 901 CPU 903 ROM 905 RAM 907 Host Bus 909 Bridge 911 External Bus 913 Interface 915 Input Unit 917 Output Unit 919 Storage Unit 921 Drive 923 Removable Recording Media 925 Connection Port 927 External connection terminal 929 Communication Unit LS Live Streaming LV Streamer NW Network SP Specific part AU1, AU2 viewers C1, C2, C3, C4, C0 categories F1, F2, F3, F4 Filters R1, R2, R3, R4 raw streams S302~S312, S322~S342, S352~S382 ​​process VD, VD1, VD2 Video

Claims

1. 1. A server for managing streams in a live streaming platform, comprising: one or more processors, the one or more processors executing machine-readable instructions to: receiving a first stream from a user terminal of a user; determining whether the first stream satisfies a first category; adding the first stream to the first category in response to the first stream matching the first category; A server comprising:

2. generating a category link corresponding to the first stream and the first category; storing said category link in said first stream; The server of claim 1 further comprising:

3. the category link being in the form of a linked list linking the first stream to the first category; 3. The server of claim 2, wherein the first category is accessed from the first stream based on the category link.

4. and updating the first stream via the category link; 3. The server of claim 2, wherein updating the first stream comprises removing the first stream from the first category and / or adding the first stream to a second category.

5. 2. The server of claim 1, further comprising, in response to the first stream not matching any category, adding the first stream to a third category.

6. generating a first filter of the first category; hooking said first filter with said first stream; Further comprising: The first filter and the first stream are hooked together by long polling.

2. The server according to claim 1 .

7. and acquiring information of the user in response to receiving the first stream; The server of claim 1 , wherein the information of the user includes the user's unique key, gender, first live stream time, region, or hashtag.

8. 2. The server of claim 1, wherein the first stream in the first category includes a time to live (TTL) parameter that specifies a life or remaining duration of the first stream in the first category.

9. 1. A method for managing streams in a live streaming platform, comprising: receiving a first stream from a user terminal of a user; determining whether the first stream meets a first category; adding the first stream to the first category in response to the first stream matching the first category; A method comprising:

10. A computer program comprising: receiving a first stream from a user terminal of a user; determining whether the first stream satisfies a first category; adding the first stream to the first category in response to the first stream matching the first category; A computer program characterized by causing a computer to execute the following:

Citation Information

Patent Citations

  • Video release account screening method and device, electronic equipment and storage medium

    CN114268839A