System for providing community live streaming service and method thereof
The community live streaming system addresses the asymmetry in streaming privileges by allowing room administrators to select streamers based on participant status and preferences, ensuring stable and collaborative live streaming experiences.
Patent Information
- Application Number
- JP2024076976
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-18
- Filing Date
- 2024-05-10
- Publication Date
- 2024-11-28
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Conventional live streaming services limit the participation of community members by pre-determining streamers, leading to asymmetry in streaming privileges and inhibiting active engagement.
A community live streaming system that allows a room administrator streamer to select fellow streamers based on participant camera/audio status, network quality, and preference similarity, using a server to manage user information and generate candidate lists for collaborative live streaming.
Enables dynamic selection of streamers, enhances community participation, and ensures stable live streaming by considering network quality and user preferences, facilitating seamless collaboration and interaction.
Smart Images

Figure 2024166111000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a system and method for providing a community live streaming service, and more particularly to a system and method for providing a community live streaming service in which a room manager streamer who creates a party room for a specific purpose and community members who participate in the party room can become fellow streamers at the selection of the room manager streamer during a live broadcast and perform live streaming (live distribution) in a collaborative manner. [Background technology]
[0002] The recent rapid spread of electronic devices such as personal computers, smartphones, and tablet PCs has been remarkable. This has led to the emergence of a wide variety of video content that can be broadcast and viewed online using such electronic devices.
[0003] Also, an increasing number of viewers spend their leisure time watching a wide variety of videos using electronic devices due to environmental and spatial constraints, etc. In particular, recently, an increasing number of viewers are watching real-time videos using live streaming services that transmit real-time video data received from a video sending device of a live streamer (video sender) to a video playback device of the viewer, thereby enabling the viewer to watch real-time videos.
[0004] In live streaming, users communicate with each other primarily through chat rooms, which are an important component of the live streaming experience, and through features such as emojis, emoticons, or donations (financial support), which are alternative ways in which they can interact with the live streamer.
[0005] There were also cases where other streamers would host the live show together using co-streaming.
[0006] However, in conventional live streaming services, one or more streamers who will participate in the live stream are pre-determined, and other users are excluded from streaming, so they are limited to watching the streams of the pre-determined streamers. Therefore, although it claims to be two-way live streaming, streaming rights are not shared, and from the perspective of community activities, the asymmetry of streaming rights poses a problem in that it inhibits active participation of community members.
[0007] For this reason, the present applicant provides a community live streaming service providing system in which a room administrator streamer can select streamers to collaborate with from among users who have participated in the live stream during live streaming, and can live stream with these streamers. Summary of the Invention [Problem to be solved by the invention]
[0008] The problem to be solved by the present invention is to provide a system and method for providing a community live streaming service in which a room administrator streamer who creates a party room for a specific purpose and community members who participate in the party room can become fellow streamers at the selection of the room administrator streamer during a live broadcast and perform live streaming (live distribution) in a collaborative manner.
[0009] In particular, the object of the present invention is to provide a system and method for providing a community live streaming service that can provide a list of candidate streamers based on the on / off status of participants' cameras / audio and network quality status to help room administrator streamers select fellow streamers.
[0010] Another object of the present invention is to provide a system and method for providing a community live streaming service that can recommend fellow streamers based on the preference similarity between a room manager streamer and participants, thereby helping the room manager streamer select fellow streamers. [Means for solving the problem]
[0011] In order to solve the above-mentioned problems, a community live streaming service providing system according to an embodiment of the present invention includes a plurality of user terminals and a server providing a live streaming service, and the plurality of user terminals may include a room manager streamer terminal that creates a party room and participant terminals that participate in the party room.
[0012] In this case, the server may include a setting confirmation unit that, when receiving a request to enter the party room from the participant terminal, checks the on / off status of the camera and microphone of the participant terminal; a network quality measurement unit that checks the network quality of the participant terminal; a candidate streamer list generation unit that provides the room administrator streamer terminal with a list of candidate streamers based on the on / off status of the camera and microphone and the network quality for at least one participant terminal; and a service support unit that outputs the camera footage of the room administrator streamer terminal and the camera footage of a participant terminal selected as a fellow streamer by the room administrator streamer terminal to a set area of a live streaming screen and provides them to user terminals that have joined the party room.
[0013] The network quality measurement unit may determine a grade of network quality based on the communication bandwidth, latency, packet loss, and playback buffer latency of the participant terminal.
[0014] Furthermore, the service support unit may support differential video quality according to the grade of network quality of the participant terminal.
[0015] Furthermore, the candidate streamer list generation unit may provide the room administrator streamer terminal with a candidate streamer list including participant information corresponding to participant terminals in descending order of network quality grade while the camera and microphone are on.
[0016] Furthermore, the community live streaming service providing system may further include a management unit that stores and manages user information including personal information and interest information, party room information, and participant activity history information, and a recommendation unit that compares the user information with the party room information and user information of room manager streamers, respectively, and recommends party rooms and room manager streamers in order of preference similarity to the user terminal.
[0017] Furthermore, the community live streaming service providing system may further include a similarity calculation unit that compares the party room information with user information and participant activity history of participants in the party room to calculate a similarity with the party room, and the candidate streamer list generation unit may generate a candidate streamer list based on the on / off state of a camera and microphone for at least one participant terminal, network quality, and the similarity with the party room.
[0018] Furthermore, the user information may include personal information including at least one of age, gender, country / region, and language, and interest information by category, the party room information may include at least one of category, party room title, party room introduction information, associated tags, and capacity, and the participant activity history information may include at least one of the number and frequency of participation in a party room, donation information, party evaluation score, number of times of desire to become a fellow streamer, activity information within the party room (chats, emojis, games, etc.), and number of times a fellow streamer was selected.
[0019] Furthermore, the community live streaming service providing system may further include a UI generating unit for providing a UI to the user terminal, the UI generating unit providing a live streaming screen when generating the party room.
[0020] Furthermore, the live streaming screen may include a background area, a plurality of split screen areas overlapping the background area, and a plurality of function icons, and in the plurality of split screen areas, the camera output areas of a plurality of fellow streamers may be arranged centered on the camera output area of the room administrator streamer terminal, and a location number (location number) may be set in the camera output area of each fellow streamer.
[0021] Furthermore, the community live streaming service providing system may further include a pre-screening unit that, when a camera output area of a fellow streamer is selected on the room manager streamer terminal, provides the list of candidate streamers including participant information and receives selection of a fellow streamer of the location number.
[0022] Furthermore, the UI generation unit may provide a pre-screening screen for a corresponding location number when the camera output area of the fellow streamer is selected on the room manager streamer terminal.
[0023] Furthermore, the pre-screening screen may also include a candidate preview including participant information and camera output images of the participant terminal, arranged in order of priority of the candidate streamers, and a mainframe area providing a list of candidate streamers with the highest priority superimposed on the preview.
[0024] Furthermore, when a candidate streamer is selected from the list of candidate streamers in the main frame area by the room manager streamer terminal, the service support unit may output a camera output image of the corresponding participant terminal to the split screen area of the location number.
[0025] In addition, according to an embodiment of the present invention, a method for providing a community live streaming service in a system including a room manager streamer terminal that generates a party room, a plurality of user terminals including participant terminals that participate in the party room, and a server that provides a live streaming service may include the following steps.
[0026] (a) the room manager streamer terminal creating a party room; (b) when the server receives a request to enter the party room from the participant terminal, checking the on / off state of the camera and microphone of the participant terminal; (c) the server checking the network quality of the participant terminal; (d) the server providing the room administrator streamer terminal with a list of candidate streamers including the on / off status of the camera and microphone and the network quality for at least one participant terminal; (e) the room manager streamer terminal selecting fellow streamers; and (f) A step in which the server outputs the camera footage of the room administrator streamer terminal and the camera footage of the participant terminals selected as fellow streamers by the room administrator streamer terminal to a set area of a live streaming screen and provides them to the user terminals participating in the party room.
[0027] In step (c), the network quality may be graded based on the communication bandwidth, latency, packet loss, and playback buffer latency of the participant terminal.
[0028] Furthermore, in the step (f), differential video quality may be supported according to the grade of network quality of the participant terminal.
[0029] Furthermore, in step (d), while the camera and microphone are on, a list of candidate streamers including participant information corresponding to participant terminals in descending order of network quality grade may be provided to the room administrator streamer terminal.
[0030] Furthermore, the method for providing a community live streaming service may further include a step in which the server stores and manages user information including personal information and interest information, party room information, and participant activity history information, and a step in which the server compares the user information with the party room information and user information of room manager streamers, respectively, and recommends party rooms and room manager streamers in order of preference similarity to the user terminal.
[0031] Furthermore, the method of providing a community live streaming service may further include a step in which the server compares the party room information with user information and participant activity history of participants in the party room to calculate a similarity with the party room.
[0032] Furthermore, in the step (d), the candidate streamer list may be generated based on the on / off state of a camera and a microphone for at least one participant terminal, the network quality, and the similarity to the party room.
[0033] Furthermore, the user information may include personal information including at least one of age, gender, country / region, and language, and interest information by category, the party room information may include at least one of category, party room title, party room introduction information, associated tags, and capacity, and the participant activity history information may include at least one of number and frequency of participation in a party room, donation information, party evaluation score, number of times of desire to be a fellow streamer, and number of times of selecting a fellow streamer.
[0034] Furthermore, the method for providing a community live streaming service may further include a step in which the server provides a pre-screening screen for a corresponding location number when the server selects a camera output area of the fellow streamer on the room manager streamer terminal.
[0035] Furthermore, the live streaming screen may include a background area, a plurality of split screen areas overlapping the background area, and a plurality of function icons, and in the plurality of split screen areas, the camera output areas of a plurality of fellow streamers may be arranged centered on the camera output area of the room administrator streamer terminal, and a location number may be set in the camera output area of each fellow streamer.
[0036] Furthermore, the method for providing a community live streaming service may further include a step in which the server provides a pre-screening screen for a corresponding location number when the server selects a camera output area of the fellow streamer on the room manager streamer terminal.
[0037] Furthermore, the pre-screening screen may also include a candidate preview including participant information and camera output images of the participant terminal, arranged in order of priority of the candidate streamers, and a mainframe area providing a list of candidate streamers with the highest priority superimposed on the preview.
[0038] Furthermore, the step (d) may include a step in which, when a room administrator streamer terminal selects a candidate streamer from the list of candidate streamers in the mainframe area, the server outputs a camera output image of the corresponding participant terminal to the split screen area of the location number. Effect of the Invention
[0039] According to one embodiment of the present invention, a system and method for providing a community live streaming service can be provided in which a room administrator streamer who creates a party room for a specific purpose and community members who participate in the party room can become fellow streamers at the selection of the room administrator streamer during a live broadcast and perform live streaming (live distribution) in a collaborative manner.
[0040] At this time, a participant score is calculated based on whether the participant's camera / audio is on / off, network quality status, similarity of preferences between the room administrator streamer and the participants, similarity between the participant's user information and party room information, the participant's activity history, and their desire to become a fellow streamer. The score is then sorted by participant, and a list of candidate streamers is provided in descending order, which can be used to help the room administrator streamer select fellow streamers.
[0041] In addition, the system of the present invention can recommend party rooms and room manager streamers that are matched to a user terminal based on user-specific preference information (personal information, interest information, etc.).
[0042] Furthermore, the system of the present invention can support stable live streaming of party rooms by measuring the network quality of participants, classifying the network quality grades, and controlling the video / audio quality according to the classified network quality grades.
[0043] Furthermore, the system of the present invention provides a UI with permissions for each user (user, room administrator streamer, fellow streamer, candidate streamer, viewer), making it easy to create and set up a party room, use interaction functions (chat, raise hand, fellow streamer's desire to join), view and search for recommended room administrator streamers / party rooms, etc. In particular, by providing a list of candidate streamers and a pre-screening screen, it is easy for a room administrator streamer to select a fellow host.
[0044] The effects of the present invention are not limited in any way to the contents exemplified above, and various other effects are included in this specification. [Brief description of the drawings]
[0045] [Figure 1] FIG. 1 is a schematic diagram of a community live streaming service providing system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a diagram illustrating multiple party rooms live-streamed in the community live streaming service providing system of FIG. 1. [Diagram 3] A block diagram showing a schematic configuration of a user terminal according to one embodiment of the present invention. [Figure 4] FIG. 2 is a block diagram showing a schematic configuration of a server according to an embodiment of the present invention. [Diagram 5] 1 is a flowchart illustrating a method for providing a community live streaming service according to an embodiment of the present invention. [Figure 6]FIG. 13 is a diagram illustrating a party room screen according to an embodiment of the present invention. [Figure 7] FIG. 1 is a block diagram showing a schematic configuration of a room manager streamer mode according to an embodiment of the present invention. [Figure 8] FIG. 13 is a diagram for explaining an entry screen for a party room according to an embodiment of the present invention. [Figure 9] FIG. 13 is a diagram for explaining a pre-screening screen according to one embodiment of the present invention. [Figure 10] FIG. 11 is a block diagram showing a schematic configuration of a server according to another embodiment of the present invention. [Figure 11] 11 is a flowchart illustrating selection of fellow streamers based on recommendations according to another embodiment of the present invention. [Figure 12] 4 is a flowchart illustrating a method for a participant to join a party room according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0046] The following content is merely illustrative of the principles of the present invention. Therefore, those skilled in the art can invent various devices and methods that embody the principles of the present invention and are included in the concept and scope of the present invention, even if not explicitly described or shown in the present specification. It should be understood that all conditional terms and embodiments listed in this specification are, in principle, clearly intended only for the purpose of making the concept of the present invention understandable, and are not limited to the embodiments and conditions specifically listed in this specification.
[0047] Furthermore, in the following description, phrases including ordinal numbers such as first, second, etc. are intended to describe objects which are equivalent to each other and independent, and the order does not imply main / sub or master / slave.
[0048] The above-mentioned objects, features and advantages will become more apparent from the following detailed description taken in conjunction with the accompanying drawings, which will enable a person having ordinary skill in the art to which the present invention pertains to easily implement the technical concept of the present invention.
[0049] The features of the various embodiments of the present invention may be partially or fully combined or combined with each other, and various technical interlocking and driving mechanisms are possible, as will be fully understood by those skilled in the art, and each embodiment may be implemented independently of each other, or may be implemented together in a linked relationship.
[0050] Various embodiments of the present invention will now be described in detail with reference to the accompanying drawings.
[0051] Fig. 1 is a schematic diagram of a community live streaming service providing system according to an embodiment of the present invention. Fig. 2 is a diagram for explaining a plurality of party rooms live streamed in the community live streaming service providing system of Fig. 1. Fig. 3 is a block diagram showing a schematic configuration of a user terminal according to an embodiment of the present invention. Fig. 4 is a block diagram showing a schematic configuration of a server according to an embodiment of the present invention.
[0052] The community live streaming service providing system (hereinafter referred to as the streaming system) of the present invention can provide a platform where multiple users can form a non-face-to-face community (party room in Figure 2) using various devices and generate and stream live content in a collaborative manner.
[0053] Here, the party room is a non-face-to-face community area created for a specific purpose, and can be created by a specific user (room manager streamer), and a plurality of other users (participants) can participate in the party room to form a non-face-to-face community. In particular, in the present invention, the party room can provide a community live streaming service for holding a party with participants who have a common interest and communicating with each other on the theme of a category according to a specific purpose. The party room can be an N:N image chat service area, and in the present invention, it can be realized based on WebRTC-Peer-to-Peer (P2P), and when security is required due to deterioration of quality / security, it can be realized using a relay server such as a Selective Forwarding Unit (SFC) and a Multi-point Control Unit (MCU). Referring to FIG. 1, a streaming providing system according to an embodiment of the present invention may include a plurality of user terminals 100a to 100n that receive a community live streaming service and a server 200 that provides a community live streaming service.
[0054] Here, the user terminals 100a to 100n may be a variety of devices used by users, such as personal computers (PCs), notebook computers, tablets, and smartphones, and the user terminals 100a to 100n may install applications for the community live streaming service or receive services via a web-based browser.
[0055] In the present invention, users are classified into room manager streamers, participants (candidate streamers), fellow streamers, and viewers, and the user terminals of each user can be classified into room manager streamer terminals, participant terminals (i.e., candidate streamer terminals), fellow streamer terminals, and viewer terminals. In addition, each classified user is given different privileges within the party room by the user mode setting unit 240 of the server 200.
[0056] The room manager streamer is a user who creates a party room and can be the moderator of live streaming. The room manager streamer can be given all privileges in the party room, such as setting up the party room, generating events, creating live streaming content, selecting fellow streamers, managing participants, and interacting with the party room (chat, games, etc.).
[0057] Participants are users who join a party room created by a room manager streamer. They can be divided into fellow streamers and viewers, and any participant can become a candidate streamer. Participants can be given permission to set their personal camera / audio, share their fellow streamers' preferences, and use interaction functions (chat, games, etc.).
[0058] Fellow streamers can be selected by the room administrator streamer who is "live" from among the candidate streamers who have joined the party room to become participants who can join the video / audio live streaming.
[0059] A viewer is a participant who is not a fellow streamer among the potential streamers who have joined the party room and who watches the live-streamed video, and can only participate in the live streaming using the chat service.
[0060] 2, the party room forms a community including at least one of a room administrator streamer, fellow streamers, candidate streamers, and viewers, and multiple party rooms can be formed. For example, non-face-to-face communities can be formed in a variety of forms, such as party room 1a, party room 1b, where pre-screening of fellow streamers for participants is performed, party room 1c where pre-screening has been completed, and party room 1n, where the room administrator streamer and fellow streamers are adopted without pre-screening based on the settings of the room administrator streamer.
[0061] In this case, the composition of the party room can be 1:m+n:m:n (n is a natural number greater than m) of room administrator streamer: candidate streamer: fellow streamer: viewers. For example, m can be 6 people, but the number can be adjusted depending on the situation and need. n can be smaller than m, or m or n can be absent.
[0062] Referring to FIG. 3, the user terminals 100a to 100n may be equipped with a communication unit 110, a processor 120, a camera 130, a microphone 140, a speaker 150, and a UI unit 160, and depending on whether or not they have the components of the communication unit 110, the processor 120, the camera 130, the microphone 140, and the speaker 150, they may be restrictive in granting authority to the room administrator streamer and fellow streamers.
[0063] The server 200 may be a service platform for providing a community live streaming service. Referring to FIG. 4, the server 200 according to an embodiment of the present invention may include a management unit 210, a database 220, a UI generation unit 230, a user mode setting unit 240, a setting confirmation unit 250, a network quality measurement unit 260, and a service support unit 270. Meanwhile, functions and operations of each component of FIG. 3 and FIG. 4 will be described with reference to FIG. 5 to FIG. 9. FIG. 5 is a flowchart for explaining a method for providing a community live streaming service according to an embodiment of the present invention.
[0064] The communication unit 110 of the user terminals 100a to 100n can communicate with the server 200 and other user terminals via a network. As the communication unit 110, a communication module such as wired, 3G, 4G, 5G, or wifi built into the terminal can be adopted, and in the case of a wifi module, communication can be performed via an external sharer.
[0065] The processor 120 can control and operate the overall components based on an application or web for providing a community live streaming service. In addition, the camera 130 can capture a user and transmit the image in real time, and the microphone 140 can output an audio signal such as the user's voice in real time. In addition, the speaker 150 can output an audio signal generated from the party room to the user's terminal.
[0066] The UI unit 160 can be a user interface for using the service, and can be provided from the UI generation unit 230 of the server 200. It can function as an input unit that requests login, generation and setting of a party room, interaction functions during live streaming, etc., and as an output unit that receives and provides responses from the server 200 in response to the requests.
[0067] A user can register as a member or log in through the UI unit 160. The UI generation unit 230 provides a UI for registering as a member or logging in, and when user information such as personal information and interest information of the user input through the UI is received, the management unit 210 can store and manage the information for each user in the database 220.
[0068] In this case, personal information may include age, sex, country / region, language, etc., and interests may include sports, music / entertainment, Global Cuisine Exchange, art / creativity, travel / adventure, language, movies / television, games / e-sports, occupation, health, exercise, friends / family, etc., which may be categorized and matched with personal information and stored. Meanwhile, categories are not limited to these, and may be categorized in more various ways and further subdivided.
[0069] Also, a user can create a party room through the UI unit 160. The UI unit 160 can receive input of party room information through the party room creation UI. Here, the party room information can include a category, a title of the party room, party room introduction information, related tags, capacity, a PIN number, and the like. In addition, the activity history of the user's room manager streamer (popularity, frequency of hosting and participating in parties, evaluations, word of mouth, and the like) can also be stored. At this time, the generated party room information and party room activity history can be matched with user information and stored in the database 220 by the management unit 210.
[0070] Furthermore, the management unit 210 can store and manage information such as the user's party participation record (donations, number and frequency of participation in party rooms, etc.), party evaluation score, interaction (number of times raising one's hand to indicate a desire to be a fellow streamer, chat, games, emojis, etc.), number of times a fellow streamer was selected, number of times a friend was invited and shared, etc., according to the activities of the user participants.
[0071] Furthermore, when a party room is generated in the user terminal, the user mode setting unit 240 can provide a room manager streamer mode 241. When the user terminal participates in a party room as a participant, the user mode setting unit 240 sets the user terminal as a candidate streamer via a candidate streamer mode 243, and provides a fellow streamer mode 242 or a viewer mode 244 depending on whether a fellow streamer is selected, and can differentially grant authority in the party room to the user terminal depending on each mode.
[0072] Specifically, the room administrator streamer mode 241 gives the user of the user terminal authority corresponding to a room administrator streamer, and the room administrator streamer mode 241 can give the room administrator streamer terminal authority as a live streamer that also plays the role of host or facilitator of a live streaming event. Thus, the room administrator streamer can set up and manage the live streaming, guide the general direction and atmosphere of the live streaming, invite fellow streamers to participate, and lead discussions and activities that occur during the live streaming.
[0073] Also, the peer streamer mode 242 gives the user of the user terminal authority to correspond to a peer streamer, and the peer streamer mode 242 can give the peer streamer terminal authority as a live streamer to participate in a live stream together with the room manager streamer and other peer streamers. Thus, the peer streamer can be selected from among the candidate streamers and invited by the room manager streamer, and the peer streamers can cooperate with each other to create a real-time stream.
[0074] Additionally, the candidate streamer mode 243 may provide a user of a user terminal with the ability to correspond to candidate streamers, and the candidate streamer mode 243 may provide a candidate streamer terminal with the ability to be a potential streamer for a live streaming event, whereby a candidate streamer may be identified by a room administrator streamer as a potential candidate, but has not yet been selected or confirmed as a fellow streamer, and a list of candidate streamers may be provided based on a curation algorithm.
[0075] Furthermore, the viewer mode 244 gives the user of the user terminal the authority to correspond to the viewer, and the viewer mode 244 can give the viewer terminal the authority to watch the live streaming. Therefore, the viewer participates in the live streaming only through the chat room, and is therefore distinguished from other streamers (room administrator streamer, fellow streamers, and candidate streamers).
[0076] Based on the authority for each mode of the user mode setting unit 240, real-time streaming of the party room can be performed according to the method of Fig. 5. As shown in Fig. 5, when a party room is created by a specific user terminal (for example, 100c) (S100), a live streaming screen 1 generated by the UI generating unit 230 can be provided as shown in Fig. 6. At this time, the room manager streamer terminal 100c can exercise authority according to the room manager streamer mode 241.
[0077] Fig. 6 is a diagram for explaining a party room screen according to an embodiment of the present invention. Referring to Fig. 6, Fig. 6 shows a streaming screen 1 that can be shared by all participants in the party room. At this time, the streaming screen 1 includes a background area 2, a plurality of split screen areas 20, 30a to 30f that overlap with the background area 2, and may include a plurality of functional icons 41 to 50.
[0078] Here, the background area 2 can be specified by the room administrator streamer terminal, and an image or video of party food or the like can be specified according to a category.
[0079] In addition, the camera output area 20 of the room administrator streamer terminal and the camera output areas 30a to 30f of the multiple fellow streamers can be arranged in the split screen area. Seat numbers can be set in the camera output areas of the multiple fellow streamers. In this case, the title 21 of the party room can be displayed in the camera output area 20 of the room administrator streamer terminal.
[0080] Furthermore, the room administrator streamer terminal and all participant terminals have the authority to use the function icons, and the settings of the function icons 41 to 44, 50 are made using personal function icons which can be settings on one's own device, such as camera switch 41 which switches the output from the participant's terminal to either the output to the participant's own camera or the output to the streaming screen, video on / off 42 which determines whether or not to output to the participant's own camera, microphone on / off 43, and room administrator streamer screen sharing 44, and exit 50 can be a function to leave the party room (exit the party room).
[0081] Furthermore, the interaction functions 45-49 may include emojis, games, surveys, participation in events such as ratings 45, a list of participants 46, chat 47, raising a hand 48 to indicate a desire to become a fellow streamer, and the current number of participants 49.
[0082] On the other hand, the streaming screen 1 of FIG. 6 is merely one embodiment, and can be implemented to have a wide variety of functions and designs by modifying, adding, deleting, and the like the functions and designs.
[0083] The room administrator streamer terminal 100c can configure various settings for the party room via the live streaming screen 1 with authority according to the room administrator streamer mode 241.
[0084] 7 is a block diagram showing a schematic configuration of a room manager streamer mode according to an embodiment of the present invention. Referring to FIG. 7, the room manager streamer mode 241 may include a party room setting unit 2411, a candidate streamer list generating unit 2412, and a pre-screening unit 2413.
[0085] The room administrator streamer terminal 100c can prepare for streaming, such as setting up the party room (inserting a background image and stickers, setting the camera / audio, etc.) on the screen of FIG. 10, via the party room setting unit 2411.
[0086] Next, when a participant enters the party room created in step S100 of FIG. 5 (S200), the server 200 can check the on / off status of the camera 130 and microphone 140 of the participant terminal and the network quality status of the communication unit 110 (S300).
[0087] As an example, a screen for a participant to enter a party room can be seen in Fig. 8. Fig. 8 is a diagram for explaining a screen for entering a party room according to an embodiment of the present invention.
[0088] Referring to Figure 8, a participant joining a party room can check the UI screen of Figure 8 (party room entry screen 10) through the participant terminal, and through the UI screen 10, can check the image 11 output from the camera of the participant terminal, the title 12 of the party room, and the number of participants in the party room, and can enter the party room after setting their own camera on / off and microphone on / off.
[0089] At this time, the setting confirmation unit 250 of the server 200 can check whether the camera / microphone of the participant terminal is on / off. The on / off status may be checked from the on / off setting inputted as shown in FIG. 11 when the participant joins, or may be checked based on the presence or absence of connection to the device.
[0090] Also, the network quality measurement unit 260 of the server 200 can perform a network quality test on the communication units 110 of the participating terminals to classify the network quality.
[0091] Specifically, the network quality measurement unit 260 can check the communication bandwidth, latency, packet loss, and playback buffer latency to calculate a grade score. In the following description, the "communication bandwidth" may be simply referred to as the "bandwidth."
[0092] The user's Internet speed has a great impact on the quality of video chat. Therefore, without sufficient bandwidth, the image quality may be degraded and there may be delays in the transmission of images and audio. In the present invention, the bandwidth is measured by the user's upload and download bandwidth.
[0093] Generally, images are sent and received at 128kps in video chat. Based on this, the download bandwidth and upload bandwidth can be calculated as follows:
[0094] - Download bandwidth: (Number of participants in image chat - Number of room administrators and streamers) x 128Kbps
[0095] - Upload bandwidth: (number of video chat participants - number of room administrator streamers + number of monitoring servers) x 128Kbps
[0096] Here, the number of participants in the video chat is the sum of the number of room administrator streamers (1 person) and the number of selected fellow streamers, and the monitoring server is a node for monitoring service quality and video, and becomes the network quality measurement unit 260, and the number of monitoring servers can be one.
[0097] For example, if the number of selected fellow streamers is 6, a minimum download bandwidth of 768Kbps and an upload bandwidth of 896Kbps are required for stable transmission. In addition, the user terminal can use the network not only for images but also for chat and other applications. Taking this into consideration, the network quality level criteria can be defined as follows:
[0098] Grade A: Upload / download speeds of 2,000Kbps (2Mbps) or more
[0099] Grade B: Upload / download speeds are 1,200Kbps~1,999Kbps
[0100] C grade: Upload / download: 900Kbps~1,200Kbps respectively
[0101] D grade: 700Kbps~899Kbps
[0102] F grade: 700Kbps or less
[0103] In addition, a ping test is used to measure the delay time between the communication unit 110 of the participant terminal and the chat server 200. The round trip time (RTT) can be calculated using the ping command, and when the delay time is 150 ms, it does not have a significant effect on the video chat, so the standard of the delay time can be defined as follows based on this.
[0104] A grade: 0ms~50ms, B grade: 51ms~100ms, C grade: 101ms~150ms
[0105] D grade: 151ms~200ms, F grade: 201ms or more
[0106] Furthermore, the packet loss test can be performed by using a ping command using ICMP (Internet Control Message Protocol) packets to check the percentage of packets lost. In this case, other methods can be used as the test method in addition to the ICMP method. If the packet loss is less than 1%, it does not have a significant effect on the quality of the video chat. Based on this, the packet loss standard can be defined as follows:
[0107] A grade: 0%~0.2%, B grade: 0.21%~0.5%, C grade: 0.51%~1%
[0108] D grade: 1.01%~2%, F grade: 2.01% or more
[0109] Furthermore, since a playback buffer delay of 500 ms or less is appropriate in real-time video chat, the playback buffer delay standard can be defined as follows:
[0110] A grade: 0ms~100ms, B grade: 101ms~250ms, C grade: 251ms~400ms
[0111] D grade: 401ms~500ms, F grade: 501ms or more
[0112] The network quality measurement unit 260 can provide scores for each grade calculated for each of the bandwidth, delay time, packet loss, and playback buffer delay, and calculate grade scores by providing a weighting value for each measurement criterion.
[0113] That is, the network quality grade can be classified according to the combined score of (the product of the bandwidth grade score and the bandwidth weighting value), (the product of the delay grade score and the delay weighting value), (the product of the packet loss grade score and the packet loss weighting value), and (the product of the playout buffer delay grade score and the playout buffer delay weighting value).
[0114] For example, for each grade, 5 points for grade A, 4 points for grade B, 3 points for grade C, 2 points for grade D and 1 point for grade F may be given, and the weighting values may be 0.5 for bandwidth, 0.3 for delay time, 0.1 for packet loss and 0.1 for playback buffer delay.
[0115] For example, the network quality can be classified based on the total score as follows:
[0116] 1st grade: 4.5~5.0, 2nd grade: 4.0~4.4, 3rd grade: 3.6~3.9,
[0117] Grade 4: 3.0~3.5, Grade 5: less than 3.0
[0118] The network quality measurement unit 260 transmits the calculated network quality grade to the service support unit 270 and the room manager streamer mode 241 of the user mode setting unit 240 so that the grade can be used to generate a list of candidate streamers.
[0119] Next, the candidate streamer list generation unit 2412 of the room administrator streamer mode 241 of the server 200 calculates the scores of the participants using the on / off status of the camera and microphone of the participant terminal and the network quality grade, and generates a list of candidate streamers in descending order of score and provides it to the room administrator streamer terminal (S400).
[0120] Here, the participant score can be measured such that the higher the network quality grade, the higher the score, while the camera and microphone are on. The list of candidate streamers may include participant information such as whether the camera is on / off, whether the microphone is on / off, the network quality grade, and the participant score.
[0121] On the other hand, if a new participant joins during the streaming preparation time, steps S200 to S400 can be repeated to update the list of candidate streamers.
[0122] In the embodiment of Figure 5, an embodiment has been described in which participant priority is determined based on camera on / off, microphone on / off, and network quality grade when generating a list of candidate streamers. However, participant priority can also be determined on a first-come, first-served basis, randomly, by participant voting, or based on matching similarity with the room administrator streamer.
[0123] Alternatively, when generating a list of candidate streamers, participant priority can be determined by taking into consideration a combination of factors such as whether the camera is on / off, whether the microphone is on / off, the network quality grade, and the matching similarity with the room administrator streamer.
[0124] At this time, the method of determining the participant priority can also be selected by the room manager streamer terminal.
[0125] Next, the room administrator streamer terminal can select and set a fellow streamer in the fellow streamer's camera output areas 30a to 30f on the streaming screen 1 in Fig. 6. Specifically, a seat number is set in the camera output areas 30a to 30f of a plurality of fellow streamers. When the room administrator streamer terminal clicks on a fellow streamer camera output area of a particular seat number, the pre-screening unit 2413 can provide a pre-screening screen to the room administrator streamer terminal.
[0126] At this time, the pre-screening screen may be provided as shown in Fig. 9. Fig. 9 is a diagram for explaining a pre-screening screen according to an embodiment of the present invention. Referring to Fig. 9, the pre-screening unit 2413 may provide a pre-screening screen 60 including a candidate streamer list, which is a participant list generated by the candidate streamer list generating unit 2412.
[0127] The pre-screening is a process for selecting a fellow streamer in the fellow streamer camera output area (e.g., 30b) of the location number (e.g., no. 2) clicked by the room administrator streamer terminal. The pre-screening screen 60 provides a preview of a list of candidate streamers in order of candidate scores, and the main frame area 70 can display and provide a list of candidate streamers with the highest priority.
[0128] At this time, the main frame area 70 is provided overlapping the center of the previewed candidate streamer list, and by selecting "Previous" 62 or "Next" 63, the candidate streamer list according to the priority can be moved and provided in the main frame area 70. In this case, the position of the previewed candidate streamer list can also be moved to the left or right in order of priority.
[0129] Alternatively, a specific preview candidate streamer list can be clicked or dragged to display in the main frame area 70. The candidate streamer list displayed in the main frame area 70 may include images output from real-time candidate participant terminals and participant information (camera on / off, microphone on / off, network quality grade, candidate score), etc.
[0130] Next, by selecting 64 the candidate streamer list displayed in the main frame area 70, the candidate can be selected as a fellow streamer for location number 2. In step S500, in the same manner as this method, a fellow streamer for each location number can be selected and a fellow streamer area can be set (S500).
[0131] Next, the video output from the selected fellow streamer's terminal (corresponding camera) can be output to the fellow streamer area of the corresponding location number (S600).
[0132] When the video of the selected fellow streamer is output to the fellow streamer area of each location number, the room manager streamer terminal can proceed with real-time streaming in collaboration with multiple fellow streamers (S700). In this case, the fellow streamer area does not have to be completely filled based on the setting of the room manager streamer terminal.
[0133] On the other hand, the room administrator streamer terminal can delete and manage the party room, or can continue to hold it without deleting it. Even if the room administrator streamer leaves the party room 50, participants may still be participating in the party room.
[0134] In this case, the room administrator streamer can set up auto-staging; if auto-staging is set, participants up to the number already set can be automatically selected as fellow streamers on a first-come, first-served basis (no pre-screening is required); if there is no room administrator streamer and auto-staging is not set, participants will only be able to communicate via chat.
[0135] The service support unit 270 may support live streaming corresponding to the network quality grade calculated by the network quality measurement unit 260. For example, the service support unit 270 may provide differential support such as adjusting and providing image chat quality according to the network quality grade of the participant terminal, or providing low-quality video or interrupting video transmission for a low grade such as D.
[0136] Meanwhile, Fig. 10 is a block diagram showing a schematic configuration of a server according to another embodiment of the present invention. Referring to Fig. 10, the server of Fig. 10 may include a management unit 210, a database 220, a UI generation unit 230, a user mode setting unit 240, a setting confirmation unit 250, a network quality measurement unit 260, a service support unit 270, a similarity calculation unit 280, and a recommendation unit 290. That is, the server according to the other embodiment of Fig. 10 may further include the similarity calculation unit 280 and the recommendation unit 290 in addition to the configuration of the server 200 according to the embodiment of Fig. 4.
[0137] In this case, components with the same reference numerals perform the same functions and operations, so only the added components, the similarity calculation unit 280, the recommendation unit 290, and the candidate streamer list generation unit 242 in FIG. 6 that performs further additional functions will be described in detail.
[0138] A corresponding method will be described with reference to Figs. 11 and 12. Fig. 11 is a flowchart for explaining the selection of fellow streamers based on recommendations according to another embodiment of the present invention. Fig. 11 is similar to the method in Fig. 5, but differs in that similarity is reflected in the candidate streamer list. Therefore, the description of each step is omitted since it is similar to Fig. 5, and S350 (similarity calculation step) and S400-1 (candidate streamer list generation step) will be described in detail.
[0139] The similarity calculation unit 280 can calculate the preference similarity between a user and an already registered party room, and the preference similarity between the user and the room administrator streamer of the party room, based on the user-specific information stored and managed by the management unit 210.
[0140] In this case, the recommendation unit 290 can compare the user information (personal information and interest information) with the party room information when the user initially logs in and registers as a member, and recommend the party room in order of high similarity. The recommendation unit 290 can also compare the user information (personal information and interest information) of the user with the user information of the room manager streamer, and recommend the room manager streamer in order of high similarity.
[0141] In addition, similarity calculation unit 280 can compare the party room information with information (user information and participant activity history) of participants in the party room, and give scores to participants with the highest similarity to the party room in descending order (S350).
[0142] The candidate streamer list generation unit 2412 of the room administrator streamer mode 241 of the server 200 calculates participant scores based on the on / off status of the camera and microphone of the participant terminal, the network quality grade, and the points assigned according to the similarity between the participant and the party room, and generates a list of candidate streamers in descending order of participant scores and provides it to the room administrator streamer terminal (S400-1).
[0143] Here, the participant score can be measured such that the higher the network quality grade and the higher the similarity score are while the camera and microphone are on, the higher the participant score will be. The list of candidate streamers may include participant information such as whether the camera is on / off, whether the microphone is on / off, the network quality grade, the similarity score, and the participant score.
[0144] On the other hand, if a new participant joins during the streaming preparation time, steps S200 to S400-1 can be repeated to update the list of candidate streamers.
[0145] FIG. 12 is a flowchart illustrating a method for a participant to join a party room according to an embodiment of the present invention.
[0146] Referring to FIG. 12, when a user registers as a member or logs in, the similarity calculation unit 280 can calculate the preference similarity between the user and an already registered party room, and the preference similarity between the user and the room administrator streamer of the party room, based on user-specific information (the user's personal information and interest information) stored and managed by the management unit 210.
[0147] That is, when a user logs in or registers as a member, the server 200 can recommend at least one of a party room and a room manager streamer based on the user's personal information and interest information (S1000).
[0148] For example, when logging in, thumbnails of party rooms may be displayed on the main screen, with party rooms currently being live streamed being displayed at the top and recommended party rooms being displayed at the bottom, and users may search for party rooms using a search function, etc.
[0149] Next, when the user selects the thumbnail of a specific party room, the user will see the party room entry screen 10 as shown in FIG. 8, and through screen 10, the user can see the image 11 output from the camera of the participant's terminal, the title 12 of the party room, and the number of participants in the party room, and after setting their own camera on / off and microphone on / off, they can enter the party room (S1100).
[0150] Next, the user can use the hand raising function 48 to set whether or not to support fellow streamers (S1200).
[0151] Next, if the participant is selected as a fellow streamer by the room manager streamer terminal (Y in S1300), the video output from the selected fellow streamer's terminal, i.e., the participant's terminal, is output to the fellow streamer's area in the party room and the screen can be shared (S1400). That is, the participant will participate in live streaming as a fellow streamer.
[0152] On the other hand, if the participant is not selected as a fellow streamer in the party room (N in S1300), the participant will participate as a viewer watching the live streaming (S1500) and can participate in the live streaming using the chat function.
[0153] As a result, the community live streaming service providing system and method of the present invention enables a room administrator streamer to select streamers to collaborate with from among the participants participating in the live streaming and live stream live content together.
[0154] Although the embodiment of the present invention has been described in detail above with reference to the accompanying drawings, the present invention is not necessarily limited to such an embodiment, and various modifications can be made within the scope of the technical idea of the present invention. Therefore, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention, but are merely for explanation, and the scope of the technical idea of the present invention is not limited by such embodiments. Therefore, it should be understood that the above-mentioned embodiments are merely illustrative and not limiting in all respects. The scope of protection of the present invention should be interpreted according to the following claims, and any technical idea within the scope equivalent thereto should be interpreted as being included in the scope of the present invention. [Explanation of symbols]
[0155] 100a~100n User devices (room administrator streamer device, candidate streamer (participant) device, fellow streamer device, viewer device) 200 Servers 210 Management Department 220 Database 230 UI generation section 240 User mode setting section 241 Room Admin Streamer Mode 2411 Party Room Setup Department 2412 Candidate Streamer List Generation Unit 2413 Preliminary Examination Department 242 Fellow Streamer Mode 243 Candidate Streamer Mode 244 Viewer Mode 250 Setting confirmation section 260 Network Quality Measurement Unit 270 Service Support Department 280 Similarity Calculation Unit 290 Recommendation Department
Claims
1. A streaming service providing system comprising a plurality of user terminals and a server for providing a live streaming service, The plurality of user terminals include: a room manager streamer device that generates a party room; A participant terminal for participating in the party room; Equipped with The server, a setting confirmation unit that, when receiving a request to enter the party room from the participant terminal, confirms whether a camera and a microphone of the participant terminal are on or off; A network quality measurement unit for checking the network quality of the participant terminal; a candidate streamer list generating unit for providing the room manager streamer terminal with a candidate streamer list based on the on / off state of a camera and a microphone and a network quality for at least one participant terminal; a service support unit that outputs the camera image of the room manager streamer terminal and the camera image of the participant terminal selected as a fellow streamer by the room manager streamer terminal to a set area of a live streaming screen and provides the same to the user terminals that have joined the party room; A community live streaming service providing system comprising:
2. The network quality measurement unit includes: determining a network quality grade based on the communication bandwidth, latency, packet loss, and playback buffer latency of the participant terminal; The community live streaming service providing system of claim 1 , wherein the service support unit supports differential video quality according to a network quality grade of the participant terminal.
3. The candidate streamer list generation unit The community live streaming service providing system of claim 2 , further comprising: providing, to the room manager streamer terminal, a list of candidate streamers including participant information corresponding to the participant terminal in descending order of the network quality grade while the camera and microphone are on.
4. a management unit that stores and manages user information including personal information and interest information, party room information, and participant activity history information; a recommendation unit that compares the user information with the party room information and the user information of the room manager streamer, and recommends party rooms and room manager streamers to the user terminal in order of preference similarity; The community live streaming service providing system of claim 1 , further comprising:
5. a similarity calculation unit that calculates a similarity between the party room and the party room information by comparing the party room information with user information and a participant activity history of the participants in the party room; The candidate streamer list generation unit The community live streaming service providing system according to claim 4 , further comprising: generating a list of candidate streamers based on an on / off state of a camera and a microphone for at least one participant terminal, a network quality, and a similarity to the party room.
6. The user information includes personal information including at least one of age, sex, country / region, and language, and interest information by category; The party room information includes at least one of a category, a title of the party room, party room introduction information, related tags, and a capacity of the party room; The community live streaming service providing system of claim 5, wherein the participant activity history information includes at least one of the number and frequency of participation in a party room, donation information, party evaluation score, number of times of desire to become a fellow streamer, and number of times of selection of a fellow streamer.
7. The device further includes a UI generating unit that provides a UI (User Interface) to the user terminal, The UI generating unit provides a live streaming screen when generating the party room; The live streaming screen is A background area, a plurality of split screen areas overlapping the background area, and a plurality of function icons; 3. The community live streaming service providing system of claim 2, wherein the camera output areas of the fellow streamers are arranged in the multiple split screen areas centered around the camera output area of the room administrator streamer terminal, and a location number is set in the camera output area of each fellow streamer.
8. 8. The community live streaming service providing system of claim 7, further comprising a pre-screening unit that provides the list of candidate streamers including participant information when the camera output area of the fellow streamer is selected on the room manager streamer terminal, and receives selection of a fellow streamer of the location number.
9. The UI generation unit is When the camera output area of the fellow streamer is selected on the room manager streamer terminal, a pre-screening screen for the corresponding location number is provided; The pre-screening screen is The candidate streamer list will be arranged in order of priority, and a candidate preview including participant information and the camera output image of the participant's device will be displayed. A mainframe area that provides a list of the highest priority candidate streamers overlaid with a preview; The community live streaming service providing system according to claim 7 , comprising:
10. The service support unit includes:
10. The community live streaming service providing system of claim 9, wherein when the room manager streamer terminal selects a candidate streamer from the list of candidate streamers in the main frame area, a camera output image of the corresponding participant terminal is output to the split screen area of the corresponding location number.
11. A community live streaming service providing method executed by a room manager streamer terminal that generates a party room, a plurality of user terminals including participant terminals that participate in the party room, and a server that provides a live streaming service, comprising: (a) the room manager streamer terminal creating a party room; (b) when the server receives a request to enter the party room from the participant terminal, checking whether a camera and a microphone of the participant terminal are on / off; (c) the server checking the network quality of the participant terminal; (d) the server providing the room manager streamer terminal with a list of candidate streamers including the on / off status of the camera and microphone and the network quality for at least one participant terminal; (e) the room manager streamer terminal selecting fellow streamers; (f) the server outputs the camera video of the room manager streamer terminal and the camera video of the participant terminal selected as a fellow streamer by the room manager streamer terminal to a set area of a live streaming screen and provides them to the user terminals participating in the party room; A method for providing a community live streaming service, including:
12. In the step (c), determining a network quality grade based on the communication bandwidth, latency, packet loss, and playback buffer latency of the participant terminal; The method of claim 11, wherein in step (f), differential video quality is supported according to a grade of network quality of the participant terminal.
13. In the step (d), The method of claim 12, further comprising providing the room manager streamer terminal with a list of candidate streamers including participant information corresponding to the participant terminals in descending order of network quality grade while the camera and microphone are on.
14. The server stores and manages user information including personal information and interest information, party room information, and participant activity history information; The server compares the user information with the party room information and the user information of the room manager streamer, respectively, and recommends party rooms and room manager streamers in order of preference similarity to the user terminal; The method of claim 11 , further comprising:
15. The method further includes a step of the server calculating a similarity between the party room information and user information and participant activity history of participants in the party room by comparing the party room information, In the step (d), The method for providing a community live streaming service according to claim 14, further comprising generating a list of candidate streamers based on a camera and microphone on / off state, a network quality, and a similarity to the party room for at least one participant terminal.
16. The user information includes personal information including at least one of age, sex, country / region, and language, and interest information by category; The party room information includes at least one of a category, a title of the party room, party room introduction information, related tags, and a capacity of the party room; The method for providing a community live streaming service of claim 15, wherein the participant activity history information includes at least one of the number and frequency of participation in a party room, donation information, party evaluation score, number of times of desire to become a fellow streamer, and number of times of selection of a fellow streamer.
17. The method further includes a step of the server providing a live streaming screen to the room manager streamer terminal when the party room is generated; The live streaming screen is A background area, a plurality of split screen areas overlapping the background area, and a plurality of function icons; 13. The community live streaming service providing method of claim 12, wherein the plurality of split screen areas are arranged with the camera output areas of the room manager streamer terminal at the center, and a location number is set in the camera output area of each fellow streamer.
18. The method of claim 17, further comprising the step of: when the server selects a camera output area of the fellow streamer on the room manager streamer terminal, providing a pre-screening screen for a corresponding location number.
19. The pre-screening screen is The candidate streamer list will be arranged in order of priority, and a candidate preview including participant information and the camera output image of the participant's device will be displayed. A mainframe area that provides a list of the highest priority candidate streamers overlaid with a preview; The method of claim 18, comprising:
20. 20. The method of claim 19, wherein step (d) includes a step of the server outputting a camera output image of a corresponding participant terminal to a split screen area of a location number when the room manager streamer terminal selects a candidate streamer from the list of candidate streamers in the mainframe area.
Citation Information
Patent Citations
Game management device, game system, game management method, and program
JP2014097129A
Live broadcast system
JP2019036969A
Dynamically modifying live video streams for participant devices in digital video rooms
JP2021182375A
Video distribution system, video distribution method, and video distribution program
JP2022184845A
Information processing system, information processing method, and information processing program
JP7449523B2
