Servers, methods, and computer programs

Abstract

This invention provides servers, methods, and computer programs for live streaming. [Solution] In a live streaming system, the server performs the following functions: receiving streaming data from a first user terminal of a first user; detecting music from the streaming data; displaying first information about the music in the live streaming room; and transmitting second information about the music to the second user terminal of a second user in response to an operation on the first information from the second user terminal of a second user. The application of AI technology not only enables real-time identification of music, but can also increase viewer engagement, help live streamers select more popular songs, and prevent potential violations within the live streaming room. Therefore, the user experience may be improved.

Description

Technical Field

[0001] The present disclosure relates to information and communication technology, and more particularly, to a server, a method, and a computer program in live streaming.

Background Art

[0002] Some applications and platforms provide live streaming services that allow live streamers and viewers to interact. For example, a live streamer may perform a performance to cheer up viewers, or a viewer may send gifts or donations to support the live streamer.

[0003] Currently, viewers in a live streaming room often have difficulty identifying the title or other information of a song even when listening to it. In such cases, viewers need to ask others or use third-party music recognition tools to identify the music. However, due to the fast tempo and frequent interactions in live streaming, they often cannot do so. Patent Document 1 discloses a method for enabling viewers to grasp information about music in a live streaming room.

[0004] However, these methods are not necessarily effective and often interfere with the viewing experience of live streaming. The present disclosure aims to address the problems faced by viewers in identifying the music played or sung by a live streamer during live streaming.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

[0006] One embodiment of the present disclosure relates to a server including a circuit, which is configured to perform the following functions: receiving streaming data from a first user terminal of a first user; detecting music from the streaming data; displaying first information about the music in a live streaming room; and transmitting second information about the music to the second user terminal of a second user in response to an operation on the first information from the second user terminal of a second user.

[0007] Another embodiment of the present disclosure is a method, which includes the steps of: receiving streaming data from a first user terminal of a first user; detecting music from the streaming data; displaying first information of the music in a live streaming room; and transmitting second information of the music to the second user terminal of a second user in response to an operation on the first information from the second user terminal of a second user.

[0008] Another embodiment of the present disclosure relates to a computer program that enables a server to have the following functions: to receive streaming data from a first user terminal of a first user; to detect music from the streaming data; to display first information about the music in a live streaming room; and to transmit second information about the music to the second user terminal of a second user in response to an operation on the first information from the second user terminal of a second user.

[0009] According to this disclosure, the application of AI technology can not only enable real-time music identification, but also increase viewer engagement, help live streamers select more popular songs, and prevent potential violations within live streaming rooms. Therefore, the user experience may be improved. [Brief explanation of the drawing]

[0010] [Figure 1] This is a schematic diagram showing the configuration of a live streaming system 1 based on some embodiments of the present disclosure. [Figure 2] This is a block diagram of a user terminal 20 based on some embodiments of the present disclosure. [Figure 3] This is a block diagram of server 10 based on some embodiments of the present disclosure. [Figure 4] Figure 3 is a table showing an example data structure for the stream DB320. [Figure 5] Figure 3 is a table showing an example data structure for user DB322. [Figure 6] Figure 3 is a table showing an example data structure for the gift DB324. [Figure 7] Figure 3 is a table showing an example data structure of the music DB326. [Figure 8] This is an illustrative screen image of a live streaming room screen 600 displayed on the display of the live streamer's user terminal 20 or the viewer's user terminal 30. [Figure 9] This is an illustrative screen image of a live streaming room screen 600 displayed on the display of the live streamer's user terminal 20 or the viewer's user terminal 30. [Figure 10] This is an illustrative screen image of a live streaming room screen 600 displayed on the display of the live streamer's user terminal 20 or the viewer's user terminal 30. [Figure 11] This is an illustrative screen image of a live streaming room screen 600 displayed on the display of the live streamer's user terminal 20 or the viewer's user terminal 30. [Figure 12] This is an illustrative screen image of a live streaming room screen 600 displayed on the display of the live streamer's user terminal 20 or the viewer's user terminal 30. [Figure 13] This is an exemplary functional structure of a live streaming system 1 based on certain embodiments of the present disclosure. [Figure 14] This is an exemplary sequence diagram of a live streaming system 1 based on some embodiments of the present disclosure. [Figure 15] This is an exemplary hardware configuration of an information processing device based on some embodiments of the present disclosure. [Modes for carrying out the invention]

[0011] In the following drawings, identical or similar components, members, procedures, or signals are denoted by the same reference numerals, and redundant explanations are omitted where appropriate. Furthermore, some components that are not essential to the description of each drawing are omitted.

[0012] A live streaming system 1 based on certain embodiments of this disclosure provides enhanced features that facilitate communication and interaction among users. More specifically, it entertains viewers and live streamers in a technical way.

[0013] Fig. 1 shows a schematic diagram illustrating the configuration of a live streaming system 1 according to some embodiments of the present disclosure. The live streaming system 1 provides a live streaming service for real-time interaction between a live streamer (also referred to as a liver, streamer, or distributor) LV and viewers (also referred to as an audience) AU (AU1, AU2...). As shown in Fig. 1, the live streaming system 1 can include a server 10, a user terminal 20, and user terminals 30 (30a, 30b...). The user terminal 20 may be a live streamer, and the user terminal 30 may be a viewer. In some embodiments, the live streamer and the viewer may be referred to as users. The server 10 can include one or more information processing devices connected via a network NW. The user terminals 20 and 30 may be, for example, portable terminals such as smartphones, tablets, notebook PCs, recorders, portable game machines, wearable terminals, or stationary computers such as desktop PCs. The server 10, the user terminal 20, and the user terminal 30 may be communicably connected by any type of wired or wireless network NW.

[0014] An app provider (not shown) that provides the live streaming system 1, the live streamer LV, the viewer AU, and the server 10 is involved. The live streamer LV can be a person who records content such as their own songs, talks, performances, game streaming, etc. on their user terminal 20 and uploads it to the server 10 to distribute the content in real time. In some embodiments, the live streamer LV can communicate with the viewer AU via the live streaming.

[0015] The application provider can provide a platform for content that is live-streamed on the server 10. In some embodiments, the application provider may be a media or manager that manages real-time communication between the live streamer LV and the viewer AU. The viewer AU can access the platform via the user terminal 30 and select and watch the content they wish to view. The viewer AU can use the user terminal 30 to interact with the live streamer, such as by commenting on or cheering for them. The live streamer providing the content can respond to such comments and cheers. The live streamer's response can be transmitted to the viewer AU via video and / or audio. Thus, mutual communication between the live streamer and the viewer can be achieved.

[0016] As used herein, "live streaming" may refer to data transmission that enables a viewer AU to substantially play and view content recorded by a live streamer LV on a user terminal 20 via a user terminal 30. In some embodiments, "live streaming" may also refer to streaming achieved through the above-described data transmission. Such live streaming can be implemented using known technologies such as HTTP live streaming, CMAF (Common Media Application Format), WebRTC (Web Real-Time Communications), RTMP (Real-Time Messaging Protocol), and MPEG DASH. Such live streaming may further include embodiments in which the viewer AU can play or view the content with a certain delay while the live streamer is recording the content. The degree of such delay should preferably be small enough to allow the live streamer LV and the viewer AU to communicate. However, live streaming is different from so-called on-demand delivery. More specifically, such on-demand delivery may refer to storing all the data of the recorded content on a server and providing the data to the user from the server at random timings in response to the user's request.

[0017] As used herein, "streaming data" can refer to data including image data and audio data. More specifically, the image data (which may also be referred to as video data) may be generated by the image capture functions of the user terminals 20 and 30. The audio data (which may also be referred to as audio data) may be generated by the audio input functions of the user terminals 20 and 30. The streaming data may be played back on the user terminals 20 and 30 so that the user can view content related to the user. In some embodiments, between the generation of the streaming data on the user terminal of the live streamer and the playback on the user terminal of the viewer, processes for changing the data format, size, and specifications, such as compression, decompression, encoding, decoding, transcoding, etc., are assumed. Before and after such processes, the content (video and audio) is not substantially changed. Therefore, in the current embodiments of the present disclosure, it is explained that the streaming data before being processed and the streaming data after being processed are the same. That is, when the streaming data generated by the user terminal of the live streamer is played back on the user terminal of the viewer via the server 10, the streaming data generated by the user terminal of the live streamer, the streaming data that has passed through the server 10, and the streaming data received and played back by the user terminal of the viewer are all the same streaming data.

[0018] As shown in FIG. 1, the live streamer LV provides live streaming. The user terminal 20 of the live streamer generates streaming data by recording the video and (or) audio of the streamer, and transmits it to the server 10 via the network NW. At the same time, the user terminal 20 can display the video VD on the display of the user terminal 20 and check the streaming content of the live streamer LV.

[0019] Viewers AU1 and AU2 of user terminals 30a and 30b, which request the platform to provide the live stream of the live streamer, receive streaming data corresponding to the live stream via the network NW, play the received streaming data to display video VD1 and VD2 on a display, and output audio from speakers or the like. The video VD1 and VD2 displayed on user terminals 30a and 30b are substantially the same as the video recorded by the user terminal of the live streamer LV, and the audio output from user terminals 30a and 30b is substantially the same as the audio recorded by the user terminal of the live streamer LV.

[0020] The recording of the live streamer on the user terminal 20 may occur simultaneously with the playback of the streaming data on the user terminals 30a and 30b of the viewers AU1 and AU2. When viewer AU1 inputs a comment regarding the live streamer's content into user terminal 30a, the server 10 displays the comment in real time on the live streamer's user terminal 20, and also on the user terminals 30a and 30b of viewers AU1 and AU2, respectively. If the live streamer LV responds to the comment, the response is output as text, image, video, or audio from the user terminals 30a and 30b of viewers AU1 and AU2, thereby enabling communication between the live streamer LV and viewers AU1 and AU2. Thus, the live streaming system can realize two-way live streaming.

[0021] Figure 2 is a block diagram showing the functions and configuration of the user terminal 20 shown in Figure 1, based on an embodiment of the present disclosure. The user terminal 30 has the same functions and configuration as the user terminal 20. The blocks depicted in the block diagrams of this specification are implemented by hardware such as a computer CPU or mechanical parts, and software such as a computer program that represents a functional block performed by the cooperation of these elements. Therefore, it will be understood by those skilled in the art that functional blocks can be implemented in various ways through combinations of hardware and software.

[0022] The live streamer (LV) and viewer (AU) can download and install the live streaming application (live streaming app) described herein from a download site to their user terminals 20 and 30 via the network (NW). Alternatively, the live streaming app may be pre-installed on the user terminals 20 and 30. By performing live streaming on the user terminals 20 and 30, they can communicate with the server 10 via the network (NW) and implement multiple functions. These functions, implemented by the execution of the live streaming app by the user terminals 20 and 30 (more specifically, by the processor such as the CPU), are described below as functions of the user terminals 20 and 30. These functions are basically functions that the live streaming app enables the user terminals 20 and 30 to implement. In some embodiments, these functions may be implemented by sending them from the server 10 to the web browser of the user terminals 20 and 30 via the network (NW) and executing them by a computer program in the web browser. This computer program may be written in a programming language such as HTML (Hyper Text Markup Language).

[0023] The user terminal 20 includes a streaming unit 100 and a viewing unit 200. In some embodiments, the streaming unit 100 is configured to record the user's audio and / or video data and generate streaming data to send to the server 10. The viewing unit 200 is configured to receive and play the streaming data from the server 10. In some embodiments, the user can activate the streaming unit 100 when broadcasting or when viewing a stream. In some embodiments, the user terminal activating the streaming unit 100 may be referred to as a live streamer or as the user terminal generating the streaming data. The user terminal activating the viewing unit 200 may be referred to as a viewer or as the user terminal playing the streaming data.

[0024] The streaming unit 100 may include a video control unit 102, an audio control unit 104, a distribution unit 106, and a UI control unit 108. The video control unit 102 may be connected to a camera (not shown), and the video is controlled by the camera. The video control unit 102 can acquire video data from the camera. The audio control unit 104 may be connected to a microphone (not shown), and the audio is controlled by the microphone. The audio control unit 104 can acquire audio data from the microphone.

[0025] The distribution unit 106 receives streaming data, which includes video data from the video control unit 102 and audio data from the audio control unit 104, and transmits it to the server 10 via the network NW. In some embodiments, the distribution unit 106 transmits the streaming data in real time. That is, the generation of the streaming data from the video control unit 102 and the audio control unit 104 and the distribution by the distribution unit 106 are performed simultaneously.

[0026] The UI control unit 108 controls the UI of the live streamer. The UI control unit 108 is connected to a display (not shown) and is configured to generate the streaming data for the recipient to whom the distribution unit 106 transmits, plays, and displays on the display. The UI control unit 108 is configured to display an object to be manipulated or an object to receive instructions on the display and to accept tap input from the live streamer.

[0027] The viewing unit 200 may include a UI control unit 202, a rendering unit 204, and an input transmission unit 206. The viewing unit 200 is configured to receive streaming data from the server 10 via a network NW. The UI control unit 202 controls the viewer's UI. The UI control unit 202 is connected to a display (not shown) and / or a speaker (not shown) and is configured to display video on the display and output audio from the speaker by playing the streaming data. In some embodiments, outputting video on the display and outputting audio from the speaker may be referred to as "playing streaming data". The UI control unit 202 is connected to an input unit such as a touch panel, keyboard, or display and can acquire user input.

[0028] The rendering unit 204 may be configured to render streaming data from the server 10 and frame images. The frame images may include user interface objects for receiving user input, comments entered by viewers, and data received from the server 10. The input transmission unit 206 is configured to receive the user input from the UI control unit 202 and transmit it to the server 10 via the network NW.

[0029] In some embodiments, the user input may be clicking on an object on the user's terminal screen, such as selecting a live stream, entering a comment, sending a gift, following or unfollowing a user, voting in an event, or playing a game. For example, the input transmission unit 206 may generate gift information and send it to the server 10 via the Internet network when the viewer's terminal clicks on a gift object on the screen to send a gift to the live streamer.

[0030] In some embodiments, the user terminal 20 may include a terminal-side gift database (not shown). The terminal-side gift database is configured to store the gift information of the user terminal 20 or 30. The terminal-side gift database may include a gift ID, an icon ID, an effect data ID, and a last updated date. The gift ID may identify the gift. The icon ID may be the icon data of the gift object. The effect data ID may identify the data that implements the effect corresponding to the gift. The last updated date may identify the last updated date of the gift.

[0031] In some embodiments, the viewer may download the gift in advance, or download the gift when sending it. In some embodiments, the gift information may be downloaded and stored in the terminal-side gift database in advance. In some embodiments, the terminal-side gift database may include a gift list corresponding to the gift list provided by the server 10. In some embodiments, the gift list in the terminal-side gift database may be synchronized with the server 10 periodically or by user operation.

[0032] Figure 3 is a block diagram of the server 10 based on some embodiments of the present disclosure. The server 10 may include a streaming information unit 302, a relay unit 304, a processing unit 306, a stream DB 320, a user DB 322, a gift DB 324, a music DB 326, and a machine learning model 330.

[0033] The streaming information unit 302 receives live streaming requests from the user terminal 20 of the live streamer via the network NW. Upon receiving a request, the streaming information unit 302 registers the live streaming information in the stream DB 320. In some embodiments, the live streaming information may consist of the stream ID of the live streaming and / or the live streamer ID of the live streamer corresponding to the live streaming.

[0034] When the streaming information unit 302 receives a request for information about the live stream from the viewer via the network NW to the viewing unit 200 of the user terminal 30, it refers to the stream DB 320 and generates a list of available live streams.

[0035] Subsequently, the streaming information unit 302 transmits the list to the user terminal 30 via the network NW. The UI control unit 202 of the user terminal 30 generates a live streaming selection screen based on the list and displays the list on the user terminal 30's display.

[0036] When the input transmission unit 206 of the user terminal 30 receives a live streaming selection made by the viewer on the live streaming selection screen, it generates a distribution request including the stream ID of the selected live streaming and sends it to the server 10 via the network. The streaming information unit 302 can then begin providing the live streaming specified by the stream ID in the distribution request to the user terminal 30. The streaming information unit 302 can update the stream DB 320 and add the viewer ID of the viewer on the user terminal 30 to the live streamer ID of the stream ID.

[0037] The relay unit 304 can relay the transmission of the live stream from the live streamer's user terminal 20 to the viewer's user terminal 30 in the live stream initiated by the streaming information unit 302. The relay unit 304 can receive a signal indicating user input from the viewer from the input transmission unit 206 while the streaming data is being played back. The signal indicating user input may be an object designation signal indicating the designation of an object displayed on the user terminal 30's display. The object designation signal may include the viewer's viewer ID, the live streamer ID of the live streamer distributing the live stream the viewer is watching, and the object ID designated by the object. If the object is a gift, the object ID may be a gift ID, etc. Similarly, the relay unit 304 can receive a signal indicating user input from the live streamer, such as the object designation signal, from the streaming unit 100 of the user terminal 20 while the streaming data is being played back.

[0038] The processing unit 306 is configured to process data within the live streaming room. In some embodiments, the processing unit 306 may receive streaming data such as video and audio, or interaction data such as comments and event information, within the live streaming room. In some embodiments, the processing unit 306 may receive interaction data such as gifts, comments, and votes from viewers within the live streaming room. In some embodiments, the processing unit 306 may receive streaming data or interaction data from the live streamer or viewers in real time from historical data.

[0039] In some embodiments, the processing unit 306 may collect data for analyzing the trends and preferences of live streamers and viewers in the live streaming room. In some embodiments, the processing unit 306 may perform such analysis via an internal service or a pre-trained machine learning model, or via a third-party service or machine learning model such as a speech-to-text service, TTS or STT technology, Google Gemini, or ChatGPT.

[0040] In some embodiments, the processing unit 306 may perform some application based on the results of the analysis. For example, the processing unit 306 may rank the top 10 most frequently requested songs based on the preferences of viewers in the live streaming room. In some embodiments, the application of the data may be performed via an internal service or a pre-trained machine learning model, or via a third-party service or machine learning model.

[0041] In some embodiments, the processing unit 306 may transmit the analysis or application of the data to the live streamer or viewers for reference. For example, the processing unit 306 may transmit to the live streamer the percentage of viewers who most prefer a particular music genre, allowing the live streamer to perform or sing music based on the preferences of the viewers in the live streaming room.

[0042] In some embodiments, the server 10 may further include a gift information unit (not shown) and a gift processing unit (not shown). The gift information unit provides gift information to the corresponding streamer and viewer. The gift information unit transmits gift information for the user terminal to the streamer in response to a request from the user terminal. The gift information unit obtains effect data from the gift DB corresponding to the gift ID included in the gift information signal received by the relay unit 304. The gift information unit transmits the obtained effect data to other user terminals 20, 30 as a response to the gift transmission request signal.

[0043] The gift processing unit updates the user DB 322 to update the streamer's and viewers' points according to the points of the gift identified by the gift ID included in the gift redemption signal. Specifically, the gift processing unit refers to the gift DB and identifies the points to be assigned to the gift ID included in the received gift redemption signal. The gift processing unit then updates the user DB 322 and adds the determined points to the points of the streamer ID included in the gift redemption signal. In some embodiments, the gift processing unit may update the user DB 322 and subtract the determined points from the points of the viewer ID included in the gift redemption signal.

[0044] Figure 4 is a table showing an exemplary data structure of the Stream DB320 in Figure 3. The Stream DB320 holds information about the live stream currently in progress. The Stream DB320 stores, in relation to each other, a Stream ID for identifying the live stream on the live streaming platform provided by the Live Streaming System 1, a Live Streamer ID for identifying the live streamer providing the live stream, and a Viewer ID for identifying the viewers of the live stream.

[0045] Figure 5 is a table showing an exemplary data structure of the user DB322 in Figure 3. The user DB322 holds information about users. The user DB322 stores, in relation to each other, a user ID to identify the user, points to identify the points accumulated by the user, a level to identify the user's level, and a status to identify the user's status. The points are electronic value that circulates within the live streaming platform. The level may be an indicator of the amount of activity or engagement of the user on the live streaming platform. The status may be the user's identity or membership status on the live streaming platform.

[0046] Figure 6 shows a table illustrating the exemplary data structure of the Gift DB324 in Figure 3. The Gift DB324 holds information about gifts that viewers can use during live streaming. The Gift DB324 stores, in association with each other, a Gift ID to identify the gift, the amount of points that viewers spend to send a gift to the streamer, an Event ID to identify the event to which the gift corresponds, and gift effect data.

[0047] Viewers can send gifts to streamers by paying equivalent value points for their desired gifts while watching the live stream. Such equivalent value point payments can be made by appropriate electronic means; for example, viewers can pay equivalent value points to the administrator. Alternatively, bank transfers or credit card payments may be used. The relationship between awarded points and equivalent value points can be set at the administrator's discretion.

[0048] The gift is electronic data with the following characteristics: - It can be purchased in exchange for points (explained in detail later), or it may be given away for free. - Viewers can send gifts to streamers. - Giving gifts to streamers is sometimes referred to as "using gifts" or "throwing gifts." - Some gifts can be used immediately upon purchase, while others can be used later at the buyer's or recipient's discretion after purchase or gifting. - When a viewer sends a gift to a streamer, the streamer is awarded points corresponding to the gift, and an effect associated with the gift is displayed. For example, the effect corresponding to the gift is displayed on the live stream screen.

[0049] The effect in question is a visual, auditory, or tactile effect (e.g., vibration) that characterizes the gift, or a combination thereof. Examples of visual effects include animation, images, and flashing lights. Examples of auditory effects include sound effects and voices. The effect data is data that enables such effects to be implemented on the user terminal 20, and the user terminal 20 implements such effects by processing the effect data. Since the technology for implementing the effect data is publicly known, a detailed explanation thereof will be omitted below.

[0050] Figure 7 is a table showing an exemplary data structure of the music DB326 in Figure 3. The music DB326 holds information about events on the live streaming platform provided by the live streaming system 1. The music DB326 stores and associates resources for identifying music resources, such as a music ID for identifying music, a title for identifying the title of music, a singer for identifying the artist of music, and a URL for identifying the location of music.

[0051] In some embodiments, the music DB 326 may store a dance ID to identify dance information if there is dance information corresponding to the music. In some embodiments, there may be a separate dance DB, for example, to store the corresponding dance information. In some embodiments, the dance information may be facial expressions or body movements from the user, and may be stored as absolute or relative coordinates of, for example, the head, hands, and feet. In some embodiments, these coordinates may be determined by video or image detection technology using a machine learning model or the like. In some embodiments, any technology can be flexibly introduced to realize the implementation of music and dance information.

[0052] Figures 8 to 12 are illustrative screen images of a live streaming room screen 600 displayed on the display of a live streamer's user terminal 20 or a viewer's user terminal 30. When a viewer selects a live streaming room and enters it, the live streamer's live streaming room screen 600 may be displayed on the display. The live streaming room screen 600 may include a live streamer information object 602, a live streamer image 604, a message zone 606, a message input box 608, a gift object 610, a shared object (not shown), etc.

[0053] The live streamer information object 602 displays information about the streamer. The live streamer image zone 604 displays an image or video of the streamer, which may be obtained by playing video data. The message zone 606 displays messages from viewers, streamers, or the server 10. The message input zone 608 indicates an input zone for the streamer or viewers to enter messages, etc. The gift object 610 provides the user with the ability to send gifts to the live streamer, and the share object 612 provides the user with the ability to share the live streaming room. In some embodiments, the UI and related functions within the live streaming room may be flexibly designed.

[0054] In some embodiments, the live streamer may perform music M or sing a song of music M within the live streaming room, as shown in Figure 8. In some embodiments, the live streamer may perform a dance or beatboxing within the live streaming room. In some embodiments, the music may be detected automatically or manually in response to actions from viewers. For example, the live streaming room screen 600 may include a music icon button 612, as shown in Figure 8. The music icon button 612 may be clicked by the user to detect music within the live streaming room.

[0055] In some embodiments, the streaming data within the live streaming room may include visual and audio streaming data from the live streamer. For example, the streaming data may include a series of images and sounds from the live streamer. In some embodiments, the audio streaming data may include any possible audio data, such as audio from a microphone, music from a user terminal, or sounds that are automatically or manually triggered.

[0056] In some embodiments, the audio data of music received from the microphone or the user terminal itself may be a resource independent of other sounds, or it may be audio data mixed with other noises. In some embodiments, if the audio data is mixed with noise, data preprocessing may be performed using audio processing techniques or machine learning techniques to remove the noise.

[0057] In some embodiments, the processing unit 306 may receive a specific portion of the audio streaming data (such as music audio data) from the live streaming room. In some embodiments, the processing unit 306 may analyze information about the music. In some embodiments, the information about the music may include, for example, the song title, the artist, the album, the release date, the lyrics, and a description of the artist. In some embodiments, the information about the music may include any possible data related to the music.

[0058] In some embodiments, the processing unit 306 may transmit information about the music to the live streamer or viewer and display information about the song. In some embodiments, the information displayed on the user terminal of the live streamer or viewer may be displayed automatically when entering or starting the live streaming room and during the live streaming room, or its display may be manually triggered by the operation of a UI object or the like. For example, information about the song may be displayed when the live streamer plays the song, or in response to a viewer clicking a UI button or the like.

[0059] In some embodiments, the music information may be displayed on screen 600 for reference, as shown in Figure 9. In some embodiments, only a portion of the information may be displayed on screen 600. For example, as shown in Figure 9, the song title and artist may be displayed on screen 600. In some embodiments, a portion P1 of the information may be displayed on screen 600, and another portion P2 of the information may be displayed in response to user interaction. For example, after the song title is displayed, a UI button may be displayed, and when the user clicks it, other information such as a description of the artist and lyrics may be displayed.

[0060] In some embodiments, AI virtual characters such as AI virtual live streamers or AI virtual assistants may be generated based on audio streaming data such as music. For example, as shown in Figure 10, an AI virtual singer VS or an AI virtual dancer VR may be generated and displayed on screen 600 within the live streaming room. In some embodiments, the model building of the virtual character may be generated via an internal service or a third-party service such as Preferred Network or LIVE 2D. In some embodiments, the generation of the behavior and interactions of the AI ​​virtual character may be achieved by a pre-trained or third-party machine learning model such as Google Gemini or ChatGPT.

[0061] In some embodiments, the facial expressions and body movements of the AI ​​virtual character may be generated based on the music, etc. For example, the mouth of the AI ​​virtual singer may change based on the lyrics, etc. In some embodiments, if the music is danceable, an AI virtual dancer may be generated and dance based on the melody of the music, etc.

[0062] In some embodiments, the processing unit 306 may receive audio streaming data from the live streaming room and extract music from the audio streaming data. In some embodiments, the processing unit 306 may receive video streaming data from the live streaming room and extract, for example, the live streamer's movements related to music or dance. For example, the live streamer may dance by waving their hands or swaying their body, and the server 10 may play corresponding music or encourage the live streamer to perform.

[0063] In some embodiments, the music database may store, for example, information about the music and a dance corresponding to the music. In some embodiments, the dance information may be a specific sequence of facial expressions and body movements from the live streamer. In some embodiments, the live streamer's movements may be detected using any video or image processing technology.

[0064] In some embodiments, an AI virtual singer may be generated to sing along with the live streamer. For example, if the live streamer is singing a love song originally sung by a female and male singer, a male AI virtual singer may be generated to sing along with the live streamer. In some embodiments, an AI virtual instrument player may be generated to perform or assist the live streamer in singing. For example, a virtual cellist or violinist may be generated and displayed while the corresponding song is being played or sung. According to this embodiment, the viewer may feel as if they are experiencing a lounge bar or an orchestral performance, potentially enhancing enjoyment and user experience.

[0065] In some embodiments, server 10 may receive interaction data within the live streaming room. This interaction data may include any possible data within the live streaming room, such as points received by the live streamer, points donated by viewers, and comments and votes from viewers. In some embodiments, server 10 may analyze viewers' preferences for the music and dance based on this interaction data within the live streaming room. In some embodiments, this analysis may be performed by inputting the interaction data into an internal or third-party data analysis service, or into a pre-trained or third-party machine learning model.

[0066] In some embodiments, the analysis may be based on the relationship between viewer contributions and the number of comments at each time point in time when the music is performed. For example, if a live streamer receives the highest number of points when performing or singing songs A, B, and C, the server 10 may recommend that the live streamer perform or sing songs A, B, and C. In some embodiments, the server 10 may recommend songs A, B, and C to other live streamers.

[0067] In some embodiments, the interaction from the viewer may be used to recommend the live streamer of the music. For example, if a viewer has requested a live streamer to sing or play song A, or if the viewer has talked about their favorite singer, the server 10 may acquire this information, analyze the preferences of the viewers in the live streaming room, and recommend song A, the singer, etc., to the live streamer.

[0068] In some embodiments, server 10 may recommend music or performances to the live streamer in real time based on the current topic. The topic may be extracted from television news or trending topics on social media. In some embodiments, server 10 may obtain the topic from an internal database or from an external source such as the internet. For example, if there is television news that a famous singer is holding a concert, server 10 may extract information about the singer and recommend to the live streamer that the singer perform or play one of their songs. Another example is if a dance is gaining popularity on the internet, such as on Weibo, server 10 may recommend the song or performance of the dance to the live streamer.

[0069] In some embodiments, the server 10 may recommend music and dance based on parameters of the viewers in the live streaming room. These parameters may include, for example, age, generation, gender, zodiac sign, blood type, MBTI, etc. For example, if most of the viewers in the live streaming room are around 40 years old, the server 10 may recommend music that is appropriate for their generation.

[0070] In some embodiments, as shown in Figure 11, a message RM may be displayed on screen 600 for the live streamer to refer to when preparing their performance for the audience. The message RM may include, for example, the current status of the live streaming room or the audience's preferences for the performance. In some embodiments, the current status of the live streaming room may include, for example, the number of viewers, a list of viewers, the status of the viewers (online, busy, etc.), or any possible information related to the viewers in the live streaming room.

[0071] In some embodiments, the viewer's preferences for a performance may be their preferences for music, dance, etc., based on analysis results from data analysis services or machine learning models. In some embodiments, the performance may include, for example, the viewer's favorite songs or music genres, or the hottest music topics being discussed on the internet. In some embodiments, the analysis data may be visualized to make it easier for the live streamer to understand and judge a performance for the viewer.

[0072] In some embodiments, server 10 may further recommend music based on viewer parameters. These viewer parameters may include, for example, viewer points, level, or status. For example, SVIP status or a level above 80 may be able to request music preferentially, and server 10 may give higher priority to requests from SVIPs, etc. In some embodiments, server 10 may recommend music based on viewers who spend points or send gifts to the live streamer.

[0073] In some embodiments, the server 10 may recommend to the live streamer not to perform or sing a song, as shown in Figure 12. In some embodiments, the music or performance from the live streamer may be inappropriate in the live streaming room for reasons such as containing offensive language or intellectual property infringement, and the server 10 may display a hint message HM in the live streaming room to that effect. For example, if the live streamer is singing a song that may infringe intellectual property rights, a message such as "This song may infringe intellectual property rights" may be displayed on screen 600.

[0074] In some embodiments, if the server 10 detects inappropriate content in the live streamer's performance, it may mute the live streamer or stop processing streaming data from the live streamer to viewers. For example, if the live streamer is singing a copyrighted song, the server 10 may detect the infringing content and stop providing audio or video streaming data to viewers. According to this embodiment, even if a live streamer may be infringing intellectual property rights or is unaware of any intellectual property-related issues, their performance will not be delivered to viewers. This may improve the user experience.

[0075] Figure 13 is a schematic diagram showing an example of the functional configuration of a live streaming system 1 based on some embodiments of the present disclosure. As described above, the server 10 may generate viewer preferences for music within the live streaming room. The live streamer can perform based on these viewer preferences, thereby attracting more viewers to join the live streaming room to enjoy the live streamer's performance.

[0076] In some embodiments, the generation of the preference analysis may be achieved by a machine learning model, such as machine learning model 330. In some embodiments, the processing unit 306 may acquire corresponding data, input them into the machine learning model 330, and generate the preferences. In some embodiments, the corresponding information may be, for example, audio or video streaming data such as music or images, the status in the live streaming room, interaction data such as comments from the streamer or viewers, ongoing events, points received by the streamer, and real-time or historical data in the live streaming room.

[0077] In some embodiments, the processing unit 306 may infer or predict the preferences of viewers in the live streaming room and generate, for example, an analysis report on preferences based on the information described above. For example, if the live streamer sings or plays many songs in the live streaming room, the interaction data may be input into a machine learning model to analyze the viewers' preferences for those songs. In some embodiments, the machine learning model may be a pre-trained machine learning model or a third-party machine learning model such as Google Gemini or ChatGPT.

[0078] In some embodiments, the processing unit 306 may monitor the status of the live streaming room and provide feedback to the machine learning model 330. In some embodiments, the status within the live streaming room (such as conversations) may be input to the machine learning model 330 for preference estimation or prediction, and dynamic further analysis reports may be generated. For example, several viewers are talking about a popular song. The processing unit 306 may input this discussion to the machine learning model 330. When the discussion ends and the viewers talk about something else (such as a concert by a famous singer), the machine learning model 330 may estimate or predict another song by that singer and regenerate preferences based on the discussion.

[0079] Figure 14 is an exemplary sequence diagram showing the operation of a configuration of a live streaming system 1 based on some embodiments of the present disclosure. In some embodiments, the live streamer may start live streaming by setting up video sources and sound sources such as a camera and a microphone (S302). Once the setup is complete and the live streaming has started, the user terminal 20 may push streaming data to the streaming source (S304).

[0080] In some embodiments, the processing unit 306 may receive the streaming data from the streaming source (S306). In some embodiments, the processing unit 306 may collect the data and extract information useful for analysis from it (S308). For example, the processing unit 306 may extract audio streaming data such as music. In some embodiments, the audio streaming data of the music may be analyzed internally, by a third-party service, or by machine learning technology (S310). Here, for example, a machine learning model may be used for the analysis of the music.

[0081] The machine learning model may identify information about the music, such as the song title and artist (S312). In some embodiments, the processing unit 306 may transmit this information to the live streamer and viewers and display it on the screen 600 in the live streaming room (S314). According to this embodiment, the user in the live streaming room can understand the song and enjoy the atmosphere even more.

[0082] Furthermore, the live streamer and viewers may interact within the live streaming room (S316 and S318). For example, when the live streamer broadcasts and viewers enter the live streaming room, the live streamer may perform, such as singing a song, and the viewers may comment with "likes" and send gifts to support the live streamer. In some embodiments, the processing unit 306 may collect data within the live streaming room (S320). This data may include, for example, streaming data, interaction data, or any possible data within the live streaming room.

[0083] In some embodiments, the processing unit 306 may input the data into an internal or third-party analysis service or machine learning model for analyzing the viewer's musical preferences (S322). Here, a machine learning model is used as an example for analyzing the viewer's musical preferences. The machine learning model may infer or predict the viewer's musical preferences based on real-time or historical parameters within the live streaming room (S324).

[0084] In some embodiments, the processing unit 306 may extract data useful for analysis and generate a report message RM for the live streamer, as shown in Figure 11. For example, the machine learning model may predict with a high probability that the viewer will like songs A, B, and C, and the processing unit 306 may rank the songs and generate an analysis report. In some embodiments, the processing unit 306 may send the analysis report to the live streamer (S328). The live streamer may perform based on the analysis report. According to this embodiment, the live streamer can sing or play songs based on the viewer's preferences, which may improve the user experience.

[0085] In some embodiments, the analysis report may be sent to the viewer, and the viewer may provide feedback on the analysis report. In some embodiments, the processing unit 306 may modify the analysis report based on the feedback from the viewer. According to this embodiment, the analysis report can accurately reflect the viewer's preferences, so that the live streamer can understand the viewer's preferences.

[0086] In some embodiments, the Disclosure provides an AI-based music prompting system that identifies music in real time from live audio and video streaming data, displays related information, provides analysis of viewer interactions and preferences, and assists live streamers in preparing for performances and managing order within the live streaming room, including copyright issues. In some embodiments, the Disclosure may include, for example, an audio or video recognition unit, a music information display unit, an interactive function unit, and a viewer preference analysis unit.

[0087] In some embodiments, the audio or video recognition unit may use AI technology to identify songs and performances from live audio and video streaming data. In some embodiments, the music information display unit may display the identified song title and related information in the live streaming room for reference. In some embodiments, the interactive function unit may allow viewers to click on song information to obtain more detailed information, such as lyrics and artist descriptions. In some embodiments, the viewer preference analysis unit may analyze songs that attract more viewers and provide data to help the live streamer prepare for their performance.

[0088] In some embodiments, when a live streamer plays music during a live stream, the server 10 may use AI technology or the like to analyze the audio streaming data in real time and automatically identify the song. In some embodiments, this recognition process may be implemented based on a large-scale music database or the like. Once the song is identified, the server 10 may automatically display information such as the song title, artist, album, and other related information on the live streaming screen for viewers to refer to.

[0089] In some embodiments, the viewer may click on the information displayed on screen 600 to access more detailed information such as lyrics, external website links, and song history. Server 10 may further record or collect the time the music was played and the corresponding viewer reactions, and perform data analysis. According to this embodiment, this analysis can help the live streamer understand the viewer's musical preferences and optimize future performances.

[0090] Furthermore, server 10 may notify the live streamer of any potential issues within the live streaming room related to the live streamer's performance. For example, server 10 may notify the live streamer of copyright issues based on identified music and provide relevant copyright information to enable the live streamer to comply with copyright laws and avoid potential infringement risks.

[0091] In some embodiments, this disclosure can be applied to multiple scenarios and offer various benefits. For example, it can be broadly applied to live streaming platforms, online music streaming platforms, video sharing platforms, and other scenarios where automatic music identification and display of related music information are required in real-time audio or video streaming.

[0092] In some embodiments, the server 10 may classify the streaming data into different types of streaming data. More specifically, the streaming data may include audio streaming data and video streaming data, and further, for example, the audio streaming data may include audio data from a smartphone microphone or a local music player. In some embodiments, the audio data from the microphone may include the voice of the live streamer, background music or noise from the live streamer's room, etc. In some embodiments, the server 10 may extract each streaming data individually using any possible audio processing or machine learning techniques. For example, the server 10 may separate human voices and background music from the audio streaming data using a machine learning model, etc.

[0093] In some embodiments, the server 10 may provide the viewer with the streaming data they require. For example, the viewer may choose to receive the complete streaming data or only the music streaming data. According to this embodiment, the viewer can more flexibly select between an audio-only mode, a music-only mode, etc., which may improve the user experience.

[0094] In some embodiments, the live streamer LV may be a human or an AI model. The streaming data of the live streamer LV may be generated or rendered by the server 10 or by a user terminal 20, etc. Communication between the live streamer LV and viewers AU1, AU2 may be achieved via a network NW. In some embodiments, the AI ​​model may be internally trained or provided by a third-party service such as Google PaLM, ChatGPT, or other LLMs (Large-Scale Language Models).

[0095] According to this disclosure, the application of AI technology can not only enable real-time music identification, but also increase viewer engagement, help live streamers select more popular songs, and prevent potential violations within live streaming rooms. Therefore, the user experience may be improved.

[0096] Figure 15 is a schematic block diagram of computer hardware for executing a system configuration and processing based on certain embodiments of the present disclosure. The information processing device 900 in Figure 17 is configured, for example, to realize the server 10 and the user terminals 20 and 30, respectively, based on certain embodiments of the present disclosure.

[0097] The information processing device 900 includes a CPU 901, read-only memory (ROM) 903, and random access memory (RAM) 905. Furthermore, the information processing device 900 may also include a host bus 907, a bridge 909, an external bus 911, an interface 913, an input unit 915, an output unit 917, a storage unit 919, a drive 921, a connection port 925, and a communication unit 929. The information processing device 900 may also include an imaging device (not shown), such as a camera. The CPU 901 is an example of a hardware configuration for realizing the functions realized by the components described herein. The functions described herein may also be realized by circuits programmed to realize such functions. Circuits programmed to realize the functions described herein include a CPU (Central Processing Unit), a DSP (Digital Signal Processor), a general-purpose processor, an application-specific processor, an integrated circuit, an ASIC (Application Specific Integrated Circuit), and / or a combination thereof. In this specification, a unit that implements a particular function may be implemented as a circuit programmed to implement that function. This unit includes, but is not limited to, a streaming unit 100, a video control unit 102, an audio control unit 104, a distribution unit 106, a UI control unit 108, a viewing unit 200, a UI control unit 202, a rendering unit 204, an input transmission unit 206, a streaming information unit 302, a relay unit 304, a processing unit 306, a stream DB 320, a user DB 322, a gift DB 324, a music DB 326, a machine learning model 330, and the like.

[0098] The CPU 901 functions as an arithmetic processing unit and control unit, and controls the overall operation or a part of the operation of the information processing unit 900 according to various programs recorded in the ROM 903, RAM 905, storage unit 919, or removable recording medium 923. For example, the CPU 901 controls the overall operation of each functional unit included in the server 10 and the user terminals 20 and 30 in the above-described embodiment. The ROM 903 stores programs and operating parameters used by the CPU 901. The RAM 905 transiently stores programs used when the CPU 901 is executed and parameters that change as appropriate when executing those programs. The CPU 901, ROM 903, and RAM 905 are connected to each other via a host bus 907, which is composed of internal buses such as a CPU bus. The host bus 907 is connected to an external bus 911, such as a peripheral component interconnect / interface (PCI) bus, via a bridge 909.

[0099] The input unit 915 is a device operated by the user, such as a mouse, keyboard, touch panel, button, switch, or lever. The input unit 915 may also be a device that converts physical quantities into electrical signals, such as an audio sensor (microphone, etc.), acceleration sensor, tilt sensor, infrared sensor, depth sensor, temperature sensor, or humidity sensor. The input unit 915 may also be a remote control device that uses infrared rays or other types of radio waves. Alternatively, the input unit 915 may be an external connection terminal 927, such as a mobile phone, that is compatible with the operation of the information processing device 900. The input unit 915 includes an input control circuit that generates an input signal based on information input from the user and outputs the generated input signal to the CPU 901. The user inputs various data and gives instructions to the information processing device 900 for processing operations by operating the input unit 915.

[0100] The output unit 917 includes a device that can visually or audibly notify the user of the acquired information. The output unit 917 may be, for example, a display device such as an LCD, PDP, or OLED, an audio output device such as a speaker or headphones, or a printer. The output unit 917 outputs the results obtained by the processing performed by the information processing device 900 in the form of text, images or other visuals, or audio or other sounds.

[0101] The storage unit 919 is a data storage device and is an example of a storage unit of the information processing device 900. The storage unit 919 includes, for example, magnetic storage devices such as hard disk drives (HDDs), semiconductor storage devices, optical storage devices, magneto-optical storage devices, etc. The storage unit 919 stores programs and various data executed by the CPU 901, as well as various data acquired from external sources.

[0102] The drive 921 is a reader / writer for removable recording media 923 such as magnetic disks, optical disks, magneto-optical disks, and semiconductor memory, and is built into or attached to the information processing device 900. The drive 921 reads information recorded on the installed removable recording media 923 and outputs it to the RAM 905. The drive 921 also writes data to the installed removable recording media 923.

[0103] The connection port 925 is a port used to directly connect equipment to the information processing device 900. The connection port 925 may be, for example, a USB (Universal Serial Bus) port, an IEEE 1394 port, or a SCSI (Small Computer System Interface) port. The connection port 925 may also be an RS-232C port, an optical audio terminal, an HDMI (High-Definition Multimedia Interface®) port, etc. By connecting an external connection terminal 927 to the connection port 925, various types of data can be exchanged between the information processing device 900 and the external connection terminal 927.

[0104] The communication unit 929 is, for example, a communication interface that includes a communication device for connecting to a communication network NW. The communication unit 929 may also be, for example, a communication card for a wired or wireless local area network (LAN), Bluetooth®, or wireless USB (WUSB).

[0105] The communication unit 929 may be, for example, a router for optical communication, a router for ADSL (asymmetric digital subscriber line), or a modem for various types of communication. For example, the communication unit 929 uses a predetermined protocol such as TCP / IP to send and receive signals over the Internet or to other communication devices. The communication network NW to which the communication unit 929 is connected is a network established by a wired or wireless connection. The communication network NW may be, for example, the Internet, a home LAN, infrared communication, radio communication, or satellite communication.

[0106] The imaging device (not shown) is a device that captures real space and generates an image using an image sensor such as a CCD (charge-coupled device) or CMOS (complementary metal-oxide-semiconductor) and various components such as a lens for controlling the imaging of a subject on the image sensor. The imaging device may capture still images or moving images.

[0107] The live streaming system 1 of this disclosure has been described above with reference to embodiments. The embodiments described above are for illustrative purposes only. Rather, it is readily apparent to those skilled in the art that various combinations and modifications of the components and processes of the embodiments can be made, and these are also included within the technical scope of this disclosure.

[0108] The processes described herein, particularly those described using flowcharts, may be modified by omitting some of the processes, adding processes not explicitly included in the processes, and / or rearranging the order of the processes. Such modifications, including omissions, additions, and rearrangements, are still included within the scope of this disclosure, provided they do not deviate from the essence of this disclosure.

[0109] In some embodiments, at least a portion of the functions performed by the server 10 may be performed by an entity other than the server 10, for example, by the user terminal 20 or 30. In some embodiments, at least a portion of the functions performed by the user terminal 20 or 30 may be performed by an entity other than the user terminal 20 or 30, for example, by the server 10. In some embodiments, the rendering of frame images may be performed by the user terminal, such as a viewer, server, or live streamer.

[0110] Furthermore, the system or method described in the above embodiments may be provided as a non-transient computer-readable storage device such as a solid-state memory device, optical disk memory device, or magnetic disk memory device, or as a computer program product. Alternatively, the program may be downloaded from a server via the Internet.

[0111] While the technical content and features of this disclosure have been described above, any person with ordinary skill in the art to which this disclosure pertains can make many further modifications and alterations without departing from the teachings and disclosures of this disclosure. Therefore, the scope of this disclosure is not limited to the embodiments already disclosed, but is also included in the scope of any subsequent claims, including other modifications and alterations that do not depart from this disclosure. [Explanation of Symbols]

[0112] 1. Live Streaming System 10 servers 20 User Terminals 100 Streaming Units 102 Video Control Unit 104 Audio Control Unit 106 distribution units 108 UI Control Unit 200 viewing units 202 UI Control Unit 204 rendering units 206 Input Units 30, 30a, 30b User terminals 302 Streaming Information Unit 304 Relay Unit 306 Processing Units 320 Stream DB 322 User DB 324 Gift DB 326 Music Database 330 Machine Learning Models 600 screens 602 Object 604 images 606 Message Zone 608 Message Input Box 610 Gift Objects 612 buttons 900 Information Processing Equipment 901 CPU 903 ROM 905 RAM 907 Host Bus 909 Bridge 911 External bus 913 Interface 915 Input Unit 917 Output Unit 919 Storage Units 921 Drive 923 Removable recording media 925 connection ports 927 External connection terminal 929 Communication Unit LS Live Streaming LV Live Streamer NW Network SP specific part AU1, AU2 viewers S302~S328 process VD, VD1, VD2 video

Claims

1. A server including a circuit, wherein the circuit is A function to receive streaming data from the first user's first user terminal, A function to detect music from the aforementioned streaming data, A function to display the first information of the aforementioned music within the live streaming room, A function to transmit the second information of the music to the second user's second user terminal in response to an operation on the first information of the first user from the second user's second user terminal, A server characterized by being configured to perform the following.

2. The function to acquire interaction data from the aforementioned live streaming room, The aforementioned interaction data is input into a machine learning model to generate listener preferences regarding music, The function further includes transmitting the aforementioned preferences to the first user terminal of the first user, The server according to claim 1, characterized in that the interaction data includes past and real-time interaction data within the live streaming room.

3. A function to extract music streaming data from the aforementioned streaming data, A function that, in response to an operation from the second user's second user terminal, provides the second user's second user terminal with the streaming data or only the music streaming data, The server according to claim 1, further comprising:

4. Based on the aforementioned music, a function is provided to generate an AI virtual character using a machine learning model. The function further includes the function of displaying the AI ​​virtual character within the live streaming room, The server according to claim 1, characterized in that the AI ​​virtual character is a virtual singer who moves their mouth based on the music, or a virtual dancer who moves their body.

5. A function to detect dance from the aforementioned streaming data, A function to identify a second piece of music corresponding to the aforementioned dance, The second function is to play the aforementioned music within the live streaming room, The server according to claim 1, further comprising:

6. A function to retrieve trending topics from the internet, The system further includes a function to recommend a second piece of music related to the aforementioned hot topic to the first user of the first user terminal, The server according to claim 1, characterized in that the aforementioned topic is from a daily news site or a social networking website.

7. The system further includes a function to display a notification on the first user's first user terminal or to stop processing streaming data from the first user's first user terminal in response to the detection of inappropriate content in the music, The server according to claim 1, characterized in that the inappropriate content includes foul language or information infringing intellectual property rights.

8. The aforementioned streaming data further includes audio streaming data and / or video streaming data within the live streaming room. The first user of the first user terminal is the live streamer who started the live streaming room, The server according to claim 1, characterized in that the audio streaming data includes the music performed or sung by the live streamer.

9. It is a method, The process of receiving streaming data from the first user's first user terminal, The process of detecting music from the aforementioned streaming data, The steps include displaying the first information of the music within the live streaming room, The process includes transmitting the second information of the music to the second user's second user terminal in response to an operation from the second user's second user terminal on the first information, A method characterized by including

10. A computer program, which is on a server, A function to receive streaming data from the first user's first user terminal, A function to detect music from the aforementioned streaming data, A function to display the first information of the aforementioned music within the live streaming room, A function to transmit the second information of the music to the second user's second user terminal in response to an operation on the first information of the first user from the second user's second user terminal, A computer program characterized by achieving the following.

Images