Information interaction method, device and electronic device

Abstract

The present disclosure provides an information interaction method, device, and electronic device. A specific embodiment of the method includes the steps of: displaying a live streaming data stream of a multimedia conference on a live streaming interface of the multimedia conference in response to a user logging in to the live streaming interface of the multimedia conference, the live streaming data stream being generated based on interactive data streams of users participating in the multimedia conference; receiving interactive content input by the user based on the live streaming data stream, generating interactive information based on the interactive content; and transmitting the interactive information to a server side to instruct the server side to transmit the interactive information to a terminal device displaying the live streaming interface, thereby improving the efficiency of information communication related to the multimedia conference content.

Description

[Technical field]

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application claims priority to a Chinese patent application filed on March 27, 2020, with application number 202010232284.2, entitled "Information interaction method, device and electronic device," the entire text of which is incorporated herein by reference.

[0002] Technical Field TECHNICAL FIELD The embodiments of the present disclosure relate to the technical field of Internet, and in particular to an information interaction method, device and electronic device. [Background technology]

[0003] Network multimedia conferencing can realize real-time transmission of information in the form of event images, voice, and application data (electronic whiteboard, graph) between two or more points, and is suitable for remote conferences, network seminars, etc. People at two or more points can interact through network multimedia conferencing. In a typical network multimedia conference, a multimedia conference server receives multimedia data streams sent by participating users and interactively transmits the multimedia data streams sent by the participating users. Summary of the Invention

[0004] The Summary of the Disclosure describes concepts in a concise form, which are described in detail in the Detailed Description section below. The Summary of the Disclosure is not intended to identify key features or necessary features of the technical solution claimed for a patent, nor is it intended to limit the scope of the technical solution claimed for a patent.

[0005] Some embodiments of the present disclosure propose an information interaction method, an apparatus, and an electronic device.

[0006] In a first aspect, some embodiments of the present disclosure provide an information interaction method applied to a terminal device, the information interaction method including: displaying a live streaming data stream of a multimedia conference on a live streaming interface of the multimedia conference in response to a user logging in to the live streaming interface of the multimedia conference, where the live streaming data stream is generated based on interactive data streams of users participating in the multimedia conference; receiving interactive content input by the user based on the live streaming data stream, generating interactive information based on the interactive content; and transmitting the interactive information to a server side, so that the server side transmits the interactive information to a terminal device displaying the live streaming interface.

[0007] In a second aspect, some embodiments of the present disclosure provide an information interaction method applied to a server side, comprising: a step of transmitting a live streaming data stream to a terminal device in response to receiving an acquisition request for acquiring a live streaming data stream of a multimedia conference transmitted from the terminal device, so that the terminal device displays the live streaming data stream on a live streaming interface, where the acquisition request is generated by the terminal device based on a user logging in to a live streaming interface of the multimedia conference, and the live streaming data stream is generated based on an interactive data stream of a participating user in the multimedia conference; a step of receiving interactive information transmitted from the terminal device, where the interactive information is generated based on interactive content input by the user based on the live streaming data stream; and a step of transmitting the interactive information to a terminal device displaying the live streaming interface, so that the terminal device displays the interactive information on the live streaming interface.

[0008] In a third aspect, some embodiments of the present disclosure provide an information interaction device applied to a terminal device, the information interaction device including: a display unit for displaying a live streaming data stream of a multimedia conference on a live streaming interface of the multimedia conference in response to a user logging in to the live streaming interface of the multimedia conference, the live streaming data stream being generated based on an interactive data stream of a participating user in the multimedia conference; a first receiving unit for receiving interactive content input by the user based on the live streaming data stream and generating interactive information based on the interactive content; and a first sending unit for sending the interactive information to a server side, so that the server side sends the interactive information to a terminal device displaying the live streaming interface.

[0009] In a fourth aspect, some embodiments of the present disclosure provide an information interaction device applied to a server side, the information interaction device including: a second transmitting unit for transmitting a live streaming data stream to a terminal device in response to receiving an acquisition request for acquiring a live streaming data stream of a multimedia conference transmitted from the terminal device, so that the terminal device displays the live streaming data stream on a live streaming interface, the acquisition request being generated by the terminal device based on a user logging in to a live streaming interface of the multimedia conference, and the live streaming data stream being generated based on an interactive data stream of a participating user in the multimedia conference; a second receiving unit for receiving interactive information transmitted from the terminal device, the interactive information being generated based on interactive content input by the user based on the live streaming data stream; and a third transmitting unit for transmitting the interactive information to a terminal device displaying the live streaming interface, so that the terminal device displays the interactive information on the live streaming interface.

[0010] In a fifth aspect, some embodiments of the present disclosure provide an electronic device including one or more processors and a storage device having one or more programs stored therein, the one or more programs being executed by the one or more processors to cause the one or more processors to realize the method of the first aspect or the method of the second aspect.

[0011] In a sixth aspect, some embodiments of the present disclosure provide a computer readable medium having a computer program stored thereon, the program being configured to implement the method of the first aspect or the method of the second aspect when executed by a processor.

[0012] Some embodiments of the present disclosure provide an information interaction method, device, and electronic device, which includes the steps of displaying a live distribution data stream of a multimedia conference on a live distribution interface of the multimedia conference in response to a user logging in to the live distribution interface of the multimedia conference, the live distribution data stream being generated based on interactive data streams of participating users of the multimedia conference, receiving interactive content input by the user based on the live distribution data stream and generating interactive information based on the interactive content, and transmitting interactive information to a server side, so that the server side transmits the interactive information to a terminal device displaying the live distribution interface. Compared with a conventional multimedia conference in which only participating users can transmit interactive information and viewing users of the live distribution data stream of the multimedia conference cannot perform information interaction with participating users of the multimedia conference or other viewing users about the content of the multimedia conference, the present solution provides a channel for viewing users of the multimedia conference to publish interactive information related to the multimedia conference. The users of the multimedia conference can view the interactive information of the viewing users of the multimedia conference in real time on the interface of the multimedia conference. Compared with information exchange only by participating users of the multimedia conference, the present solution improves the efficiency of information communication about the content of the multimedia conference. [Brief description of the drawings]

[0013] The above and other features, advantages and aspects of each embodiment of the present disclosure will become more apparent by reference to the following specific embodiments in conjunction with the drawings. Throughout the drawings, the same or similar drawing reference numerals represent the same or similar elements. For illustrative purposes, it should be understood that the actual parts and elements are not necessarily drawn to scale. [Figure 1] 1 is a flow chart of some exemplary information interaction methods of the present disclosure. [Diagram 2] 1 is a flow chart of some exemplary information interaction methods of the present disclosure. [Diagram 3] 1 is a block diagram of some embodiments of an information interaction device according to the present disclosure. [Figure 4] 1 is a block diagram of some embodiments of an information interaction device according to the present disclosure. [Diagram 5] FIG. 2 is an architecture diagram of some embodiments of the information interaction system of the present disclosure. [Figure 6] FIG. 1 is a block diagram of an electronic device suitable for implementing some embodiments of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] Hereinafter, the embodiments of the present disclosure will be described in more detail with reference to the drawings. Although some embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure can be realized in various forms and should not be construed as being limited to the embodiments described herein, but rather, these embodiments are provided for the purpose of making the present disclosure more thorough and complete. It should be understood that the drawings and embodiments of the present disclosure are merely for illustrative purposes and are not intended to limit the scope of protection of the present disclosure.

[0015] It should be understood that the steps recited in the method embodiments of the present disclosure may be performed in different orders and / or in parallel, and that method embodiments may include additional steps and / or omit the performance of steps that are shown, and the scope of the present disclosure is not limited in this respect.

[0016] As used herein, the term "comprises" and variations thereof are intended to mean a non-exclusive inclusion, i.e., "including, but not limited to." The term "based on" means "based at least in part on." The term "in one embodiment" refers to "at least one embodiment," the term "in another embodiment" refers to "at least one other embodiment," and the term "in some embodiments" refers to "at least some embodiments." Relevant definitions of other terms are provided below.

[0017] It should be noted that the concepts of "first", "second", etc. mentioned in this disclosure are merely intended to distinguish different devices, modules or units, and are not intended to limit the order of functions performed by these devices, modules or units or their mutual dependencies.

[0018] It should be noted that the modifications "a" and "a plurality" referred to in this disclosure are intended to be exemplary rather than limiting. Those skilled in the art should understand "one or more" unless otherwise specified.

[0019] The names of messages or information exchanged between devices in the embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of these messages or information.

[0020] Please refer to Figure 1, which shows a flow chart of some embodiments of the information interaction method of the present disclosure. The information interaction method is applied to a terminal device and includes the following steps:

[0021] In step 101, in response to a user logging into the multimedia conference live streaming interface, a live streaming data stream of the multimedia conference is displayed on the multimedia conference live streaming interface.

[0022] In a multimedia conference, participating users usually perform information interaction. Because the amount of data that needs to be interacted during a multimedia conference is large, if the number of participating users becomes too large, the phenomenon of delay in multimedia data stream will occur. Therefore, the number of participating users in a multimedia conference is usually limited, that is, when the multimedia conference is not live-streamed, the range of users that can be affected by the multimedia conference is limited to the participating user group.

[0023] In order to expand the reach of a multimedia conference, a live broadcast data stream of the multimedia conference can be provided. The live broadcast data stream is generated based on interactive data streams of participating users of the multimedia conference. The multimedia conference can be an audio conference or a video conference. Viewing users can listen to and / or watch the live broadcast data stream during the holding time of the multimedia conference. In some application scenarios, the host of the multimedia conference can identify users who are viewing users and grant these viewing users the authority to watch the live broadcast data stream.

[0024] A participating user of a multimedia conference, or a viewing user viewing a live streaming data stream of a multimedia conference, or a predetermined multimedia conference management user can execute a predetermined live streaming start operation on a terminal device used by the user. The terminal device receives the predetermined live streaming start operation for starting the live streaming of the multimedia conference, and then transmits a live streaming request for live streaming the multimedia conference to a server side, so that the server side generates a live streaming data stream of the multimedia conference in response to the live streaming request. The live streaming data stream is generated based on interactive data of the participating users of the multimedia conference.

[0025] In some application scenarios, the initiator of the above-mentioned specified operation is a participating user of a multimedia conference, and the specified live streaming start operation includes a trigger operation executed by the participating user of the multimedia conference on a live streaming widget for starting live streaming displayed on a display interface for displaying a multimedia conference information stream.

[0026] In these application scenarios, the terminal device of the participating user in the multimedia conference can display a display interface of multimedia conference information. If the multimedia conference is already in progress, the display interface can be an interface for displaying interactive data streams of the multimedia conference. If the multimedia conference has not yet started, the display interface can be an interface for displaying multimedia information of the multimedia conference, such as the conference name, conference agenda, etc. The display interface can display a live streaming widget for starting live streaming of the multimedia conference. The participating user can perform a trigger operation, such as clicking, touching, etc., on the live streaming widget. The terminal device can regard the reception of the trigger operation as the reception of a live streaming start operation.

[0027] The predetermined live distribution start operation may be started before the start of the multimedia conference or during the progress of the multimedia conference. That is, the start timing of the predetermined live distribution start operation includes one of before the start of the multimedia conference or during the progress of the multimedia conference.

[0028] The viewing addresses of the live broadcast data stream of the multimedia conference may be preset and distributed, for example, to the viewing users of the multimedia conference.

[0029] The operation of logging in to the live streaming interface of the multimedia conference may be any operation that can obtain a live streaming data stream. The "logging in" may, for example, include an operation of obtaining a link corresponding to a live streaming address of the live streaming data stream, and moving to a live streaming page corresponding to the live streaming address through the link. Or, it may include an operation of opening a live streaming page of the multimedia conference by directly inputting a live streaming address corresponding to the live streaming data stream into a page. The live streaming page may be a web page, or may be a live streaming room corresponding to a live streaming platform of the live streaming data stream of the multimedia conference. In some application scenarios, the operation of logging in to the live streaming interface of the multimedia conference further includes a step of inputting user identity information, so as to complete authentication of user identity information.

[0030] A user can use a terminal device to log in to the live streaming interface of the multimedia conference. For example, the user logs in to the live streaming interface of the multimedia conference by clicking a link of the live streaming data stream displayed on the screen of the terminal device. When the user logs in to the live streaming interface of the multimedia conference, the terminal device can send an acquisition request to the server side to acquire the live streaming data stream of the multimedia conference. The server side transmits the live streaming data stream of the multimedia conference to the terminal device in real time in response to the acquisition request. After the terminal device acquires the live streaming data stream, the terminal device can display the live streaming data stream of the multimedia conference on the live streaming interface of the multimedia conference.

[0031] In some application scenarios, the live streaming interface of the multimedia conference may be arranged on a web page. A user may not have installed an application for playing the live streaming data stream of the multimedia conference on a terminal device, and in this case, the user may have difficulty in viewing the live streaming data stream. By arranging the live streaming interface of the multimedia conference on a web page, the user can easily view the live streaming data stream of the multimedia conference.

[0032] In some application scenarios, a user browses information in a third-party platform, and in these application scenarios, the user can log in to a live streaming interface of the multimedia conference through an address corresponding to the live streaming data stream of the multimedia conference in the third-party platform.

[0033] For example, the third-party platform can display a link corresponding to the live streaming data stream of the multimedia conference, the user can click on the link, and when the terminal device receives the user's click operation on the link, it parses an address corresponding to the live streaming data stream of the multimedia conference corresponding to the link, thereby displaying a live streaming interface of the multimedia conference on the third-party platform, and realizing the user's login to the live streaming interface of the multimedia conference.

[0034] As another example, a user can input an address corresponding to the live streaming data stream of the multimedia conference into an address input box in a third-party platform, whereby a live streaming interface of the multimedia conference is displayed on the third-party platform, and the user is able to log in to the live streaming interface of the multimedia conference.

[0035] In these application scenarios, a user can directly log in to the live streaming interface of the multimedia conference on the third-party platform. Compared with the prior art, when a user wants to watch the live streaming data stream of the multimedia conference while browsing information on the third-party platform, he needs to close the third-party platform, then open the multimedia conference application or open a web page, and then enter the address or click the link corresponding to the address in the multimedia conference application or in the opened web page to log in to the live streaming interface, the operation of the user logging in to the live streaming interface of the live streaming data stream of the multimedia conference can be reduced, so as to save the user's time and improve the user experience.

[0036] In step 102, interactive content input by a user based on the live broadcast data stream is received, and interactive information is generated based on the interactive content.

[0037] The live streaming interface may include a display window for playing the live streaming data stream.

[0038] During the process of a user viewing the live broadcast data stream of multimedia, the user can input interactive content based on the live broadcast data stream through a terminal device, and the user can input the interactive content in the form of text, voice, etc.

[0039] The terminal device can generate interactive information based on the interactive content. The interactive information may include, for example, user identity information, time information when the user transmits the interactive content, etc. The interactive information may include at least one of text interactive information, voice interactive information, default facial expression, etc.

[0040] In some application scenarios, for example, when the content related to the multimedia conference is relatively important or when there are relatively many participating users, the viewing users may send text interactive information, which helps the participating users to view the text interactive information on the premise that it does not interfere with the interactive information stream of the multimedia conference.

[0041] In some application scenarios, for example, the content related to the multimedia conference is highly interactive, and the viewing user cannot participate in the conference due to the limitation of the number of participants in the conference, in this case, the viewing user can transmit voice interactive information and / or facial expression information so as to improve the interactivity of the multimedia conference.

[0042] The information interaction method provided in this embodiment includes the steps of displaying a live distribution data stream of the multimedia conference on the live distribution interface of the multimedia conference in response to a user logging in to the live distribution interface of the multimedia conference, the live distribution data stream being generated based on the interactive data stream of the participating users of the multimedia conference; receiving interactive content input by the user based on the live distribution data stream and generating interactive information based on the interactive content; and transmitting the interactive information to the server side, so as to instruct the server side to transmit the interactive information to the terminal device displaying the live distribution interface. Compared with the conventional multimedia conference in which only the participating users can transmit interactive information and the viewing users of the live distribution data stream of the multimedia conference cannot perform information interaction with the participating users of the multimedia conference or other viewing users about the content of the multimedia conference, this solution provides a channel for the viewing users of the multimedia conference to publish interactive information related to the multimedia conference. The users of the multimedia conference can view the interactive information of the viewing users of the multimedia conference in real time on the interface of the multimedia conference. Compared with the information exchange only by the participating users of the multimedia conference, this solution improves the efficiency of information communication about the content of the multimedia conference.

[0043] In some alternative embodiments of this embodiment, before step 102, the information interaction method further includes obtaining a user nickname of the user, and step 102 may include generating interactive information according to the interactive content and the user nickname of the user.

[0044] The user's user nickname may be different from the user's username. The user nickname may contain any characters.

[0045] The step of acquiring the user nickname of the user may include acquiring a user nickname previously input by the user, and the user nickname previously input by the user is used as the nickname for announcing the current interactive information.

[0046] In some application scenarios, the step of acquiring a user nickname may include acquiring a user nickname input by the user when watching the currently played live streaming data stream. As an exemplary explanation, the live streaming interface of the multimedia conference may display a widget for inputting a user nickname. The user inputs the user nickname by clicking the widget for inputting the user nickname. As another exemplary explanation, when the user inputs interactive content and clicks an option to send the interactive content, an alert window may pop up to indicate to the user whether or not to use the user nickname for presenting interactive information. The user can input the user nickname in the displayed user nickname input window by performing a selection operation on an option for indicating to use the user nickname for presenting interactive information in the alert window.

[0047] The terminal device can generate interactive information based on the interactive content and the user nickname input by the user.

[0048] In the live broadcast interface of the multimedia conference displayed by the terminal devices of other users, the displayed interactive information may include the user nickname and the interactive content, so that the user who publishes the interactive information does not need to use his / her real user name to publish the interactive information, and the need of the user to publish the interactive information anonymously can be met.

[0049] Furthermore, optionally, in these application scenarios, the association relationship between the user and the user nickname is valid while the user is viewing the live streaming data stream of the current video conference, that is, the user's user nickname is valid only while the user is viewing the current live streaming data stream, and becomes invalid after the live streaming data stream ends, which contributes to protecting the user's privacy.

[0050] In some optional embodiments of this embodiment, before step 101, the above information interaction method further includes the following steps:

[0051] First, the identification information of the user is obtained based on a predetermined operation performed by the user on the login widget.

[0052] Then, the user's identity information is sent to the server side to determine whether the user has the right to obtain the live broadcast data stream.

[0053] In these alternative embodiments, the user identity may include, for example, a username to distinguish between different users.

[0054] The login user identity may be a username for logging in to an application, or may be user personal information associated with the user. The username may be a username applied and registered by the user, and is used to distinguish the user identity of different users.

[0055] A user list may be predefined, which corresponds to users who have viewing rights to view the live broadcast data stream of the multimedia conference, and the user list may include identity information corresponding to each of a plurality of predetermined users.

[0056] The terminal device may send user identity information to the server side, and the server side checks whether the user identity information is included in a list of users authorized to watch the live streaming data stream, and if so, determines that the user is authorized to obtain the live streaming data stream, and if not, determines that the user is not authorized to obtain the live streaming data stream.

[0057] In these alternative embodiments, the identity information of the user is used to determine whether the user is authorized to obtain the live broadcast data stream, thereby improving the security of the multimedia conference information.

[0058] In some optional embodiments of this embodiment, step 102 may include, in response to the number of characters corresponding to the received user input interactive content exceeding a predetermined number threshold, displaying alert information to indicate that the number of characters has exceeded the number limit.

[0059] In the live streaming interface of the multimedia conference, the live streaming data stream and the interactive information should be displayed, so if the interactive content input by the user is too large, the area occupied in the live streaming interface will be large, which will have a negative impact on the display effect of displaying the interactive information of multiple users.

[0060] The above-mentioned predetermined number threshold may be, for example, 40, 50, 60, etc., and may be set according to a specific application scene. It is not limited here.

[0061] When the number of characters corresponding to the interactive content input by the user exceeds a predetermined number threshold, the interactive content subsequently input by the user will not be embodied in the interactive information.

[0062] If the number of characters corresponding to the interactive content entered by the user exceeds a predetermined threshold, alert information may be displayed indicating that the number of characters of the interactive content entered by the user has exceeded the number limit, which contributes to reducing invalid information input by users and improving the user experience.

[0063] In some optional embodiments of this embodiment, the above step 103 may include a step of sending interactive information to the server side, so that the server side determines whether to send the interactive information to a terminal device that displays the live streaming interface based on the content of the interactive information.

[0064] In these alternative embodiments, before transmitting the user's interactive information to the terminal device displaying the live streaming interface, the server side may perform approval of the interactive information, such as determining whether the interactive information contains sensitive words, determining whether the interactive information is related to the content of the multimedia conference, determining whether the interactive information has a tendency to criticize others, etc.

[0065] The server side approves the interactive information, and determines whether to transmit the interactive information to the terminal device displaying the live distribution interface of the live distribution data stream based on the approval result, thereby contributing to improving the validity of the interactive information displayed on the live distribution interface.

[0066] In some optional embodiments of this embodiment, the above step of having the server side determine whether to send interactive information to the terminal device displaying the live streaming interface based on the content of the interactive information includes a step of sending feedback information to the user's terminal device to indicate that the interactive information is not approved if the server side determines not to send the interactive information to the terminal device displaying the live streaming interface.

[0067] Moreover, the information interaction method further includes the step of displaying the feedback information to the user in response to receiving feedback information indicating that the interactive information sent from the server side is not approved.

[0068] That is, when the terminal device receives the feedback information, the terminal device can display the feedback information in a form such as a pop-up window or a floating window.

[0069] In these optional embodiments, the feedback information allows the user to understand whether the interactive information he or she sends is being sent to other users, and thereby allows the user to decide whether or not to continue editing the interactive information.

[0070] In some optional embodiments of this embodiment, the information interaction method further includes a step of displaying text interactive content corresponding to the interactive information in a text information input box displayed on the live distribution interface in response to receiving feedback information that indicates that the interactive information sent from the server side is not approved.

[0071] In these optional embodiments, displaying text interactive content corresponding to the interactive information in the text information input box helps the user view the interactive information he or she has entered, while facilitating the user to adjust the interactive content in the text information input box for resubmitting the interactive information.

[0072] In some optional embodiments of this embodiment, the information interaction method further includes a step of displaying the user's interactive information in a live broadcast interface, and the manner of displaying the interactive information includes at least one of a list, a barrage, and a floating window; The interactive information includes interactive content, user identification information of a user who transmits the interactive content, and time information when the user transmits the interactive content.

[0073] The user identification information here may be the user's user nickname.

[0074] Each of the user interactive information may include interactive information input by a plurality of users respectively based on the live broadcast data stream, and the content of the user interactive information includes at least one.

[0075] In some application scenarios, the interactive information may be displayed in the live streaming interface in the form of a list.

[0076] In these application scenarios, the live streaming interface may be divided into a first area for playing the live streaming data stream and a second area for displaying the list of the interactive information, and the second area may be located at one of the right side, left side, upper side, and lower side of the first area.

[0077] In some application scenarios, interactive information of multiple users may be displayed in the live streaming interface of a multimedia conference in the form of a barrage, which can move from left to right or from right to left in the live streaming interface playing the live streaming data stream.

[0078] In some application scenarios, interactive information of multiple users may be displayed in the form of floating windows on a live streaming interface playing the live streaming data stream.

[0079] In some application scenarios, a user may select a display mode of interactive information, and the terminal device displays interactive information of multiple users according to the display mode selected by the user. A user may select one or more display modes of interactive information.

[0080] In some alternative embodiments of this embodiment, the interactive information of at least one user is displayed in a list displaying the interactive information in order based on the time of transmission.

[0081] In this embodiment, the plurality of interactive information of at least one user may be displayed in a list for displaying the interactive information.

[0082] For example, the plurality of interactive information may be displayed in the list in a front-to-back order based on the transmission time. The plurality of interactive information may be displayed in the list in a back-to-front order based on the transmission time.

[0083] Displaying multiple pieces of interactive information in a list in chronological order encourages users to read the contents of the interactive information in detail.

[0084] In some alternative embodiments of this embodiment, the top of the list is sticky and displays sticky interactive information.

[0085] In these alternative embodiments, the user's interactive information is displayed in the form of a list.

[0086] In some application scenarios, a user with certain authority in a multimedia conference may set one or more of the plurality of pieces of interactive information as sticky interactive information.

[0087] These sticky interactive information may be interactive information such as advertisements, or interactive information whose interactive contents have a large impact. By making these pieces of information sticky, when a user wants to find the sticky information, the user can directly check these pieces of information from the top of the list. Compared with the case where the sticky information is not made sticky, the time required for the user to find the sticky information from multiple pieces of interactive information can be saved.

[0088] In some optional embodiments of this embodiment, the information interaction method further includes a step of receiving a scrolling operation performed by a user on the list, and a step of displaying interactive information corresponding to the scrolling operation.

[0089] In these alternative embodiments, the user's interactive information is displayed in the form of a list.

[0090] The scroll operation may include, for example, a slide operation that is realized by the user touching the touch screen with his / her finger, a click operation that the user executes on the scroll bar of the list with a mouse, and the like.

[0091] In these optional embodiments, the interactive information displayed in the list can display interactive information at the destination of the scroll operation as the user scrolls, which helps the user check interactive contents of multiple interactive information.

[0092] In some optional embodiments of this embodiment, the terminal device is a terminal device used by a user with predetermined authority, and the information interaction method further includes a step of sending information of the specified operation to the server side in response to receiving a specified operation performed by the user with predetermined authority on the displayed interactive information, so that the server side sends an operation result corresponding to the specified operation to the terminal device of another user.

[0093] The predetermined operation includes one of the following: sticky, delete, and set a timeout for the sender of the interactive information.

[0094] In these alternative embodiments, the interactive information is displayed in the form of a list.

[0095] As an exemplary description, the user with the predetermined authority may right-click on the interactive information, and an edit widget is displayed on the interactive information interface in response to the user's right-click operation. The edit widget may display options such as "sticky", "delete", "quiet", etc. The user with the predetermined authority can select the option, thereby completing the execution of the operation corresponding to the option.

[0096] In some application scenarios, the user with the predetermined authority may be a moderator of a multimedia conference, and the user with the predetermined authority can manage the interactive information published by users and the users who publish the interactive information.

[0097] After a user with a certain authority performs a sticky operation on one piece of interactive information, the terminal device can transmit the sticky operation to the server side, and the server side transmits the information, whose interactive information display setting parameter is a sticky parameter, to the terminal device displaying the live distribution interface of each user, so as to sticky-display the interactive information in a list displaying interactive information in the live distribution interface displayed on the terminal device of each user.

[0098] After a user with a certain authority performs a delete operation on one piece of interactive information, the terminal device can transmit information of the delete operation to the server side, and the server side transmits the information with the interactive information deleted to the terminal device displaying the live distribution interface of each user, thereby deleting the interactive information from the list displaying the interactive information in the live distribution interface displayed on the terminal device of each user.

[0099] A user with a certain authority can execute a speech prohibition operation on a user who is presenting an interaction. The terminal device transmits user information corresponding to the speech prohibition operation to the server, and the server can transmit identification information of the user corresponding to the speech prohibition operation and information that the user has been set as speech-prohibited to the terminal device that displays the live distribution interface. As a result, information that the user has been prohibited from speaking is displayed on the terminal device of each user.

[0100] In some alternative embodiments of this embodiment, the user's interactive information is displayed in a barrage format.

[0101] The step of displaying the user's interactive information on the live streaming interface includes a step of determining whether to turn on the barrage display based on the user's operation on a predetermined barrage widget on the live streaming interface.

[0102] In these optional embodiments, a danmaku widget may be placed in the live streaming interface. The danmaku widget has the danmaku function turned off as a default. When a user performs a selection operation such as clicking or touching on an option for instructing to turn on the danmaku function displayed in the danmaku widget, the danmaku display is turned on, and interactive information of multiple users can be displayed in the live streaming interface as a danmaku.

[0103] In addition, when the above interactive information is displayed in the form of a barrage in the live streaming interface, the barrage display of the user interactive information in the live streaming interface can be turned off in response to a user selecting an option to instruct turning off the barrage function in the barrage widget by clicking or touching the option.

[0104] It should be noted that according to the user's operation, the user's interactive information displayed in a barrage manner and the interactive information displayed in a list form can be simultaneously displayed on the live distribution interface of the multimedia conference.

[0105] In these alternative embodiments, the barrage is displayed on the live streaming interface of the live streaming data stream, and the barrage is displayed in real time, which helps users to understand other users' interactive information on the segment when listening to or watching the live streaming data stream segment in real time, thereby improving the efficiency of information communication compared with the case where users need to check the users' interactive information on the segment in a list.

[0106] Further referring to Figure 2, it shows the flow of some embodiments of the information interaction method, which is applicable to the server side and includes the following steps:

[0107] In step 201, in response to receiving an acquisition request for acquiring a live streaming data stream of a multimedia conference transmitted from a terminal device, a live streaming data stream is transmitted to a terminal device, such that the terminal device displays the live streaming data stream on a live streaming interface.

[0108] The multimedia data stream for live distribution is identified by the multimedia conference server based on the interactive data streams sent by the users participating in the multimedia conference.

[0109] The acquisition request is generated by a terminal device based on a user logging in to a live distribution interface of a multimedia conference.

[0110] Upon receiving the acquisition request, the server side sends the live streaming data stream of the multimedia conference corresponding to the acquisition request to the terminal device, so that the terminal device displays the live streaming data stream on a live streaming interface.

[0111] The live streaming data stream is generated in response to a received live streaming request, which is sent by a terminal device based on a predetermined live streaming start operation for starting the received live streaming of the multimedia conference.

[0112] The live distribution request may be sent by one of a participating user of the multimedia conference, a viewing user, or a predetermined multimedia conference management user.

[0113] The start timing at which the terminal device starts the predetermined live distribution start operation includes one of before the start of the multimedia conference and while the multimedia conference is in progress.

[0114] In step 202, interactive information transmitted from a terminal device is received, and the interactive information is generated based on interactive content input by a user based on a live broadcast data stream.

[0115] In step 203, the interactive information is sent to a terminal device displaying the live streaming interface, so that the terminal device displays the interactive information on the live streaming interface.

[0116] For a detailed explanation of steps 201 to 203, please refer to the explanation of the example shown in Fig. 1. The explanation will be omitted here.

[0117] In this embodiment, the live streaming data stream of the multimedia conference is sent to the terminal device according to the acquisition request sent from the terminal device, so that the terminal device displays the live streaming data stream on the live streaming interface of the multimedia conference, the user input interactive information sent from the terminal device is received, and the interactive information is sent to the terminal device displaying the live streaming interface, so that the terminal device displays the interactive information on the live streaming interface. Therefore, the multimedia conference user can view the interactive information of the viewing user of the multimedia conference in real time on the interface of the multimedia conference. Compared with the information exchange only by the participating users of the multimedia conference, this solution improves the efficiency of information communication on the multimedia conference content.

[0118] In some alternative embodiments of this embodiment, step 201 includes the steps of: in response to receiving an acquisition request for acquiring a live streaming data stream of a multimedia conference sent from a terminal device, determining whether the user is a participating user based on user identity information of the user corresponding to the acquisition request; and in response to determining that the user is a participating user, sending the live streaming data stream and silent playback setting parameters to the terminal device, so as to instruct the terminal device to play the live streaming data stream in silent mode and display alert information in text to indicate the silent playback to the user.

[0119] In these alternative embodiments, the users who watch the multimedia conference may be participating users of the multimedia conference. Since the multimedia data streams of the participating users are interactively transmitted to each participating user of the multimedia conference, in order to avoid disturbing the interactive data streams of the multimedia conference, if a participating user selects to watch the live broadcast data stream, a muted live broadcast data stream may be displayed to the participating users. In addition, alert information is displayed in text to indicate the muted playback to the participating users and the alert target users.

[0120] The participating user may be a user with a certain authority in a multimedia conference. Because the user needs to manage live streaming interactive information, the user needs to open both a video conference and a live streaming page. In this case, in order to avoid echo, when the participating user opens the live streaming interface of the live streaming data stream, the muted live streaming data stream may be displayed to the participating user. And, alert information is displayed in text to indicate the muted playback to the participating users and the alert target users.

[0121] In some optional embodiments of this embodiment, before step 203, the information interaction method further includes the following steps:

[0122] In a first step, it is determined whether to transmit the interactive information to a terminal device displaying a live distribution interface according to the content of the interactive information.

[0123] In the second step, when it is determined that the interactive information is to be transmitted to the terminal device that displays the live distribution interface, the interactive information is transmitted to the terminal device that displays the live distribution interface.

[0124] In the third step, if it is determined that the interactive information is not to be transmitted to the terminal device displaying the live distribution interface, feedback information indicating that the interactive information is not approved is transmitted to the user's terminal device.

[0125] In these optional embodiments, approval of the user's interactive information and a determination of whether or not to transmit the interactive information to the terminal device displaying the live streaming interface are performed, thereby avoiding the display of poor interactive information in the live streaming interface and contributing to maintaining the validity of the interactive information.

[0126] In some alternative embodiments of this embodiment, the information interaction method includes: The method further includes storing interactive information corresponding to the live-streamed data stream of the multimedia conference and generating an interactive information storage document associated with the multimedia conference.

[0127] Optionally, the interactive information storage document further includes a time when the user transmits the interactive information, the interactive content, and identification information of the user transmitting the interactive information, which are associated with each other and may be a user nickname of the user.

[0128] In these alternative embodiments, generating a storage document for storing the interactive information contributes to checking the interactive information of the user after the multimedia conference, and contributes to digging deeper into the interactive information.

[0129] In some alternative embodiments of this embodiment, the information interaction method includes: The method further includes storing the interactive information storage document in a cloud space of a user having a predetermined authority for the multimedia conference.

[0130] In these alternative embodiments, the interactive information can be stored in a cloud space of a user with certain permissions for multimedia conference, which helps to maintain the security of the multimedia conference information and interactive information.

[0131] In some alternative embodiments of this embodiment, the information interaction method includes: The method further includes a step of associating each piece of interactive information with an associated multimedia conference segment in the recorded live broadcast data stream in the interactive information storage document, such that a user can click on the interactive information to transition to a live broadcast data stream segment of the live broadcast data stream corresponding to the interactive information.

[0132] In these alternative embodiments, since each piece of interactive information is associated with a corresponding associated multimedia conference segment in the recorded live streaming data stream in the storage document, when a user selects to play the recorded live streaming data stream, the user can view the recorded live streaming data stream and the interactive information posted by multiple users on the live streaming data stream in an interface displaying the recorded live streaming data stream. For example, the interactive information is displayed in the form of a list. When a user clicks on one piece of interactive information, a window of the live streaming data stream can be displayed or a live streaming data stream segment corresponding to the interactive information can be moved to, which helps the user interpret the interactive information based on the live streaming data stream segment.

[0133] Further referring to FIG. 3, as an implementation of the method shown in FIG. 1 above, the present disclosure provides several embodiments of information interaction devices, which device embodiments correspond to those method embodiments shown in FIG. 1, and which are specifically applicable to various electronic devices.

[0134] As shown in FIG. 3, an information interaction device in some embodiments includes: a display unit 301 for displaying a live streaming data stream of a multimedia conference on a live streaming interface of the multimedia conference in response to a user logging in to the live streaming interface of the multimedia conference, where the live streaming data stream is generated based on the interactive data stream of a participating user of the multimedia conference; a first receiving unit 302 for receiving interactive content input by the user based on the live streaming data stream and generating interactive information based on the interactive content; and a first sending unit 303 for sending the interactive information to a server side, so as to instruct the server side to send the interactive information to a terminal device displaying the live streaming interface.

[0135] In this embodiment, the specific processing of the display unit 301, the first receiving unit 302, and the first sending unit 303 of the information interaction device and the technical effects achieved thereby can be referred to the relevant descriptions of steps 101, 102, and 103 in the embodiment corresponding to FIG. 1, respectively, and the description thereof will be omitted here.

[0136] In an optional embodiment of some embodiments, the information interaction device further includes a nickname obtaining unit (not shown) for obtaining a user nickname of a user before the first receiving unit 302 receives interactive content input by a user according to a live broadcast data stream and generates interactive information according to the interactive content, and the first receiving unit 302 is further used for generating interactive information according to the interactive content and the user nickname of the user.

[0137] In an alternative embodiment of some examples, the association between the user and the user nickname is valid while the user is viewing the live broadcast data stream.

[0138] In an optional embodiment of some examples, the information interaction device further includes a user identity information acquisition unit (not shown) for transmitting the user identity information to the server side, so that the display unit 301, in response to the user logging in to the live streaming interface of the multimedia conference, acquires the user identity information based on a predetermined operation performed by the user on the login widget before displaying the live streaming data stream of the multimedia conference on the live streaming interface of the multimedia conference, and determines whether the user has the authority to acquire the live streaming data stream.

[0139] In an alternative embodiment of some examples, the live streaming interface is located on a web page.

[0140] In alternative embodiments of some examples, the interactive information includes at least one of text interactive information, voice interactive information, and default facial expressions.

[0141] In an optional embodiment of some examples, the first receiving unit 302 is further used for displaying alert information to indicate that the number of characters corresponding to the received user input interactive content exceeds a predetermined number threshold.

[0142] In optional embodiments of some embodiments, the first sending unit 303 is further used for sending interactive information to the server side, so that the server side determines whether to send the interactive information to a terminal device displaying a live streaming interface based on the content of the interactive information.

[0143] In optional embodiments of some examples, if the server side determines not to send interactive information to the terminal device displaying the live streaming interface, it sends feedback information to the user's terminal device to indicate that the interactive information is not approved.

[0144] In an optional embodiment of some examples, the information interaction device further includes a feedback information display unit (not shown) for displaying feedback information alert information to a user to indicate that the interactive information sent from the server side is not approved in response to receiving feedback information indicating that the interactive information is not approved.

[0145] In an optional embodiment of some examples, the information interaction device further includes a text content display unit (not shown) for displaying text interactive content corresponding to the interactive information in a text information input box displayed on the live distribution interface in response to receiving feedback information indicating that the interactive information sent from the server side is not approved.

[0146] In an optional embodiment of some examples, the information interaction device includes an interactive information display unit (not shown) for displaying a user's interactive information on a live streaming interface, and the manner of displaying the interactive information includes at least one of a list, a barrage, and a floating window, and the interactive information includes interactive content, user identification information of a user who transmits the interactive content, and time information of the user who transmits the interactive content.

[0147] In an alternative embodiment of some examples, the interactive information of at least one user is displayed in a list displaying the interactive information in order based on the time of transmission.

[0148] In an alternative embodiment of some examples, the top of the list is sticky and displays sticky interactive information.

[0149] In an alternative embodiment of some examples, the interactive information display unit is further used to receive a scrolling operation performed by a user on the list, and display interactive information corresponding to the scrolling operation.

[0150] In an alternative embodiment of some examples, the user's interactive information is displayed in a barrage format.

[0151] In an optional embodiment of some examples, the interactive information display unit is further used for determining whether to turn on the barrage display based on a user's operation on a predetermined barrage widget in the live streaming interface.

[0152] In an optional embodiment of some examples, the terminal device is a terminal device used by a user having a predetermined authority, and the information interaction device further includes an interactive information management unit (not shown) for transmitting information of the predetermined operation to the server side in response to receiving a predetermined operation performed by the user having the predetermined authority on the displayed interactive information, so that the server side transmits an operation result corresponding to the predetermined operation to the terminal device of another user, and the predetermined operation includes one of sticky, deletion, and speech prohibition setting for the sender of the interactive information.

[0153] The information interaction device provided in this embodiment includes a display unit for displaying a live distribution data stream of a multimedia conference on a live distribution interface of the multimedia conference in response to a user logging in to the live distribution interface of the multimedia conference, the live distribution data stream being generated based on an interactive data stream of a participating user of the multimedia conference, a first receiving unit for receiving interactive content input by the user based on the live distribution data stream and generating interactive information based on the interactive content, and a first sending unit for sending interactive information to a server side, so as to instruct the server side to send interactive information to a terminal device displaying the live distribution interface. Compared with the conventional multimedia conference in which only the participating users can send interactive information and the viewing users of the live distribution data stream of the multimedia conference cannot perform information interaction with the participating users of the multimedia conference or other viewing users about the content of the multimedia conference, the present solution provides a channel for the viewing users of the multimedia conference to publish interactive information related to the multimedia conference. The users of the multimedia conference can view the interactive information of the viewing users of the multimedia conference in real time on the interface of the multimedia conference. Compared with the information exchange only by the participating users of the multimedia conference, the present solution improves the efficiency of information communication about the content of the multimedia conference.

[0154] The present disclosure provides an information interaction device, which is applicable to various electronic devices, specifically terminal devices.

[0155] The information interaction device includes a live streaming start operation receiving unit for receiving a predetermined live streaming start operation for starting live streaming of the multimedia conference, and a live streaming request sending unit for sending a live streaming request for live streaming the multimedia conference to a server side, so that the server side generates a live streaming data stream of the multimedia conference in response to the live streaming request, and the live streaming data stream is generated based on interactive data of participating users of the multimedia conference.

[0156] In some alternative embodiments, the predetermined live broadcast start operation is initiated by one of a participating user of the multimedia conference, the viewing user, or a predetermined multimedia conference management user.

[0157] In some optional embodiments, an initiator of the specified live broadcast start operation is a participating user of the multimedia conference, and the specified live broadcast start operation includes a trigger operation that the participating user of the multimedia conference executes on a live broadcast widget for starting a live broadcast that is displayed on a display interface for displaying multimedia conference information.

[0158] In some alternative embodiments, the start timing of the predetermined live streaming start operation includes one of: before a multimedia conference starts, while a multimedia conference is in progress.

[0159] Continuing to refer to FIG. 4, as an implementation of the method shown in FIG. 2 above, the present disclosure provides several embodiments of information interaction devices, which device embodiments correspond to the method embodiments shown in FIG. 2, and the devices are specifically applicable to various electronic devices.

[0160] As shown in FIG. 4 , an information interaction device in some embodiments includes: a second sending unit 401 for sending a live streaming data stream to a terminal device in response to receiving an acquisition request for acquiring a live streaming data stream of a multimedia conference sent from the terminal device, so that the terminal device displays the live streaming data stream on a live streaming interface, where the acquisition request is generated by the terminal device based on a user logging in to a live streaming interface of the multimedia conference, and the live streaming data stream is generated based on an interactive data stream of a participating user in the multimedia conference; a second receiving unit 402 for receiving interactive information sent from the terminal device, where the interactive information is generated based on interactive content input by a user based on the live streaming data stream; and a third sending unit 403 for sending the interactive information to a terminal device displaying the live streaming interface, so that the terminal device displays the interactive information on the live streaming interface.

[0161] In this embodiment, the specific processing of the second transmitting unit 401, the second receiving unit 402, and the third transmitting unit 403 of the information interaction device and the technical effects achieved thereby can be referred to the relevant descriptions of steps 401, 402, and 403 in the embodiment corresponding to FIG. 2, respectively, and the description is omitted here.

[0162] In an alternative embodiment of some embodiments, the second transmitting unit 401 is further used for, in response to receiving an acquisition request for acquiring a live streaming data stream of a multimedia conference sent from a terminal device, determining whether the user is a participating user based on user identity information of the user corresponding to the acquisition request, and sending the live streaming data stream and silent playback setting parameters to the terminal device in response to determining that the user is a participating user, so as to instruct the terminal device to play the live streaming data stream in silent mode and display alert information in text to indicate the silent playback to the user.

[0163] In an optional embodiment of some embodiments, the information interaction device further includes an approval unit (not shown) for determining whether to send the interactive information to the terminal device displaying the live streaming interface based on the content of the interactive information before the third sending unit 403 sends the interactive information to the terminal device displaying the live streaming interface, and if it is determined that the interactive information is to be sent to the terminal device displaying the live streaming interface, sending the interactive information to the terminal device displaying the live streaming interface, and if it is determined that the interactive information is not to be sent to the terminal device displaying the live streaming interface, sending feedback information that the interactive information is not approved to the user's terminal device.

[0164] In an optional embodiment of some examples, the information interaction device further includes an interactive information storage unit (not shown) for storing interactive information corresponding to the live broadcast data stream of the multimedia conference and generating an interactive information storage document associated with the multimedia conference.

[0165] In an alternative embodiment of some embodiments, the interactive information storage document is associated with and stores the time at which a user transmits interactive information, the interactive content, and the identity of the user transmitting the interactive information.

[0166] In an alternative embodiment of some embodiments, the interactive information storage document is stored in a cloud space of a user with certain privileges for multimedia conferencing.

[0167] In an optional embodiment of some examples, the interactive information storage unit is further used to associate each piece of interactive information with an associated multimedia conference segment in a correspondingly recorded live broadcast data stream in the interactive information storage document, such that a user can click on the interactive information to transition to a live broadcast data stream segment of the live broadcast data stream corresponding to the interactive information.

[0168] Further reference is made to FIG. 5, which illustrates an exemplary system architecture to which the information interaction method or information interaction device of some embodiments of the present disclosure can be applied.

[0169] 5, the system architecture may include terminal devices 501, 502, 503, a network 504, and a server 505. The network 504 is used to provide a medium for a communication link between the terminal devices 501, 502, 503 and the server 505. The network 504 may include various connection types, such as wired, wireless communication links, or fiber optic cables.

[0170] The terminal devices 501, 502, 503 can interact with a server 505 through a network 504, to send and receive messages, etc. Various client applications may be installed on the terminal devices 501, 502, 503, such as a web browser application, a search application, a news application, etc. The client applications in the terminal devices 501, 502, 503 can receive a user's command and complete a corresponding function according to the user's command, for example, add corresponding information to information according to the user's command.

[0171] The terminal devices 501, 502, and 503 may be hardware or software. If the terminal devices 501, 502, and 503 are hardware, they may be various electronic devices that have a display screen and support web browsing, including, but not limited to, smartphones, tablet computers, e-book readers, MP3 (Moving Picture Experts Group Audio Layer III, Moving Picture Experts Group Audio Layer 3) players, MP4 (Moving Picture Experts Group Audio Layer IV, Moving Picture Experts Group Audio Layer 4) players, laptop-type portable computers, and desktop computers. If the terminal devices 501, 502, and 503 are software, they may be installed in the electronic devices listed above. They may be realized as multiple software or software modules (e.g., multiple software or software modules for providing distributed services), or as a single software or software module. There is no specific limitation here.

[0172] The server 505 may be a server that provides various services, such as receiving information requests sent from the terminal devices 501, 502, and 503, and acquiring display information corresponding to the information requests in various ways according to the information requests, and transmitting data related to the display information to the terminal devices 501, 502, and 503.

[0173] It should be noted that the information processing method provided in the embodiment of the present disclosure may be performed by a terminal device, and accordingly, the information processing device may be provided in the terminal devices 501, 502, and 503. In addition, the information processing method provided in the embodiment of the present disclosure may be performed by the server 505, and accordingly, the information processing device may be provided in the server 505.

[0174] It should be understood that the number of terminal devices, networks and servers in Figure 5 is merely exemplary, and any number of terminal devices, networks and servers may be provided according to the needs of implementation.

[0175] Reference is now made to FIG. 6, which illustrates a configuration diagram of an electronic device (e.g., a server or terminal device in FIG. 5) suitable for implementing some embodiments of the present disclosure. The terminal devices in some embodiments of the present disclosure may include, but are not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablets), PMPs (portable multimedia players), and in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. The terminal devices / servers illustrated in FIG. 6 are merely examples and do not limit the functions and scope of use of the embodiments of the present disclosure in any way.

[0176] As shown in Fig. 6, the electronic device may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 601, which can realize various appropriate operations and processes by programs stored in a read only memory (ROM) 602 or programs loaded from a storage device 608 into a random access memory (RAM) 603. The RAM 603 also stores various programs and data necessary for the operation of the electronic device. The processing device 601, the ROM 602, and the RAM 603 are interconnected via a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.

[0177] In general, input devices 606 including, for example, a touch screen, touch panel, keyboard, mouse, camera, microphone, accelerometer, gyro, etc., output devices 607 including, for example, a liquid crystal display (LCD), speaker, oscillator, etc., storage devices 608 including, for example, a magnetic tape, hard disk, memory card, etc., and communication devices 609 may be connected to the I / O interface 605. The communication devices 609 allow the electronic device to communicate wirelessly or wired with other devices to exchange data. Although an electronic device with various devices is shown in FIG. 6, it should be understood that it is not required to implement or include all of the devices shown. Alternatively, more or fewer devices may be implemented or included. Each block shown in FIG. 6 may represent one device or multiple devices as needed.

[0178] In particular, according to some embodiments of the present disclosure, the processes described above with reference to the flowcharts can be implemented as a computer software program. For example, some embodiments of the present disclosure include a computer program product, which includes a computer program carried on a computer-readable medium, the computer program including program code for performing the method illustrated in the flowcharts. In some such embodiments, the computer program can be downloaded and installed from a network by the communication device 609, or installed from the storage device 608, or installed from the ROM 602. When the computer program is executed by the processing device 601, it performs the above-mentioned functions defined in the method of some embodiments of the present disclosure.

[0179] It should be explained that the computer-readable medium in some embodiments of the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination of both. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of the computer-readable storage medium may include, but are not limited to, an electrical connection having one or more conductors, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In some embodiments of the present disclosure, the computer-readable storage medium may be any tangible medium that contains or stores a program, which may be used or used in conjunction with an instruction execution system, apparatus, or device. Meanwhile, in some embodiments of the present disclosure, the computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, in which the computer-readable program code is embodied. The data signal thus propagated may take many forms, including, but not limited to, electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which may transmit, propagate, or transmit a program for use in or in connection with an instruction execution system, apparatus, or device. The program code contained in the computer-readable medium may be transmitted by any suitable medium, including, but not limited to, wireless, wire, optical cable, RF (radio frequency), etc., or any suitable combination thereof.

[0180] In some embodiments, the clients and servers may communicate using any network protocol now known or hereafter developed, such as HTTP (HyperText Transfer Protocol), and may interconnect with any form or medium of digital data communication (e.g., a communications network). Examples of communications networks include local area networks ("LANs"), wide area networks ("WANs"), internetworks (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), and any networks now known or hereafter developed.

[0181] The computer-readable medium may be included in the electronic device, or may exist separately from the electronic device. The computer-readable medium is loaded with one or more programs, and the one or more programs are executed by the electronic device, so that the electronic device displays a live streaming data stream of a multimedia conference on a live streaming interface of the multimedia conference in response to a user logging in to the live streaming interface of the multimedia conference, the live streaming data stream is generated based on interactive data streams of participating users of the multimedia conference, receives interactive content input by a user based on the live streaming data stream, generates interactive information based on the interactive content, and transmits the interactive information to a server side, so that the server side transmits the interactive information to a terminal device displaying the live streaming interface. Or, In response to receiving an acquisition request to acquire a live streaming data stream of the multimedia conference transmitted from a terminal device, the live streaming data stream is transmitted to the terminal device so that the terminal device displays the live streaming data stream on the live streaming interface, where the acquisition request is generated by the terminal device based on a user's login to the live streaming interface of the multimedia conference, the live streaming data stream is generated based on interactive data streams of participating users of the multimedia conference, interactive information transmitted from the terminal device is received, the interactive information is generated based on interactive content input by a user based on the live streaming data stream, and the interactive information is transmitted to a terminal device displaying the live streaming interface, where the terminal device displays the interactive information on the live streaming interface.

[0182] Computer program code for carrying out operations of some embodiments of the present disclosure may be written in one or more programming languages ​​or combinations thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and general procedural programming languages ​​such as "C" or similar. The program code may run entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer by any network, including a local area network (LAN) or wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0183] The flowcharts and block diagrams in the drawings illustrate possible system architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowcharts or block diagrams may represent a module, program segment, or part of code, which includes one or more executable instructions for implementing a specified logic function. It should be noted that in some alternative implementations, the functions depicted in the blocks may be implemented in a different order than that depicted in the drawings. For example, two consecutive blocks may be executed substantially simultaneously, and depending on the functionality, they may be executed in a reverse order. It should be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented by a dedicated system based on hardware that executes the specified function or operation, or by a combination of dedicated hardware and computer instructions.

[0184] The units described in some embodiments of the present disclosure may be implemented in the form of software or hardware, and the names of the units are not intended to limit the units themselves in any case, for example, a display unit may be described as "a unit for displaying a live broadcast data stream of a multimedia conference on a live broadcast interface of a multimedia conference in response to a user logging in to the live broadcast interface of a multimedia conference."

[0185] The functionality described herein may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), etc.

[0186] In the context of this disclosure, a machine-readable medium may be a tangible medium, and may contain or store a program for use in, or in conjunction with, an instruction execution system, device, or apparatus. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or apparatus, or any suitable combination thereof. More specific examples of machine-readable storage media include one or more cable-based electrical connections, portable computer disks, hard disks, random access memories (RAMs), read-only memories (ROMs), erasable programmable read-only memories (EPROMs or flash memories), optical fibers, compact disc read-only memories (CD-ROMs), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0187] The above is merely a description of some preferred embodiments of the present disclosure and the technical principles applied thereto. It is obvious to those skilled in the art that the scope of the present disclosure is not limited to the technical solutions based on the specific combinations of the above technical features, but should also include other technical solutions formed by any combination of the above technical features or features equivalent thereto without departing from the above inventive concept. For example, it also includes technical solutions formed by replacing the above features with technical features having similar functions according to the disclosure of the embodiments of the present disclosure (not limited thereto).

Claims

1. An information interaction method applied to a terminal device, comprising: displaying a live streaming data stream of the multimedia conference on the live streaming interface of the multimedia conference in response to a user logging in to the live streaming interface of the multimedia conference, the live streaming data stream being generated based on interactive data streams of participating users of the multimedia conference; receiving interactive content input by a user based on the live broadcast data stream, and generating interactive information based on the interactive content; a step of transmitting the interactive information to a server side so as to instruct the server side to transmit the interactive information to a terminal device displaying the live distribution interface, the step of transmitting the interactive information to the server side so that the server side determines whether to transmit the interactive information to the terminal device displaying the live distribution interface based on the interactive information; receiving a silent playback setting parameter from the server side and displaying a silent playback alert message in text form to the user, the silent playback setting parameter instructing the terminal device to silently play the live distribution data stream, and the user being a participating user of the multimedia conference; An information interaction method comprising:

2. Prior to the step of receiving interactive content input by a user based on the live broadcast data stream and generating interactive information based on the interactive content, obtaining a user nickname of the user; and The step of receiving interactive content input by a user based on the live broadcast data stream and generating interactive information based on the interactive content includes:

10. The method of claim 1, further comprising generating the interactive information based on the interactive content and a user nickname of the user.

3. 3. The method of claim 2, wherein the association between the user and the user nickname is valid while the user is viewing the live broadcast data stream.

4. prior to displaying the multimedia conference live streaming data stream on the multimedia conference live streaming interface in response to a user logging into the multimedia conference live streaming interface; acquiring user identity information based on a predetermined operation performed by the user on a login widget; The method of claim 1 , further comprising: sending user identity information to a server side to determine whether the user has the right to obtain the live broadcast data stream.

5. The method of claim 1 , wherein the live streaming interface is located on a web page.

6. The interactive information includes:

10. The method of claim 1, further comprising at least one of text interactive information, voice interactive information, and default facial expressions.

7. The step of receiving interactive content input by a user based on the live broadcast data stream and generating interactive information based on the interactive content includes:

2. The method of claim 1, further comprising the step of: in response to a number of characters corresponding to the received user input interactive content exceeding a predetermined number threshold, displaying alert information to indicate that the number of characters has exceeded a number limit.

8. The method according to claim 1, further comprising the step of: when the server side determines not to transmit the interactive information to the terminal device displaying the live distribution interface, transmitting feedback information to the user's terminal device to indicate that the interactive information is not approved.

9. 9. The method according to claim 8, further comprising the step of displaying to a user, in response to receiving feedback information indicating that the interactive information transmitted from the server side is not approved, alert information of the feedback information to indicate that the interactive information is not approved.

10. The method of claim 1, further comprising the step of displaying text interactive content corresponding to the interactive information in a text information input box displayed on the live distribution interface in response to receiving feedback information that indicates that the interactive information transmitted from the server side is not approved.

11. The method further includes the step of displaying user interactive information on the live streaming interface, wherein the manner of displaying the interactive information includes at least one of a list, a barrage, and a floating window; The method of claim 1 , wherein the interactive information includes interactive content, user identification information of a user transmitting the interactive content, and time information of the user transmitting the interactive content.

12. 11. The method of claim 10, wherein the plurality of interactive information of at least one user are displayed in a list displaying the interactive information in order based on the time of transmission.

13. The method of claim 11, wherein the top of the list is displayed as sticky interactive information.

14. receiving a scroll operation performed by a user on the list; The method of claim 12 , further comprising: displaying interactive information corresponding to the scrolling operation.

15. The method according to claim 11, characterized in that the user's interactive information is displayed in a barrage manner.

16. The step of displaying user interactive information on the live streaming interface includes: The method according to claim 15, further comprising a step of determining whether or not to turn on a barrage display based on a user's operation on a predetermined barrage widget in the live streaming interface.

17. The terminal device is a terminal device used by a user having a predetermined authority, and The method further includes a step of transmitting information of a predetermined operation to a server side in response to receiving a predetermined operation performed by the user having the predetermined authority on the displayed interactive information, so that the server side transmits an operation result corresponding to the predetermined operation to a terminal device of another user; The predetermined operation is 13. The method of claim 12, including one of the following: sticky, delete, and set timeout for the sender of the interactive information.

18. An information interaction method applied to a terminal device, comprising: receiving a predetermined live streaming start operation for starting a live streaming of a multimedia conference; sending a live streaming request for live streaming the multimedia conference to the server side, so that the server side generates a live streaming data stream of the multimedia conference in response to the live streaming request, the live streaming data stream being generated based on interactive data of participating users of the multimedia conference; A server side determines whether to transmit the interactive information to the terminal device displaying the live distribution interface based on the interactive information, and the interactive information is generated based on interactive content input by a user; In response to receiving an acquisition request for acquiring the live distribution data stream of the multimedia conference from the terminal device, the server side determines whether the user is a participating user of the multimedia conference based on the user's identification information corresponding to the acquisition request, and if the user is a participating user of the multimedia conference, transmits the live distribution data stream and silent playback setting parameters to the terminal device to silently play the live distribution data stream and instructs the terminal device to display a silent playback alert message in text to the user. Information interaction methods.

19. The predetermined live distribution start operation is 20. The method of claim 18, wherein the method is initiated by one of a participating user of the multimedia conference, a viewing user, and a predetermined multimedia conference management user.

20. The initiator of the predetermined live distribution start operation is a participating user of the multimedia conference, and the predetermined live distribution start operation is The method according to claim 18 or 19, characterized in that the method includes a trigger operation performed by a participating user of the multimedia conference on a live streaming widget for starting a live stream displayed on a display interface for displaying multimedia conference information.

21. The start timing of the predetermined live distribution start operation is 20. The method of claim 18, comprising one of: before a multimedia conference starts, while a multimedia conference is in progress.

22. An information interaction method applied to a server side, comprising: transmitting the live streaming data stream to the terminal device in response to receiving an acquisition request for acquiring the live streaming data stream of the multimedia conference transmitted from the terminal device, so that the terminal device displays the live streaming data stream on a live streaming interface, the acquisition request being generated by the terminal device based on a user's login to the live streaming interface of the multimedia conference, and the live streaming data stream being generated based on interactive data streams of participating users of the multimedia conference; receiving interactive information transmitted from a terminal device, the interactive information being generated based on interactive content input by a user based on the live broadcast data stream; determining whether to transmit the interactive information to a terminal device that displays the live distribution interface based on the interactive information; transmitting the interactive information to a terminal device that displays the live streaming interface, so that the terminal device displays the interactive information on the live streaming interface; In response to receiving a request to acquire a live broadcast data stream of a multimedia conference transmitted from a terminal device, the step of transmitting the live broadcast data stream to the terminal device includes: In response to receiving an acquisition request for acquiring a live broadcast data stream of a multimedia conference transmitted from a terminal device, determining whether the user is a participating user based on user identity information of the user corresponding to the acquisition request; and transmitting the live distribution data stream and silent playback setting parameters to the terminal device in response to determining that the user is a participating user, so as to instruct the terminal device to silently play the live distribution data stream and to display alert information indicating the silent playback to the user in text. method.

23. Before the step of transmitting the interactive information to a terminal device that displays the live streaming interface, determining whether to transmit the interactive information to a terminal device that displays the live streaming interface according to the content of the interactive information; when it is determined that the interactive information is to be transmitted to the terminal device that displays the live distribution interface, transmitting the interactive information to the terminal device that displays the live distribution interface; The method according to claim 21, further comprising: when it is determined that the interactive information should not be transmitted to the terminal device displaying the live streaming interface, transmitting feedback information to the user's terminal device indicating that the interactive information is not approved.

24. 22. The method of claim 21, further comprising the step of storing interactive information corresponding to a live-streamed data stream of the multimedia conference to generate an interactive information storage document associated with the multimedia conference.

25. 25. The method according to claim 24, wherein the interactive information storage document is stored in association with a time when a user transmits interactive information, interactive content, and identification information of the user transmitting the interactive information.

26. The method according to claim 25, characterized in that the interactive information storage document is stored in a cloud space of a user having a predetermined authority for the multimedia conference.

27. 26. The method of claim 25, further comprising a step of associating each piece of interactive information with an associated multimedia conference segment in a corresponding recorded live broadcast data stream in the interactive information storage document, such that a user can click on the interactive information to transition to a live broadcast data stream segment of the live broadcast data stream corresponding to the interactive information.

28. 22. The method of claim 21, wherein the live streaming data stream is generated in response to a received live streaming request, the live streaming request being sent by a terminal device based on a predetermined live streaming start operation for starting the live streaming of the received multimedia conference.

29. An information interaction device applied to a terminal device, comprising: a display unit for displaying a live streaming data stream of the multimedia conference on the live streaming interface of the multimedia conference in response to a user logging in to the live streaming interface of the multimedia conference, the live streaming data stream being generated based on interactive data streams of participating users of the multimedia conference; A first receiving unit for receiving interactive content input by a user based on the live distribution data stream, and generating interactive information based on the interactive content; a first transmission unit for transmitting the interactive information to a server side, so as to instruct the server side to transmit the interactive information to a terminal device displaying the live distribution interface, the first transmission unit being configured to transmit the interactive information to the server side, so that the server side determines whether to transmit the interactive information to the terminal device displaying the live distribution interface based on the interactive information; and a unit for receiving a silent playback setting parameter from the server side and displaying a silent playback alert message to the user in text, the silent playback setting parameter instructing the terminal device to silently play the live distribution data stream, and the user being a participating user of the multimedia conference; An information interaction device comprising:

30. An information interaction device applied to a terminal device, comprising: a live distribution start operation receiving unit for receiving a predetermined live distribution start operation for starting a live distribution of a multimedia conference; a live streaming request sending unit for sending a live streaming request for live streaming the multimedia conference to the server side, so that the server side generates a live streaming data stream of the multimedia conference in response to the live streaming request, the live streaming data stream being generated based on interactive data of participating users of the multimedia conference; A server side determines whether to transmit the interactive information to the terminal device displaying the live distribution interface based on the interactive information, and the interactive information is generated based on interactive content input by a user; In response to receiving an acquisition request for acquiring the live distribution data stream of the multimedia conference from the terminal device, the server side determines whether the user is a participating user of the multimedia conference based on the user's identification information corresponding to the acquisition request, and if the user is a participating user of the multimedia conference, transmits the live distribution data stream and silent playback setting parameters to the terminal device to silently play the live distribution data stream and instructs the terminal device to display a silent playback alert message in text to the user. Information interaction device.

31. An information interaction device applied to a server side, comprising: a second sending unit for sending the live streaming data stream to the terminal device in response to receiving an acquisition request for acquiring the live streaming data stream of the multimedia conference sent from the terminal device, so that the terminal device displays the live streaming data stream on a live streaming interface, the acquisition request being generated by the terminal device based on a user's login to the live streaming interface of the multimedia conference, and the live streaming data stream being generated based on interactive data streams of participating users of the multimedia conference; a second receiving unit for receiving interactive information transmitted from a terminal device, the interactive information being generated based on interactive content input by a user based on the live distribution data stream; a determining unit for determining whether to transmit the interactive information to a terminal device that displays the live distribution interface based on the interactive information; a third sending unit for sending the interactive information to the terminal device displaying the live streaming interface, so that the terminal device displays the interactive information on the live streaming interface; The second transmission unit is In response to receiving an acquisition request for acquiring a live broadcast data stream of a multimedia conference transmitted from a terminal device, determining whether the user is a participating user based on user identity information of the user corresponding to the acquisition request; and in response to determining that the user is a participating user, transmitting the live distribution data stream and silent playback setting parameters to the terminal device so as to instruct the terminal device to play the live distribution data stream in silent mode and to display alert information indicating the silent playback to the user in text. Information interaction device.

32. one or more processors; a storage device having one or more programs stored therein; An electronic device, wherein the one or more programs are executed by the one or more processors, causing the one or more processors to implement a method according to any one of claims 1 to 17, or a method according to any one of claims 18 to 21, or a method according to any one of claims 22 to 28.

33. A computer readable medium having a computer program stored thereon, the program, when executed by a processor, implementing the method according to any one of claims 1 to 17, or implementing the method according to any one of claims 18 to 21, or implementing the method according to any one of claims 22 to 28.

Images