Information interaction method and apparatus, and device, medium and program product

Abstract

Provided in the embodiments of the present disclosure are an information interaction method and apparatus, and a device, a medium and a program product. The method comprises: playing multimedia information, wherein the multimedia information comprises target audio information; and when the target audio information comprises preset audio information, displaying interaction information corresponding to the target audio information.

Description

Information interaction method, device, equipment, medium and program product

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to the Chinese patent application filed on November 17, 2023, with application number 202311544180.5 and invention name “Information interaction method, device, equipment, medium and program product”. The entire contents of that application are incorporated by reference into this application. Technical Field

[0003] The embodiments of the present disclosure relate to the field of information interaction technology, and in particular to an information interaction method, apparatus, device, medium, and program product. Background Art

[0004] With the rapid development of computer technology and Internet technology, various service scenarios are emerging. In service scenarios, the scene functions and interaction methods are often enriched through the multiple scene services associated with them. Summary of the Invention

[0005] The present disclosure provides an information interaction method, apparatus, device, medium, and program product.

[0006] In a first aspect, an embodiment of the present disclosure provides an information interaction method, the method comprising:

[0007] Playing multimedia information, wherein the multimedia information includes target audio information;

[0008] In a case where the target audio information includes preset audio information, interactive information corresponding to the target audio information is displayed.

[0009] In a second aspect, an embodiment of the present disclosure further provides an information interaction device, the device comprising:

[0010] A multimedia playing module, configured to play multimedia information, wherein the multimedia information includes target audio information;

[0011] The interactive information display module is used to display interactive information corresponding to the target audio information when the target audio information includes preset audio information.

[0012] In a third aspect, an embodiment of the present disclosure further provides an electronic device, the electronic device comprising:

[0013] one or more processors;

[0014] a storage device for storing one or more programs,

[0015] When the one or more programs are executed by the one or more processors, the one or more processors implement the information interaction method as described in any one of the embodiments of the present disclosure.

[0016] In a fourth aspect, an embodiment of the present disclosure further provides a storage medium comprising computer-executable instructions, which, when executed by a computer processor, are used to execute the information interaction method as described in any one of the embodiments of the present disclosure.

[0017] In a fifth aspect, an embodiment of the present disclosure further provides a computer program product, which includes a computer program, and when the computer program is executed by a processor, it implements the information interaction method as described in any one of the embodiments of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The above and other features, advantages, and aspects of the various embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and that the originals and elements are not necessarily drawn to scale.

[0019] FIG1 is a flow chart of an information interaction method provided by an embodiment of the present disclosure;

[0020] FIG2 is a schematic diagram of a live broadcast room page of an anchor terminal provided by an embodiment of the present disclosure;

[0021] FIG3 is a schematic diagram of a live broadcast room page on a viewer side provided by an embodiment of the present disclosure;

[0022] FIG4 is a flow chart of another information interaction method provided by an embodiment of the present disclosure;

[0023] FIG5 is a schematic structural diagram of an information interaction device provided by an embodiment of the present disclosure;

[0024] FIG6 is a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0025] The following describes embodiments of the present disclosure in more detail with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments described herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.

[0026] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0027] As used herein, the term "including" and its variations are open-ended, i.e., "including but not limited to." The term "based on" means "based, at least in part, on." The term "one embodiment" means "at least one embodiment," the term "another embodiment" means "at least one additional embodiment," and the term "some embodiments" means "at least some embodiments." Other terms are defined in the following description.

[0028] It should be noted that the concepts of "first" and "second" mentioned in this disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0029] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, they should be understood as "one or more".

[0030] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0031] It is understandable that before using the technical solutions disclosed in the various embodiments of this disclosure, the type, scope of use, usage scenarios, etc. of the personal information involved in this disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0032] For example, in response to a user's active request, a prompt message is sent to the user to clearly inform the user that the operation requested will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the electronic device, application, server, storage medium, or other software or hardware that performs the operations of the disclosed technical solution based on the prompt message.

[0033] As an optional but non-limiting implementation, in response to receiving a user's active request, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. Furthermore, the pop-up window may also contain a selection control for the user to select "agree" or "disagree" to provide personal information to the electronic device.

[0034] It is understandable that the above notification and user authorization process are merely illustrative and do not limit the implementation of the present disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0035] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) must comply with the requirements of relevant laws, regulations and relevant provisions.

[0036] Before introducing this technical solution, an example application scenario can be provided. This technical solution can be applied to any information interaction scenario. For example, when implementing interaction based on a service scenario, the service scenario display terminal typically interacts with the service scenario viewing terminal through oral broadcasting; alternatively, the service scenario display terminal enters interactive information through manual text input and displays the interactive information at a preset location to achieve interaction with the service scenario viewing terminal. However, when using the first method for information interaction, there may be problems such as the inability to replay the interaction and the service scenario viewing terminal easily missing the interactive information. When using the second method for information interaction, if the number of service scenario viewing terminals is large, there may be problems such as a slow input rate for interactive information, inability to display interactive information in a timely manner, and a certain interaction time difference. This can result in poor interactive effects, low information interaction efficiency, and a low interactive experience. In this case, based on the technical solution of the disclosed embodiment, during the playback of multimedia information including target audio information, if it is detected that the played target audio information includes preset audio information, interactive information can be generated based on the target audio information and the preset audio information, and the interactive information can be displayed. Thus, the effect of identifying specific audio information and converting the identified audio information into interactive information in a specific format is achieved during the information interaction process, thereby improving the information interaction efficiency and enhancing the interactive experience.

[0037] Before introducing the present technical solution, it should be noted that the device for executing the information interaction method provided by the embodiment of the present disclosure can be integrated into an application software that supports page display and information interaction functions, and the software can be installed in an electronic device. Optionally, the electronic device can be a mobile terminal or a PC. The application software can be a type of software for data interaction, and its specific application software will not be described here one by one, as long as it can realize information interaction. It can also be a specially developed application program, which is integrated into the software for realizing interaction, or integrated into the corresponding page, and the interaction can be realized through the page integrated in the PC.

[0038] Figure 1 is a flow chart of an information interaction method provided by an embodiment of the present disclosure. The embodiment of the present disclosure is applicable to any scenario where interactive information needs to be displayed. The method can be executed by an information interaction device, which can be implemented in the form of software and / or hardware. Optionally, it can be implemented by an electronic device, which can be a mobile terminal, a PC or a server, etc.

[0039] As shown in FIG1 , the method of this embodiment may specifically include:

[0040] S110: Play multimedia information, where the multimedia information includes target audio information.

[0041] Among them, multimedia information can be understood as information that can be displayed based on the output device (display or speaker) of the terminal device. Multimedia information can be at least one of images, videos, texts and audios. Optionally, multimedia information can include only target audio information; or, it can also include target audio information and other multimedia information associated with the target audio information. The target audio information can be understood as audio information to be audio detected and identified, and the audio information can be any audio information displayed based on the information display information. It should be noted that different target audio information can correspond to different service scenarios. For example, in a live broadcast scenario, the target audio information can be the host audio; in a game scenario, the target audio information can be the sound effect information in the game scene; in an audio and video (such as a movie or a recorded image) playback scenario, the target audio information can be the audio information that has been played. Optionally, other multimedia information associated with the target audio information may include the played image or video, such as any frame image in a live video or a played video, etc.; it may also include text information corresponding to the target audio information. For example, if the target audio information is audio information that has been played, the text information corresponding to the target audio information may be subtitles associated with the played audio information.

[0042] It should be noted that multimedia information can be played on at least one server. For example, in a live broadcast scenario, multimedia information can be played on the host and / or the viewer. Different servers have different corresponding multimedia information playback triggering methods. To more clearly explain the playback triggering methods corresponding to different servers, we will use a live broadcast scenario as an example to illustrate the playback triggering process corresponding to different servers.

[0043] Optionally, for the audience end: before playing the multimedia information, it also includes: in response to a viewing trigger operation input to the live broadcast room, pulling multimedia information corresponding to the live broadcast room from a preset server.

[0044] In this embodiment, the viewing trigger operation can be understood as the operation of entering the live broadcast page of the corresponding live broadcast room after being triggered. Optionally, the viewing trigger operation can include triggering the live broadcast viewing control or receiving the live broadcast viewing instruction. The preset server can be a streaming server associated with the corresponding viewer terminal.

[0045] In actual applications, when a viewer triggers a viewing operation for a live broadcast room, the system can respond to the trigger and determine the preset server associated with the viewer terminal. Then, the system can pull multimedia information corresponding to the triggered live broadcast room from the preset server and play the pulled multimedia information.

[0046] Optionally, for the anchor side, playing multimedia information includes: responding to a start trigger operation input to the live broadcast room, collecting multimedia information, and pushing the multimedia information to the live broadcast room based on preset push parameters to play the multimedia information in the live broadcast room.

[0047] In this embodiment, the start trigger operation can be understood as an operation that, upon triggering, initiates the live broadcast process. Optionally, the start trigger operation can include triggering a start control or receiving a start instruction. The preset push parameters can be understood as parameters used when executing the push operation. Optionally, the preset push parameters can include the host's address, resolution, bitrate, and / or frame rate.

[0048] In actual applications, when a broadcast trigger operation is detected for the live broadcast room, the broadcast trigger operation can be responded to and multimedia information can be collected based on the multimedia information collection device (such as a camera and / or microphone) set in the corresponding terminal. Furthermore, preset push stream parameters can be obtained and the collected multimedia information can be pushed to the live broadcast room based on the preset push stream parameters so that the collected multimedia information can be played in the live broadcast room.

[0049] S120: When the target audio information includes preset audio information, display interactive information corresponding to the target audio information.

[0050] The preset audio information may be a key audio that is pre-set and used to detect the displayed audio information. Optionally, the preset audio information may be a continuous audio information or an audio information including at least one keyword.

[0051] In this embodiment, the preset audio information includes reference audio information and associated audio information corresponding to the reference audio information. The associated audio information has the same semantics as the reference audio information. Specifically, the target audio information includes the preset audio information, which may mean that the target audio information includes the reference audio information, or that the target audio information includes associated audio information corresponding to the reference audio information. For example, if the reference audio information is "thank you," the associated information corresponding to the reference audio information may be "thank you," "thank you very much," or "grateful."

[0052] In this embodiment, interactive information can be understood as information that can realize interactive functions. Interactive information can include any multimedia information that can be displayed in the live broadcast room. Optionally, interactive information includes at least one of interactive audio, interactive text, interactive images, and interactive animations.

[0053] It should be noted that the preset audio information can correspond to the content being played. That is, multiple playback contents can be pre-determined as preset playback contents, and preset audio information corresponding to each preset playback content can be determined separately, and an association relationship between the playback content and the preset audio information can be established. Furthermore, in actual applications, when it is detected that the content being played is preset playback content, the preset audio information corresponding to the playback content can be determined based on the pre-established association relationship. Furthermore, the target audio information can be detected based on the preset audio information to determine whether the target audio information includes the preset audio information. Optionally, the preset playback content can include movie clips, news clips, radio dramas including audio information and default images, and recorded videos. Exemplarily, the preset playback content can be a radio drama including audio information and default images, and the corresponding preset audio information can include action information and scene information corresponding to the action information (e.g., "Go to XX place"), and the target audio information can be audio information in the radio drama. When it is detected that the content being played is a radio drama, the preset audio information corresponding to the radio drama can be determined. Furthermore, the audio information in the radio drama can be detected based on the preset audio information to determine whether the played radio drama includes the preset audio information.

[0054] Alternatively, the preset audio information may correspond to an interactive operation associated with the played content. That is, multiple interactive operations can be pre-determined as preset operations, and preset audio information corresponding to each interactive operation can be determined. An association between the interactive operation and the preset audio information can then be established. Furthermore, in practical applications, if it is detected that the interactive operation associated with the played content is a preset operation, the preset audio information corresponding to the interactive operation can be determined. Furthermore, the target audio information being played can be tested based on the preset audio information to determine whether the target audio information includes the preset audio information. Optionally, the interactive operation includes at least one of entering a live broadcast room, triggering preset controls for the live broadcast room, receiving live broadcast feedback for the live broadcast room, completing resource acquisition for the live broadcast room, and a change in the account status of the live broadcast viewer. The preset audio information corresponding to the interactive operation may include operation feedback information and operation description information corresponding to the interactive operation. The operation description information may include identification information of the initiator and / or operator of the interactive operation. The operation feedback information may include preset interactive keywords, which may include at least one of welcome, thank you, and congratulations. For example, in a live broadcast scenario, the preset audio information corresponding to the interactive operation may be "Congratulations to live broadcast viewer A for reaching account level 20." In this case, the host's audio can be tested based on the preset audio information to determine whether the host's audio includes at least part of the information in the preset audio information.

[0055] In actual applications, before determining whether the target audio information includes the preset audio information, the preset audio information can also be pre-determined. Specifically, during the playback of multimedia information, if it is detected that the multimedia information being played meets the preset detection trigger condition, the preset audio information corresponding to the multimedia information can be determined, and the target audio information can be detected based on the preset audio information. Optionally, the page-associated content can include the content displayed on the page or the interactive operations associated with the page. Accordingly, the preset detection trigger condition can be that the displayed content is the preset content, or the interactive operation is the preset operation, etc.

[0056] Furthermore, after determining the preset audio information, the target audio information being played can be periodically or continuously detected based on the preset audio information. Furthermore, if the target audio information is detected to include the preset audio information, the target audio information can be intercepted based on the preset audio information to obtain an audio clip. Furthermore, interactive information can be generated based on the audio clip.

[0057] In this embodiment, the interactive information is generated based on the target audio information and / or the preset audio information. Optionally, when the interactive information is generated based on the target audio information and the preset audio information, the process of generating the interactive information may include: obtaining an audio segment including the preset audio information in the target audio information as the interactive audio; and generating the interactive information based on the interactive audio.

[0058] The audio clip may be a clip obtained by clipping the audio information according to a preset clipping range. The preset clipping range may be a range that meets the audio processing requirements. In this embodiment, the preset clipping range may include the audio range of the preset audio information. Interactive audio can be understood as audio that can realize interactive functions. Interactive audio can be a continuous and complete audio information, or it can be audio information composed of multiple discontinuous audio clips.

[0059] In actual applications, when it is detected that the target audio information includes the preset audio information, there may be a continuous section of the target audio information that includes all of the information in the preset audio information, or all of the information in the preset audio information may be dispersed across multiple audio segments in the target audio information. Furthermore, the target audio information can be intercepted based on how the preset audio information is presented in the target audio information. The audio segments in the target audio information that include the preset audio information can be intercepted to obtain the audio segments that include the preset audio information, and the obtained audio segments can be used as the interactive audio.

[0060] It should be noted that the number of audio clips can be one or more. If there is only one audio clip obtained that includes the preset audio information, it can be indicated that the audio clip includes all the information in the preset audio information. If there are multiple audio clips obtained that include the preset audio information, it can be indicated that the complete preset audio information can be obtained by splicing the multiple audio clips together.

[0061] Optionally, obtaining an audio segment including preset audio information in the target audio information as interactive audio includes: determining an audio interception position corresponding to the target audio information based on the position and / or time at which the preset audio information appears in the target audio information; and intercepting an audio segment in the target audio information based on the audio interception position as interactive audio.

[0062] The position where the preset audio information appears in the target audio information can be understood as the audio track position where the preset audio information appears in the target audio information. The time when the preset audio information appears in the target audio information can include the start time and end time when the preset audio information appears in the target audio information. The audio clipping position can be understood as the audio track position when the target audio information is clipped, or it can be understood as the audio playback timestamp when the target audio information is clipped.

[0063] In actual applications, when it is determined that the target audio information includes preset audio information, the target audio information can be cropped based on the preset audio information. Specifically, it can be: first, the position where the preset audio information first appears in the target audio information, and / or the corresponding audio playback timestamp when it first appears, can be determined. Then, the position and / or playback timestamp can be used as an audio interception position. Further, the position where the last audio information in the preset audio information appears in the target audio information, and / or the corresponding playback timestamp when the last audio information appears in the target audio information can be determined. Then, the position and / or playback timestamp can be used as an audio interception position. Then, the target audio information can be cropped according to the determined audio interception position, and the cropped segment can be used as an audio segment including the preset audio information, and as interactive audio.

[0064] In actual applications, due to the different ways of expressing language among each audience, there may be preset audio information that appears in the target audio information in the form of fragments. In this case, the target audio information can be intercepted in fragments. Specifically, it can be: first, the position where the preset audio information first appears in the target audio information can be determined, and this position can be used as the first audio interception position. Afterwards, the target audio information within the first preset time length starting from this position can be detected. If audio information other than the preset audio information is detected in this section of the target audio information, the position where the preset audio information last appears in this section of the target audio information can be determined, and this position can be used as the second audio interception position. Then, the target audio information can be trimmed according to these two audio interception positions to obtain the first audio segment. Furthermore, starting from the second audio interception position, the target audio information continues to be detected. When the preset audio information is detected to appear again in the target audio information, the position where it appears this time can be used as the third audio interception position. Afterwards, the target audio information within the second preset time length starting from this position can be detected. If audio information other than the preset audio information is detected in this section of the target audio information, the position where the preset audio information last appears in this section of the target audio information can be determined, and this position can be used as the fourth audio interception position. Furthermore, the target audio information can be cropped according to these two audio interception positions to obtain a second audio segment. Afterwards, the above operation is repeated until the position where the last audio information in the preset audio information appears in the target audio information is determined, and this position is used as the last audio interception position. The target audio information can be cropped according to the determined audio interception position to obtain multiple audio segments. Afterwards, the multiple audio segments obtained are spliced ​​together according to the playback timestamps, and the spliced ​​audio can be used as interactive audio.

[0065] In this embodiment, the benefits of cropping the target audio information based on the preset audio information are: improving the accuracy of the interactive audio, enhancing the correlation between the preset audio information and the interactive audio, and thus improving the display effect of the interactive information.

[0066] Optionally, when the interactive information is generated based on the target audio information, at least a portion of the audio segments in the target audio information may be obtained, and then, the interactive information corresponding to the target audio information may be generated based on the audio segments.

[0067] Optionally, when the interactive information is generated based on preset audio information, the preset audio information included in the target audio information may be obtained, and then, interactive information corresponding to the target audio information may be generated based on the preset audio information.

[0068] In this embodiment, after the interactive audio is obtained, interactive information can be generated based on the interactive audio and displayed.

[0069] It should be noted that the information type of the interactive information may include at least one of audio, text, image and video.

[0070] Optionally, when the information type of the interactive information is audio, generating the interactive information based on the interactive audio includes: using the interactive audio as the interactive information.

[0071] In practical applications, after obtaining the interactive audio, the interactive audio can be used as interactive information. Furthermore, when displaying the interactive information, the interactive audio can be displayed directly; or an audio playback control including the interactive audio can be generated and displayed.

[0072] Optionally, when the information type of the interactive information is text, generating the interactive information based on the interactive audio includes: converting the interactive audio into interactive text, and using the interactive text as the interactive information.

[0073] The interactive text may be text information corresponding to the interactive audio. In this embodiment, the interactive audio may be converted into interactive text by recognizing the interactive audio based on a preset text recognition algorithm and using the recognized text information as the interactive text; or, alternatively, the interactive audio may be subjected to text recognition processing using other audio-to-text conversion methods to obtain the interactive text, which is not specifically limited in this embodiment.

[0074] In practical applications, after obtaining the interactive audio, text recognition processing can be performed on the interactive audio to obtain recognized text information. Furthermore, this text information can be used as interactive text and displayed.

[0075] It should be noted that interactive information can include both interactive audio and interactive text. Furthermore, when displaying interactive information, both the interactive audio and interactive text can be displayed simultaneously. The benefit of including at least one type of information in interactive information is that it enhances the diversity of interactive information display, improves the interactive information display effect, and strengthens the information interaction effect.

[0076] Exemplarily, this technical solution may include: when it is detected that the interactive operation meets the preset operation, the anchor end starts keyword detection, collects the audio of the keyword and the audio within a preset time after the keyword. Afterwards, the collected audio information is sent to the first server (such as an ASR server), and the audio information is converted into text based on the first server, and the text is sent to the anchor end. Furthermore, the anchor end can send the text corresponding to the audio information and the interactive operation data to the second server (such as a business server) for matching, obtain the matching audience identification and the revised copy, and feed back the audience identification and the revised copy to the anchor end. Afterwards, the anchor end generates a voice comment based on the revised copy and the locally saved audio data, and sends the voice comment to the second server. Finally, the second server sends the voice comment to all viewers in the live broadcast room through the message platform.

[0077] It should be noted that the interactive information may include at least one of audio, text, video, images, and special effects props. Accordingly, generating interactive information based on audio clips may include multiple implementation methods, which are described below:

[0078] The first one: when the interactive information includes audio information, the audio clip can be used as interactive audio, and the interactive audio can be used as interactive information; or, an audio playback control including the interactive audio can be generated, and the audio playback control can be displayed as interactive information.

[0079] The second method: when the interactive information includes text information, text recognition can be performed on the audio clip, and the recognized text information can be used as the interactive text, and the interactive text can be used as the interactive information.

[0080] Third: If the interactive information includes image information, an image corresponding to the keyword in the audio clip can be retrieved from the application's library and used as the interactive image. Alternatively, the audio clip can be processed based on a preset image generation algorithm to generate a generated image, which can be used as the interactive image. Furthermore, the interactive image can be used as interactive information.

[0081] Fourth option: If the interactive information includes video information, the video segment corresponding to the audio segment can be determined based on the video information included in the multimedia information and used as the interactive video. Alternatively, a video can be randomly retrieved from a pre-stored video library and used as the interactive video. Furthermore, the interactive video can be used as interactive information.

[0082] Fifth: When the interactive information includes special effects props, a special effects prop corresponding to the audio clip can be determined from a plurality of pre-set special effects props and used as the interactive special effects. Furthermore, the interactive special effects can be used as the interactive information.

[0083] It should be noted that when the technical solutions of the embodiments of the present disclosure are applied in a live broadcast scenario, at least some pages of the corresponding live broadcast pages may be different for the host and the live broadcast viewer. During the process of generating interactive information based on interactive audio, to facilitate the host's clear and intuitive understanding of the interactive information generation progress and generation results (success or failure), the interactive information generation progress and generation results can be displayed at a preset location on the live broadcast page corresponding to the live broadcast end. During the interactive information generation process, the interactive information generation progress can be displayed at the preset location in a preset display format. The preset display format can be any format, and optionally, it can be a progress bar, and the progress bar can be composed of characters included in the interactive information. In other words, during the interactive information generation process, the generated characters are displayed sequentially at the preset location according to the generation progress. After the interactive information generation process is completed, if the interactive information is successfully generated, a success indicator and the generated interactive information can be displayed at the preset location. Afterwards, the generated interactive information can be displayed in a preset format (e.g., an interactive comment format). If the interactive information is not successfully generated, a prompt message can be generated and displayed in the live broadcast room. Exemplarily, the live broadcast scene is taken as an example to illustrate the display method of the generation process of interactive information. Figure 2 can be a schematic diagram of the live broadcast room page corresponding to the live broadcast end. As shown in Figure 2, the live broadcast room page includes a live screen display area 10 and an information release area 11. The information release area 11 can specifically be the comment release area of ​​the live broadcast room. During the interactive information generation process, the interactive information generation progress can be displayed in the information release area 11 in the form of a comment box 12, and the position where it is displayed can be the bottom area or the top area in the information release area. Furthermore, when the interactive information is successfully generated, the success mark and the generated interactive information can be displayed in the comment box 12 (such as "Thanks to XXX for sending XXX" in Figure 2).

[0084] Furthermore, for the live broadcast room page corresponding to the live broadcast viewing terminal, when the interactive information is successfully generated, the generated interactive information can be displayed on the live broadcast room page, and the generation process of the interactive information is not displayed. For example, continuing to refer to the above example, Figure 3 is a schematic diagram of the live broadcast room page corresponding to the live broadcast viewing terminal. As shown in Figure 3, the live broadcast room page includes a live screen display area 20 and an information release area 21. When the interactive information is successfully generated, the generated interactive information can be displayed in the information release area 21 in the interactive comment format. As can be seen from Figure 3, the displayed interactive information includes not only the generated interactive audio and interactive text, but also the anchor identification.

[0085] The technical solution of the disclosed embodiment provides an information interaction entrance and an information interaction platform by playing multimedia information, wherein the multimedia information includes target audio information. Furthermore, when it is detected that the target audio information includes preset audio information, interactive information corresponding to the target audio information is displayed. This solves the problems existing in the related technology such as the inability to achieve interactive backtracking, the service scene viewing end easily missing interactive information, and the slow input rate of interactive information, which makes it impossible to display interactive information in time. This realizes the effect of identifying specific audio information during the information interaction process and converting the identified audio information into interactive information in a specific format, thereby improving the information interaction efficiency and enhancing the interactive experience.

[0086] FIG4 is a flow chart of another information interaction method provided by an embodiment of the present disclosure. The technical solution of this embodiment is based on the above-mentioned embodiment. Before generating interactive information based on the target audio information and the preset audio information, the preset audio information is first determined. Furthermore, the target audio information can be detected based on the preset audio information to determine whether the target audio information includes the preset audio information. For specific implementation methods, please refer to the description of this embodiment. Technical features that are identical or similar to those of the above-mentioned embodiments will not be repeated here.

[0087] As shown in FIG4 , the method of this embodiment may specifically include:

[0088] S210: Play multimedia information, where the multimedia information includes target audio information.

[0089] S220: When the interactive operation associated with the multimedia information is a preset operation, determine preset audio information corresponding to the interactive operation, and detect the target audio information based on the preset audio information.

[0090] Interactive operations can be understood as interactive operations that occur during multimedia information playback. Interactive operations can also be understood as operations involving an initiating object and an affected object, that is, operations that affect each other between at least two parties. Preset operations can be understood as pre-set interactive operations used to trigger audio information detection.

[0091] In this embodiment, the interactive operation is associated with the multimedia information. For example, taking the multimedia information including the live video stream of the live broadcast room as an example, the associated interactive operation may include at least one of the operation of entering the live broadcast room, the triggering operation of the preset control of the live broadcast room, the reception of live feedback information for the live broadcast room, the operation of completing the resource acquisition of the live broadcast room, and the change of the account status of the live broadcast viewing object. Among them, receiving feedback information for the live broadcast room may include receiving comment information for the live broadcast room, receiving positive evaluation information for the live broadcast room, receiving the triggering operation of the follow control corresponding to the anchor of the live broadcast room, and receiving live sharing information for the live broadcast room. Completing the resource acquisition of the live broadcast room can be understood as completing the task of transferring resource value, that is, obtaining interactive objects (such as interactive gifts, recommended display objects or virtual resources, etc.) to transfer resource value to the interactive object provider. The change in the account status of the live broadcast viewing object may include the improvement of the object level of the live broadcast viewing object or the increase in the ranking order of the live broadcast viewing object in the live broadcast room.

[0092] In this embodiment, the preset audio information corresponding to the interactive operation can be understood as audio information that can represent the operation feature information associated with the interactive operation. Optionally, the preset audio information includes operation feedback information and operation description information corresponding to the interactive operation.

[0093] Operation feedback information can be understood as feedback information sent to the initiator of an interactive operation after receiving the interactive operation. Operation feedback information may include preset keywords, and the corresponding preset keywords are different for different interactive operations. For example, referring to the above example, if the interactive operation is entering the live broadcast room, the preset keyword in the operation feedback information may be "welcome"; if the interactive operation is receiving feedback information for the live broadcast room, the preset keyword may be "thank you"; if the interactive operation is a change in the account status of the live broadcast viewer, the preset keyword may be "congratulations".

[0094] Among them, the operation description information can be understood as information that provides an overall description of the interactive operation. The operation description information includes the identification information of the initiating object and / or the operating object corresponding to the interactive operation. The initiating object can be the object that implements the interactive operation. The identification information of the initiating object is the identification that represents the identity information of the initiating object. The identification information of the initiating object can be any form of identification, and optionally, it can be an object avatar and / or an object nickname, etc. For example, in a live broadcast scenario, the initiating object can be a live broadcast viewing object. The identification information of the initiating object can be at least part of the characters in the nickname of the live broadcast viewing object. The identification information of the operating object can be understood as information used to identify the interactive operation. For example, if the interactive operation is an operation to complete the resource acquisition of the live broadcast room, the identification information of the operating object can be a task identifier (for example, the name or abbreviation of the interactive gift).

[0095] In this embodiment, multiple types of interactive operations can be predetermined, and the information composition framework of the preset audio information corresponding to each interactive operation can be determined respectively. The information composition framework can include operation feedback information corresponding to the interactive operation and an operation description framework corresponding to the interactive operation. Furthermore, the type identifier corresponding to the interactive operation can be determined, and the type identifier and the corresponding preset audio information information composition framework can be stored in the terminal device in correspondence. In actual applications, when it is detected that the interactive operation is a preset operation, the type identifier corresponding to the interactive operation can be obtained, and the information composition framework of the preset audio information can be retrieved based on the type identifier. Furthermore, the information to be supplemented in the information composition framework can be determined based on the interactive operation, and the information to be supplemented can be added to obtain the preset audio information corresponding to the interactive operation.

[0096] In actual applications, during the playback of multimedia information, multiple interactive operations associated with the multimedia information may occur. These interactive operations may or may not include preset operations. Furthermore, when an interactive operation associated with the multimedia information is detected, the interactive operation can be detected to determine whether it is a preset operation. Furthermore, when the interactive operation is detected to be a preset operation, corresponding preset audio information can be determined based on the interactive operation, thereby obtaining the preset audio information corresponding to the interactive operation. Thus, the target audio information can be detected based on the preset audio information.

[0097] In this embodiment, the preset audio information includes operation feedback information and operation description information corresponding to the interactive operation. Therefore, when the target audio information is detected based on the preset audio information, the target audio information can be detected based on the operation feedback information and the operation description information. When it is determined that the target audio information includes both the operation feedback information and the operation description information, it can be determined that the target audio information includes the preset audio information.

[0098] Optionally, determine the preset audio information corresponding to the interactive operation, and detect the target audio information based on the preset audio information, including: determining the operation feedback information and operation description information corresponding to the interactive operation, and detecting the target audio information based on the operation feedback information; when the target audio information has operation feedback information, detect the target audio information based on the operation description information and the preset detection time.

[0099] The preset detection time can be any length, and can optionally be 1 minute, 5 minutes or 10 minutes.

[0100] In actual applications, when it is determined that the interactive operation is a preset operation, the operation feedback information and operation description information corresponding to the interactive operation can be determined. Furthermore, the target audio information played can be detected based on the operation feedback information. At this time, the target audio information detected can be the target audio information after the interactive operation is detected. Afterwards, when it is detected that the target audio information has operation feedback information, the display time of the target audio information can be used as the detection starting time. Afterwards, the target audio information within the preset detection time after the detection starting time can be detected to determine whether the target audio information within the preset detection time includes the operation description information. Thus, the process of detecting the target audio information based on the preset audio information can be completed. The advantage of such a setting is that it realizes the effect of detecting audio information based on keyword triggering, enhances the intelligence of audio information detection, and improves the detection efficiency of audio information.

[0101] In practical applications, the technical solution provided by the embodiment of the present disclosure can be applied to a live broadcast scenario. Accordingly, the multimedia information includes the live video stream of the live broadcast room, and the target audio information includes the host audio. The interactive operations associated with the multimedia information include at least one of the operations of entering the live broadcast room, triggering the preset controls of the live broadcast room, receiving live feedback information for the live broadcast room, completing the resource acquisition of the live broadcast room, and changes in the account status of the live broadcast viewing object. The operation feedback information included in the preset audio information includes preset interactive keywords, and the preset interactive keywords include at least one of welcome, thanks, and congratulations. For example, taking the target audio information as the host audio and the interactive operation as object A entering the live broadcast page as an example, the preset audio information corresponding to the interactive operation can be "Welcome A to enter the live broadcast room". Among them, the operation feedback information can be "Welcome"; the operation description information can be "A enters the live broadcast room". The preset detection time can be 5 minutes. Afterwards, if the audio information of "Welcome" is detected in the host audio displayed after the interactive operation is detected, the display time of the audio information can be used as the detection starting time, and the host audio within 5 minutes after this moment can be detected to determine whether the host audio within this time length includes the audio information of "A enters the live broadcast room".

[0102] S230: When the target audio information includes preset audio information, display interactive information corresponding to the target audio information.

[0103] The technical solution of the embodiment of the present disclosure plays multimedia information, wherein the multimedia information includes target audio information. Further, when the interactive operation associated with the multimedia information is a preset operation, the preset audio information corresponding to the interactive operation is determined, and the target audio information is detected based on the preset audio information. Finally, when the preset audio information is included in the target audio information, the interactive information corresponding to the target audio information is displayed, thereby realizing the effect of triggering audio information detection based on the interactive operation to complete the information interaction, enhancing the intelligence of the information interaction function, and enhancing the correlation between the interactive operation and the interactive information.

[0104] FIG5 is a schematic structural diagram of an information interaction device provided by an embodiment of the present disclosure. As shown in FIG5 , the device includes: a multimedia playback module 310 and an interactive information display module 320 .

[0105] The multimedia playback module 310 is used to play multimedia information, wherein the multimedia information includes target audio information; the interactive information display module 320 is used to display interactive information corresponding to the target audio information when the target audio information includes preset audio information.

[0106] Based on the above optional technical solutions, optionally, the interactive information is generated based on the target audio information and / or the preset audio information.

[0107] Based on the above-mentioned optional technical solutions, optionally, the interactive information includes at least one of interactive audio, interactive text, interactive image and interactive animation.

[0108] Based on the above optional technical solutions, optionally, the device further includes: a preset audio information determination module.

[0109] A preset audio information determination module is used to determine the preset audio information corresponding to the interactive operation before generating interactive information based on the target audio information and the preset audio information, when the interactive operation associated with the multimedia information is a preset operation, and to detect the target audio information based on the preset audio information.

[0110] Based on the above-mentioned optional technical solutions, optionally, the preset audio information includes operation feedback information and operation description information corresponding to the interactive operation, and the operation description information includes identification information of the initiating object and / or operation object corresponding to the interactive operation.

[0111] Based on the above optional technical solutions, optionally, the preset audio information determination module includes: an information determination unit and an information detection unit.

[0112] an information determining unit, configured to determine the operation feedback information and the operation description information corresponding to the interactive operation, and detect the target audio information based on the operation feedback information;

[0113] The information detection unit is configured to detect the target audio information based on the operation description information and a preset detection duration when the target audio information contains the operation feedback information.

[0114] Based on the above-mentioned optional technical solutions, optionally, the multimedia information includes a live video stream of the live broadcast room, and the target audio information includes the host audio.

[0115] Based on the above-mentioned optional technical solutions, optionally, the interactive operation includes at least one of an operation of entering the live broadcast room, a triggering operation for preset controls of the live broadcast room, receiving live broadcast feedback information for the live broadcast room, completing the operation of acquiring resources for the live broadcast room, and a change in the account status of the live broadcast viewing object.

[0116] Based on the above optional technical solutions, optionally, the device further includes: a multimedia information pulling module. The multimedia information pulling module is configured at the viewer end.

[0117] The multimedia information pulling module is used to pull the multimedia information corresponding to the live broadcast room from a preset server in response to a viewing trigger operation input to the live broadcast room before playing the multimedia information.

[0118] On the basis of the above-mentioned optional technical solutions, optionally, the multimedia playback module 310 includes: a multimedia information collection unit, which is configured at the host end.

[0119] The multimedia information collection unit is used to collect multimedia information in response to a broadcast trigger operation input to the live broadcast room, and push the multimedia information to the target live broadcast room based on preset push parameters to play the multimedia information in the target live broadcast room.

[0120] The technical solution of the embodiment of the present disclosure provides an information interaction entrance and an information interaction platform by playing multimedia information, wherein the multimedia information includes target audio information. Furthermore, when the target audio information includes preset audio information, interactive information corresponding to the target audio information is displayed. This solves the problems existing in the related technology such as the inability to achieve interactive backtracking, the service scene viewing end easily missing interactive information, and the slow input rate of interactive information, which makes it impossible to display interactive information in time. It realizes the effect of identifying specific audio information during the information interaction process and converting the identified audio information into interactive information in a specific format, thereby improving the information interaction efficiency and enhancing the interactive experience.

[0121] The information interaction device provided in the embodiments of the present disclosure can execute the information interaction method provided in any embodiment of the present disclosure, and has the corresponding functional modules and beneficial effects of the execution method.

[0122] It is worth noting that the various units and modules included in the above-mentioned device are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the protection scope of the embodiments of the present disclosure.

[0123] FIG6 is a schematic diagram of the structure of an electronic device provided by an embodiment of the present disclosure. Referring to FIG6 , a schematic diagram of the structure of an electronic device (such as a terminal device or server in FIG6 ) 500 suitable for implementing an embodiment of the present disclosure is shown below. The terminal device in the embodiment of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. The electronic device shown in FIG6 is merely an example and should not impose any limitations on the functions and scope of use of the embodiments of the present disclosure.

[0124] As shown in FIG6 , the electronic device 500 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 501, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 502 or a program loaded from a storage device 508 into a random access memory (RAM) 503. Various programs and data required for the operation of the electronic device 500 are also stored in the RAM 503. The processing device 501, the ROM 502, and the RAM 503 are connected to each other via a bus 504. An edit / output (I / O) interface 505 is also connected to the bus 504.

[0125] Typically, the following devices may be connected to the I / O interface 505: an input device 506 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 507 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 508 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 509. The communication device 509 may allow the electronic device 500 to communicate with other devices wirelessly or by wire to exchange data. Although FIG. 6 illustrates the electronic device 500 with various devices, it should be understood that not all of the illustrated devices are required to be implemented or present. More or fewer devices may alternatively be implemented or present.

[0126] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication device 509, or installed from the storage device 508, or installed from the ROM 502. When the computer program is executed by the processing device 501, the above-mentioned functions defined in the method of the embodiment of the present disclosure are performed.

[0127] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0128] The electronic device provided by the embodiment of the present disclosure and the information interaction method provided by the above embodiment belong to the same inventive concept. For technical details not fully described in this embodiment, please refer to the above embodiment, and this embodiment has the same beneficial effects as the above embodiment.

[0129] An embodiment of the present disclosure provides a computer storage medium on which a computer program is stored. When the program is executed by a processor, the information interaction method provided by the above embodiment is implemented.

[0130] It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, device, or component. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.

[0131] In some embodiments, the client and server can communicate using any currently known or later developed network protocol, such as HTTP (HyperText Transfer Protocol), and can be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or later developed network.

[0132] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0133] The above-mentioned computer-readable medium carries one or more programs. When the above-mentioned one or more programs are executed by the electronic device, the electronic device: plays multimedia information, wherein the multimedia information includes target audio information; and displays interactive information corresponding to the target audio information when the target audio information includes preset audio information.

[0134] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages, or a combination thereof, including, but not limited to, object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on the remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0135] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the module, program segment, or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0136] The units involved in the embodiments described in this disclosure may be implemented in software or hardware. In some cases, the name of a unit does not limit the unit itself. For example, the first acquisition unit may also be described as a "unit for acquiring at least two Internet Protocol addresses."

[0137] The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0138] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0139] According to one or more embodiments of the present disclosure, [Example 1] provides an information interaction method, including:

[0140] Playing multimedia information, wherein the multimedia information includes target audio information;

[0141] In a case where the target audio information includes preset audio information, interactive information corresponding to the target audio information is displayed.

[0142] According to one or more embodiments of the present disclosure, [Example 2] provides the method of Example 1, further comprising:

[0143] Optionally, the interactive information is generated based on the target audio information and / or the preset audio information.

[0144] According to one or more embodiments of the present disclosure, [Example 3] provides the method of Example 2, further comprising:

[0145] Optionally, the interactive information includes at least one of interactive audio, interactive text, interactive image and interactive animation.

[0146] According to one or more embodiments of the present disclosure, [Example 4] provides the method of Example 1, further comprising:

[0147] Optionally, before displaying the interactive information corresponding to the target audio information, the method further includes:

[0148] In a case where the interactive operation associated with the multimedia information is a preset operation, preset audio information corresponding to the interactive operation is determined, and the target audio information is detected based on the preset audio information.

[0149] According to one or more embodiments of the present disclosure, [Example 5] provides the method of Example 4, further comprising:

[0150] Optionally, the preset audio information includes operation feedback information and operation description information corresponding to the interactive operation, and the operation description information includes identification information of an initiating object and / or an operating object corresponding to the interactive operation.

[0151] According to one or more embodiments of the present disclosure, [Example 6] provides the method of Example 5, further comprising:

[0152] Optionally, determining preset audio information corresponding to the interactive operation and detecting the target audio information based on the preset audio information includes:

[0153] Determining the operation feedback information and the operation description information corresponding to the interactive operation, and detecting the target audio information based on the operation feedback information;

[0154] In a case where the target audio information contains the operation feedback information, the target audio information is detected based on the operation description information and a preset detection duration.

[0155] According to one or more embodiments of the present disclosure, [Example 7] provides the method of Example 5, further comprising:

[0156] Optionally, the multimedia information includes a live video stream of the live broadcast room, and the target audio information includes the host audio.

[0157] According to one or more embodiments of the present disclosure, [Example 8] provides the method of Example 7, further comprising:

[0158] Optionally, the interactive operation includes at least one of an operation of entering the live broadcast room, a triggering operation of preset controls for the live broadcast room, a receiving of live broadcast feedback information for the live broadcast room, an operation of completing resource acquisition for the live broadcast room, and a change in the account status of a live broadcast viewing object.

[0159] According to one or more embodiments of the present disclosure, [Example 9] provides the method of Example 1, further comprising:

[0160] Optionally, when applied to a viewer end, before playing the multimedia information, the method further includes:

[0161] In response to a viewing trigger operation input for the live broadcast room, the multimedia information corresponding to the live broadcast room is pulled from a preset server.

[0162] According to one or more embodiments of the present disclosure, [Example 10] provides the method of Example 1, further comprising:

[0163] Optionally, in the application to the host terminal, the multimedia information playing includes:

[0164] In response to a broadcast trigger operation input to the live broadcast room, multimedia information is collected and pushed to the target live broadcast room based on preset push parameters to play the multimedia information in the target live broadcast room.

[0165] According to one or more embodiments of the present disclosure, [Example 11] provides an information interaction device, including:

[0166] A multimedia playing module, configured to play multimedia information, wherein the multimedia information includes target audio information;

[0167] The interactive information display module is used to display interactive information corresponding to the target audio information when the target audio information includes preset audio information.

[0168] The above description is merely a preferred embodiment of the present disclosure and an illustration of the technical principles employed. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by the specific combination of the above-mentioned technical features, but also includes other technical solutions formed by any combination of the above-mentioned technical features or their equivalents without departing from the above-mentioned disclosed concepts. For example, a technical solution formed by replacing the above-mentioned features with (but not limited to) technical features with similar functions disclosed in this disclosure.

[0169] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details have been included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0170] Although the subject matter has been described in language specific to structural features and / or methodological logical acts, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims.

Claims

1. An information interaction method, comprising: Playing multimedia information, wherein the multimedia information includes target audio information; In a case where the target audio information includes preset audio information, interactive information corresponding to the target audio information is displayed.

2. The information interaction method according to claim 1, wherein: The interactive information is generated based on the target audio information and / or the preset audio information.

3. The information interaction method according to claim 2, wherein: The interactive information includes at least one of interactive audio, interactive text, interactive image and interactive animation.

4. The information interaction method according to claim 1, wherein: Before displaying the interactive information corresponding to the target audio information, the method further includes: In the case that the interactive operation associated with the multimedia information is a preset operation, preset audio information corresponding to the interactive operation is determined, and the target audio information is detected based on the preset audio information.

5. The information interaction method according to claim 4, wherein: The preset audio information includes operation feedback information and operation description information corresponding to the interactive operation, and the operation description information includes identification information of an initiating object and / or an operating object corresponding to the interactive operation.

6. The information interaction method according to claim 5, wherein: The determining of preset audio information corresponding to the interactive operation, and detecting the target audio information based on the preset audio information, includes: Determine the operation feedback information and the operation description information corresponding to the interactive operation, and detect the target audio information based on the operation feedback information; In a case where the target audio information contains the operation feedback information, the target audio information is detected based on the operation description information and a preset detection duration.

7. The information interaction method according to claim 5, wherein: The multimedia information includes a live video stream of the live broadcast room, and the target audio information includes the host audio.

8. The information interaction method according to claim 7, wherein: The interactive operation includes at least one of an operation of entering the live broadcast room, a triggering operation for a preset control of the live broadcast room, receiving live broadcast feedback information for the live broadcast room, an operation of completing resource acquisition for the live broadcast room, and a change in the account status of a live broadcast viewing object.

9. The information interaction method according to claim 1, wherein: Applied to the audience end, before playing the multimedia information, it also includes: In response to a viewing trigger operation input to the live broadcast room, the multimedia information corresponding to the live broadcast room is pulled from a preset server.

10. The information interaction method according to claim 1, wherein: Applied to the anchor end, the playing of multimedia information includes: In response to a broadcast trigger operation input to the live broadcast room, multimedia information is collected, and the multimedia information is pushed to the live broadcast room based on preset push parameters to play the multimedia information in the live broadcast room.

11. An information interaction device, comprising: A multimedia playing module, used for playing multimedia information, wherein the multimedia information includes target audio information; The interactive information display module is used to display interactive information corresponding to the target audio information when the target audio information includes preset audio information.

12. An electronic device comprising: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the information interaction method as described in any one of claims 1-10.

13. A storage medium comprising computer executable instructions, wherein: The computer executable instructions are used to execute the information interaction method as described in any one of claims 1-10 when executed by a computer processor.

14. A computer program product, wherein: The computer program product comprises a computer program, and when the computer program is executed by a processor, the information interaction method according to any one of claims 1 to 10 is implemented.

Images