Information interaction method and device, equipment, medium and program product

Abstract

The embodiment of the invention provides an information interaction method and device, equipment, a medium and a program product. The method comprises the steps that multimedia information is played, and the multimedia information comprises target audio information; and when the target audio information comprises the preset audio information, displaying interaction information corresponding to the target audio information. According to the technical scheme, in the information interaction process, the specific audio information is recognized, and the recognized audio information is converted into the interaction information in the specific format.

Description

Technical Field

[0001] The embodiments of the present disclosure relate to the field of information interaction technology, and in particular, to an information interaction method, device, equipment, medium, and program product. Background Art

[0002] With the rapid development of computer technology and Internet technology, various service scenarios emerge in an endless stream. In service scenarios, scene functions and interaction methods are often enriched through multiple scene services associated with them.

[0003] In the related art, when interaction is realized based on the service scenario, the service scenario display end usually interacts with the service scenario viewing end through oral broadcast; or, the service scenario display end inputs the interactive information through manual text input and displays the interactive information to realize the interaction with the service scene viewing end.

[0004] However, when the first method is used for information interaction, there may be problems such as being unable to realize interactive backtracking, and the service scene viewing end is prone to miss interactive information, resulting in poor interactive effect and low information interaction efficiency. When the second method is used for information interaction, when the number of service scene viewing ends is relatively large, there may be problems such as slow input rate of interactive information, inability to display interactive information in a timely manner, and a certain interactive time difference, resulting in poor interactive effect, low information interaction efficiency, and low interactive experience. Summary of the invention

[0005] The present disclosure provides an information interaction method, apparatus, device, medium and program product to achieve the effect of identifying specific audio information during the information interaction process and converting the identified audio information into interactive information in a specific format.

[0006] In a first aspect, an embodiment of the present disclosure provides an information interaction method, the method comprising:

[0007] Playing multimedia information, wherein the multimedia information includes target audio information;

[0008] In a case where the target audio information includes preset audio information, interactive information corresponding to the target audio information is displayed.

[0009] In a second aspect, an embodiment of the present disclosure further provides an information interaction device, the device comprising:

[0010] A multimedia playing module, used for playing multimedia information, wherein the multimedia information includes target audio information;

[0011] The interactive information display module is used to display interactive information corresponding to the target audio information when the target audio information includes preset audio information.

[0012] In a third aspect, an embodiment of the present disclosure further provides an electronic device, the electronic device comprising:

[0013] one or more processors;

[0014] a storage device for storing one or more programs,

[0015] When the one or more programs are executed by the one or more processors, the one or more processors implement the information interaction method as described in any one of the embodiments of the present disclosure.

[0016] In a fourth aspect, the embodiments of the present disclosure further provide a storage medium comprising computer executable instructions, which, when executed by a computer processor, are used to execute the information interaction method as described in any one of the embodiments of the present disclosure.

[0017] In a fifth aspect, an embodiment of the present disclosure further provides a computer program product, which includes a computer program, and when the computer program is executed by a processor, it implements the information interaction method as described in any one of the embodiments of the present disclosure.

[0018] The technical solution of the disclosed embodiment provides an information interaction portal and an information interaction platform by playing multimedia information, wherein the multimedia information includes target audio information. Furthermore, when the target audio information includes preset audio information, interactive information corresponding to the target audio information is displayed. This solves the problems existing in the related technology that interactive backtracking cannot be achieved, the viewing end of the service scene easily misses the interactive information, and the input rate of the interactive information is slow, making it impossible to display the interactive information in time. This realizes the effect of identifying specific audio information during the information interaction process and converting the identified audio information into interactive information in a specific format, thereby improving the information interaction efficiency and enhancing the interactive experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and the originals and elements are not necessarily drawn to scale.

[0020] Figure 1 A flowchart of an information interaction method provided by an embodiment of the present disclosure;

[0021] Figure 2A schematic diagram of a live broadcast room page of an anchor terminal provided in an embodiment of the present disclosure;

[0022] Figure 3 A schematic diagram of a live broadcast room page on the audience side provided by an embodiment of the present disclosure;

[0023] Figure 4 A flowchart of another information interaction method provided by an embodiment of the present disclosure;

[0024] Figure 5 A schematic diagram of the structure of an information interaction device provided by an embodiment of the present disclosure;

[0025] Figure 6 A schematic diagram of the structure of an electronic device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0026] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments described herein, which are instead provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0027] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0028] The term "including" and its variations used herein are open inclusions, i.e., "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the following description.

[0029] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0030] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0031] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0032] It is understandable that before using the technical solutions disclosed in the embodiments of the present disclosure, the types, scope of use, usage scenarios, etc. of the personal information involved in the present disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0033] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly prompt the user that the operation requested to be performed will require obtaining and using the user's personal information. Thus, the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, application, server, or storage medium that performs the operation of the technical solution of the present disclosure according to the prompt message.

[0034] As an optional but non-limiting implementation, in response to receiving an active request from the user, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0035] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that meet the relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0036] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.

[0037] Before introducing the present technical solution, an exemplary description of the application scenario can be given. The technical solution can be applied to any information interaction scenario. Exemplarily, when the interaction is realized based on the service scenario, the service scenario display end usually interacts with the service scenario viewing end by oral broadcast; or, the service scenario display end inputs the interactive information by manual text input, and displays the interactive information at a preset position to realize the interaction with the service scene viewing end. However, when the first method is used for information interaction, there may be a problem that the interaction cannot be traced back, and the service scene viewing end is easy to miss the interactive information. When the second method is used for information interaction, when the number of service scene viewing ends is relatively large, there may be a slow input rate of interactive information, the interactive information cannot be displayed in time, and there is a certain interactive time difference. As a result, the interactive effect is poor, the information interaction efficiency is low, and the interactive experience is low. At this time, based on the technical solution of the embodiment of the present disclosure, in the process of playing multimedia information including target audio information, when it is detected that the target audio information played includes preset audio information, interactive information can be generated based on the target audio information and the preset audio information, and the interactive information is displayed. Thereby, the effect of identifying specific audio information during the information interaction process and converting the identified audio information into interactive information in a specific format is achieved, thereby improving the information interaction efficiency and enhancing the interactive experience.

[0038] Before introducing the present technical solution, it should be noted that the device for executing the information interaction method provided by the embodiment of the present disclosure can be integrated into the application software that supports the page display and information interaction functions, and the software can be installed in the electronic device. Optionally, the electronic device can be a mobile terminal or a PC. The application software can be a type of software for data interaction, and its specific application software will not be described one by one here, as long as information interaction can be achieved. It can also be a specially developed application program, which is integrated in the software for realizing interaction, or integrated in the corresponding page, and the interaction can be realized through the page integrated in the PC.

[0039] Figure 1 A flow chart of an information interaction method provided in an embodiment of the present disclosure is applicable to any scenario where interactive information needs to be displayed. The method can be executed by an information interaction device, which can be implemented in the form of software and / or hardware. Optionally, it can be implemented by an electronic device, which can be a mobile terminal, a PC or a server, etc.

[0040] like Figure 1 As shown, the method of this embodiment may specifically include:

[0041] S110: Play multimedia information, where the multimedia information includes target audio information.

[0042] Among them, multimedia information can be understood as information that can be displayed based on the output device (display or speaker) of the terminal device. Multimedia information can be at least one of images, videos, texts and audios. Optionally, the multimedia information can include only the target audio information; or, it can also include the target audio information and other multimedia information associated with the target audio information. The target audio information can be understood as audio information to be detected and identified, and the audio information can be any audio information displayed based on the information display information. It should be noted that different target audio information can correspond to different service scenarios. Exemplarily, in a live broadcast scenario, the target audio information can be the host audio; in a game scenario, the target audio information can be the sound effect information in the game scene; in an audio and video (such as a movie or a recorded video) playback scenario, the target audio information can be the audio information that has been played. Optionally, other multimedia information associated with the target audio information may include the played image or video, such as any frame image in a live video or an already played video, etc.; it may also include text information corresponding to the target audio information. For example, if the target audio information is audio information that has been played, the text information corresponding to the target audio information may be subtitles associated with the played audio information.

[0043] It should be noted that the multimedia information can be played on at least one server. For example, in a live broadcast scenario, the multimedia information can be played on the host and / or the viewer. Different servers have different corresponding multimedia information playback triggering methods. In order to more clearly introduce the playback triggering methods corresponding to different servers, the playback triggering process corresponding to different servers can be described by taking the live broadcast scenario as an example.

[0044] Optionally, for the audience: before playing the multimedia information, it also includes: in response to a viewing trigger operation input to the live broadcast room, pulling the multimedia information corresponding to the live broadcast room from a preset server.

[0045] In this embodiment, the viewing trigger operation can be understood as an operation of entering the live page of the corresponding live room after being triggered. Optionally, the viewing trigger operation may include triggering a live viewing control or receiving a live viewing instruction, etc. The preset server may be a streaming server associated with the corresponding viewer terminal.

[0046] In actual applications, when a viewing trigger operation input by a viewer for a live broadcast room is detected, the trigger operation can be responded to and a preset server associated with the viewer terminal can be determined. Then, multimedia information corresponding to the triggered live broadcast room can be pulled from the preset server and played.

[0047] Optionally, for the anchor side, playing the multimedia information includes: responding to a start trigger operation input to the live broadcast room, collecting the multimedia information, and streaming the multimedia information to the live broadcast room based on preset streaming parameters to play the multimedia information in the live broadcast room.

[0048] In this embodiment, the broadcast trigger operation can be understood as an operation that can enter the live broadcast process after being triggered. Optionally, the broadcast trigger operation may include triggering a broadcast control or receiving a broadcast instruction. The preset push stream parameters can be understood as parameters based on which the push stream operation is performed. Optionally, the preset push stream parameters may include the host end address, resolution, bit rate and / or frame rate.

[0049] In actual applications, when a broadcast trigger operation input to the live broadcast room is detected, the broadcast trigger operation can be responded to, and multimedia information can be collected based on the multimedia information collection device (such as a camera and / or a microphone) set in the corresponding terminal. Further, preset push stream parameters can be obtained, and the collected multimedia information can be pushed to the live broadcast room based on the preset push stream parameters, so that the collected multimedia information can be played in the live broadcast room.

[0050] S120. When the target audio information includes preset audio information, display interactive information corresponding to the target audio information.

[0051] The preset audio information may be a key audio that is preset and used to detect the displayed audio information. Optionally, the preset audio information may be a continuous audio information or audio information including at least one keyword.

[0052] In this embodiment, the preset audio information includes reference audio information and associated audio information corresponding to the reference audio information. The associated audio information has the same semantics as the reference audio information. Specifically, the target audio information includes the preset audio information, which may be that the target audio information includes the reference audio information, or that the target audio information includes the associated audio information corresponding to the reference audio information. For example, the reference audio information is "thank you", and the associated information corresponding to the reference audio information may be "thank you", "thank you very much" or "thank you", etc.

[0053] In this embodiment, interactive information can be understood as information that can realize interactive functions. The interactive information can include any multimedia information that can be displayed in the live broadcast room. Optionally, the interactive information includes at least one of interactive audio, interactive text, interactive image and interactive animation.

[0054] It should be noted that the preset audio information may correspond to the content being played. That is, a plurality of playback contents may be predetermined as preset playback contents, preset audio information corresponding to each preset playback content may be determined respectively, and an association relationship between the playback content and the preset audio information may be established. Furthermore, in practical applications, when it is detected that the content being played is the preset playback content, the preset audio information corresponding to the playback content may be determined according to the pre-established association relationship. Furthermore, the target audio information may be detected based on the preset audio information to determine whether the preset audio information is included in the target audio information. Optionally, the preset playback content may include movie clips, news clips, radio dramas including audio information and default pictures, and recorded broadcast images, etc. Exemplarily, the preset playback content may be a radio drama including audio information and default pictures, and the corresponding preset audio information may be action information and scene information corresponding to the action information (e.g., go to XX place), and the target audio information may be audio information in the radio drama. When it is detected that the content being played is a radio drama, the preset audio information corresponding to the radio drama may be determined. Furthermore, the audio information in the radio drama may be detected based on the preset audio information to determine whether the preset audio information is included in the played radio drama.

[0055] Alternatively, the preset audio information may also correspond to the interactive operation associated with the playback content. That is, multiple interactive operations may be predetermined as preset operations, preset audio information corresponding to each interactive operation may be determined respectively, and an association relationship between the interactive operation and the preset audio information may be established. Furthermore, in practical applications, when it is detected that the interactive operation associated with the playback content is a preset operation, the preset audio information corresponding to the interactive operation may be determined. Furthermore, the target audio information played may be detected according to the preset audio information to determine whether the preset audio information is included in the target audio information. Optionally, the interactive operation includes at least one of an operation of entering the live broadcast room, a trigger operation for a preset control of the live broadcast room, receiving live feedback information for the live broadcast room, completing the operation of acquiring resources for the live broadcast room, and a change in the account status of the live broadcast viewing object. The preset audio information corresponding to the interactive operation may include operation feedback information and operation description information corresponding to the interactive operation, and the operation description information includes identification information of the initiating object and / or the operation object corresponding to the interactive operation. The operation feedback information may include preset interactive keywords, and the preset interactive keywords may include at least one of welcome, thanks, and congratulations. For example, in a live broadcast scenario, the preset audio information corresponding to the interactive operation may be "Congratulations to live broadcast viewer A for reaching level 20". At this time, the host audio may be detected according to the preset audio information to determine whether the host audio includes at least part of the information in the preset audio information.

[0056] In practical applications, before determining whether the target audio information includes the preset audio information, the preset audio information can also be pre-determined. Specifically, in the process of playing multimedia information, if it is detected that the multimedia information being played meets the preset detection trigger condition, the preset audio information corresponding to the multimedia information can be determined, and the target audio information can be detected based on the preset audio information. Optionally, the page-associated content may include the content displayed in the page or the interactive operation associated with the page. Accordingly, the preset detection trigger condition may be that the displayed content is the preset content, or the interactive operation is the preset operation, etc.

[0057] Furthermore, after determining the preset audio information, the target audio information being played can be detected periodically or continuously based on the preset audio information. Furthermore, when it is detected that the target audio information includes the preset audio information, the target audio information can be intercepted based on the preset audio information, and an audio clip obtained after the interception can be obtained. Furthermore, interactive information can be generated based on the audio clip.

[0058] In this embodiment, the interactive information is generated based on the target audio information and / or the preset audio information. Optionally, in the case where the interactive information is generated based on the target audio information and the preset audio information, the generation process of the interactive information may include: obtaining an audio segment including the preset audio information in the target audio information as the interactive audio; generating the interactive information based on the interactive audio.

[0059] The audio clip may be a clip obtained by clipping the audio information according to a preset clipping range. The preset clipping range may be a range that meets the audio processing requirements. In this embodiment, the preset clipping range may include an audio range of the preset audio information. Interactive audio may be understood as audio that can realize interactive functions. Interactive audio may be a continuous and complete audio information, or may be audio information composed of multiple discontinuous audio clips.

[0060] In practical applications, when it is detected that the target audio information includes the preset audio information, there may be a continuous section of the target audio information that includes all the information in the preset audio information, or all the information in the preset audio information may be dispersed in multiple audio segments in the target audio information. Furthermore, the target audio information can be intercepted based on the display of the preset audio information in the target audio information, and the audio segment including the preset audio information in the target audio information can be intercepted to obtain the audio segment including the preset audio information, and the obtained audio segment can be used as the interactive audio.

[0061] It should be noted that the number of audio clips can be one or more. If the obtained audio clip including the preset audio information is one, it can be indicated that the audio clip includes all the information in the preset audio information. If the obtained audio clip including the preset audio information is multiple, it can be indicated that the complete preset audio information can be obtained by splicing the multiple audio clips together.

[0062] Optionally, an audio segment including preset audio information in the target audio information is obtained as interactive audio, including: determining an audio interception position corresponding to the target audio information based on the position and / or time at which the preset audio information appears in the target audio information; and intercepting an audio segment in the target audio information based on the audio interception position as interactive audio.

[0063] The position where the preset audio information appears in the target audio information can be understood as the position of the audio track where the preset audio information appears in the target audio information. The time when the preset audio information appears in the target audio information can include the start time and end time when the preset audio information appears in the target audio information. The audio interception position can be understood as the position of the audio track when the target audio information is trimmed, and can also be understood as the audio playback timestamp when the target audio information is trimmed.

[0064] In practical applications, when it is determined that the target audio information includes preset audio information, the target audio information can be cropped based on the preset audio information. Specifically, it can be: first, the position where the preset audio information first appears in the target audio information, and / or the corresponding audio playback timestamp when it first appears, can be determined. Then, the position and / or the playback timestamp can be used as an audio interception position. Further, the position where the last audio information in the preset audio information appears in the target audio information, and / or the corresponding playback timestamp when the last audio information appears in the target audio information can be determined. Then, the position and / or the playback timestamp can be used as an audio interception position. Then, the target audio information can be cropped according to the determined audio interception position, and the cropped segment can be used as an audio segment including the preset audio information, and as interactive audio.

[0065] In practical applications, due to the different ways of language expression of each audience, there may be preset audio information that appears in the target audio information in the form of fragments. At this time, the target audio information can be intercepted in fragments. Specifically, it can be: first, the position where the preset audio information first appears in the target audio information can be determined, and the position is used as the first audio interception position. After that, the target audio information within the first preset duration starting from the position can be detected. If audio information other than the preset audio information is detected in this section of the target audio information, the position where the preset audio information last appears in this section of the target audio information can be determined, and the position is used as the second audio interception position. Then, the target audio information is trimmed according to these two audio interception positions to obtain the first audio fragment. Further, starting from the second audio interception position, the target audio information continues to be detected. When the preset audio information is detected to appear again in the target audio information, the position where it appears this time can be used as the third audio interception position. Afterwards, the target audio information within the second preset time length starting from this position can be detected. If audio information other than the preset audio information is detected in this section of the target audio information, the position where the preset audio information last appears in this section of the target audio information can be determined, and this position can be used as the fourth audio interception position. Furthermore, the target audio information can be trimmed according to these two audio interception positions to obtain a second audio segment. Afterwards, the above operations are repeated until the position where the last audio information in the preset audio information appears in the target audio information is determined, and this position is used as the last audio interception position. The target audio information can be trimmed according to the determined audio interception positions to obtain multiple audio segments. Afterwards, the multiple audio segments obtained are spliced ​​together according to the playback timestamps, and the spliced ​​audio can be used as interactive audio.

[0066] In this embodiment, the benefit of cutting the target audio information based on the preset audio information is that the accuracy of the interactive audio is improved, the correlation between the preset audio information and the interactive audio is enhanced, and thus, the display effect of the interactive information is improved.

[0067] Optionally, when the interactive information is generated based on the target audio information, at least a portion of the audio segments in the target audio information may be obtained, and then the interactive information corresponding to the target audio information is generated based on the audio segments.

[0068] Optionally, when the interactive information is generated based on preset audio information, the preset audio information included in the target audio information may be acquired, and then the interactive information corresponding to the target audio information is generated based on the preset audio information.

[0069] In this embodiment, after the interactive audio is obtained, interactive information can be generated based on the interactive audio and displayed.

[0070] It should be noted that the information type of the interactive information may include at least one of audio, text, image and video.

[0071] Optionally, when the information type of the interactive information is audio, generating the interactive information based on the interactive audio includes: using the interactive audio as the interactive information.

[0072] In practical applications, after obtaining the interactive audio, the interactive audio can be used as interactive information. Further, when displaying the interactive information, the interactive audio can be directly displayed; or an audio playback control including the interactive audio can be generated and the audio playback control can be displayed.

[0073] Optionally, when the information type of the interactive information is text, generating the interactive information based on the interactive audio includes: converting the interactive audio into interactive text, and using the interactive text as the interactive information.

[0074] The interactive text may be text information corresponding to the interactive audio. In this embodiment, the interactive audio may be converted into the interactive text by recognizing the interactive audio based on a preset text recognition algorithm and using the recognized text information as the interactive text; or, the interactive audio may be processed for text recognition by other audio-text conversion methods to obtain the interactive text, which is not specifically limited in this embodiment.

[0075] In practical applications, after obtaining the interactive audio, text recognition processing can be performed on the interactive audio to obtain recognized text information, which can then be used as interactive text and displayed.

[0076] It should be noted that the interactive information can include both interactive audio and interactive text. Furthermore, when displaying the interactive information, the interactive audio and interactive text can also be displayed at the same time. The benefit of including at least one type of information in the interactive information is that it enhances the display diversity of the interactive information, improves the display effect of the interactive information, and strengthens the information interaction effect.

[0077] Exemplarily, the technical solution may include: when it is detected that the interactive operation meets the preset operation, the anchor end turns on keyword detection, collects the audio of the keyword and the audio within a preset time after the keyword. Afterwards, the collected audio information is sent to the first server (such as an ASR server), and the audio information is converted into text based on the first server, and the text is sent to the anchor end. Further, the anchor end can send the text and interactive operation data corresponding to the audio information to the second server (such as a business server) for matching, obtain the matching audience identification and the revised copy, and feed back the audience identification and the revised copy to the anchor end. Afterwards, the anchor end generates a voice comment based on the revised copy and the locally saved audio data, and sends the voice comment to the second server. Finally, the second server sends the voice comment to all viewers in the live broadcast room through the message platform.

[0078] It should be noted that the interactive information may include at least one of audio, text, video, image and special effects props. Accordingly, generating interactive information based on audio clips may include multiple implementation methods, which are described below:

[0079] The first one: when the interactive information includes audio information, the audio clip can be used as the interactive audio, and the interactive audio can be used as the interactive information; or, an audio playback control including the interactive audio can be generated, and the audio playback control can be displayed as the interactive information.

[0080] The second method: when the interactive information includes text information, text recognition can be performed on the audio clip, and the recognized text information can be used as the interactive text, and the interactive text can be used as the interactive information.

[0081] The third method: when the interactive information includes image information, an image corresponding to the keyword in the audio clip can be retrieved from the material library in the application software, and the image can be used as the interactive image. Alternatively, the audio clip can be processed based on a preset image generation algorithm to obtain a generated image, and the generated image can be used as the interactive image. Furthermore, the interactive image can be used as interactive information.

[0082] Fourth: When the interactive information includes video information, the video segment corresponding to the audio segment can be determined based on the video information included in the multimedia information, and the video segment can be used as the interactive video. Alternatively, a video can be randomly retrieved from a pre-stored video library and used as the interactive video. Furthermore, the interactive video can be used as the interactive information.

[0083] Fifth: When the interactive information includes special effect props, a special effect prop corresponding to the audio clip can be determined from a plurality of pre-set special effect props, and the special effect prop can be used as an interactive special effect. Furthermore, the interactive special effect can be used as the interactive information.

[0084] It should be noted that when the technical solution of the embodiment of the present disclosure is applied in a live broadcast scene, at least some pages in the corresponding live broadcast page may be different for the anchor end and the live broadcast viewing end. In the process of generating interactive information based on interactive audio, in order to facilitate the anchor end to clearly and intuitively understand the generation progress and generation result (success or failure) of the interactive information, the generation progress and generation result of the interactive information can be displayed at a preset position in the live broadcast page corresponding to the live broadcast end. In the process of generating interactive information, the generation progress of the interactive information can be displayed at the preset position in a preset display form. Among them, the preset display method can be any method, and optionally, it can be a progress bar, and the progress bar can be composed of characters included in the interactive information. That is to say, in the process of generating interactive information, the generated characters are displayed in sequence at the preset position according to the generation progress. After the interactive information generation process is completed, if the interactive information is successfully generated, the success mark and the generated interactive information can be displayed at the preset position, and then the generated interactive information can be displayed in a preset format (such as an interactive comment format); if the interactive information is not successfully generated, a prompt message can be generated and the prompt message can be displayed in the live broadcast room. Exemplarily, the live broadcast scene is taken as an example to illustrate the display method of the generation process of interactive information. Figure 2 It can be a schematic diagram of the live broadcast room page corresponding to the live broadcast end, such as Figure 2 The live broadcast room page includes a live broadcast screen display area 10 and an information release area 11. The information release area 11 can be a comment release area of ​​the live broadcast room. During the interactive information generation process, the interactive information generation progress can be displayed in the information release area 11 in the form of a comment box 12, and the position where it is displayed can be the bottom area or the top area of ​​the information release area. Furthermore, when the interactive information is successfully generated, the success mark and the generated interactive information (such as, Figure 2 "Thanks to XXX for XXX").

[0085] Furthermore, for the live broadcast room page corresponding to the live broadcast viewing terminal, when the interactive information is successfully generated, the generated interactive information can be displayed on the live broadcast room page, and the generation process of the interactive information is not displayed. Figure 3 This is a schematic diagram of the live broadcast room page corresponding to the live broadcast viewing terminal. Figure 3As shown, the live broadcast room page includes a live broadcast screen display area 20 and an information release area 21. When the interactive information is successfully generated, the generated interactive information can be displayed in the information release area 21 in the interactive comment format. Figure 3 It can be seen that the interactive information displayed includes not only the generated interactive audio and interactive text, but also the host identification.

[0086] The technical solution of the disclosed embodiment provides an information interaction portal and an information interaction platform by playing multimedia information, wherein the multimedia information includes target audio information. Furthermore, when it is detected that the target audio information includes preset audio information, interactive information corresponding to the target audio information is displayed. This solves the problems existing in the related technology that interactive backtracking cannot be achieved, the viewing end of the service scene easily misses the interactive information, and the input rate of the interactive information is slow, making it impossible to display the interactive information in time. This achieves the effect of identifying specific audio information during the information interaction process and converting the identified audio information into interactive information in a specific format, thereby improving the information interaction efficiency and enhancing the interactive experience.

[0087] Figure 4 A flowchart of another information interaction method provided by an embodiment of the present disclosure. The technical solution of this embodiment is based on the above embodiment. Before generating interactive information based on the target audio information and the preset audio information, the preset audio information is first determined. Then, the target audio information can be detected based on the preset audio information to determine whether the target audio information includes the preset audio information. For specific implementation methods, please refer to the description of this embodiment. Among them, the technical features that are the same or similar to the above embodiments are not repeated here.

[0088] like Figure 4 As shown, the method of this embodiment may specifically include:

[0089] S210: Play multimedia information, where the multimedia information includes target audio information.

[0090] S220: When the interactive operation associated with the multimedia information is a preset operation, determine preset audio information corresponding to the interactive operation, and detect the target audio information based on the preset audio information.

[0091] The interactive operation can be understood as the interactive operation generated during the multimedia information playback process. The interactive operation can also be understood as an operation including an initiating object and an action object, that is, an operation that affects each other between at least two parties. The preset operation can be understood as a pre-set interactive operation used to trigger audio information detection.

[0092] In this embodiment, the interactive operation is associated with the multimedia information. Exemplarily, taking the multimedia information including the live video stream of the live broadcast room as an example, the associated interactive operation may include at least one of the operation of entering the live broadcast room, the trigger operation of the preset control of the live broadcast room, the reception of the live feedback information of the live broadcast room, the operation of completing the resource acquisition of the live broadcast room, and the change of the account status of the live broadcast viewing object. Among them, receiving the feedback information of the live broadcast room may include receiving the comment information of the live broadcast room, receiving the positive evaluation information of the live broadcast room, receiving the trigger operation of the attention control corresponding to the anchor of the live broadcast room, and receiving the live broadcast sharing information of the live broadcast room. Completing the resource acquisition of the live broadcast room can be understood as completing the task of transferring the resource value, that is, the task of transferring the resource value to the interactive object provider in order to obtain the interactive object (such as interactive gifts, recommended display objects or virtual resources, etc.). The account status of the live broadcast viewing object changes, which may include the object level of the live broadcast viewing object being improved or the ranking order of the live broadcast viewing object in the live broadcast room rising.

[0093] In this embodiment, the preset audio information corresponding to the interactive operation can be understood as audio information that can represent the operation feature information associated with the interactive operation. Optionally, the preset audio information includes operation feedback information and operation description information corresponding to the interactive operation.

[0094] Among them, the operation feedback information can be understood as feedback information sent to the initiator of the interactive operation after receiving the interactive operation. The operation feedback information may include preset keywords, and for different interactive operations, the corresponding preset keywords are also different. Exemplarily, continuing to refer to the above example, if the interactive operation is the operation of entering the live broadcast room, the preset keyword in the operation feedback information can be welcome; if the interactive operation is receiving feedback information for the live broadcast room, the preset keyword can be thanks; if the interactive operation is a change in the account status of the live broadcast viewer, the preset keyword can be congratulations.

[0095] Among them, the operation description information can be understood as information that describes the interactive operation as a whole. The operation description information includes identification information of the initiating object and / or the operating object corresponding to the interactive operation. The initiating object can be the object that implements the interactive operation. The identification information of the initiating object is the identification that represents the identity information of the initiating object. The identification information of the initiating object can be any form of identification, and optionally, it can be an object avatar and / or an object nickname, etc. Exemplarily, in a live broadcast scenario, the initiating object can be a live broadcast viewing object. The identification information of the initiating object can be at least part of the characters in the nickname of the live broadcast viewing object. The identification information of the operating object can be understood as information used to identify the interactive operation. Exemplarily, if the interactive operation is an operation to complete the resource acquisition of the live broadcast room, the identification information of the operating object can be a task identifier (for example, the name or abbreviation of an interactive gift).

[0096] In this embodiment, multiple types of interactive operations can be predetermined, and the information composition framework of the preset audio information corresponding to each interactive operation can be determined respectively, and the information composition framework can include operation feedback information corresponding to the interactive operation and an operation description framework corresponding to the interactive operation. Further, the type identification corresponding to the interactive operation can be determined, and the type identification and the corresponding information composition framework of the preset audio information can be stored in the terminal device in correspondence. In actual applications, when it is detected that the interactive operation is a preset operation, the type identification corresponding to the interactive operation can be obtained, and the information composition framework of the preset audio information can be retrieved based on the type identification. Furthermore, the information to be supplemented in the information composition framework can be determined based on the interactive operation, and the information to be supplemented can be added to obtain the preset audio information corresponding to the interactive operation.

[0097] In actual applications, during the process of playing multimedia information, multiple interactive operations associated with the multimedia information may be generated, and there may or may not be preset operations in these interactive operations. Furthermore, in the case of detecting an interactive operation associated with the multimedia information, the interactive operation can be detected to determine whether the interactive operation is a preset operation. Further, in the case of detecting that the interactive operation is a preset operation, the corresponding preset audio information can be determined based on the interactive operation, and the preset audio information corresponding to the interactive operation can be obtained. Therefore, the target audio information can be detected based on the preset audio information.

[0098] In this embodiment, the preset audio information includes operation feedback information and operation description information corresponding to the interactive operation. Therefore, when the target audio information is detected based on the preset audio information, the target audio information can be detected based on the operation feedback information and the operation description information. When it is determined that the target audio information includes both the operation feedback information and the operation description information, it can be determined that the target audio information includes the preset audio information.

[0099] Optionally, preset audio information corresponding to the interactive operation is determined, and target audio information is detected based on the preset audio information, including: determining operation feedback information and operation description information corresponding to the interactive operation, and detecting the target audio information based on the operation feedback information; when the target audio information contains operation feedback information, the target audio information is detected based on the operation description information and a preset detection duration.

[0100] The preset detection time length may be any time length, and may optionally be 1 minute, 5 minutes, or 10 minutes.

[0101] In actual applications, when it is determined that the interactive operation is a preset operation, the operation feedback information and operation description information corresponding to the interactive operation can be determined. Furthermore, the target audio information played can be detected based on the operation feedback information, and the target audio information detected at this time can be the target audio information after the interactive operation is detected. Afterwards, when it is detected that there is operation feedback information in the target audio information, the display time of the target audio information can be used as the detection start time. Afterwards, the target audio information within the preset detection time after the detection start time can be detected to determine whether the target audio information within the preset detection time includes the operation description information. Thus, the process of detecting the target audio information based on the preset audio information can be completed. The advantage of such a setting is that the effect of detecting audio information based on keyword triggering is achieved, the intelligence of audio information detection is enhanced, and the detection efficiency of audio information is improved.

[0102] In practical applications, the technical solution provided by the embodiment of the present disclosure can be applied to a live broadcast scenario. Accordingly, the multimedia information includes a live video stream of the live broadcast room, and the target audio information includes the host audio. The interactive operations associated with the multimedia information include at least one of the operations of entering the live broadcast room, triggering the preset controls of the live broadcast room, receiving live feedback information for the live broadcast room, completing the operation of acquiring resources for the live broadcast room, and changes in the account status of the live broadcast viewing object. The operation feedback information included in the preset audio information includes preset interactive keywords, and the preset interactive keywords include at least one of welcome, thanks, and congratulations. Exemplarily, taking the target audio information as the host audio and the interactive operation as object A entering the live broadcast page as an example, the preset audio information corresponding to the interactive operation can be "Welcome A to enter the live broadcast room". Among them, the operation feedback information can be "Welcome"; the operation description information can be "A enters the live broadcast room". The preset detection time can be 5 minutes. Afterwards, if the audio information of "Welcome" is detected in the host audio displayed after the interactive operation is detected, the display time of the audio information can be used as the detection starting time, and the host audio within 5 minutes after this time can be detected to determine whether the host audio within this time length includes the audio information of "A enters the live broadcast room".

[0103] S230. When the target audio information includes preset audio information, display interactive information corresponding to the target audio information.

[0104] The technical solution of the disclosed embodiment plays multimedia information, wherein the multimedia information includes target audio information. Further, when the interactive operation associated with the multimedia information is a preset operation, the preset audio information corresponding to the interactive operation is determined, and the target audio information is detected based on the preset audio information. Finally, when the preset audio information is included in the target audio information, the interactive information corresponding to the target audio information is displayed, thereby realizing the effect of triggering audio information detection based on the interactive operation to complete the information interaction, enhancing the intelligence of the information interaction function, and enhancing the correlation between the interactive operation and the interactive information.

[0105] Figure 5 A schematic diagram of the structure of an information interaction device provided by an embodiment of the present disclosure is shown in FIG. Figure 5 As shown, the device includes: a multimedia playback module 310 and an interactive information display module 320.

[0106] The multimedia playback module 310 is used to play multimedia information, wherein the multimedia information includes target audio information; the interactive information display module 320 is used to display interactive information corresponding to the target audio information when the target audio information includes preset audio information.

[0107] Based on the above-mentioned optional technical solutions, optionally, the interactive information is generated based on the target audio information and / or the preset audio information.

[0108] Based on the above-mentioned optional technical solutions, optionally, the interactive information includes at least one of interactive audio, interactive text, interactive image and interactive animation.

[0109] Based on the above optional technical solutions, optionally, the device further includes: a preset audio information determination module.

[0110] A preset audio information determination module is used to determine the preset audio information corresponding to the interactive operation before generating interactive information based on the target audio information and the preset audio information, when the interactive operation associated with the multimedia information is a preset operation, and detect the target audio information based on the preset audio information.

[0111] Based on the above-mentioned optional technical solutions, optionally, the preset audio information includes operation feedback information and operation description information corresponding to the interactive operation, and the operation description information includes identification information of the initiating object and / or the operating object corresponding to the interactive operation.

[0112] Based on the above optional technical solutions, optionally, the preset audio information determination module includes: an information determination unit and an information detection unit.

[0113] an information determining unit, configured to determine the operation feedback information and the operation description information corresponding to the interactive operation, and detect the target audio information based on the operation feedback information;

[0114] The information detection unit is used to detect the target audio information based on the operation description information and a preset detection time when the target audio information contains the operation feedback information.

[0115] Based on the above-mentioned optional technical solutions, optionally, the multimedia information includes a live video stream of the live broadcast room, and the target audio information includes the host audio.

[0116] Based on the above-mentioned optional technical solutions, optionally, the interactive operation includes at least one of an operation of entering the live broadcast room, a triggering operation for preset controls of the live broadcast room, receiving live broadcast feedback information for the live broadcast room, completing the operation of acquiring resources for the live broadcast room, and a change in the account status of the live broadcast viewing object.

[0117] On the basis of the above optional technical solutions, optionally, the device further comprises: a multimedia information pulling module. The multimedia information pulling module is configured at the viewer end.

[0118] The multimedia information pulling module is used to pull the multimedia information corresponding to the live broadcast room from a preset server in response to a viewing trigger operation input to the live broadcast room before playing the multimedia information.

[0119] On the basis of the above-mentioned optional technical solutions, optionally, the multimedia playback module 310 includes: a multimedia information collection unit, and the multimedia information collection unit is configured at the anchor end.

[0120] The multimedia information collection unit is used to collect multimedia information in response to a broadcast trigger operation input to the live broadcast room, and push the multimedia information to the target live broadcast room based on preset push parameters to play the multimedia information in the target live broadcast room.

[0121] The technical solution of the disclosed embodiment provides an information interaction portal and an information interaction platform by playing multimedia information, wherein the multimedia information includes target audio information. Furthermore, when the target audio information includes preset audio information, interactive information corresponding to the target audio information is displayed. This solves the problems existing in the related technology that interactive backtracking cannot be achieved, the viewing end of the service scene easily misses the interactive information, and the input rate of the interactive information is slow, making it impossible to display the interactive information in time. This realizes the effect of identifying specific audio information during the information interaction process and converting the identified audio information into interactive information in a specific format, thereby improving the information interaction efficiency and enhancing the interactive experience.

[0122] The information interaction device provided in the embodiments of the present disclosure can execute the information interaction method provided in any embodiment of the present disclosure, and has the corresponding functional modules and beneficial effects of the execution method.

[0123] It is worth noting that the various units and modules included in the above-mentioned device are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the protection scope of the embodiments of the present disclosure.

[0124] Figure 6 This is a schematic diagram of the structure of an electronic device provided by an embodiment of the present disclosure. Figure 6 , which shows an electronic device (eg, Figure 6The terminal device in the embodiment of the present disclosure may include but is not limited to mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 6 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0125] like Figure 6 As shown, the electronic device 500 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 501, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 502 or a program loaded from a storage device 508 into a random access memory (RAM) 503. In the RAM 503, various programs and data required for the operation of the electronic device 500 are also stored. The processing device 501, the ROM 502, and the RAM 503 are connected to each other via a bus 504. An edit / output (I / O) interface 505 is also connected to the bus 504.

[0126] Typically, the following devices may be connected to the I / O interface 505: an input device 506 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 507 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 508 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 509. The communication device 509 may allow the electronic device 500 to communicate with other devices wirelessly or by wire to exchange data. Although Figure 6 The electronic device 500 is shown with various devices, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.

[0127] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device 509, or installed from a storage device 508, or installed from a ROM 502. When the computer program is executed by the processing device 501, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

[0128] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0129] The electronic device provided by the embodiment of the present disclosure and the information interaction method provided by the above embodiment belong to the same inventive concept. The technical details not fully described in this embodiment can be referred to the above embodiment, and this embodiment has the same beneficial effects as the above embodiment.

[0130] The embodiments of the present disclosure provide a computer storage medium on which a computer program is stored. When the program is executed by a processor, the information interaction method provided by the above embodiments is implemented.

[0131] It should be noted that the computer-readable medium disclosed above may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0132] In some embodiments, the client and the server may communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.

[0133] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0134] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device: plays multimedia information, wherein the multimedia information includes target audio information; and displays interactive information corresponding to the target audio information when the target audio information includes preset audio information.

[0135] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including, but not limited to, object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0136] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0137] The units involved in the embodiments described in the present disclosure may be implemented by software or hardware. The name of a unit does not limit the unit itself in some cases. For example, the first acquisition unit may also be described as a "unit for acquiring at least two Internet Protocol addresses".

[0138] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0139] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0140] According to one or more embodiments of the present disclosure, [Example 1] provides an information interaction method, including:

[0141] Playing multimedia information, wherein the multimedia information includes target audio information;

[0142] In a case where the target audio information includes preset audio information, interactive information corresponding to the target audio information is displayed.

[0143] According to one or more embodiments of the present disclosure, [Example 2] provides the method of Example 1, further comprising:

[0144] Optionally, the interactive information is generated based on the target audio information and / or the preset audio information.

[0145] According to one or more embodiments of the present disclosure, [Example 3] provides the method of Example 2, further comprising:

[0146] Optionally, the interactive information includes at least one of interactive audio, interactive text, interactive image and interactive animation.

[0147] According to one or more embodiments of the present disclosure, [Example 4] provides the method of Example 1, further comprising:

[0148] Optionally, before displaying the interactive information corresponding to the target audio information, the method further includes:

[0149] In a case where the interactive operation associated with the multimedia information is a preset operation, preset audio information corresponding to the interactive operation is determined, and the target audio information is detected based on the preset audio information.

[0150] According to one or more embodiments of the present disclosure, [Example 5] provides the method of Example 4, further comprising:

[0151] Optionally, the preset audio information includes operation feedback information and operation description information corresponding to the interactive operation, and the operation description information includes identification information of an initiating object and / or an operating object corresponding to the interactive operation.

[0152] According to one or more embodiments of the present disclosure, [Example 6] provides the method of Example 5, further comprising:

[0153] Optionally, the determining preset audio information corresponding to the interactive operation, and detecting the target audio information based on the preset audio information includes:

[0154] Determine the operation feedback information and the operation description information corresponding to the interactive operation, and detect the target audio information based on the operation feedback information;

[0155] In a case where the target audio information contains the operation feedback information, the target audio information is detected based on the operation description information and a preset detection duration.

[0156] According to one or more embodiments of the present disclosure, [Example 7] provides the method of Example 5, further comprising:

[0157] Optionally, the multimedia information includes a live video stream of the live broadcast room, and the target audio information includes the host audio.

[0158] According to one or more embodiments of the present disclosure, [Example 8] provides the method of Example 7, further comprising:

[0159] Optionally, the interactive operation includes at least one of an operation of entering the live broadcast room, a triggering operation of preset controls for the live broadcast room, receiving live broadcast feedback information for the live broadcast room, an operation of completing resource acquisition for the live broadcast room, and a change in the account status of a live broadcast viewing object.

[0160] According to one or more embodiments of the present disclosure, [Example 9] provides the method of Example 1, further comprising:

[0161] Optionally, applied to a viewer end, before playing the multimedia information, the method further includes:

[0162] In response to a viewing trigger operation input to the live broadcast room, the multimedia information corresponding to the live broadcast room is pulled from a preset server.

[0163] According to one or more embodiments of the present disclosure, [Example 10] provides the method of Example 1, further comprising:

[0164] Optionally, applied to the host end, the playing of multimedia information includes:

[0165] In response to a broadcast trigger operation input to a live broadcast room, multimedia information is collected, and the multimedia information is pushed to a target live broadcast room based on preset push parameters, so as to play the multimedia information in the target live broadcast room.

[0166] According to one or more embodiments of the present disclosure, [Example 11] provides an information interaction device, including:

[0167] A multimedia playing module, used for playing multimedia information, wherein the multimedia information includes target audio information;

[0168] The interactive information display module is used to display interactive information corresponding to the target audio information when the target audio information includes preset audio information.

[0169] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other to form a technical solution.

[0170] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0171] Although the subject matter has been described in language specific to structural features and / or methodological logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims.

Claims

1. An information interaction method, It is characterized in that include: Playing multimedia information, wherein the multimedia information includes target audio information; In a case where the target audio information includes preset audio information, interactive information corresponding to the target audio information is displayed.

2. The information interaction method according to claim 1, It is characterized in that The interactive information is generated based on the target audio information and / or the preset audio information.

3. The information interaction method according to claim 2, It is characterized in that The interactive information includes at least one of interactive audio, interactive text, interactive image and interactive animation.

4. The information interaction method according to claim 1, It is characterized in that Before displaying the interactive information corresponding to the target audio information, the method further includes: In the case that the interactive operation associated with the multimedia information is a preset operation, preset audio information corresponding to the interactive operation is determined, and the target audio information is detected based on the preset audio information.

5. The information interaction method according to claim 4, It is characterized in that The preset audio information includes operation feedback information and operation description information corresponding to the interactive operation, and the operation description information includes identification information of an initiating object and / or an operating object corresponding to the interactive operation.

6. The information interaction method according to claim 5, It is characterized in that The determining of preset audio information corresponding to the interactive operation, and detecting the target audio information based on the preset audio information, includes: Determine the operation feedback information and the operation description information corresponding to the interactive operation, and detect the target audio information based on the operation feedback information; In a case where the target audio information contains the operation feedback information, the target audio information is detected based on the operation description information and a preset detection duration.

7. The information interaction method according to claim 5, It is characterized in that The multimedia information includes a live video stream of the live broadcast room, and the target audio information includes the host audio.

8. The information interaction method according to claim 7, It is characterized in that The interactive operation includes at least one of an operation of entering the live broadcast room, a triggering operation for a preset control of the live broadcast room, receiving live broadcast feedback information for the live broadcast room, an operation of completing resource acquisition for the live broadcast room, and a change in the account status of a live broadcast viewing object.

9. The information interaction method according to claim 1, It is characterized in that Applied to the audience end, before playing the multimedia information, it also includes: In response to a viewing trigger operation input to the live broadcast room, the multimedia information corresponding to the live broadcast room is pulled from a preset server.

10. The information interaction method according to claim 1, It is characterized in that Applied to the anchor end, the playing of multimedia information includes: In response to a broadcast trigger operation input to the live broadcast room, multimedia information is collected, and the multimedia information is pushed to the live broadcast room based on preset push parameters to play the multimedia information in the live broadcast room.

11. An information interaction device, It is characterized in that include: A multimedia playing module, used for playing multimedia information, wherein the multimedia information includes target audio information; The interactive information display module is used to display interactive information corresponding to the target audio information when the target audio information includes preset audio information.

12. An electronic device, It is characterized in that The electronic device comprises: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the information interaction method as described in any one of claims 1-10.

13. A storage medium containing computer executable instructions, It is characterized in that The computer executable instructions are used to execute the information interaction method as described in any one of claims 1-10 when executed by a computer processor.

14. A computer program product, It is characterized in that The computer program product comprises a computer program, and when the computer program is executed by a processor, the computer program implements the information interaction method according to any one of claims 1 to 10.

Images