Multimedia information interaction method and apparatus, electronic device and storage medium

HK40071427BActive Publication Date: 2026-07-10TENCENT TECHNOLOGY (SHENZHEN) CO LTD

Patent Information

Authority / Receiving Office
HK · HK
Patent Type
Patents
Current Assignee / Owner
TENCENT TECHNOLOGY (SHENZHEN) CO LTD
Filing Date
2022-09-08
Publication Date
2026-07-10

AI Technical Summary

Technical Problem

Existing music players have limited functionality and cannot provide interactive feedback with multimedia information while playing music, resulting in a poor user experience.

Method used

The audio playback page displays the video content of the target audio, obtains real-time interactive information, responds to user input, and updates the interactive information on the audio playback page, including functions such as likes, comments, and video creation.

Benefits of technology

It enhances the user's interactive experience with multimedia information, provides more interactive feedback methods, and enriches the functions of the music player.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

Embodiments of the present application disclose a multimedia information interaction method and device, electronic equipment and a storage medium, comprising: displaying an audio playing page corresponding to a target audio playing request in a target client; obtaining real-time interaction information corresponding to the target audio at a current time, and displaying the real-time interaction information in the audio playing page; in response to an interaction information input operation triggered by the target client for the audio playing page, updating the interaction information displayed by the audio playing page according to interaction content corresponding to the interaction information input operation, which can enhance the user experience of multimedia information.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of computer technology, specifically to a multimedia information interaction method, apparatus, electronic device, and storage medium. Background Technology

[0002] With the rapid development of technology, various applications (Apps) have experienced explosive growth, allowing people to use them for instant messaging, watching videos, listening to music, and so on.

[0003] In some scenarios, users can share music with other users through the app. However, the music player in the app currently has limited functionality, only allowing music to be played on the player interface or by redirecting to the music app page. Summary of the Invention

[0004] This invention provides a multimedia information interaction method, apparatus, electronic device, and storage medium, which can realize interactive feedback between users and multimedia information, thus greatly enhancing the user's experience of multimedia information and providing users with more choices for multimedia interactive feedback.

[0005] This invention provides a multimedia information interaction method, including:

[0006] The target client displays the audio playback page corresponding to the target audio playback request, and the audio playback page displays the video content of the video corresponding to the target audio.

[0007] Obtain the real-time interactive information corresponding to the target audio at the current moment, and display the real-time interactive information on the audio playback page. The real-time interactive information is published by the audio client currently playing the target audio.

[0008] In response to an interactive information input operation triggered by the target client on the audio playback page, the interactive information displayed on the audio playback page is updated according to the interactive content corresponding to the interactive information input operation.

[0009] Accordingly, embodiments of this application also provide a multimedia information interaction device, including:

[0010] The display module is used to display the audio playback page corresponding to the target audio playback request in the target client, and the audio playback page displays the video content of the video corresponding to the target audio;

[0011] The acquisition module is used to acquire the real-time interactive information corresponding to the target audio at the current moment, and display the real-time interactive information on the audio playback page. The real-time interactive information is published by the audio client currently playing the target audio.

[0012] The update module is used to respond to the interactive information input operation triggered by the target client on the audio playback page, and update the interactive information displayed on the audio playback page according to the interactive content corresponding to the interactive information input operation.

[0013] Optionally, in some embodiments of this application, a detection module is further included, which is specifically used for:

[0014] When it is detected that the video corresponding to the target audio is a video published by the video production account, the video corresponding to the target audio is identified as an associated video;

[0015] The update module is specifically used to: respond to the interactive information input operation triggered by the target client on the audio playback page, and update the interactive information displayed on the audio playback page according to the interactive content corresponding to the interactive information input operation and the associated video.

[0016] Optionally, in some embodiments of this application, the updating module includes:

[0017] The display submodule is used to respond to the interactive information input operation triggered by the target client in the interactive information editing area, and to display the input interactive content in the interactive information editing area;

[0018] The update submodule is used to respond to the interactive information sending operation triggered by the target client in response to the interactive content sending control, and update the interactive information displayed in the interactive information display area according to the interactive content and the associated video.

[0019] Optionally, in some embodiments of this application, the update submodule includes:

[0020] The acquisition unit is used to acquire the timestamp of the interactive information sending operation;

[0021] The first determining unit is used to determine the video corresponding to the interactive information input operation from the associated video based on the timestamp, and obtain the target video;

[0022] The updating unit is used to update the interactive information displayed in the interactive information display area based on the interactive content and the target video.

[0023] Optionally, in some embodiments of this application, the updating unit includes:

[0024] A sub-unit is constructed to build interactive information corresponding to the target client based on the interactive content and the target video, thereby obtaining target interactive information;

[0025] The update subunit is used to update the interactive information displayed in the interactive information display area using the target interactive information.

[0026] Optionally, in some embodiments of this application, the updating subunit is specifically used for:

[0027] The real-time interactive information is arranged according to the interaction time of the real-time interactive information;

[0028] Each time target interactive information is acquired, the interactive information display area is rendered and displayed according to the order of the real-time interactive information and the timestamp of the interactive information sending operation.

[0029] Optionally, in some embodiments of this application, a hidden subunit is further included, the hidden subunit being specifically used for:

[0030] In response to a real-time interactive information closing operation triggered on the interactive information display area, the real-time interactive information, the interactive content editing area, and the interactive content sending control are hidden.

[0031] Optionally, in some embodiments of this application, a first switching unit is further included, the first switching unit being specifically used for:

[0032] In response to an interactive information viewing operation triggered by the real-time interactive information, the audio client corresponding to the target real-time interactive information is identified as the client to be viewed;

[0033] Obtain the video played when the client to be viewed sends the target real-time interactive information;

[0034] Switch the video playing on the audio playback page to the video playing when the client to be viewed sends the target real-time interactive information.

[0035] Optionally, in some embodiments of this application, a playback unit is further included, the playback unit being specifically used for:

[0036] In response to a click operation triggered by the like control, update the style of the like control, and / or;

[0037] In response to a video like operation triggered for the associated video, an animation corresponding to the video like operation is played on the audio playback page.

[0038] Optionally, in some embodiments of this application, a second switching unit is further included, the second switching unit being specifically used for:

[0039] A video switching control is displayed on the audio playback page;

[0040] In response to a click operation on the video switching control, a video list containing the associated video is displayed on the audio playback page;

[0041] In response to a selection operation of an associated video in the video list, the selected associated video is determined as the video to be switched;

[0042] Switch the currently playing associated video to the video to be switched, and display the video switching animation in the video playlist.

[0043] Optionally, in some embodiments of this application, a playback module is further included, the playback module being specifically used for:

[0044] Obtain the audio segmentation information of the target audio;

[0045] The target audio is segmented based on the audio segmentation information to obtain at least one audio slice;

[0046] The associated videos corresponding to the segmented audio are determined, and the associated videos corresponding to the segmented audio are played sequentially according to the playback time of each segmented audio.

[0047] Optionally, in some embodiments of this application, the audio playback page further includes a client-side associated control and a switching module, the switching module being specifically used for:

[0048] In response to a click operation triggered by the client-associated control, the associated client is identified and the audio playback page is switched to the page of the associated client.

[0049] Optionally, in some embodiments of this application, the audio playback page further includes a status setting control and a setting module, the setting module being specifically used for:

[0050] In response to a status setting operation triggered by the status setting control, the account status of the user account in the target client is set to audio playback status.

[0051] Optionally, in some embodiments of this application, the detection module is further used for:

[0052] If no video corresponding to the target audio is detected, a preset video will be played on the audio playback page.

[0053] Optionally, in some embodiments of this application, the detection module includes:

[0054] The first display unit is used to display video production controls on the audio playback page when it is detected that the video corresponding to the target audio is a video published by a video production account.

[0055] The second display unit is used to display a video production prompt control on the audio playback page when no video corresponding to the target audio is detected.

[0056] The third switching unit is used to switch the audio playback page to the video production page in response to a click operation triggered by the video production control or the video production prompt control. The video production page includes a video material adding area and a video material area. The video material adding area includes at least one video material.

[0057] The second determining unit is configured to determine the selected video material as the target video material in response to the selection operation for the video material.

[0058] The adding unit is used to add the target video material to the video material adding area in response to the material adding operation for the target video material, and play the animation when the video material is added.

[0059] Optionally, in some embodiments of this application, the adding unit is specifically used for:

[0060] Based on a preset time interval and the audio content of the target audio, the target audio is segmented to obtain multiple audio slices corresponding to the target audio.

[0061] Each time the target video material is added to an audio slice, the currently processed audio is switched to the next audio slice.

[0062] In this embodiment, after displaying the audio playback page corresponding to the target audio playback request on the target client, the target audio playback request is generated by the target client. The audio playback page displays the audio of the target audio and the video content of the corresponding video. It detects whether the video corresponding to the target audio is a video published by a video production account. When it is detected that the video corresponding to the target audio is a video published by a video production account, the video corresponding to the target audio is identified as an associated video. Then, it obtains the real-time interactive information corresponding to the target audio at the current moment and displays the real-time interactive information on the audio playback page. The real-time interactive information is published by the audio client currently playing the target audio. Finally, in response to the interactive information input operation triggered by the target client on the audio playback page, it updates the interactive information displayed on the audio playback page according to the interactive content corresponding to the interactive information input operation and the associated video. Therefore, this solution can realize interactive feedback between users and multimedia information, thus greatly enhancing the user's experience with multimedia information and providing users with more choices for multimedia interactive feedback. Attached Figure Description

[0063] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0064] Figure 1a This is a schematic diagram of a scenario for the multimedia information interaction method provided in the embodiments of this application;

[0065] Figure 1b This is a flowchart illustrating the multimedia information interaction method provided in the embodiments of this application;

[0066] Figures 1c to 1t This is a schematic diagram of an audio playback page according to an embodiment of this application;

[0067] Figure 2 This is another schematic flowchart of the multimedia information interaction method provided in the embodiments of this application;

[0068] Figure 3a This is a schematic diagram of the structure of a first embodiment of the multimedia information interaction device provided in this application.

[0069] Figure 3b This is a schematic diagram of the structure of a second embodiment of the multimedia information interaction device provided in this application.

[0070] Figure 3cThis is a schematic diagram of the third embodiment of the multimedia information interaction device provided in this application.

[0071] Figure 3d This is a schematic diagram of the fourth embodiment of the multimedia information interaction device provided in this application.

[0072] Figure 3e This is a schematic diagram of the fifth embodiment of the multimedia information interaction device provided in this application.

[0073] Figure 4 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application. Detailed Implementation

[0074] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0075] This application provides a multimedia information interaction method, apparatus, electronic device, and storage medium.

[0076] Specifically, the multimedia information interaction device can be integrated into a terminal. The terminal can be a smartphone, tablet, laptop, desktop computer, smart speaker, smartwatch, etc., but is not limited to these. The terminal and server can be directly or indirectly connected via wired or wireless communication. The server can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms. This application does not impose any restrictions on these aspects.

[0077] For example, please see Figure 1aThis application provides a multimedia information interaction system, including a first terminal 10, a second terminal 20, user a, and user b. When user a opens an audio connection shared by user b through terminal 20 via the first terminal 10, the first terminal 10 generates a target audio playback request based on the audio connection. Then, the first terminal 10 displays an audio playback page corresponding to the target audio playback request. This target audio playback request is generated by a target client. The audio playback page displays the audio of the target audio and the video content of the corresponding video. The target client can be an instant messaging application client. The first terminal 10 detects whether the video corresponding to the target audio is a video published by a video production account. When the first terminal 10 detects that the video corresponding to the target audio is a video published by a video production account, The first terminal 10 identifies the video corresponding to the target audio as the associated video. Then, it acquires the real-time interactive information corresponding to the target audio at the current moment and displays the real-time interactive information on the audio playback page. This real-time interactive information is published by the audio client corresponding to the currently playing target audio. For example, at the current moment, a user publishes interactive information about the target audio through the audio client in the second terminal 20. At this time, the first terminal 10 can display the interactive information in the interactive information display area. This user can be user b or other users. Finally, the first terminal 10 responds to the interactive information input operation triggered by the target client on the audio playback page and updates the interactive information displayed on the audio playback page according to the interactive content corresponding to the interactive information input operation and the associated video.

[0078] The multimedia information interaction solution provided in this application displays the audio of the target audio and the video content of the corresponding video on the audio playback page, enriching the functionality of the player integrated into the application. When the video corresponding to the target audio is a video published by a video production account, the interactive information displayed on the video playback page can be updated based on the interactive information input operation corresponding to the interactive content and associated video, so as to realize interactive feedback between the user and the multimedia information. Therefore, it greatly enhances the user's experience of multimedia information and provides more options for the user to conduct multimedia interactive feedback.

[0079] The following sections provide detailed descriptions of each example. It should be noted that the order in which the embodiments are described is not intended to limit the priority of the embodiments.

[0080] A multimedia information interaction method includes: displaying an audio playback page corresponding to a target audio playback request on a target client; obtaining real-time interactive information corresponding to the target audio at the current moment and displaying the real-time interactive information on the audio playback page; responding to an interactive information input operation triggered by the target client on the audio playback page; and updating the interactive information displayed on the audio playback page according to the interactive content corresponding to the interactive information input operation.

[0081] Please see Figure 1b , Figure 1b This is a flowchart illustrating the multimedia information interaction method provided in an embodiment of this application. The specific flow of this multimedia information interaction method can be as follows:

[0082] 101. Display the audio playback page corresponding to the target audio playback request in the target client.

[0083] The target audio playback request is generated by the target client. The audio playback page displays the audio information of the target audio and the video content of the corresponding video. The target audio playback request can be generated by the target client after the user clicks on an audio link in the target client. The audio link can be shared by user A to user B's instant messaging application client (target client) through an instant messaging application. For example, user A sends it to user B in the form of a session. Of course, it can also be triggered by user B's click operation on the audio link shared by user A in an information sharing platform. The target client generates the target audio playback request based on the click operation.

[0084] For further details, please refer to Figure 1c The audio playback page includes an audio information display area, a video information display area, and an interactive operation area, as shown in the figure. The audio information display area is located at the top of the audio playback page, the video information display area is located in the middle of the audio playback page, and the interactive operation area is located at the bottom of the audio playback page. The interactive operation area can include share controls, comment controls, and like controls. Users can click the share control to share the audio link containing the target audio and its corresponding video with other users. Users can click the like control to like the audio and / or video, indicating their liking or agreement with the content. Users can click the comment control to display a historical comment information window on the audio playback page, showing all comments posted by users on the video within a historical time period, such as... Figure 1d As shown, the historical time period can be a preset time interval or the period from the first release of the audio to the current moment. The specific settings depend on the specific situation and will not be elaborated here.

[0085] It should be noted that, in this application, the target video may include at least one audio slice, and each audio slice may correspond to one video. That is, optionally, in some embodiments, it may further include: obtaining audio segmentation information of the target audio; segmenting the target audio based on the audio segmentation information to obtain at least one audio slice; determining the associated video corresponding to the segmented audio, and sequentially playing the associated video corresponding to the segmented audio according to the playback time of each segmented audio.

[0086] Optionally, in some embodiments, to facilitate users switching the application player to the associated client corresponding to the target audio, the audio playback page may also include a client association control. Users can switch the audio playback page to the associated client's page by clicking the client association control. That is, the method may further include: in response to a click operation triggered by the client association control, determining the associated client associated with the target client, and switching the audio playback page to the associated client's page.

[0087] For example, such as Figure 1e As shown, the user opens the target audio through the client of an instant messaging application. The audio link of the target audio is sent to the user by a friend through the client of the target audio (i.e., the associated client). Therefore, the user can switch the audio playback page to the page of the associated client by clicking the "Return to Associated Application" control.

[0088] In addition, the audio playback page also includes status setting controls, such as... Figure 1f As shown, the status setting control is an icon for "I am listening to music". Users can click on the icon to set the account status of the user account in the target client to "I am listening to music". Optionally, in some embodiments, the method may further include: in response to a status setting operation triggered by the status setting control, setting the account status of the user account in the target client to audio playback status.

[0089] 102. Obtain the real-time interactive information corresponding to the target audio at the current moment, and display the real-time interactive information on the audio playback page.

[0090] The real-time interactive information is published by the audio client corresponding to the currently playing target audio. Specifically, the real-time interactive information can be sorted according to its publication time, such as... Figure 1q As shown, the real-time interactive information can be displayed in a "bubble" style, or other styles, depending on the actual situation.

[0091] 103. In response to interactive information input operations triggered by the target client on the audio playback page, update the interactive information displayed on the audio playback page according to the interactive content corresponding to the interactive information input operation.

[0092] To enable interactivity between users and multimedia information, the interactive information displayed on the audio playback page can be updated based on the interactive content corresponding to the input operation and the video corresponding to the target audio. It should be noted that some audio may not have an associated video, such as user-generated audio. Therefore, this application can detect whether the video corresponding to the target audio is a video published by a video production account. When it is detected that the video corresponding to the target audio is a video published by a video production account, the video corresponding to the target audio is determined to be an associated video.

[0093] It should also be noted that the step of detecting whether the video corresponding to the target audio is a video published by the video production account can be done before step 103 or before step 102, depending on the actual situation, and no restriction is imposed here.

[0094] The video corresponding to the target audio can be a video published by a video production account. In this application, to achieve interactivity between the user and multimedia information, the video published by the video production account is associated with that video production account. That is, when a user plays the target audio, if the video Q produced by video production account G is the video corresponding to the target video, and the user likes the video, video production account G can receive the user's like information for video Q. Please continue reading. Figure 1g In some embodiments, users can click the like control to like the video, indicating their liking for the video or their agreement with its content. Users can click the comment control to display a window of historical comments on the audio playback page, and they can also swipe up and down to view all historical comments.

[0095] Optionally, in some embodiments, when it is detected that the video corresponding to the target audio is a video published by the video production account, the video corresponding to the target audio is determined as an associated video; when no video corresponding to the target audio is detected, a preset video is played on the audio playback page.

[0096] The preset video is a pre-set video. It can be a video installed along with the target client or a default video selected by the user, depending on the actual situation.

[0097] Furthermore, to enable interactive feedback between users and multimedia information, users can create associated videos corresponding to the target audio. There are two scenarios:

[0098] Scenario 1: The video corresponding to the target audio is a video published by the video production account. Please refer to [link / reference]. Figure 1h The audio playback page can display video production controls s. Then, in response to a click operation triggered on the video production controls s, the audio playback page is switched to the video production page. In response to a selection operation on video material, the selected video material is identified as the target video material. In response to a material addition operation on the target video material, the target video material is added to the video material addition area, and the animation of adding the video material is played.

[0099] Please see Figure 1i The video editing page includes two video material addition areas: area A and area B. Each video material addition area contains at least one video material. Users can browse video materials within these areas by swiping, and when a user selects a desired video material, they can drag and drop it into the addition area. Figure 1j As shown.

[0100] Scenario 2: The video corresponding to the target audio is not a video published by the video production account. Please refer to [link / reference needed]. Figure 1k The system can display video production controls on the audio playback page. Then, in response to a click on the video production prompt control, the audio playback page switches to the video production page. In response to a selection of video material, the selected video material is designated as the target video material. In response to an addition operation for the target video material, the target video material is added to the video material addition area, and an animation of the video material addition is played. The video production prompt control can display corresponding prompts to guide the user in creating the associated video for the target audio. For example, the video production prompt control can display "Please Add Video." When the user clicks the icon corresponding to "Please Add Video," the audio playback page switches to the video production page.

[0101] Furthermore, different video clips can be added to different audio segments of the target audio. Specifically, in some embodiments, the step "in response to a clip addition operation for the target video clip, adding the target video clip to the video clip addition area and playing the animation during clip addition" may include:

[0102] (11) According to the preset time interval and the audio content of the target audio, the target audio is segmented to obtain multiple audio slices corresponding to the target audio;

[0103] (12) Each time a target video material is added to an audio slice, the currently processed audio will be switched to the next audio slice.

[0104] Please see Figure 11 In some embodiments, the target audio can be segmented according to a preset time interval and the audio content of the target audio, thereby obtaining multiple audio slices corresponding to the target audio. When displaying the audio slices, the playback duration of each audio slice can be displayed, which makes it convenient for users to add corresponding video materials. Whenever the target video material is added to an audio slice, the system automatically switches to the next audio slice.

[0105] It should be noted that after creating the video corresponding to the target audio, the user can choose to publish or save the video. When the user needs to publish the video, it needs to be done through the corresponding video account. That is, in some embodiments, the user needs to log in to their video account before publishing the created video. If the user has not registered a video account, they need to create one. After the user completes the video creation, they can click the video publishing control on the video creation page to switch the video creation page to the video publishing page. Figure 1m As shown, the video publishing page includes a publishing control and an audio link containing the target audio and the user-created video. The cover art for this link can be set by the user or generated by the system based on the audio information of the target audio. The user can click the publishing control to publish the audio link. It should be noted that when publishing a video, if the user is logged into their corresponding video creation account, they can directly publish the audio link; if the user is not logged into their corresponding video creation account, or does not have a video creation account, the video publishing page can be switched to an account login page. This account login page includes an account information input area A, an account login control B, and an account registration control C, as shown below. Figure 1n As shown, if a user is not logged into their corresponding video production account, they can enter their username and password in the account information input area A. After entering the information, the user can click the account login control B to log in to their video production account. After successful login, the account login page will switch to the video publishing page to publish the audio link. If the user does not have a video production account, they can click the account registration control C to switch the video publishing page to the account registration page. Figure 1o As shown, a corresponding video production account can then be generated with one click based on the user's account information on the target client. After successful registration, the account registration page will be switched to the video publishing page to publish the audio link.

[0106] Optionally, in some embodiments, after logging into their corresponding video production account, users can view the likes, comments, and following information for videos posted by that account, such as... Figure 1n As shown.

[0107] Furthermore, users can also view the plain videos, music videos, and drafts posted by the video creation account, such as... Figure 1p As shown, music video (MV) is the video associated with the target audio in this application. It refers to a short film that is paired with music (usually mostly songs). Modern music videos are mainly produced to promote music records. Every time a user releases a new MV, the corresponding music video release list can be updated.

[0108] For example, specifically, a user can input interactive content through the target client. Then, based on the interactive content and associated video, corresponding interactive information can be generated and added to the audio playback page to update the interactive information displayed on the audio playback page. Optionally, in some embodiments, to avoid user misoperation leading to poor efficiency in publishing interactive content, the audio playback page can be divided into areas. That is, the audio playback page includes an interactive information display area, an interactive content editing area, and an interactive content sending control. The step "responding to the interactive information input operation triggered by the target client on the audio playback page, updating the interactive information displayed on the audio playback page according to the interactive content and associated video corresponding to the interactive information input operation" can specifically include:

[0109] (21) In response to an interactive information input operation triggered by the target client in the interactive information editing area, display the input interactive content in the interactive information editing area;

[0110] (22) In response to the interactive information sending operation triggered by the target client’s interactive content sending control, update the interactive information displayed in the interactive information display area according to the interactive content and associated video.

[0111] Please see Figure 1r Users can enter relevant interactive content in the interactive information editing area. Then, users can publish the interactive content by clicking the interactive content sending control. Next, based on the interactive content and the associated video, the interactive information displayed in the interactive information display area is updated. In some embodiments, video information of the associated video, such as video name and / or video author, can be added below the published interactive content.

[0112] Furthermore, in some embodiments, the target audio may include multiple audio segments. Therefore, to improve the accuracy of user-posted interactive information, the corresponding target video is determined from the associated videos based on the timestamp of the interactive information sending operation, that is, the video corresponding to the current audio segment is determined. Then, based on the interactive content and the target video, the interactive information displayed in the interactive information display area is updated. That is, the step "in response to the interactive information sending operation triggered by the target client's interactive content sending control, update the interactive information displayed in the interactive information display area according to the interactive content and the associated video" may specifically include:

[0113] (31) Obtain the timestamp of the interactive information sending operation;

[0114] (32) Determine the video corresponding to the interactive information input operation from the associated videos based on the timestamp to obtain the target video;

[0115] (33) Update the interactive information displayed in the interactive information display area according to the interactive content and the target video.

[0116] Specifically, interactive information corresponding to the target client can be constructed based on interactive content and target video to obtain target interactive information. The style of the target interactive information can be preset by the operation and maintenance personnel or the client, such as setting the information displayed by the target interactive information, its size in the interactive information display area, and the interval between it and other interactive information. Optionally, in some embodiments, the target interactive information includes interactive content published by the user and the video watched when the user triggers the interactive content publishing operation.

[0117] Furthermore, updating the interactive information displayed in the interactive information display area can be done in two ways: 1) hiding the real-time interactive information in the interactive information display area and only displaying the target interactive information; 2) rendering and displaying the interactive information display area each time the target interactive information is obtained, based on the publication time of the real-time interactive information and the publication time of the target interactive information. That is, optionally, in some embodiments, the step "updating the interactive information displayed in the interactive information display area using the target interactive information" may specifically include:

[0118] (41) Arrange the real-time interactive information according to the interaction time of the real-time interactive information;

[0119] (42) Each time target interactive information is acquired, the interactive information display area is rendered and displayed according to the order of the real-time interactive information and the timestamp of the interactive information sending operation.

[0120] Optionally, in some embodiments, to facilitate video viewing, all real-time interactive information, the interactive content editing area, and the interactive content sending control in the interactive information display area can be hidden. The server can generate a hiding instruction for the real-time interactive information; upon receiving this instruction, all real-time interactive information in the interactive information display area is hidden. Alternatively, the user can perform the hiding operation. For example, the audio playback page also includes a real-time interactive close control; the user can click this control to hide all real-time interactive information, the interactive content editing area, and the interactive content sending control. In other words, optionally, in some embodiments, the method may further include: hiding the real-time interactive information, the interactive content editing area, and the interactive content sending control in response to a real-time interactive information close operation triggered on the interactive information display area.

[0121] In addition, please see Figure 1s Users can view the video that the user who posted the interactive information was watching when they clicked on it. Optionally, in some embodiments, the method may further include:

[0122] (51) In response to the interactive information viewing operation triggered by real-time interactive information, the audio client corresponding to the target real-time interactive information is identified as the client to be viewed;

[0123] (52) Determine the video played when the client to be viewed sends the target real-time interactive information;

[0124] (53) Switch the video playing on the audio playback page to the video playing when the client to be viewed sends the target real-time interactive information.

[0125] Optionally, in some embodiments, to enhance interactivity between users and video creators, a like control can be set in the audio playback page. Users can like the video by clicking the like control, or by double-clicking the video. That is, the audio playback page includes a video like control. The method may further include:

[0126] (61) In response to a click action triggered by the like control, update the style of the like control, and / or;

[0127] (62) In response to a video like operation triggered for an associated video, play the animation corresponding to the video like operation on the audio playback page.

[0128] When the target audio plays, the associated video also plays simultaneously. Users can pause the target audio by clicking on the audio playback page, and the associated video also pauses when the target audio pauses. Users can "like" the video by double-clicking on the associated video on the audio playback page, and a "like" animation will play in this way. Furthermore, users can double-click to like consecutively, at which point the corresponding animation for consecutive double-clicks will play. It should be noted that when double-clicking consecutively, only the animation for consecutive double-clicks will play, without increasing the number of likes; that is, the number of likes will be 1. Of course, clicking the style of the "like" control can also achieve the same effect as liking the video. In this way, no animation will play; only the style of the "like" control will inform the user that they have liked the video. For example, the initial style of the "like" control is a hollow heart, and after the user clicks the "like" control, the style of the "like" control will change to a solid heart.

[0129] It should also be noted that the target audio can be associated with one or more videos. When there are multiple associated videos, a video switching control can be displayed on the audio playback page. Then, in response to a click on the video switching control, a video list containing the associated videos is displayed on the audio playback page. Next, in response to a selection operation on an associated video in the video list, the selected associated video is determined as the video to be switched. Finally, the currently playing associated video is switched to the video to be switched, and the animation of the video switching is displayed in the video playback list. For example, if the currently playing video is video A, and the user selects video B as the video to be switched in the video list, and then the user clicks the video switching control to switch the video, the process of switching from video A to video B can be displayed with a video flipping effect.

[0130] Optionally, in some embodiments, users can click on the lyrics to enter a full-screen lyrics page, such as... Figure 1t As shown, users can then swipe left, swipe right, or tap the arrow on the full-screen lyrics page to exit.

[0131] This application embodiment, after displaying the audio playback page corresponding to the target audio playback request, detects whether the video corresponding to the target audio is a video published by a video production account. Then, it obtains the real-time interactive information corresponding to the target audio at the current moment and displays the real-time interactive information on the audio playback page. Finally, in response to the interactive information input operation triggered by the target client on the audio playback page, it updates the interactive information displayed on the audio playback page according to the interactive content corresponding to the interactive information input operation. The multimedia information interaction scheme provided in this application displays the audio of the target audio and the video content of the corresponding video on the audio playback page, enriching the functionality of the player integrated into the application. When the video corresponding to the target audio is a video published by a video production account, the interactive information displayed on the audio playback page can be updated according to the interactive content corresponding to the interactive information input operation, thereby realizing interactive feedback between the user and multimedia information. Therefore, it greatly enhances the user's experience with multimedia information and provides more options for users to provide multimedia interactive feedback.

[0132] The method described in the embodiments will be further described in detail below with examples.

[0133] In this embodiment, the multimedia information interaction device will be specifically integrated into the terminal as an example for explanation.

[0134] Please see Figure 2 A multimedia information interaction method, the specific process of which can be as follows:

[0135] 201. The terminal displays the audio playback page corresponding to the target audio playback request in the target client.

[0136] The target audio playback request is generated by the target client. The audio playback page displays the audio of the target audio and the video content of the corresponding video. The target audio playback request can be generated by the target client after the user clicks on the audio link in the target client.

[0137] 202. The terminal detects whether the video corresponding to the target audio is a video published by the video production account.

[0138] 203. When the terminal detects that the video corresponding to the target audio is a video published by the video production account, it identifies the video corresponding to the target audio as the associated video.

[0139] When the terminal detects that the video corresponding to the target audio is a video published by a video production account, the terminal can display video production controls on the audio playback page. Then, in response to a click operation triggered by the video production controls, the terminal switches the audio playback page to the video production page. In response to a selection operation for video materials, the terminal identifies the selected video material as the target video material. In response to a material addition operation for the target video material, the terminal adds the target video material to the video material addition area and plays the animation of adding the video material.

[0140] 204. The terminal obtains the real-time interactive information corresponding to the target audio at the current moment and displays the real-time interactive information on the audio playback page.

[0141] Among them, real-time interactive information is published by the audio client corresponding to the currently playing target audio. Specifically, the terminal can sort the real-time interactive information according to the publication time of the real-time interactive information.

[0142] 205. The terminal responds to the interactive information input operation triggered by the target client on the audio playback page, and updates the interactive information displayed on the audio playback page according to the interactive content corresponding to the interactive information input operation and the associated video.

[0143] For example, a user can input interactive content through the target client. Then, the terminal can generate corresponding interactive information based on the interactive content and associated video, and add the interactive information to the audio playback page to update the interactive information displayed on the audio playback page.

[0144] In this embodiment, after displaying the audio playback page corresponding to the target audio playback request, the terminal detects whether the video corresponding to the target audio is a video published by a video production account. When the terminal detects that the video corresponding to the target audio is a video published by a video production account, it determines the video corresponding to the target audio as an associated video. Then, the terminal obtains the real-time interactive information corresponding to the target audio at the current moment and displays the real-time interactive information on the audio playback page. Finally, in response to the interactive information input operation triggered by the target client on the audio playback page, the terminal updates the interactive information displayed on the audio playback page according to the interactive content corresponding to the interactive information input operation and the associated video. The multimedia information interaction scheme provided in this application displays the audio of the target audio and the video content of the video corresponding to the target audio on the audio playback page, enriching the functionality of the player integrated into the application. When the video corresponding to the target audio is a video published by a video production account, the interactive information displayed on the audio playback page can be updated according to the interactive content corresponding to the interactive information input operation and the associated video, thereby realizing interactive feedback between the user and multimedia information. Therefore, it greatly enhances the user's experience with multimedia information and provides more options for users to conduct multimedia interactive feedback.

[0145] To facilitate better implementation of the multimedia information interaction method of this application embodiment, this application embodiment also provides a multimedia information interaction device (hereinafter referred to as the interaction device) based on the above-described multimedia information interaction method. The meanings of the terms are the same as in the multimedia information interaction method described above, and specific implementation details can be found in the description of the method embodiment.

[0146] Please see Figure 3a , Figure 3a This is a schematic diagram of the structure of a multimedia information interaction device provided in an embodiment of this application. The interaction device may include a display module 301, an acquisition module 302, and an update module 303, as follows:

[0147] Display module 301 is used to display the audio playback page corresponding to the target audio playback request in the target client.

[0148] The target audio playback request is generated by the target client. The audio playback page displays the audio of the target audio and the video content of the corresponding video. The target audio playback request can be generated by the target client after the user clicks on the audio link in the target client. The display module 301 can display the audio information of the target audio and the video content of the corresponding video.

[0149] The acquisition module 302 is used to acquire the real-time interactive information corresponding to the target audio at the current moment and display the real-time interactive information on the audio playback page.

[0150] The real-time interactive information is published by the audio client corresponding to the currently playing target audio. Specifically, the acquisition module 302 can acquire the real-time interactive information corresponding to the target audio at the current moment and sort the real-time interactive information according to the publication time of the real-time interactive information.

[0151] The update module 303 is used to respond to the interactive information input operation triggered by the target client on the audio playback page, and update the interactive information displayed on the audio playback page according to the interactive content corresponding to the interactive information input operation and the associated video.

[0152] For example, a user can input interactive content through the target client. Then, the update module 303 can generate corresponding interactive information based on the interactive content and associated video, and add the interactive information to the audio playback page to update the interactive information displayed on the audio playback page.

[0153] Optionally, in some embodiments, please refer to Figure 3b The interactive device may further include a detection module 304, which may be used to: when it is detected that the video corresponding to the target audio is a video published by the video production account, determine the video corresponding to the target audio as an associated video.

[0154] It is understood that, in some embodiments, the update module 303 may specifically be used to: update the interactive information displayed on the audio playback page in response to an interactive information input operation triggered by the target client for the audio playback page, based on the interactive content corresponding to the interactive information input operation and the associated video.

[0155] Optionally, in some embodiments, the update module 303 may specifically include

[0156] The display submodule is used to respond to interactive information input operations triggered by the target client in the interactive information editing area and display the input interactive content in the interactive information editing area;

[0157] The update submodule is used to respond to the interactive information sending operation triggered by the target client's interactive content sending control, and update the interactive information displayed in the interactive information display area according to the interactive content and the associated video.

[0158] Optionally, in some embodiments, the update submodule may specifically include:

[0159] The acquisition unit is used to obtain the timestamp of the interactive information sending operation;

[0160] The first determining unit is used to determine the video corresponding to the interactive information input operation from the associated video based on the timestamp, and obtain the target video;

[0161] The update unit is used to update the interactive information displayed in the interactive information display area based on the interactive content and the target video.

[0162] Optionally, in some embodiments, the updating unit may include:

[0163] The sub-unit is constructed to build the corresponding interactive information for the target client based on the interactive content and the target video, thereby obtaining the target interactive information.

[0164] The update sub-unit is used to update the interactive information displayed in the interactive information display area using the target interactive information.

[0165] Optionally, in some embodiments, the updating subunit may be specifically used to: arrange the real-time interactive information according to the interaction time of the real-time interactive information; and render and display the interactive information display area according to the arrangement order of the real-time interactive information and the timestamp of the interactive information sending operation each time the target interactive information is obtained.

[0166] Optionally, in some embodiments, a hidden sub-unit may be included, which may be used to: hide the real-time interactive information, the interactive content editing area, and the interactive content sending control in response to a real-time interactive information closing operation triggered on the interactive information display area.

[0167] Optionally, in some embodiments, a first switching unit is further included. The first switching unit may be used to: in response to an interactive information viewing operation triggered for real-time interactive information, determine the audio client corresponding to the target real-time interactive information as the client to be viewed, obtain the video played when the client to be viewed sends the target real-time interactive information, and switch the video played on the audio playback page to the video played when the client to be viewed sends the target real-time interactive information.

[0168] Optionally, in some embodiments, a playback unit is also included, which may be used to: update the style of the like control in response to a click operation triggered on the like control, and / or; and play an animation corresponding to the video like operation on the audio playback page in response to a video like operation triggered on an associated video.

[0169] Optionally, in some embodiments, a second switching unit is further included. The second switching unit can be specifically used to: display a video switching control on the audio playback page; in response to a click operation on the video switching control, display a video list containing the associated video on the audio playback page; in response to a selection operation on an associated video in the video list, determine the selected associated video as the video to be switched; switch the currently playing associated video to the video to be switched, and display the animation of the video switching in the video playback list.

[0170] Optionally, in some embodiments, the detection module 304 may specifically include:

[0171] The first display unit is used to display video production controls on the audio playback page when it is detected that the video corresponding to the target audio is a video published by a video production account.

[0172] The second display unit is used to display a video production prompt control on the audio playback page when no video corresponding to the target audio is detected.

[0173] The third switching unit is used to switch the audio playback page to the video production page in response to a click operation triggered by the video production control or video production prompt control. The second determining unit is used to determine the selected video material as the target video material in response to a selection operation of the video material.

[0174] The add unit is used to respond to the material add operation for the target video material, add the target video material to the video material add area, and play the animation when the video material is added.

[0175] The video creation page includes a video material addition area and a video material area. The video material addition area includes at least one video material. Users can browse the video materials in the video material area by swiping, and when a user determines the video material to be selected, the target video material can be added to the video material addition area by dragging and dropping.

[0176] Optionally, in some embodiments, the adding unit may be specifically used to: segment the target audio according to a preset time interval and the audio content of the target audio to obtain multiple audio slices corresponding to the target audio; when the target video material is added to an audio slice each time, the currently processed audio is switched to the next audio slice.

[0177] Optionally, in some embodiments, the detection module 304 may also be used to: play a preset video on the audio playback page when no video corresponding to the target audio is detected.

[0178] Optionally, in some embodiments, please refer to Figure 3c The interactive device may further include a playback module 305, which may be used to: acquire audio segmentation information of the target audio; segment the target audio based on the audio segmentation information to obtain at least one audio slice; determine the associated video corresponding to the segmented audio, and play the associated video corresponding to the segmented audio in sequence according to the playback time of each segmented audio.

[0179] Optionally, in some embodiments, the audio playback page may also include client-side associated controls; see [link to relevant documentation]. Figure 3d The interactive device may further include a switching module 306, which may be used to: in response to a click operation triggered by a client-associated control, determine the associated client associated with the target client, and switch the audio playback page to the page of the associated client.

[0180] Optionally, in some embodiments, the audio playback page also includes a status setting control; see [link to relevant documentation]. Figure 3e The interactive device may further include a setting module 307, which may be used to: in response to a state setting operation triggered by a state setting control, set the account state of the user account in the target client to an audio playback state.

[0181] In this embodiment, after the display module 301 displays the audio playback page corresponding to the target audio playback request, the acquisition module 302 acquires the real-time interactive information corresponding to the target audio at the current moment and displays the real-time interactive information on the audio playback page. Finally, the update module 303 responds to the interactive information input operation triggered by the target client on the audio playback page, and updates the interactive information displayed on the audio playback page according to the interactive content corresponding to the interactive information input operation and the associated video. The multimedia information interaction scheme provided in this application displays the audio of the target audio and the video content of the corresponding video on the audio playback page, enriching the functionality of the player integrated into the application. When the video corresponding to the target audio is a video published by a video production account, the interactive information displayed on the audio playback page can be updated according to the interactive content corresponding to the interactive information input operation, thereby realizing interactive feedback between the user and multimedia information. Therefore, it greatly enhances the user's experience with multimedia information and provides more options for users to conduct multimedia interactive feedback.

[0182] Furthermore, embodiments of this application also provide an electronic device, such as... Figure 4 As shown, it illustrates a structural schematic diagram of the electronic device involved in the embodiments of this application, specifically:

[0183] The electronic device may include components such as a processor 401 with one or more processing cores, a memory 402 with one or more computer-readable storage media, a power supply 403, and an input unit 404. Those skilled in the art will understand that... Figure 4 The electronic device structure shown does not constitute a limitation on the electronic device and may include more or fewer components than shown, or combine certain components, or have different component arrangements. Wherein:

[0184] The processor 401 is the control center of the electronic device, connecting various parts of the device via various interfaces and lines. It executes software programs and / or modules stored in the memory 402, and calls data stored in the memory 402, to perform various functions and process data. Optionally, the processor 401 may include one or more processing cores; preferably, the processor 401 may integrate an application processor and a modem processor, wherein the application processor mainly handles the operating system, user interface, and applications, and the modem processor mainly handles wireless communication. It is understood that the modem processor may not be integrated into the processor 401.

[0185] The memory 402 can be used to store software programs and modules. The processor 401 executes various functional applications and data processing by running the software programs and modules stored in the memory 402. The memory 402 may mainly include a program storage area and a data storage area. The program storage area may store the operating system, application programs required for at least one function (such as sound playback function, image playback function, etc.), etc.; the data storage area may store data created according to the use of the electronic device, etc. In addition, the memory 402 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory 402 may also include a memory controller to provide the processor 401 with access to the memory 402.

[0186] The electronic device also includes a power supply 403 that supplies power to the various components. Preferably, the power supply 403 can be logically connected to the processor 401 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system. The power supply 403 may also include one or more DC or AC power supplies, recharging systems, power fault detection circuits, power converters or inverters, power status indicators, and other arbitrary components.

[0187] The electronic device may also include an input unit 404, which can be used to receive input digital or character information, and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.

[0188] Although not shown, the electronic device may also include a display unit, etc., which will not be described in detail here. Specifically, in this embodiment, the processor 401 in the electronic device loads the executable files corresponding to the processes of one or more applications into the memory 402 according to the following instructions, and the processor 401 runs the applications stored in the memory 402 to realize various functions, as follows:

[0189] Display the audio playback page corresponding to the target audio playback request, obtain the real-time interactive information corresponding to the target audio at the current moment, and display the real-time interactive information on the audio playback page. In response to the interactive information input operation triggered by the target client on the audio playback page, update the interactive information displayed on the audio playback page according to the interactive content corresponding to the interactive information input operation.

[0190] For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.

[0191] This application embodiment, after displaying the audio playback page corresponding to the target audio playback request, obtains the real-time interactive information corresponding to the target audio at the current moment and displays the real-time interactive information on the audio playback page. Finally, in response to the interactive information input operation triggered by the target client on the audio playback page, it updates the interactive information displayed on the audio playback page according to the interactive content corresponding to the interactive information input operation and the associated video. The multimedia information interaction scheme provided in this application displays the audio of the target audio and the video content of the corresponding video on the audio playback page, enriching the functionality of the player integrated into the application. When the video corresponding to the target audio is a video published by a video production account, the interactive information displayed on the audio playback page can be updated according to the interactive content corresponding to the interactive information input operation, thereby realizing interactive feedback between the user and multimedia information. Therefore, it greatly enhances the user's experience with multimedia information and provides more options for users to provide multimedia interactive feedback.

[0192] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be performed by instructions, or by instructions controlling related hardware. These instructions can be stored in a computer-readable storage medium and loaded and executed by a processor.

[0193] Therefore, embodiments of this application provide a storage medium storing a plurality of instructions that can be loaded by a processor to execute steps in any of the multimedia information interaction methods provided in embodiments of this application. For example, the instructions can execute the following steps:

[0194] The system displays the audio playback page corresponding to the target audio playback request, detects whether the video corresponding to the target audio is a video published by the video production account, and identifies the video corresponding to the target audio as an associated video when it is detected that the video is published by the video production account. It also obtains the real-time interactive information corresponding to the target audio at the current moment and displays the real-time interactive information on the audio playback page. In response to the interactive information input operation triggered by the target client on the audio playback page, the system updates the interactive information displayed on the audio playback page according to the interactive content corresponding to the interactive information input operation and the associated video.

[0195] For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.

[0196] The storage medium may include: read-only memory (ROM), random access memory (RAM), disk or optical disk, etc.

[0197] Since the instructions stored in the storage medium can execute the steps of any of the multimedia information interaction methods provided in the embodiments of this application, the beneficial effects that any of the multimedia information interaction methods provided in the embodiments of this application can achieve can be realized. For details, please refer to the previous embodiments, which will not be repeated here.

[0198] The above provides a detailed description of a multimedia information interaction method, apparatus, electronic device, and storage medium provided in the embodiments of this application. Specific examples have been used to illustrate the principles and implementation methods of this application. The description of the above embodiments is only for the purpose of helping to understand the method and core ideas of this application. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of this application. Therefore, the content of this specification should not be construed as a limitation of this application.

Claims

1. A multimedia information interaction method, characterized in that, include: The target client displays an audio playback page corresponding to the target audio playback request. This audio playback page displays the audio information of the target audio, the video content of the video corresponding to the target audio, client-related controls, and video production controls. The target client includes an instant messaging application client. The target audio playback request is generated by the target client based on a user's click on an audio link of the target audio shared by another user within the target client. This audio link is shared by another user in an associated client of the target audio. The client-related controls are used to switch from the audio playback page to the associated client's page upon triggering. Obtain the real-time interactive information corresponding to the target audio at the current moment, and display the real-time interactive information on the audio playback page. The real-time interactive information is published by the audio client currently playing the target audio. In response to an interactive information viewing operation triggered by a target real-time interactive information in the real-time interactive information, the audio client corresponding to the target real-time interactive information is identified as the client to be viewed; the video played when the client to be viewed sent the target real-time interactive information is obtained as the video to be viewed; the video played on the audio playback page is switched to the video to be viewed; In response to an interactive information input operation triggered by the target client on the audio playback page, the interactive information displayed on the audio playback page is updated according to the interactive content corresponding to the interactive information input operation and the video being played. The interactive information includes interactive content and video information displayed below the interactive content. The video information is the video corresponding to the target audio that is being played when the interactive information is published. In response to a click operation triggered by the video production control, the target audio is segmented into multiple audio slices according to a preset time interval and the audio content of the target audio. The multiple audio slices and the playback duration corresponding to each audio slice are displayed. Whenever video material is added to an audio slice, the system automatically switches to the next audio slice so that the user can add video material to the next audio slice. In response to a publishing operation for a newly created video, an audio link containing the target audio and the new video is published.

2. The method according to claim 1, characterized in that, Before updating the interactive information displayed on the audio playback page, the method further includes: When it is detected that the video corresponding to the target audio is a video published by the video production account, the video corresponding to the target audio is identified as an associated video; The step of responding to an interactive information input operation triggered by the target client on the audio playback page, and updating the interactive information displayed on the audio playback page according to the interactive content corresponding to the interactive information input operation and the video being played, includes: In response to an interactive information input operation triggered by the target client on the audio playback page, the interactive information displayed on the audio playback page is updated according to the interactive content corresponding to the interactive information input operation and the associated video.

3. The method according to claim 2, characterized in that, The audio playback page includes an interactive information display area, an interactive content editing area, and an interactive content sending control. The step of responding to an interactive information input operation triggered by the target client on the audio playback page, and updating the interactive information displayed on the audio playback page based on the interactive content corresponding to the input operation and the associated video, includes: In response to an interactive information input operation triggered by the target client in the interactive content editing area, the input interactive content is displayed in the interactive content editing area; In response to the interactive information sending operation triggered by the target client's interactive content sending control, the interactive information displayed in the interactive information display area is updated according to the interactive content and the associated video.

4. The method according to claim 3, characterized in that, The step of responding to the interactive information sending operation triggered by the target client's interactive content sending control, and updating the interactive information displayed in the interactive information display area according to the interactive content and the associated video, includes: Obtain the timestamp of the interactive information sending operation; Based on the timestamp, determine the video corresponding to the interactive information input operation from the associated videos to obtain the target video; The interactive information displayed in the interactive information display area is updated based on the interactive content and the target video.

5. The method according to claim 4, characterized in that, The step of updating the interactive information displayed in the interactive information display area based on the interactive content and the target video includes: Based on the interactive content and the target video, construct the interactive information corresponding to the target client to obtain the target interactive information; The interactive information displayed in the interactive information display area is updated using the target interactive information.

6. The method according to claim 5, characterized in that, The step of updating the interactive information displayed in the interactive information display area using the target interactive information includes: The real-time interactive information is arranged according to the interaction time of the real-time interactive information; Each time the target interactive information is acquired, the interactive information display area is rendered and displayed according to the order of the real-time interactive information and the timestamp of the interactive information sending operation.

7. The method according to claim 5, characterized in that, Also includes: In response to a real-time interactive information closing operation triggered on the interactive information display area, the real-time interactive information, the interactive content editing area, and the interactive content sending control are hidden.

8. The method according to claim 4, characterized in that, The audio playback page includes a video like control and also includes: In response to a click operation triggered by the video like control, update the style of the video like control, and / or; In response to a video like operation triggered for the associated video, an animation corresponding to the video like operation is played on the audio playback page.

9. The method according to claim 4, characterized in that, After determining the video corresponding to the target audio as the associated video, the process also includes: A video switching control is displayed on the audio playback page; In response to a click operation on the video switching control, a video list containing the associated video is displayed on the audio playback page; In response to a selection operation of an associated video in the video list, the selected associated video is determined as the video to be switched; Switch the currently playing associated video to the video to be switched, and display the animation of the video switching in the video list.

10. The method according to any one of claims 1 to 9, characterized in that, Also includes: Obtain the audio segmentation information of the target audio; The target audio is segmented based on the audio segmentation information to obtain at least one audio slice; The associated videos corresponding to the segmented audio are determined, and the associated videos corresponding to the segmented audio are played sequentially according to the playback time of each segmented audio.

11. A multimedia information interactive device, characterized in that, include: The display module is used to display an audio playback page corresponding to a target audio playback request in a target client. The audio playback page displays the audio information of the target audio, the video content of the video corresponding to the target audio, client-related controls, and video production controls. The target client includes an instant messaging application client. The target audio playback request is generated by the target client based on a user's click operation on an audio link of the target audio shared by another user in the target client. The audio link is shared by another user in an associated client of the target audio. The client-related controls are used to switch from the audio playback page to the page of the associated client upon triggering. The acquisition module is used to acquire the real-time interactive information corresponding to the target audio at the current moment, and display the real-time interactive information on the audio playback page. The real-time interactive information is published by the audio client currently playing the target audio. The update module is used to respond to an interactive information viewing operation triggered by a target real-time interactive information in the real-time interactive information, and to determine the audio client corresponding to the target real-time interactive information as the client to be viewed; to obtain the video played when the client to be viewed sent the target real-time interactive information, and to use it as the video to be viewed; and to switch the video played on the audio playback page to the video to be viewed. The update module is further configured to respond to an interactive information input operation triggered by the target client on the audio playback page, and update the interactive information displayed on the audio playback page according to the interactive content corresponding to the interactive information input operation and the video being played. The interactive information includes interactive content and video information displayed below the interactive content. The video information is the video corresponding to the target audio that is being played when the interactive information is published. The detection module is used to respond to a click operation triggered by the video production control, segment the target audio according to a preset time interval and the audio content of the target audio, obtain multiple audio slices, and display the multiple audio slices and the playback duration corresponding to each audio slice; whenever video material is added to an audio slice, it automatically switches to the next audio slice so that the user can add video material to the next audio slice; in response to the publishing operation of the newly created video, it publishes an audio link containing the target audio and the new video.

12. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein, When the processor executes the computer program, it implements the steps of the multimedia information interaction method as described in any one of claims 1-10.

13. A storage medium, characterized in that, It stores a computer program, wherein when the computer program is executed by a processor, it implements the steps of the multimedia information interaction method as described in any one of claims 1-10.