Information interaction processing method and device, and electronic equipment

Abstract

The application provides an information interaction processing method and device, electronic equipment and a computer readable storage medium. The method comprises the following steps: displaying to-be-commented information and a music comment entry corresponding to the to-be-commented information; in response to a triggering operation on the music comment entry, displaying a music comment matched with the to-be-commented information in an editing area, wherein the music comment comprises music material for commenting on the to-be-commented information; and in response to a sending operation on the music comment in the editing area, displaying the music comment in a comment area of the to-be-commented information. Through the application, rich and efficient information interaction can be realized through music comment.

Description

Technical Field

[0001] This application relates to network media technology, and more particularly to an information interaction processing method, apparatus, electronic device, and computer-readable storage medium. Background Technology

[0002] With the development of mobile network technology and the rise of mobile social applications, users can publish information anytime and anywhere, and contacts who have a relationship with the user can interact and comment on the information published by the user, thereby increasing the efficiency of information interaction. However, when users of social applications interact and comment with each other, they can often only interact in text form, and the interaction form is relatively simple.

[0003] In related technologies, multimedia information is used to enhance interactivity. However, the multimedia information used for commenting is usually published in the form of links, which link to an audio playback page to play the full audio, such as a song playback page. However, this approach cannot guarantee that the comment content is relevant to the content being commented on, and it also limits the efficiency of obtaining the comment content. Summary of the Invention

[0004] This application provides an information interaction processing method, apparatus, electronic device, and computer-readable storage medium, which can achieve rich and efficient information interaction through music reviews.

[0005] The technical solution of this application embodiment is implemented as follows:

[0006] This application provides an information interaction processing method, including:

[0007] Displays the information to be commented on, as well as the entry point for music comments related to the information to be commented on;

[0008] In response to a trigger operation on the music comment entry, a music comment matching the information to be commented is displayed in the editing area, wherein the music comment includes music material used to comment on the information to be commented;

[0009] In response to a sending operation for the music comment in the editing area, the music comment is displayed in the comment area of ​​the information to be commented.

[0010] This application provides an information interaction processing device, including:

[0011] The display module is used to display the information to be commented on, as well as the music comment entry for the information to be commented on;

[0012] An editing module is used to respond to a trigger operation on the music comment entry point by displaying music comments matching the information to be commented on in the editing area, wherein the music comments include music material for commenting on the information to be commented on;

[0013] A sending module is configured to display the music comment in the comment area of ​​the information to be commented in response to a sending operation for the music comment in the editing area.

[0014] In the above scheme, the editing module is further configured to perform identification processing on the information to be commented before displaying the music comment matching the information to be commented in the editing area, and obtain at least one of the following identification processing results: the emotion expressed by the information to be commented, the keywords in the information to be commented, and the theme of the information to be commented; and determine the music material that matches the identification processing result as the music comment matching the information to be commented.

[0015] In the above scheme, the editing module is further configured to display a music search area before displaying music reviews that match the information to be reviewed in the editing area; in response to a keyword search operation received in the music search area, music materials that match the keywords of the information to be reviewed are used as music reviews that match the information to be reviewed.

[0016] In the above scheme, the editing module is further configured to obtain account interest features for commenting on the information to be commented on before displaying music comments matching the information to be commented on in the editing area; obtain music material matching the interest features; and determine the music material as music comments matching the information to be commented on.

[0017] In the above scheme, the editing module is further configured to, before displaying a music comment matching the information to be commented in the editing area, obtain the music material for commenting on the information to be commented from multiple candidate music materials; in response to a segment setting operation for the music material, obtain the set music material segment matching the information to be commented from the music material, and use the music material segment as the music comment.

[0018] In the above scheme, the editing module is further configured to display the text corresponding to each music material fragment in the music material; in response to the fragment setting operation for selecting at least one of the texts, the music material fragment corresponding to the selected at least one text that matches the information to be commented is used as the music comment.

[0019] In the above scheme, the editing module is further configured to, before displaying the music comment matching the information to be commented in the editing area, obtain the music material for commenting on the information to be commented from multiple candidate music materials; and use the music material fragment matching the information to be commented from the music material as the music comment.

[0020] In the above scheme, the editing module is further configured to perform at least one of the following processes to obtain the music material: perform content recognition processing on the information to be commented to obtain at least one of the following dimensions of the information to be commented: text content; image content; emoticon content; determine the candidate music material that matches the content among the plurality of candidate music materials as the music material for commenting on the information to be commented; display a music search area; in response to a keyword search operation received in the music search area, select the candidate music material that matches the keyword among the plurality of candidate music materials as the music material for commenting on the information to be commented; display a plurality of popular music materials, wherein popular music materials are candidate music materials whose play count exceeds a play count threshold; in response to a selection operation for the plurality of popular music materials, select the popular music material as the music material for commenting on the information to be commented; obtain the interest characteristics of the account used to comment on the information to be commented, obtain the candidate music material that matches the interest characteristics among the plurality of candidate music materials, and determine it as the music material for commenting on the information to be commented.

[0021] In the above scheme, the editing module is further configured to display a music comment recording entry before displaying a music comment matching the information to be commented in the editing area; in response to a trigger operation on the music comment recording entry, collect voice matching the information to be commented; in response to a determination operation on the voice, replace the original voice in the music material with the collected voice to obtain updated music material, and determine the updated music material as the music material for commenting on the information to be commented.

[0022] In the above scheme, the editing module is further configured to display the music comment recording entry in response to the music recording mode switching operation; the step of replacing the original voice in the music material with the collected voice to obtain updated music material includes: in response to the segment setting operation for the music material, determining the music material segment to be replaced; replacing the original voice in the music material segment with the collected voice to obtain updated music material segment.

[0023] In the above scheme, the editing module is further configured to display the text corresponding to each music material fragment in the music material; in response to the fragment setting operation for selecting at least one of the texts, the music material fragment corresponding to the selected at least one of the texts is used as the music material fragment to be replaced.

[0024] In the above scheme, the editing module is further configured to, in response to the switching operation of the original music mode, display a determination entry for the original voice in the music material when the music comment recording entry is displayed; and in response to the triggering operation of the determination entry, use the music material with the original voice retained as the music comment.

[0025] In the above scheme, the editing module is further configured to perform any one of the following processes: using the music material segment that is extracted most frequently as the music material segment to be replaced; using the music material segment that has the highest matching degree with the information to be commented as the music material segment to be replaced; using the music material segment that has the highest matching degree with the comment account of the information to be commented as the music material segment to be replaced; and replacing the original voice in the music material segment with the collected voice to obtain an updated music material segment.

[0026] In the above scheme, the editing module is further configured to display the music comment recording entry after collecting the voice that matches the information to be commented on; in response to the trigger operation of the music comment recording entry, the previously collected voice in the music material is replaced with the voice collected again to obtain the updated music material, and the updated music material is determined as the music material for commenting on the information to be commented on.

[0027] In the above scheme, the editing area includes a text editing area and a music editing area; the editing module is further configured to, in response to a keyword input operation for the music comment in the text editing area, display at least one candidate music material matching the keyword of the music comment in the music editing area; and, in response to a selection operation for the at least one candidate music material in the music editing area, determine the selected candidate music material as the music comment and stop displaying the unselected candidate music materials.

[0028] In the above scheme, the device further includes: an operation module, configured to: after displaying the music comment in the comment area of ​​the information to be commented, in response to a playback operation for the music comment in the comment area, play the music material included in the music comment in the comment area; and in response to a pause operation for the music comment in the comment area, stop playing the music comment in the comment area.

[0029] In the above scheme, the operation module is further configured to: display the source playback entry of the music comment when the music comment is displayed in the comment area of ​​the information to be commented on; and display the playback area of ​​the source music material in response to a trigger operation on the source playback entry, wherein the music material included in the music comment is extracted from the source music material.

[0030] In the above scheme, the operation module is further configured to: display the music comment in the comment area of ​​the information to be commented on, and display the text entry of the music comment; in response to the trigger operation of the text entry, display the text of the music material included in the music comment.

[0031] In the above scheme, the sending module is further configured to: send a comment request corresponding to the music comment to the server, so that the server can obtain the music comment and the corresponding music style; receive the music comment and the corresponding music style sent by the server; and display the music comment in the comment area using the music style.

[0032] This application provides an information interaction processing method, the method comprising:

[0033] Displays the information to be commented on, as well as the entry point for music comments related to the information to be commented on;

[0034] In response to a trigger operation on the music comment entry, music material is displayed, and at least one music material fragment for commenting on the information to be commented on is obtained from the music material;

[0035] The editing area displays music comments for the information to be commented on, wherein the music comments include at least one music clip;

[0036] In response to a sending operation for the music comment in the editing area, the music comment is displayed in the comment area of ​​the information to be commented.

[0037] This application provides an information interaction processing device, including:

[0038] The display module is used to display the information to be commented on, as well as the music comment entry for the information to be commented on;

[0039] An editing module is used to respond to a trigger operation on the music comment entry, display music material, and obtain at least one music material fragment from the music material for commenting on the information to be commented on;

[0040] The editing module is also used to display music comments on the information to be commented on in the editing area, wherein the music comments include at least one music clip;

[0041] A sending module is configured to display the music comment in the comment area of ​​the information to be commented in response to a sending operation for the music comment in the editing area.

[0042] This application provides an electronic device, including:

[0043] Memory, used to store executable instructions;

[0044] The processor, when executing executable instructions stored in the memory, implements the information interaction processing method provided in the embodiments of this application.

[0045] This application provides a computer-readable storage medium storing executable instructions, which, when executed by a processor, implement the information interaction processing method provided in this application.

[0046] The embodiments of this application have the following beneficial effects:

[0047] By triggering an action on the music comment entry point, music comments matching the information to be commented on are displayed in the editing area. The music comments include music materials used to comment on the information to be commented on, and the music comments including the music materials are sent for display. The music materials can improve the richness and efficiency of information interaction, and because the music materials match the information to be commented on, the music comments can effectively improve the efficiency and accuracy of information interaction. Attached Figure Description

[0048] Figure 1 It is a product interface diagram of an information interaction product in related technologies;

[0049] Figure 2 This is a schematic diagram of the structure of the information interaction processing system provided in the embodiments of this application;

[0050] Figure 3 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application;

[0051] Figures 4A-4D This is a flowchart illustrating the information interaction processing method provided in the embodiments of this application;

[0052] Figures 5A-5H This is a product interface diagram of the information interaction product provided in the embodiments of this application;

[0053] Figure 6 This is a logical schematic diagram of the information interaction processing method provided in the embodiments of this application;

[0054] Figure 7 This is a schematic diagram of the front-end processing of the information interaction processing method provided in the embodiments of this application;

[0055] Figure 8 This is a schematic diagram of the front-end processing of the information interaction processing method provided in the embodiments of this application. Detailed Implementation

[0056] To make the objectives, technical solutions, and advantages of this application clearer, the application will be further described in detail below with reference to the accompanying drawings. The described embodiments should not be regarded as limitations on this application. All other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0057] In the following description, references are made to “some embodiments,” which describe a subset of all possible embodiments. However, it is understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0058] In the following description, the terms "first, second, third" are used merely to distinguish similar objects and do not represent a specific ordering of objects. It is understood that "first, second, third" may be interchanged in a specific order or sequence where permitted, so that the embodiments of this application described herein can be implemented in an order other than that illustrated or described herein.

[0059] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of this application only and is not intended to limit this application.

[0060] In the implementation of this application, the collection and processing of relevant data should strictly comply with the requirements of relevant laws and regulations, obtain the informed consent or separate consent of the personal information subject, and carry out subsequent data use and processing within the scope of laws and regulations and the authorization of the personal information subject.

[0061] Before providing a further detailed description of the embodiments of this application, the nouns and terms involved in the embodiments of this application will be explained, and the nouns and terms involved in the embodiments of this application shall be interpreted as follows.

[0062] 1) In response to, used to indicate the conditions or states on which the operation performed depends. When the conditions or states on which it depends are met, one or more operations performed may be performed in real time or with a set delay. Unless otherwise specified, there is no restriction on the order in which the multiple operations are performed.

[0063] 2) Client: An application that runs on a terminal and provides various services, such as social clients, video clients, etc.

[0064] 3) Music materials: Both music materials and music material clips are audio that can be played directly. Music materials include vocals and background music, or music materials are purely vocals, or purely background music. When music materials include vocals, the vocals are the original singer's voice or the user's voice through a microphone.

[0065] In related technologies, comments on the information to be commented on typically only include text comments or image comments. If one wishes to express a comment on the information to be commented on in the form of music, then the comment can only be made through a music link. See [link to relevant documentation]. Figure 1 , Figure 1 This is a product interface diagram of an information interaction product in related technologies. The human-computer interaction interface 301 displays the information to be commented on 302 and the comment information 303 on the information to be commented on 302. The comment information 303 is a music link and explanatory text for a certain song.

[0066] The method of sharing the entire song by using a link as a comment in related technologies has the following drawbacks: 1. Only part of the content in the entire song matches the information to be commented, thus failing to meet the user's need to use only part of the content as a comment; 2. When playing the music, it is necessary to jump to a page via a link, and it is difficult to directly play the content that matches the information to be commented, resulting in low information acquisition efficiency.

[0067] This application provides an information interaction processing method, apparatus, electronic device, and computer-readable storage medium, which can interact through music to achieve rich and efficient information interaction. The following describes exemplary applications of the electronic device provided in this application. The electronic device provided in this application can be implemented as various types of user terminals such as laptops, tablets, desktop computers, set-top boxes, and mobile devices (e.g., mobile phones, portable music players, personal digital assistants, dedicated messaging devices, portable gaming devices). The following describes exemplary applications when the device is implemented as a terminal.

[0068] See Figure 2 , Figure 2 This is a schematic diagram of the information interaction processing system provided in the embodiment of this application. In order to support an instant messaging client application, terminal 400-1 and terminal 400-2 are connected to server 200 through network 300. Network 300 can be a wide area network or a local area network, or a combination of the two.

[0069] In some embodiments, in response to user A's posting operation on terminal 400-1 for information to be commented on, the information to be commented on is sent to server 200, and server 200 sends the information to be commented on to terminal 400-2. The information to be commented on and an editing area for the information to be commented on are displayed on the human-computer interaction interfaces of user B's terminal 400-2 and user A's terminal 400-1, wherein the editing area includes a music comment entry. In response to user B's triggering operation on the music comment entry, a music comment matching the information to be commented on is displayed in the editing area, wherein the music comment includes music material for commenting on the information to be commented on. In response to user B's sending operation on the music comment in the editing area, the music comment is displayed in the comment area of ​​the information to be commented on on user B's terminal 400-2 and user A's terminal 400-1. In response to user A's playback operation on terminal 400-1 or user B's playback operation on terminal 400-2 for the music comment, the music material in the music comment is played in the comment area of ​​their respective terminals.

[0070] In some embodiments, terminals 400-1 and 400-2 can implement the interactive information processing method provided in this application by running a computer program. For example, the computer program can be a native program or software module in an operating system; it can be a native application (APP), i.e., a program that needs to be installed in the operating system to run; it can also be a mini-program, i.e., a program that only needs to be downloaded to a browser environment to run; or it can be a game mini-program that can be embedded in any APP. In short, the above-mentioned computer program can be any form of application, module, or plugin.

[0071] In some embodiments, server 200 may be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms. Terminals may be smartphones, tablets, laptops, desktop computers, smart speakers, smartwatches, etc., but are not limited to these. Terminals and servers can be directly or indirectly connected via wired or wireless communication, which is not limited in this embodiment of the invention.

[0072] See Figure 3 , Figure 3 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. The description will take a terminal as an example. Figure 3 The terminal shown (specifically, it can be) Figure 2Terminal 400-1 or terminal 400-2 includes: at least one processor 410, memory 450, at least one network interface 420, and user interface 430. The various components in the terminal are coupled together via a bus system 440. It is understood that the bus system 440 is used to implement communication between these components. In addition to a data bus, the bus system 440 also includes a power bus, a control bus, and a status signal bus. However, for clarity, in... Figure 3 The general labeled all buses as Bus System 440.

[0073] Processor 410 can be an integrated circuit chip with signal processing capabilities, such as a general-purpose processor, a digital signal processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor can be a microprocessor or any conventional processor, etc.

[0074] User interface 430 includes one or more output devices 431 that enable the presentation of media content, including one or more speakers and / or one or more visual displays. User interface 430 also includes one or more input devices 432, including user interface components that facilitate user input, such as a keyboard, mouse, microphone, touch screen display, camera, other input buttons and controls.

[0075] The memory 450 may be removable, non-removable, or a combination thereof. Exemplary hardware devices include solid-state storage, hard disk drives, optical disk drives, etc. The memory 450 may optionally include one or more storage devices physically located away from the processor 410.

[0076] The memory 450 may include volatile memory or non-volatile memory, or both. The non-volatile memory may be read-only memory (ROM), and the volatile memory may be random access memory (RAM). The memory 450 described in this application embodiment is intended to include any suitable type of memory.

[0077] In some embodiments, memory 450 is capable of storing data to support various operations, examples of which include programs, modules, and data structures or subsets or supersets thereof, as illustrated below.

[0078] Operating system 451 includes system programs for handling various basic system services and performing hardware-related tasks, such as the framework layer, core library layer, driver layer, etc., for implementing various basic business functions and handling hardware-based tasks;

[0079] The network communication module 452 is used to reach other computing devices via one or more (wired or wireless) network interfaces 420, exemplary network interfaces 420 including: Bluetooth, WiFi, and Universal Serial Bus (USB), etc.

[0080] Presentation module 453 is configured to enable the presentation of information (e.g., a user interface for operating peripheral devices and displaying content and information) via one or more output devices 431 associated with user interface 430 (e.g., a display screen, a speaker, etc.).

[0081] The input processing module 454 is used to detect and translate one or more user inputs or interactions from one or more input devices 432.

[0082] In some embodiments, the information interaction processing apparatus provided in this application can be implemented in software. Figure 3 An information interaction processing device 455-1 stored in memory 450 is shown. This device can be software in the form of programs and plug-ins, and includes the following software modules: a first display module 4551, a first editing module 4552, a first sending module 4553, and an operation module 4554. Figure 3 An information interaction processing device 455-2 stored in memory 450 is shown. It can be software in the form of programs and plug-ins, including the following software modules: a second display module 4555, a second editing module 4556, and a second sending module 4557. These modules are logical and can therefore be arbitrarily combined or further divided according to the functions they implement. The functions of each module will be described below.

[0083] The information interaction processing method provided in this application will be described in conjunction with exemplary applications and implementations of the terminal provided in the embodiments of this application.

[0084] See Figure 4A , Figure 4A This is a flowchart illustrating the information interaction processing method provided in the embodiments of this application, which will be combined with... Figure 4A The steps shown are explained.

[0085] In step 101, the information to be commented on and the editing area for the information to be commented on are displayed on the human-computer interaction interface.

[0086] As an example, see Figure 5A , Figure 5AThis is a product interface diagram of the information interaction product provided in the embodiments of this application. The human-computer interaction interface displays the information to be commented 502A and the comment entry 503A. In response to the trigger operation of the comment entry 503A, the editing area 504A is displayed, and the editing area 504A includes the music comment entry 505A.

[0087] In step 102, in response to a trigger operation on the music comment entry, a music comment matching the information to be commented is displayed in the editing area.

[0088] As an example, music reviews include music material or music material fragments used to comment on information to be reviewed. Both music material and music material fragments are audio that can be played directly. Music material includes vocals and background music, or music material is purely vocals, or music material is purely background music. When music material includes vocals, the vocals are the original singer's voice of the song or the user's voice through a microphone.

[0089] In some embodiments, the editing area includes a text editing area and a music editing area, displaying music comments in the music editing area and text comments in the text editing area. In response to a text input operation in the text editing area, a text comment is added in the text editing area. In response to a trigger operation on the send control, the text comment and the music comment are sent as a whole.

[0090] As an example, see Figure 5F , Figure 5F This is a product interface diagram of the information interaction product provided in this application embodiment. The human-computer interaction interface displays the information to be commented 502F and the comment entry 503F. In response to the trigger operation of the comment entry 503F, the editing area 504F is displayed. The editing area 504F includes a text editing area 505F. At least one candidate music material matching the keyword is displayed in the extended area 501F (music editing area) of the editing area 504F. In response to the selection operation of the candidate music material 506F, the unselected candidate music material is deleted and hidden. Then, in response to the text input operation in the text editing area 505F, the text comment is displayed. In response to the trigger operation of the send control 507F, the selected candidate music material and the text comment are displayed in the comment area of ​​the information to be commented.

[0091] In step 103, in response to the sending operation for the music comment in the editing area, the music comment is displayed in the comment area of ​​the information to be commented.

[0092] In some embodiments, before displaying music reviews that match the information to be reviewed in the editing area, the information to be reviewed is identified to obtain at least one of the following dimensions: the emotion expressed in the information to be reviewed, the keywords in the information to be reviewed, and the theme of the information to be reviewed; music materials that match the identification results are identified as music reviews that match the information to be reviewed.

[0093] As an example, the information to be commented on, A ("I'm in a bad mood today, I miss rainy days"), is processed to identify the emotion expressed in the information to be commented on as "sadness", the keyword in the information to be commented on as "rain", and the theme of the information to be commented on as "expressing emotions". Music materials that match the identification results are identified as music comments that match the information to be commented on. Music materials that can express sadness and are related to rain are identified as music comments that match the information to be commented on. The music materials can be complete song audio or a segment of song audio.

[0094] In some embodiments, a music search area is displayed before displaying music reviews that match the information to be reviewed in the editing area; in response to a keyword search operation received in the music search area, music material that matches the keywords of the information to be reviewed is used as a music review that matches the information to be reviewed.

[0095] As an example, see Figure 5A In response to the triggered operation of the music comment entry 505A, the music search area 501A of the music material is displayed in the human-computer interaction interface. The music search area 501A of the music material can receive keyword search operations to obtain music materials. For example, if the keyword entered in the keyword search operation is the keyword "rain" of the information to be commented, then the music material that matches "rain" will be used as the music comment that matches the information to be commented. The music material can be a complete song audio or a segment of song audio. The music search area is a different area from the editing area and is displayed after the editing area is displayed.

[0096] In some embodiments, the keywords displayed in the music search area include at least one of the following: keywords entered by the user based on the information to be commented on, keywords automatically extracted from the information to be commented on, i.e., the automatically extracted keywords are displayed in the music search area, thereby responding to a keyword search operation corresponding to the displayed keywords.

[0097] In some embodiments, before displaying music comments related to the information to be commented on in the editing area, the interest characteristics of the account used to comment on the information to be commented on are obtained; music materials matching the interest characteristics are obtained from multiple candidate music materials, and the music materials are identified as music comments matching the information to be commented on.

[0098] As an example, the interest characteristics of the account used to comment on the information to be commented on are obtained. For example, the information to be commented on is posted by user A, and user B comments on the information to be commented on through an account. The interest characteristics of user B's account are obtained, including at least one of the following: account registration information, web pages frequently visited by the account (visit frequency exceeding the frequency threshold), the account's historical comment content, the account's historical posting content, etc. Music materials matching the interest characteristics are obtained from multiple candidate music materials, and the music materials are determined as music comments matching the information to be commented on. The music materials can be complete song audio or a segment of song audio.

[0099] In some embodiments, see Figure 4B , Figure 4B This is a flowchart illustrating the information interaction processing method provided in this application embodiment. In step 102, before displaying music comments matching the information to be commented in the editing area, the following steps will be performed: Figure 4B Steps 104-106 are shown, and step 104 is performed in response to a triggering operation for the music comment entry.

[0100] In step 104, music materials for commenting on the information to be commented on are obtained from multiple candidate music materials.

[0101] In some embodiments, the above-mentioned acquisition of music materials for commenting on information to be commented from multiple candidate music materials can be achieved through the following technical solutions: performing at least one of the following processes to acquire music materials: performing content recognition processing on the information to be commented to obtain at least one of the following dimensions of the content of the information to be commented: text content; image content; emoticon content; determining the candidate music materials that match the content among multiple candidate music materials as music materials for commenting on information to be commented; displaying a music search area; in response to a keyword search operation received in the music search area, using the candidate music materials that match the keywords among multiple candidate music materials as music materials for commenting on information to be commented; displaying multiple popular music materials, wherein popular music materials are candidate music materials whose play count exceeds a play count threshold; in response to a selection operation for multiple popular music materials, using the selected popular music materials as music materials for commenting on information to be commented; acquiring the interest characteristics of the account used to comment on information to be commented; acquiring the candidate music materials that match the interest characteristics among multiple candidate music materials and determining them as music materials for commenting on information to be commented.

[0102] As an example, content recognition processing is performed on the information to be commented on, A ("I'm in a bad mood today, I miss rainy days"). This yields at least one of the following dimensions of the information to be commented on: text content; image content; and emoticon content. The text content is "I'm in a bad mood today, I miss rainy days." No emoticon or image content is recognized. Further recognition processing is performed on the text content, revealing that the emotion expressed in the information to be commented on is "sadness," the keyword in the information to be commented on is "rain," and the theme of the information to be commented on is "expressing emotions." Candidate music materials matching the recognition results are then selected as the music materials for commenting on the information to be commented on. Specifically, candidate music materials that express sadness and are related to rain are selected as the music materials for commenting on the information to be commented on. The music materials can be complete song audio or a segment of song audio.

[0103] As an example, a music search area is displayed. In response to a keyword search operation received in the music search area, candidate music pieces that match the keywords from a pool of candidate music pieces are selected as the music pieces to be used for commenting on the information to be commented on. See [link to relevant documentation]. Figure 5A In response to the trigger operation of the music comment entry 505A, the music search area 501A of the music material is displayed in the human-computer interaction interface. The music search area 501A of the music material can receive keyword search operations to obtain music materials. For example, if the keyword entered in the keyword search operation is the name of the music material (song A) "xxx", then the candidate music material song A will be used as the music material for commenting on the information to be commented on. The music material can be the complete song audio or a segment of the song audio.

[0104] As an example, multiple popular music tracks are displayed. Popular music tracks are candidate music tracks whose play counts exceed a certain threshold. In response to a selection operation on multiple popular music tracks, the selected popular music track is used as the music track for the comment to be posted. Here, popular music tracks are candidate music tracks whose play counts exceed a certain threshold. See also... Figure 5A In response to the triggered operation of the music comment entry 505A, the music search area 501A of the music material is displayed in the human-computer interaction interface. Multiple popular music materials 505A are displayed in the music search area 501A of the music material. The selected popular music material is used as the music material for commenting on the information to be commented on. The music material can be the complete song audio or a segment of the song audio.

[0105] As an example, the method shows how to obtain the interest characteristics of the account used to comment on the information to be commented on, obtain candidate music materials that match the interest characteristics from multiple candidate music materials, and determine them as the music materials used to comment on the information to be commented on. The method also involves obtaining the interest characteristics of the account used to comment on the information to be commented on. For example, if the information to be commented on is posted by user A, and user B comments on the information to be commented on through an account, the method obtains the interest characteristics of user B's account, including at least one of the following: account registration information, web pages frequently visited by the account (visit frequency exceeding a frequency threshold), the account's historical comment content, the account's historical posting content, etc. The method then obtains candidate music materials that match the interest characteristics from multiple candidate music materials and determines them as the music materials used to comment on the information to be commented on. The music materials can be complete song audio or a segment of song audio.

[0106] In step 105, the details page of the music material is displayed.

[0107] As an example, see Figure 5B , Figure 5B This is a product interface diagram of the information interaction product provided in this application embodiment. The human-computer interaction interface displays a details page 501B of the music material. The details page 501B displays text 502B corresponding to each music material segment; for example, each music material segment corresponds to a line of lyrics. The details page 501B also includes a complete selection control 506B for "using the whole song as a comment." In response to a trigger operation on the complete selection control 506B, the music material is directly displayed in the editing area.

[0108] In step 106, in response to the segment setting operation for the music material in the details page, the music material segment that is set and matches the information to be commented is obtained from the music material, and the music material segment is used as a music comment.

[0109] In some embodiments, the above-described response to a segment setting operation for music material, obtaining a set music material segment that matches the information to be commented on from the music material, and using the music material segment as a music comment, can be achieved through the following technical solution: displaying the text corresponding to each music material segment in the music material; and in response to a segment setting operation for selecting at least one text, using the music material segment corresponding to the selected at least one text that matches the information to be commented on as a music comment.

[0110] As an example, see Figure 5BThe text 502B corresponding to each music fragment in the music material is displayed. The text includes at least one of the following: lyrics, sheet music, or identification information of the music fragment. The purpose of the text is to visually prompt the user about the specific content of the music fragment selected. In response to the trigger operation on the text 502B, a selection mark control 503B is displayed on the selected text, and the music style 504B of the selected music fragment and a first confirmation control 505B are displayed on the details page 501B. In response to the trigger operation on the first confirmation control 505B, the music fragment corresponding to the selected text is determined as the music fragment used to comment on the information to be commented on. The selected text can be a corresponding continuous music fragment or a discrete music fragment.

[0111] In some embodiments, a timeline of music material is displayed in response to a segment setting operation for selecting a time range on the timeline, which is an operation of setting a start and end point on the timeline, and the music material segment corresponding to the selected time range is used as a music comment.

[0112] In some embodiments, before displaying a music comment matching the information to be commented on in the editing area, music material for commenting on the information to be commented on is obtained from a plurality of candidate music materials; any of the following processes are performed: using a music material fragment matching the information to be commented on as a music comment; using a music material fragment matching the comment account of the information to be commented on as a music comment.

[0113] As an example, a neural network model can be used to obtain the music clip with the highest matching degree to the information to be commented on, and the music clip with the highest matching degree can be used as the music comment. Alternatively, a neural network model can be used to obtain the music clip with the highest matching degree to the comment account of the information to be commented on, and the music clip with the highest matching degree can be used as the music comment.

[0114] In some embodiments, a music comment recording entry is displayed before the music comment matching the information to be commented is displayed in the editing area; in response to a trigger operation on the music comment recording entry, speech matching the information to be commented is collected; in response to a determination operation on the speech, the original speech in the music material is replaced with the collected speech to obtain updated music material, and the updated music material is determined as the music material for commenting on the information to be commented.

[0115] In some embodiments, the original speech in the music material is replaced with the collected speech to obtain updated music material, which can replace the entire music material or a segment of the music material.

[0116] As an example, when replacing segments in music material, the unreplaced segments can be retained while obtaining the replacement result. For instance, if the original speech of one of the ten music material segments, segment A, is replaced with the collected speech, then the other nine music material segments and the replaced segment A can be combined to form the updated music material.

[0117] As an example, when replacing segments in music material, unreplaced segments can be deleted while obtaining the replacement result. For instance, if the original speech of one of the ten music material segments, segment A, is replaced with the acquired speech, then only the replaced segment A will be used as the updated music material.

[0118] As an example, the step of displaying the music comment recording entry can be implemented after the voice material has been determined and before the music comment matching the information to be commented on is displayed in the editing area. See [link to relevant documentation]. Figure 5B The text 502B corresponding to each music clip in the music material is displayed. The text includes at least one of the following: lyrics, sheet music, or identifying information about the music clip. The purpose of the text is to visually indicate the specific content of the selected music clip to the user. In response to a trigger operation on the text 502B, a selection mark control 503B is displayed on the selected text, and the music style 504B of the selected music clip and a first confirmation control 505B are displayed on the details page 501B. In response to a music recording mode switching operation, such as... Figure 5D As shown in the details page 501D, the recording control 505D (music comment recording entry) is displayed.

[0119] As an example, see Figure 5D , Figure 5D This is a product interface diagram of the information interaction product provided in this application embodiment. The recording control 505D is displayed in the details page 501D. In response to the trigger operation of the recording control 505D (music comment recording entry), the voice matching the information to be commented is collected, for example, the user's singing voice is collected. In response to the confirmation operation of the voice, the original voice in the music material is replaced with the collected voice to obtain updated music material. The updated music material is determined as the music material for commenting on the information to be commented on. The collected voice can also be processed a second time, and the voice obtained from the second processing is used to replace the original voice in the music material to obtain updated music material. The updated music material is determined as the music material for commenting on the information to be commented on.

[0120] As an example, since the original audio of the audio material includes human voice and background music, the replacement can respond to the replacement mode and replace the corresponding content. For example, when the replacement mode is human voice replacement mode, the background music in the audio material is retained, and the human voice in the original audio of the audio material is replaced with the collected audio or the audio obtained through secondary processing. When the replacement mode is background replacement mode, the background music in the audio material is not retained, and the original audio in the audio material is replaced with the collected audio or the audio obtained through secondary processing.

[0121] As an example, since music material includes multiple music material segments, the replacement can be performed on the entire music material or on music material segments. For example, you can replace the entire song or replace part of the content.

[0122] In some embodiments, the above-mentioned display of the music comment recording entry can be achieved through the following technical solutions: displaying the music comment recording entry in response to the switching operation of the music recording mode; the above-mentioned replacement of the original voice in the music material with the collected voice to obtain updated music material can be achieved through the following technical solutions: determining the music material segment to be replaced in response to the segment setting operation for the music material; replacing the original voice in the music material segment with the collected voice to obtain updated music material segment.

[0123] As an example, see Figure 5D The details page 501D displays the text 502D of the corresponding music material fragment. In response to the trigger operation of the music recording mode control 506D (the music recording mode switching operation), the music recording mode is switched to. The recording control 505D (music comment recording entry) is displayed in the details page 501D. In response to the fragment setting operation of the music material, the music material fragment to be replaced is determined. The music material fragment to be replaced is the audio corresponding to continuous lyrics or discrete lyrics in the music material. The original audio in the music material fragment is replaced with the collected voice, resulting in an updated music material fragment.

[0124] In some embodiments, the above-described method of determining the music material segment to be replaced in response to a segment setting operation for music material can be implemented by the following technical solution: displaying the text corresponding to each music material segment in the music material; and in response to a segment setting operation for selecting at least one text, using the music material segment corresponding to the selected at least one text as the music material segment to be replaced.

[0125] As an example, the text 502D (lyrics or sheet music, etc.) corresponding to each music fragment in the music material is displayed. In response to the trigger operation on the text 502D (a fragment setting operation for selecting at least one text), the selection mark control 503D is displayed on the selected text, and the music fragment corresponding to the selected at least one text is used as the music fragment to be replaced.

[0126] As an example, a timeline of the music clip is displayed. In response to a segment setting operation for selecting a time range on the timeline, which is an operation to set a start and end point on the timeline, the music clip corresponding to the selected time range is used as the music clip to be replaced.

[0127] In some embodiments, when the music comment recording entry is displayed, in response to the switching operation of the original music mode, a specific entry for the original speech in the music material is displayed; in response to the triggering operation of the specific entry, the music material with the original speech retained is used as a music comment.

[0128] As an example, see Figure 5E , Figure 5E This is a product interface diagram of the information interaction product provided in this application embodiment. In the details page 501E, a selection mark control 503E is displayed at the selected text. The details page 501E also displays a recording control 505E (music comment recording entry), a music recording mode control 506E, and an original music mode control 507E. Among them, the music recording mode control 506E is highlighted. In response to the trigger operation of the original music mode control 507E (original music mode switching operation), it switches to the original voice mode and displays... Figure 5D The entry point 507D for determining the original speech in the music material, in response to the trigger operation for determining the entry point, will retain the original speech in the music material as music comments, that is, music material that has not been processed by the user as music comments.

[0129] In some embodiments, the above-mentioned replacement of the original speech in the music material with the collected speech to obtain updated music material can be achieved by the following technical solutions: performing any one of the following processes: taking the music material segment that is extracted the most times as the music material segment to be replaced; taking the music material segment with the highest matching degree with the information to be commented as the music material segment to be replaced; taking the music material segment with the highest matching degree with the comment account of the information to be commented as the music material segment to be replaced; replacing the original speech in the music material segment with the collected speech to obtain updated music material segment.

[0130] As an example, the music clips to be replaced can be automatically determined. For instance, the music clip that is most frequently extracted from the music library can be used as the replacement music clip. The music clip that has the highest match with the information to be commented on can also be used as the replacement music clip. For instance, the music clip that has the highest match with the information to be commented on can be determined through machine learning.

[0131] In some embodiments, after capturing the voice that matches the information to be commented on, a music comment recording entry is displayed; in response to a trigger operation on the music comment recording entry, the previously captured voice in the music material is replaced with the voice captured again to obtain updated music material, and the updated music material is determined as the music material for commenting on the information to be commented on.

[0132] As an example, see Figure 5E In response to a trigger operation on the recording control 505E (music comment recording entry), the system collects voice that matches the information to be commented on, such as the user's singing voice. The collected voice 502E is displayed in the corresponding music style, and the music comment recording entry is displayed again. The music comment entry that is displayed again can be a prompt message "Re-record" or a control with a similar shape to the recording control 505E. In response to a trigger operation on the music comment recording entry, the system collects voice that matches the information to be commented on, and replaces the previously collected voice in the music material with the voice collected again to obtain updated music material. In response to a trigger operation on the second determination control 504E, the updated music material is determined as the music material to be used for commenting on the information to be commented on.

[0133] In some embodiments, the editing area includes a text editing area and a music editing area; the above-mentioned display of music comments matching the information to be commented in the editing area can be achieved by the following technical solution: in response to the keyword input operation for the music comment in the text editing area, at least one candidate music material matching the keyword of the music comment is displayed in the music editing area; in response to the selection operation for at least one candidate music material in the music editing area, the selected candidate music material is determined as the music comment, and the display of unselected candidate music materials is stopped.

[0134] As an example, see Figure 5FThe human-computer interaction interface displays the information to be commented on (502F) and the comment entry (503F). In response to a trigger operation on the comment entry (503F), the editing area (504F) is displayed. The editing area (504F) includes a text editing area (505F). In response to a keyword input operation for music comments in the text editing area (505F), such as the name of the music material (song A), at least one candidate music material matching the keyword is displayed in the extended area (501F) (music editing area) of the editing area (504F). In response to a selection operation on the candidate music material (506F), the unselected candidate music material is deleted and hidden. In response to a trigger operation on the send control (507F), the selected candidate music material is displayed in the comment area of ​​the information to be commented on. The recommendations based on user input can be the entire song (music material) or a music segment (music material fragment). Since the search is performed directly in the editing area in real time, the efficiency of obtaining music material can be effectively improved.

[0135] In some embodiments, see Figure 4C , Figure 4C This is a flowchart illustrating the information interaction processing method provided in this application embodiment. In step 103, after displaying music comments in the comment area of ​​the information to be commented on, the following steps will be executed: Figure 4C Steps 107-108 are shown.

[0136] In step 107, in response to a playback operation for a music comment in the comment area, the music material included in the music comment is played in the comment area.

[0137] In step 108, in response to the pause operation for the music comment in the comment area, the playback of the music comment is stopped in the comment area.

[0138] As an example, see Figure 5G , Figure 5G This is a product interface diagram of the information interaction product provided in this application embodiment. The human-computer interaction interface displays the information to be commented 501G and the comment area 502G. The comment area 502G displays a music clip 503G and a first playback control 504G. In response to a trigger operation on the first playback control 504G, the music clip is played in the comment area and a pause control 505G is displayed. In response to a pause operation on the pause control 505G in the comment area, the music comment is stopped playing in the comment area.

[0139] In some embodiments, when a music comment is displayed in the comment area of ​​the information to be commented on, the source playback entry of the music comment is displayed; in response to a trigger operation on the source playback entry, the playback area of ​​the source music material is displayed and the full music is played on the playback page, wherein the music material included in the music comment is extracted from the source music material.

[0140] As an example, see Figure 5H , Figure 5H This is a product interface diagram of the information interaction product provided in this application embodiment. The human-computer interaction interface displays the information to be commented 501H and the comment area 502H. In the comment area 502H, a music material fragment 503H and a second playback control 504H are displayed. The second playback control is the source playback entry. In response to the trigger operation of the second playback control 504H, the playback page 505H of the source music material of the music material fragment is displayed, that is, the playback area of ​​the source music material. The music material is played on the playback page 505H and all the text 506H corresponding to the music material is displayed.

[0141] In some embodiments, when a music review is displayed in the review area of ​​the information to be reviewed, a text entry for the music review is displayed in response to a selection operation on the music review; and in response to a trigger operation on the text entry, the text of the music material included in the music review is displayed.

[0142] As an example, music reviews can also be converted into text. The selected action can be a long press on the music review. After triggering the text conversion entry, the music material in the music review will be converted into text to obtain the lyrics of the music material.

[0143] In some embodiments, the above-mentioned display of music comments in the comment area of ​​the information to be commented can be achieved by the following technical solution: sending a comment request for the corresponding music comment to the server so that the server can obtain the music comment and the corresponding music style; receiving the music comment and the corresponding music style sent by the server; and displaying the music comment in the comment area using the music style.

[0144] As an example, a comment request for the corresponding music comment is sent to the server. The cloud server then sends the music style corresponding to the lyrics and the original audio of the music comment. The original audio (music material) of the music comment is displayed in the comment area of ​​the information to be commented according to the corresponding music style.

[0145] See Figure 4D , Figure 4D This is a flowchart illustrating the information interaction processing method provided in the embodiments of this application, which will be combined with... Figure 4D Steps 201-204 are described below. For a description of the relevant embodiments of steps 201-204, please refer to the description of the embodiments of steps 101-103.

[0146] In step 201, the information to be commented on and the music comment entry for the information to be commented on are displayed.

[0147] In step 202, in response to a trigger operation on the music comment entry, music material is displayed, and at least one music material fragment for commenting on the information to be commented is obtained from the music material.

[0148] In some embodiments, obtaining at least one music material fragment from the music material for commenting on the information to be commented on in step 202 can be achieved by the following technical solution: obtaining music material for commenting on the information to be commented on from multiple candidate music materials; displaying a details page of the music material; in response to a fragment setting operation for the music material in the details page, obtaining at least one set music material fragment from the music material, wherein the at least one music material fragment is used to comment on the information to be commented on.

[0149] In some embodiments, the above-mentioned acquisition of music materials for commenting on information to be commented from multiple candidate music materials can be achieved through the following technical solutions: performing at least one of the following processes to acquire music materials: performing content recognition processing on the information to be commented to obtain at least one of the following dimensions of the content of the information to be commented: text content; image content; emoticon content; determining the candidate music materials that match the content among multiple candidate music materials as music materials for commenting on information to be commented; displaying a music search area; in response to a keyword search operation received in the music search area, using the candidate music materials that match the keywords among multiple candidate music materials as music materials for commenting on information to be commented; displaying multiple popular music materials, wherein popular music materials are candidate music materials whose play count exceeds a play count threshold; in response to a selection operation for multiple popular music materials, using the selected popular music materials as music materials for commenting on information to be commented; acquiring the interest characteristics of the account used to comment on information to be commented; acquiring the candidate music materials that match the interest characteristics among multiple candidate music materials and determining them as music materials for commenting on information to be commented.

[0150] In some embodiments, the above-mentioned response to the segment setting operation for music material in the details page, obtaining at least one music material segment to be set from the music material, can be achieved by the following technical solution: displaying the text corresponding to each music material segment in the music material; in response to the segment setting operation for selecting at least one text, using the music material segment corresponding to the selected at least one text that matches the comment information as the at least one music material segment to be set.

[0151] In some embodiments, a timeline of music material is displayed in response to a segment setting operation for selecting a time range on the timeline. The segment setting operation for selecting a time range on the timeline is an operation that sets a start point and an end point on the timeline, and the music material segment corresponding to the selected time range is used as at least one music material segment to be set.

[0152] In some embodiments, obtaining at least one music material fragment from the music material for commenting on the information to be commented on in step 202 can be achieved by the following technical solutions: obtaining music material for commenting on the information to be commented on from multiple candidate music materials; performing any of the following processes: obtaining at least one music material fragment from the music material that matches the information to be commented on, wherein at least one music material fragment is used to comment on at least one music material fragment from the music material; obtaining at least one music material fragment from the music material that matches the comment account of the information to be commented on, wherein at least one music material fragment is used to comment on at least one music material fragment from the music material.

[0153] In step 203, music comments for the information to be commented on are displayed in the editing area, wherein the music comments include at least one musical clip.

[0154] In some embodiments, the editing area includes a text editing area and a music editing area; the above-mentioned display of music comments matching the information to be commented in the editing area can be achieved by the following technical solution: in response to the keyword input operation for the music comment in the text editing area, at least one candidate music material matching the keyword of the music comment is displayed in the music editing area; in response to the selection operation for at least one candidate music material in the music editing area, the selected candidate music material is determined as the music comment, and the display of unselected candidate music materials is stopped.

[0155] In some embodiments, before displaying music comments for the information to be commented on in the editing area in step 203, a music comment recording entry is displayed; in response to a trigger operation on the music comment recording entry, voice matching the information to be commented on is collected; in response to a determination operation on the voice, the original voice in the music material is replaced with the collected voice to obtain updated music material, and the updated music material is determined as the music material for commenting on the information to be commented on.

[0156] In some embodiments, the above-mentioned display of the music comment recording entry can be achieved through the following technical solutions: displaying the music comment recording entry in response to the switching operation of the music recording mode; the above-mentioned replacement of the original voice in the music material with the collected voice to obtain updated music material can be achieved through the following technical solutions: determining the music material segment to be replaced in response to the segment setting operation for the music material; replacing the original voice in the music material segment with the collected voice to obtain updated music material segment.

[0157] In some embodiments, the above-described method of determining the music material segment to be replaced in response to a segment setting operation for music material can be implemented by the following technical solution: displaying the text corresponding to each music material segment in the music material; and in response to a segment setting operation for selecting at least one text, using the music material segment corresponding to the selected at least one text as the music material segment to be replaced.

[0158] In some embodiments, when the music comment recording entry is displayed, in response to the switching operation of the original music mode, a specific entry for the original speech in the music material is displayed; in response to the triggering operation of the specific entry, the music material with the original speech retained is used as a music comment.

[0159] In some embodiments, the above-mentioned replacement of the original speech in the music material with the collected speech to obtain updated music material can be achieved by the following technical solutions: performing any one of the following processes: taking the music material segment that is extracted the most times as the music material segment to be replaced; taking the music material segment with the highest matching degree with the information to be commented as the music material segment to be replaced; taking the music material segment with the highest matching degree with the comment account of the information to be commented as the music material segment to be replaced; replacing the original speech in the music material segment with the collected speech to obtain updated music material segment.

[0160] In some embodiments, after capturing the voice that matches the information to be commented on, a music comment recording entry is displayed; in response to a trigger operation on the music comment recording entry, the previously captured voice in the music material is replaced with the voice captured again to obtain updated music material, and the updated music material is determined as the music material for commenting on the information to be commented on.

[0161] In step 204, in response to the sending operation for the music comment in the editing area, the music comment is displayed in the comment area of ​​the information to be commented.

[0162] In some embodiments, after displaying the music comment in the comment area of ​​the information to be commented on in step 204, in response to a play operation for the music comment in the comment area, the music material included in the music comment is played in the comment area, and in response to a pause operation for the music comment in the comment area, the playback of the music comment is stopped in the comment area.

[0163] In some embodiments, when a music comment is displayed in the comment area of ​​the information to be commented on, the source playback entry of the music comment is displayed; in response to a trigger operation on the source playback entry, the playback area of ​​the source music material is displayed and the full music is played on the playback page, wherein the music material included in the music comment is extracted from the source music material.

[0164] In some embodiments, when a music review is displayed in the review area of ​​the information to be reviewed, a text entry for the music review is displayed in response to a selection operation on the music review; and in response to a trigger operation on the text entry, the text of the music material included in the music review is displayed.

[0165] In some embodiments, the above-mentioned display of music comments in the comment area of ​​the information to be commented can be achieved by the following technical solution: sending a comment request for the corresponding music comment to the server so that the server can obtain the music comment and the corresponding music style; receiving the music comment and the corresponding music style sent by the server; and displaying the music comment in the comment area using the music style.

[0166] The following will describe an exemplary application of the embodiments of this application in a real-world application scenario.

[0167] In some embodiments, user A and user B have a social relationship in a social client installed on terminals 400-1 and 400-2. In response to user A's posting operation on terminal 400-1 regarding a message to be commented on, the message is sent to server 200. Server 200 then sends the message to terminal 400-2. The message to be commented on and an editing area for it are displayed on the human-computer interaction interfaces of user B's terminal 400-2 and user A's terminal 400-1. User A's posted message expresses sadness, and user B hopes to comfort him by commenting with music. The editing area includes a music comment entry. In response to user B's triggering operation on the music comment entry, a music comment matching the message to be commented on is displayed in the editing area. Music reviews include music material used to comment on information to be reviewed. In response to user B's sending operation for music reviews in the editing area, the music reviews are displayed in the comment areas of the information to be reviewed on user B's terminal 400-2 and user A's terminal 400-1. In response to user A's playback operation for music reviews on terminal 400-1 or user B's playback operation on terminal 400-2, the music material in the music reviews is played in the comment areas of their respective terminals. During the above process, when a commenting account comments on content posted by a social account with a social relationship with the commenting account, it selects a music clip and sends the selected music clip, which is then displayed in the comment area of ​​the posted content. The music clip can be sung by the original singer or sung by the commenter. When reading the review, only the music clip can be played, or the complete music from which the music clip originates can be played.

[0168] In some embodiments, see Figure 5AThe human-computer interaction interface displays the information to be commented 502A and the comment entry 503A. In response to the trigger operation of the comment entry 503A, the editing area 504A is displayed. The editing area 504A includes the music comment entry 505A. In response to the trigger operation of the music comment entry 505A, the human-computer interaction interface displays the music search area 501A for music materials. In the music search area 501A for music materials, keyword search operations can be received to obtain music materials.

[0169] In some embodiments, see Figure 5B The system retrieves music material through keyword search and displays a details page 501B of the music material on the human-computer interaction interface. The details page 501B displays text 502B corresponding to the music material fragment. In response to a trigger operation on the text 502B, a selection mark control 503B is displayed on the selected text, and the music style 504B of the selected music material fragment and a first confirmation control 505B are displayed on the details page 501B. In response to a trigger operation on the first confirmation control 505B, the music material fragment corresponding to the selected text is determined as the music material fragment used to comment on the information to be commented on. The selected text can be a continuous music material fragment or a discrete music material fragment.

[0170] In some embodiments, see Figure 5C , Figure 5C This is a product interface diagram of the information interaction product provided in this application embodiment. After determining the music material fragment corresponding to the selected text as the music material fragment for commenting on the information to be commented on, the information to be commented on 501C and the editing area 502C are displayed in the human-computer interaction interface. The music material fragment 504C is displayed in the corresponding music style in the extended area 503C of the editing area 502C. A sending control 505C is also displayed in the editing area 502C. In response to the trigger operation of the sending control 505C, the music material fragment 504C is displayed in the comment area 506C of the information to be commented on 501C in the corresponding music style.

[0171] In some embodiments, when commenting on content posted by a social media friend, selecting a music clip allows the user's voice to be recorded as a music clip when the user is switched to music recording mode. (See also...) Figure 5DThe system retrieves music materials through keyword search and displays a details page 501D of the music materials on the human-computer interaction interface. The details page 501D displays text 502D corresponding to the music material fragment. In response to a trigger operation on the music recording mode control 506D, it switches to music recording mode and highlights the music recording mode control 506D. In response to a trigger operation on the text 502D, a selection mark control 503D is displayed on the selected text, and the music style 504D of the selected music material fragment and the recording control 505D are displayed on the details page 501D. In response to a trigger operation on the recording control 505D, the system captures the user's voice, i.e., the sound of the user singing the selected text, and uses the voice as a music material fragment for commenting on the information to be commented on. The recorded voice can also be further processed, and the processed sound can be used as a music material fragment for commenting on the information to be commented on.

[0172] In some embodiments, see Figure 5E In the details page 501E, a selection mark control 503E is displayed at the selected text. The details page 501E also displays a recording control 505E and a music recording mode control 506E. The music recording mode control 506E is highlighted. In response to the trigger operation of the recording control 505E, the user's voice is captured. The voice is the sound of the user singing the selected text. The captured voice 502E is displayed in the corresponding music style. In response to the trigger operation of the second confirmation control 504E, the voice is used as a music material fragment for commenting on the information to be commented on.

[0173] In some embodiments, music is recommended based on text entered by commenting accounts, see [link to relevant documentation]. Figure 5F The human-computer interaction interface displays the information to be commented on (502F) and the comment entry (503F). In response to a trigger operation on the comment entry (503F), the editing area (504F) is displayed, which includes a text editing area (505F). In response to a keyword search operation in the text editing area (505F), at least one candidate music material matching the keyword is displayed in the extended area (501F) of the editing area (504F). In response to a selection operation on the candidate music material (506F), the unselected candidate music material is deleted and hidden. In response to a trigger operation on the send control (507F), the selected candidate music material is displayed in the comment area of ​​the information to be commented on. The recommended music material can be the entire song (music material) or a music fragment (music material fragment) based on the user input.

[0174] In some embodiments, see Figure 5GThe human-computer interaction interface displays the information to be commented 501G and the comment area 502G. The comment area 502G displays a music clip 503G and a first playback control 504G. In response to the trigger operation on the first playback control 504G, the music clip is played in the comment area and the pause control 505G is displayed.

[0175] In some embodiments, see Figure 5H The human-computer interaction interface displays the information to be commented 501H and the comment area 502H. The comment area 502H displays a music clip 503H and a second playback control 504H. In response to the trigger operation of the second playback control 504H, the playback page 505H of the source music clip is displayed. The music clip is played on the playback page 505H and all the text corresponding to the music clip is displayed 506H.

[0176] In some embodiments, see Figure 6 , Figure 6 This is a logical schematic diagram of the information interaction processing method provided in this application embodiment. Lyrics (text) and original audio (music material) are downloaded from a cloud server's song library. In response to a selection operation for the lyrics, the corresponding music segment is determined. In response to a sending operation for the corresponding music segment, the cloud server sends the lyrics and the original audio of the corresponding music segment. The original audio of the music segment (music material fragment) is displayed in the comment area of ​​the information to be commented on. After determining the corresponding music segment, in response to a recording operation, the recorded audio (e.g., vocals) of the corresponding lyrics is collected. In response to a sending operation for the recorded audio corresponding to the lyrics, the recorded audio is uploaded to the cloud server. The cloud server sends the lyrics and the recorded audio and displays the recorded audio in the comment area of ​​the information to be commented on. After collecting the recorded audio (e.g., vocals) of the corresponding lyrics, in response to a re-recording operation, the recorded audio of the corresponding lyrics is re-collected.

[0177] In some embodiments, see Figure 7 , Figure 7 This is a front-end processing diagram of the information interaction processing method provided in this application embodiment. After downloading a music file from the cloud server to the terminal, the music file includes lyrics and original audio. The lyrics and audio are separated on the front end, and a one-to-one correspondence is established. The front end monitors the click behavior of commenting accounts, thereby monitoring the lyrics selected by the user, and also monitoring whether the user selects the original singing mode or the recorded music mode. When the original singing mode is selected, in response to the sending operation of the music segment corresponding to the lyrics, the front end sends the data corresponding to the sending operation to the cloud server. The cloud server sends the lyrics and the original audio of the corresponding music segment, and displays the original audio of the music segment (music material fragment) in the comment area of ​​the information to be commented. The music style of the music material fragment is as follows: Figure 5GThe music clip in 503G is shown below. (See also...) Figure 8 , Figure 8 This is a front-end processing diagram of the information interaction processing method provided in this application embodiment. When the music recording mode is selected, in response to the recording operation, the microphone is activated to collect the recorded audio (e.g., human voice) of the corresponding lyrics. The recorded audio and the selected lyrics are matched one-to-one and synthesized. In response to the sending operation of the recorded audio corresponding to the lyrics, the recorded audio and the corresponding lyrics (synthesized result) are uploaded to the cloud server. The cloud server sends the lyrics and the recorded audio, and displays the recorded audio as a music material fragment (music comment) in the comment area of ​​the information to be commented. The music style of the music material fragment is as follows: Figure 5G The music clip shown is 503G.

[0178] In some embodiments, the principle of music recommendation technology based on keyword matching is as follows: each music material in the music library is tagged, the text entered by the user is uploaded to the music library in real time for matching, and the matched music material is sent to the front end to be displayed to the user.

[0179] This application's embodiments distinguish between lyrics and audio, thereby determining the music clip corresponding to the selected lyrics based on the user's selection operation, and displaying it as a music comment in the comment area. In addition to sending the original audio as a music clip, it also provides the function of users recording audio, using the recorded audio to replace the original audio, thereby meeting users' personalized needs. It can also recommend related music clips based on the user's input text, thereby improving the efficiency of music clip selection and enhancing the user experience.

[0180] The following description continues to illustrate the exemplary structure of the information interaction processing device 455 provided in the embodiments of this application as a software module. In some embodiments, such as Figure 3 As shown, the software modules stored in the information interaction processing device 455-1 in the memory 450 may include: a first display module 4551 for displaying the information to be commented on and a music comment entry for the information to be commented on; a first editing module 4552 for displaying a music comment matching the information to be commented on in the editing area in response to a trigger operation for the music comment entry, wherein the music comment includes music material for commenting on the information to be commented on; and a first sending module 4553 for displaying a music comment in the comment area of ​​the information to be commented on in response to a sending operation for the music comment in the editing area.

[0181] In some embodiments, the first editing module 4552 is further configured to perform identification processing on the information to be commented before displaying the music comment matching the information to be commented in the editing area, and obtain at least one of the following identification processing results: the emotion expressed by the information to be commented, the keywords in the information to be commented, and the theme of the information to be commented; and determine the music material matching the identification processing result as the music comment matching the information to be commented.

[0182] In some embodiments, the first editing module 4552 is further configured to display a music search area before displaying music comments matching the information to be commented in the editing area; in response to a keyword search operation received in the music search area, music material matching the keywords of the information to be commented is used as music comments matching the information to be commented.

[0183] In some embodiments, the first editing module 4552 is further configured to: obtain account interest characteristics for commenting on the information to be commented on before displaying music comments matching the information to be commented on in the editing area; obtain music material matching the interest characteristics; and determine the music material as music comments matching the information to be commented on.

[0184] In some embodiments, the first editing module 4552 is further configured to obtain music material for commenting on the information to be commented on from a plurality of candidate music materials before displaying music comments matching the information to be commented on in the editing area; in response to a segment setting operation for the music material, obtain the set music material segment matching the information to be commented on from the music material, and use the music material segment as a music comment.

[0185] In some embodiments, the first editing module 4552 is further configured to display text corresponding to each music material fragment in the music material; in response to a fragment setting operation for selecting at least one text, the music material fragment corresponding to the selected at least one text that matches the information to be commented on is used as a music comment.

[0186] In some embodiments, the first editing module 4552 is further configured to obtain music material for commenting on the information to be commented on from a plurality of candidate music materials before displaying music comments that match the information to be commented on in the editing area; and to use music material fragments that match the information to be commented on as music comments.

[0187] In some embodiments, the first editing module 4552 is further configured to perform at least one of the following processes to obtain music material: performing content recognition processing on the information to be commented to obtain at least one of the following dimensions of the information to be commented: text content; image content; emoticon content; determining candidate music material that matches the content from a plurality of candidate music materials as music material for commenting on the information to be commented; displaying a music search area; in response to a keyword search operation received in the music search area, using candidate music material that matches the keyword from a plurality of candidate music materials as music material for commenting on the information to be commented; displaying a plurality of popular music materials, wherein popular music materials are candidate music materials whose play count exceeds a play count threshold; in response to a selection operation for a plurality of popular music materials, using the selected popular music material as music material for commenting on the information to be commented; obtaining the interest characteristics of the account used to comment on the information to be commented; obtaining candidate music material that matches the interest characteristics from a plurality of candidate music materials and determining it as music material for commenting on the information to be commented.

[0188] In some embodiments, the first editing module 4552 is further configured to display a music comment recording entry before displaying a music comment matching the information to be commented in the editing area; in response to a trigger operation on the music comment recording entry, collect speech matching the information to be commented; in response to a determination operation on the speech, replace the original speech in the music material with the collected speech to obtain updated music material, and determine the updated music material as the music material for commenting on the information to be commented.

[0189] In some embodiments, the first editing module 4552 is further configured to display a music comment recording entry in response to a music recording mode switching operation; and to replace the original speech in the music material with the collected speech to obtain updated music material, including: in response to a segment setting operation for the music material, determining the music material segment to be replaced; and replacing the original speech in the music material segment with the collected speech to obtain updated music material segment.

[0190] In some embodiments, the first editing module 4552 is further configured to display text corresponding to each music material fragment in the music material; in response to a fragment setting operation for selecting at least one text, the music material fragment corresponding to the selected at least one text is used as the music material fragment to be replaced.

[0191] In some embodiments, the first editing module 4552 is further configured to, in response to the switching operation of the original music mode, display a defined entry for the original speech in the music material when the music comment recording entry is displayed; and in response to the triggering operation of the defined entry, retain the music material with the original speech as a music comment.

[0192] In some embodiments, the first editing module 4552 is further configured to perform any one of the following processes: using the music material segment that is extracted most frequently as the music material segment to be replaced; using the music material segment that has the highest matching degree with the information to be commented as the music material segment to be replaced; using the music material segment that has the highest matching degree with the comment account of the information to be commented as the music material segment to be replaced; and replacing the original speech in the music material segment with the collected speech to obtain an updated music material segment.

[0193] In some embodiments, the first editing module 4552 is further configured to display a music comment recording entry after collecting the voice that matches the information to be commented on; in response to a trigger operation on the music comment recording entry, replace the previously collected voice in the music material with the voice collected again to obtain the updated music material, and determine the updated music material as the music material for commenting on the information to be commented on.

[0194] In some embodiments, the editing area includes a text editing area and a music editing area; the first editing module 4552 is further configured to, in response to a keyword input operation for a music comment in the text editing area, display at least one candidate music material matching the keyword of the music comment in the music editing area; and, in response to a selection operation for at least one candidate music material in the music editing area, determine the selected candidate music material as a music comment and stop displaying unselected candidate music materials.

[0195] In some embodiments, the device further includes: an operation module 4554, configured to: after displaying a music comment in the comment area of ​​the information to be commented on, in response to a playback operation for the music comment in the comment area, play the music material included in the music comment in the comment area; and in response to a pause operation for the music comment in the comment area, stop playing the music comment in the comment area.

[0196] In some embodiments, the operation module 4554 is further configured to: display the source playback entry of the music comment when displaying the music comment in the comment area of ​​the information to be commented; and display the playback area of ​​the source music material in response to a trigger operation on the source playback entry, wherein the music material included in the music comment is extracted from the source music material.

[0197] In some embodiments, the operation module 4554 is further configured to: display a text entry for the music comment when the comment area of ​​the information to be commented on displays a music comment; and display the text of the music material included in the music comment in response to a trigger operation on the text entry.

[0198] In some embodiments, the first sending module 4553 is further configured to: send a comment request for a corresponding music comment to the server so that the server can obtain the music comment and the corresponding music style; receive the music comment and the corresponding music style sent by the server; and display the music comment in the comment area using the music style.

[0199] In some embodiments, such as Figure 3 As shown, the software modules stored in the information interaction processing device 455-2 in the memory 450 may include: a second display module 4555 for displaying the information to be commented on and a music comment entry for the information to be commented on; a second editing module 4556 for displaying music material in response to a trigger operation for the music comment entry, and obtaining at least one music material fragment from the music material for commenting on the information to be commented on; the second editing module 4556 is also used to display a music comment for the information to be commented on in the editing area, wherein the music comment includes at least one music material fragment; and a second sending module 4557 for displaying a music comment in the comment area of ​​the information to be commented on in response to a sending operation for the music comment in the editing area.

[0200] In some embodiments, the second editing module 4556 is further configured to: obtain music material for commenting on information to be commented on from a plurality of candidate music materials; display a details page of the music material; and, in response to a segment setting operation for the music material in the details page, obtain at least one music material segment that has been set from the music material, wherein the at least one music material segment is used to comment on information to be commented on.

[0201] In some embodiments, the second editing module 4556 is further configured to obtain music material for commenting on information to be commented from a plurality of candidate music materials; and perform any of the following processes: obtaining at least one music material fragment that matches the information to be commented, wherein the at least one music material fragment is used to comment on at least one music material fragment of the information to be commented; obtaining at least one music material fragment that matches the comment account of the information to be commented, wherein the at least one music material fragment is used to comment on at least one music material fragment of the information to be commented.

[0202] This application provides a computer program product or computer program that includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the information interaction processing method described in this application.

[0203] This application provides a computer-readable storage medium storing executable instructions. When these executable instructions are executed by a processor, they cause the processor to execute the information interaction processing method provided in this application. For example, ... Figures 4A-4D The information interaction processing method shown.

[0204] In some embodiments, the computer-readable storage medium may be a memory such as FRAM, ROM, PROM, EPROM, EEPROM, flash memory, magnetic surface memory, optical disk, or CD-ROM; or it may be a variety of devices including one or any combination of the above-mentioned memories.

[0205] In some embodiments, executable instructions may take the form of a program, software, software module, script, or code, written in any form of programming language (including compiled or interpreted languages, or declarative or procedural languages), and may be deployed in any form, including as a standalone program or as a module, component, subroutine, or other unit suitable for use in a computing environment.

[0206] As an example, executable instructions may, but do not necessarily, correspond to files in a file system. They may be stored as part of a file that holds other programs or data, for example, in one or more scripts in a Hyper Text Markup Language (HTML) document, in a single file dedicated to the program in question, or in multiple collaborating files (e.g., a file that stores one or more modules, subroutines, or code sections).

[0207] As an example, executable instructions can be deployed to execute on a single computing device, or on multiple computing devices located in one location, or on multiple computing devices distributed across multiple locations and interconnected via a communication network.

[0208] In summary, through the triggering operation of the music comment entry in this application embodiment, music comments matching the information to be commented are displayed in the editing area. The music comments include music materials used to comment on the information to be commented, and music comments including music materials are sent for display. Music comments including music materials can improve the richness of information interaction, and because the music comments match the information to be commented, the music comments can effectively improve the efficiency of information interaction.

[0209] The above description is merely an embodiment of this application and is not intended to limit the scope of protection of this application. Any modifications, equivalent substitutions, and improvements made within the spirit and scope of this application are included within the scope of protection of this application.

Claims

1. An information interaction processing method, characterized in that, The method includes: Displays the information to be commented on, as well as the entry point for music comments related to the information to be commented on; In response to a trigger operation on the music comment entry point, display the text corresponding to each music clip in the music material; In response to a segment setting operation for selecting at least one of the texts, a music material segment corresponding to the selected at least one text that matches the information to be commented on is used as a music comment, and the music comment matching the information to be commented on is displayed in the editing area, wherein the music comment includes music material for commenting on the information to be commented on, and the selected text corresponds to continuous or discrete music material segments; In response to a sending operation for the music comment in the editing area, the music comment is displayed in the comment area of ​​the information to be commented on, and the source playback entry of the music comment is also displayed; In response to a triggered operation on the source playback entry, the playback page of the source music material of the music comment is displayed, and the full music is played on the playback page.

2. The method according to claim 1, characterized in that, Before displaying the music comment matching the information to be commented in the editing area, the method further includes: The information to be commented on is identified and processed to obtain at least one of the following dimensions: the emotion expressed by the information to be commented on, the keywords in the information to be commented on, and the topic of the information to be commented on; The music material that matches the recognition processing result is identified as a music comment that matches the information to be commented.

3. The method according to claim 1, characterized in that, Before displaying the music comment matching the information to be commented in the editing area, the method further includes: Display the music search area; In response to a keyword search operation received in the music search area, music material that matches the keywords of the information to be commented on is used as a music comment that matches the information to be commented on.

4. The method according to claim 1, characterized in that, Before displaying the music comment matching the information to be commented in the editing area, the method further includes: Obtain the music material used to comment on the information to be commented on from multiple candidate music materials; In response to the segment setting operation for the music material, the music material segment that is set to match the information to be commented is obtained from the music material, and the music material segment is used as the music comment.

5. The method according to claim 1, characterized in that, Before displaying the music comment matching the information to be commented in the editing area, the method further includes: Obtain the music material used to comment on the information to be commented on from multiple candidate music materials; Music clips that match the information to be commented on are used as music comments.

6. The method according to any one of claims 4 or 5, characterized in that, The step of obtaining the music material for commenting on the information to be commented on from multiple candidate music materials includes: Perform at least one of the following processes to obtain the music material: The information to be commented on is subjected to content recognition processing to obtain at least one of the following dimensions of the content of the information to be commented on: text content; image content; emoticon content; and candidate music materials that match the content among the multiple candidate music materials are determined as music materials for commenting on the information to be commented on. Display a music search area, and in response to a keyword search operation received in the music search area, select candidate music materials that match the keywords from the plurality of candidate music materials as music materials for commenting on the information to be commented on; Display multiple popular music tracks. In response to a selection operation of the multiple popular music tracks, the selected popular music track is used as the music track for commenting on the information to be commented on. The popular music track is a candidate music track whose play count exceeds a play count threshold. Obtain the interest features of the account used to comment on the information to be commented on, obtain the candidate music materials that match the interest features from the multiple candidate music materials, and determine them as the music materials used to comment on the information to be commented on.

7. The method according to any one of claims 1 to 5, characterized in that, Before displaying the music comment matching the information to be commented in the editing area, the method further includes: Displays the entry point for recording music reviews; In response to a trigger operation on the music comment recording entry point, voice recordings matching the information to be commented on are collected; In response to the determination operation for the speech, the original speech in the music material is replaced with the collected speech to obtain updated music material, and the updated music material is determined as the music material for commenting on the information to be commented on.

8. The method according to claim 7, characterized in that, The entry point for displaying music comment recordings includes: In response to the switching operation of the music recording mode, the music comment recording entry is displayed; The process of replacing the original speech in the music material with the collected speech to obtain updated music material includes: In response to a segment setting operation for the music material, determine the music material segment to be replaced; The original speech in the music clip is replaced with the collected speech to obtain an updated music clip.

9. The method according to claim 8, characterized in that, The step of determining the music clip to be replaced in response to a clip setting operation for the music material includes: Display the text corresponding to each music clip in the music material; In response to a segment setting operation for selecting at least one of the texts, the music segment corresponding to the selected at least one of the texts is used as the music segment to be replaced.

10. The method according to claim 7, characterized in that, After collecting the speech that matches the information to be commented on, the method further includes: Displays the music review recording entry; In response to the trigger operation of the music comment recording entry, the previously captured voice in the music material is replaced with the newly captured voice to obtain updated music material, and the updated music material is determined as the music material for commenting on the information to be commented on.

11. The method according to claim 1, characterized in that, The editing area includes a text editing area and a music editing area; The step of displaying the music comments that match the information to be commented on in the editing area includes: In response to a keyword input operation for the music review in the text editing area, at least one candidate music material matching the keyword of the music review is displayed in the music editing area; In response to the selection operation of at least one candidate music material in the music editing area, the selected candidate music material is identified as the music comment, and the display of unselected candidate music materials is stopped.

12. The method according to claim 1, characterized in that, After displaying the music comment in the comment area of ​​the information to be commented on, the method further includes: In response to a playback operation for the music comment in the comment area, the music material included in the music comment is played in the comment area; In response to a pause operation on the music comment in the comment area, playback of the music comment in the comment area is stopped.

13. An information interaction processing method, characterized in that, The method includes: Displays the information to be commented on, as well as the entry point for music comments related to the information to be commented on; In response to a trigger operation on the music comment entry point, display the text corresponding to each music clip in the music material; In response to a segment setting operation for selecting at least one of the texts, a music segment corresponding to the selected text for commenting on the information to be commented on is obtained from the music material; The editing area displays music comments for the information to be commented on, wherein the music comments include at least one music clip, and the selected text corresponds to continuous or discrete music clips; In response to a sending operation for the music comment in the editing area, the music comment is displayed in the comment area of ​​the information to be commented on, and the source playback entry of the music comment is also displayed; In response to a triggered operation on the source playback entry, the playback page of the source music material of the music comment is displayed, and the full music is played on the playback page.

14. The method according to claim 13, characterized in that, The method further includes: Obtain the music material used to comment on the information to be commented on from multiple candidate music materials; Display the details page of the music material; In response to a segment setting operation for the music material on the details page, at least one music material segment that has been set is obtained from the music material, and the at least one music material segment is used to comment on the music material segment of the information to be commented.

15. The method according to claim 13, characterized in that, The method further includes: Obtain the music material used to comment on the information to be commented on from multiple candidate music materials; Perform any of the following processes: Obtain at least one music fragment from the music material that matches the information to be commented on, and use the at least one music fragment to comment on the at least one music fragment of the information to be commented on; Obtain at least one music clip from the music material that matches the comment account of the information to be commented on, and use the at least one music clip to comment on the at least one music clip of the information to be commented on.

16. An information interaction processing device, characterized in that, include: The display module is used to display the information to be commented on, as well as the music comment entry for the information to be commented on; The first editing module is used to respond to the triggered operation of the music comment entry and display the text corresponding to each music material fragment in the music material; In response to a segment setting operation for selecting at least one of the texts, a music material segment corresponding to the selected at least one text that matches the information to be commented on is used as the music comment, and the music comment matching the information to be commented on is displayed in the editing area, wherein the music comment includes music material for commenting on the information to be commented on, and the selected text corresponds to continuous or discrete music material segments; A first sending module is configured to, in response to a sending operation for the music comment in the editing area, display the music comment in the comment area of ​​the information to be commented; The operation module is used to display the source playback entry of the music comment; in response to a trigger operation on the source playback entry, it displays the playback page of the source music material of the music comment and plays the complete music on the playback page.

17. The apparatus according to claim 16, characterized in that, The first editing module is further configured to identify and process the information to be commented, and obtain at least one of the following dimensions of identification and processing results: the emotion expressed by the information to be commented, the keywords in the information to be commented, and the topic of the information to be commented; The music material that matches the recognition processing result is identified as a music comment that matches the information to be commented.

18. The apparatus according to claim 16, characterized in that, The first editing module is also used to display a music search area; In response to a keyword search operation received in the music search area, music material that matches the keywords of the information to be commented on is used as a music comment that matches the information to be commented on.

19. The apparatus according to claim 16, characterized in that, The first editing module is further configured to obtain the music material used for commenting on the information to be commented on from a plurality of candidate music materials; In response to the segment setting operation for the music material, the music material segment that is set to match the information to be commented is obtained from the music material, and the music material segment is used as the music comment.

20. The apparatus according to claim 16, characterized in that, The first editing module is further configured to obtain the music material used for commenting on the information to be commented on from a plurality of candidate music materials; Music clips that match the information to be commented on are used as music comments.

21. The apparatus according to any one of claims 19 or 20, characterized in that, The first editing module is further configured to perform at least one of the following processes to obtain the music material: The information to be commented is subjected to content recognition processing to obtain at least one of the following dimensions of content: text content; image content; The emoticon content is used to determine the candidate music material that matches the content from the plurality of candidate music materials as the music material to be used to comment on the information to be commented on; Display a music search area, and in response to a keyword search operation received in the music search area, select candidate music materials that match the keywords from the plurality of candidate music materials as music materials for commenting on the information to be commented on; Display multiple popular music tracks. In response to a selection operation of the multiple popular music tracks, the selected popular music track is used as the music track for commenting on the information to be commented on. The popular music track is a candidate music track whose play count exceeds a play count threshold. Obtain the interest features of the account used to comment on the information to be commented on, obtain the candidate music materials that match the interest features from the multiple candidate music materials, and determine them as the music materials used to comment on the information to be commented on.

22. The apparatus according to any one of claims 16 to 20, characterized in that, The first editing module is also used to display the music comment recording entry point; In response to a trigger operation on the music comment recording entry point, voice recordings matching the information to be commented on are collected; In response to the determination operation for the speech, the original speech in the music material is replaced with the collected speech to obtain updated music material, and the updated music material is determined as the music material for commenting on the information to be commented on.

23. The apparatus according to claim 22, characterized in that, The first editing module is also used to display the music comment recording entry in response to the music recording mode switching operation; In response to a segment setting operation for the music material, determine the music material segment to be replaced; The original speech in the music clip is replaced with the collected speech to obtain an updated music clip.

24. The apparatus according to claim 23, characterized in that, The first editing module is also used to display the text corresponding to each music fragment in the music material; In response to a segment setting operation for selecting at least one of the texts, the music segment corresponding to the selected at least one of the texts is used as the music segment to be replaced.

25. The apparatus according to claim 22, characterized in that, The first editing module is also used to display the music comment recording entry point; In response to the trigger operation of the music comment recording entry, the previously captured voice in the music material is replaced with the newly captured voice to obtain updated music material, and the updated music material is determined as the music material for commenting on the information to be commented on.

26. The apparatus according to claim 16, characterized in that, The editing area includes a text editing area and a music editing area; The first editing module is further configured to, in response to a keyword input operation for the music review in the text editing area, display at least one candidate music material that matches the keyword of the music review in the music editing area; In response to the selection operation of at least one candidate music material in the music editing area, the selected candidate music material is identified as the music comment, and the display of unselected candidate music materials is stopped.

27. The apparatus according to claim 16, characterized in that, The device further includes: An operation module is configured to, in response to a playback operation for the music comment in the comment area, play the music material included in the music comment in the comment area; In response to a pause operation on the music comment in the comment area, playback of the music comment in the comment area is stopped.

28. An information interaction processing device, characterized in that, include: The display module is used to display the information to be commented on, as well as the music comment entry for the information to be commented on; The second editing module is used to display the text corresponding to each music clip in the music material in response to the triggered operation of the music comment entry; In response to a segment setting operation for selecting at least one of the texts, a music segment corresponding to the selected text for commenting on the information to be commented on is obtained from the music material; The second editing module is further configured to display music comments on the information to be commented on in the editing area, wherein the music comments include at least one music material fragment, and the selected text corresponds to continuous or discrete music material fragments; The second sending module is used to display the music comment in the comment area of ​​the information to be commented in response to the sending operation of the music comment in the editing area; The operation module is used to display the source playback entry of the music comment; in response to a trigger operation on the source playback entry, it displays the playback page of the source music material of the music comment and plays the complete music on the playback page.

29. The apparatus according to claim 28, characterized in that, The second editing module is further configured to obtain the music material used for commenting on the information to be commented on from a plurality of candidate music materials; Display the details page of the music material; In response to a segment setting operation for the music material on the details page, at least one music material segment that has been set is obtained from the music material, and the at least one music material segment is used to comment on the music material segment of the information to be commented.

30. The apparatus according to claim 28, characterized in that, The second editing module is further configured to obtain the music material used for commenting on the information to be commented on from a plurality of candidate music materials; Perform any of the following processes: Obtain at least one music fragment from the music material that matches the information to be commented on, and use the at least one music fragment to comment on the at least one music fragment of the information to be commented on; Obtain at least one music clip from the music material that matches the comment account of the information to be commented on, and use the at least one music clip to comment on the at least one music clip of the information to be commented on.

31. An electronic device, characterized in that, include: Memory, used to store executable instructions; A processor, when executing executable instructions stored in the memory, implements the information interaction processing method according to any one of claims 1 to 12 or 13 to 15.

32. A computer-readable storage medium, characterized in that, It stores executable instructions for use by a processor to implement the information interaction processing method according to any one of claims 1 to 12 or 13 to 15.

33. A computer program product, comprising a computer program or instructions, characterized in that, When the computer program or instructions are executed by the processor, they implement the information interaction processing method according to any one of claims 1 to 12 or 13 to 15.

Images