Information recommendation method and device, electronic equipment and storage medium

Abstract

The invention provides an information recommendation method and device, electronic equipment and a storage medium. The method comprises the steps of playing target multimedia information in a playing interface in response to a playing trigger operation for the target multimedia information, the playing interface comprising an emotion selection control; in response to a trigger operation for the emotion selection control, displaying at least one emotion material; and in response to a selection operation for the at least one emotion material, displaying recommendation information matched with the selected emotion material. According to the method and the device, the pertinence and the effect of the recommended information can be enhanced, and meanwhile, the participation degree and the satisfaction degree of the user are improved.

Description

Technical Field

[0001] This application relates to the field of Internet technologies, and in particular, to an information recommendation method, apparatus, electronic device, and storage medium. Background Art

[0002] Taking the music playing scenario as an example, in existing music playing software, the way of interacting with users' emotions is relatively single. Usually, users are allowed to rate songs, like them, or leave comments to express their preferences or feelings for the songs. These feedbacks are usually just a simple form of interaction, and the combination with advertising content is not obvious yet. Moreover, most of the existing advertising forms in music playing software are the insertion of advertisements before, during, or after songs, or the display on the application interface through pop-ups or banners. This way may lead to users' neglect or annoyance of the advertisements due to lack of pertinence and interactivity. Summary of the Invention

[0003] Embodiments of this application provide an information recommendation method, apparatus, electronic device, computer-readable storage medium, and computer program product, which can enhance the pertinence and effect of recommended information while improving users' participation and satisfaction.

[0004] The technical solution of the embodiments of this application is implemented as follows:

[0005] Embodiments of this application provide an information recommendation method, including:

[0006] In response to a play trigger operation for target multimedia information, play the target multimedia information in a play interface, where the play interface includes an emotion selection control;

[0007] In response to a trigger operation for the emotion selection control, display at least one emotion material;

[0008] In response to a selection operation for the at least one emotion material, display recommended information matching the selected emotion material.

[0009] Embodiments of this application provide an information recommendation apparatus, including:

[0010] A play module, configured to play the target multimedia information in a play interface in response to a play trigger operation for the target multimedia information, where the play interface includes an emotion selection control;

[0011] A display module, configured to display at least one emotion material in response to a trigger operation for the emotion selection control;

[0012] The display module is further configured to display recommended information matching the selected emotion material in response to a selection operation for the at least one emotion material.

[0013] An embodiment of this application provides an information recommendation method, including:

[0014] Obtain comments made by a target object on a song;

[0015] Perform emotion recognition on the comments to obtain the emotion category of the target object;

[0016] Display recommended information that matches the emotion category of the target object.

[0017] In the above solution, the displaying of recommended information that matches the emotion category of the target object includes: displaying an emotion selection control; in response to a trigger operation on the emotion selection control, displaying at least one emotion material, where the at least one emotion material includes emotion materials corresponding to the emotion category of the target object; in response to a selection operation on the emotion material corresponding to the emotion category of the target object, displaying recommended information that matches the emotion category of the target object.

[0018] In the above solution, the displaying of at least one emotion material includes: displaying an emotion material selection interface; displaying at least one emotion material in the emotion material selection interface.

[0019] In the above solution, when the number of the at least one emotion material is multiple, the displaying of at least one emotion material in the emotion material selection interface includes: displaying the emotion material corresponding to the emotion category of the target object at the middle position of the emotion material selection interface, and displaying other emotion materials in a manner that surrounds the emotion material corresponding to the emotion category of the target object, where the other emotion materials are the emotion materials other than the emotion material corresponding to the emotion category of the target object among the multiple emotion materials, and the display manner of the emotion material corresponding to the emotion category of the target object is more prominent than the display manner of the other emotion materials.

[0020] In the above solution, when the number of the at least one emotion material is multiple, the displaying of at least one emotion material in the emotion material selection interface includes: displaying the multiple emotion materials and the emotion names respectively corresponding to each of the emotion materials in the emotion material selection interface according to a set arrangement order, where the arrangement order includes one of the following: the order from the highest to the lowest number of times being selected; the order from the nearest moment when being selected last time to the current moment; the order from the largest to the smallest size.

[0021] In the above solution, the at least one emotion material is N emotion materials, where N is a positive integer greater than 1; the displaying at least one emotion material in the emotion material selection interface includes: iterating i to perform the following processing, where i is an integer variable and satisfies 1 ≤ i ≤ N - 1: displaying the i-th emotion material in the emotion material selection interface; in response to the display duration of the i-th emotion material reaching the display duration threshold, or receiving a switching operation for the i-th emotion material, switching to display the (i + 1)-th emotion material in the emotion material selection interface.

[0022] In the above solution, when the number of the at least one emotion material is multiple, the displaying at least one emotion material in the emotion material selection interface includes: determining the maximum number of the emotion materials that can be displayed in the emotion material selection interface according to the size of the emotion material selection interface and the size of the emotion materials; in response to the number of the multiple emotion materials being greater than the maximum number, dividing the multiple emotion materials into multiple groups, where the number of emotion materials included in each group is less than or equal to the maximum number; sequentially displaying the emotion materials included in the multiple groups in the emotion material selection interface.

[0023] In the above solution, the displaying the recommended information matching the emotion category of the target object includes: moving the emotion material corresponding to the emotion category of the target object to the middle position of the emotion material selection interface, canceling the display of the emotion materials other than the emotion material corresponding to the emotion category of the target object, and displaying the recommended information matching the emotion category of the target object in the emotion material selection interface.

[0024] In the above solution, the displaying at least one emotion material includes: displaying at least one emotion material in the playback interface, where the display mode of the emotion material corresponding to the emotion category of the target object is more prominent than the display modes of other emotion materials, and the other emotion materials are the emotion materials other than the emotion material corresponding to the emotion category of the target object among the at least one emotion material.

[0025] In the above solution, when the number of the at least one emotion material is multiple, the displaying at least one emotion material in the playback interface includes: controlling the multiple emotion materials to appear in the playback interface all at once or sequentially, and the positions where different emotion materials appear in the playback interface are different.

[0026] In the above solution, the display of the recommended information matching the emotional category of the target object includes: switching the display mode of the emotional material corresponding to the emotional category of the target object to a highlighted display mode, and displaying the recommended information matching the emotional category of the target object on the playback interface.

[0027] In the above solution, before displaying at least one emotional material, the method further includes: performing at least one of the following processes: obtaining emotional materials matching the target multimedia information from an emotional material library; obtaining emotional materials whose number of selected times is greater than a threshold number from the emotional material library; randomly obtaining at least one emotional material from the emotional material library; obtaining emotional materials matching the emotional category of the target object from the emotional material library, where the target object is the audience of the target multimedia information.

[0028] In the above solution, the obtaining of the emotional materials matching the target multimedia information from the emotional material library includes: performing an encoding process on the target multimedia information to obtain a feature vector of the target multimedia information; based on the feature vector, calling an emotion classification model to perform a classification process to obtain the emotional category corresponding to the target multimedia information; using the emotional materials in the emotional material library that match the emotional category corresponding to the target multimedia information as the emotional materials matching the target multimedia information.

[0029] In the above solution, the obtaining of the emotional materials matching the emotional category of the target object from the emotional material library includes: collecting images of the face of the target object to obtain at least one frame of face image; performing emotion recognition based on the at least one frame of face image to obtain the emotional category of the target object; using the emotional materials in the emotional material library that match the emotional category of the target object as the emotional materials matching the emotional category of the target object.

[0030] In the above solution, the display of the recommended information matching the emotional category of the target object includes: displaying an interaction interface; displaying the emotional materials corresponding to the emotional category of the target object and the recommended information matching the emotional category of the target object in the interaction interface.

[0031] In the above solution, the recommended information includes an acquisition control, where the acquisition control is used to acquire the object recommended by the recommended information; the method further includes: in response to a trigger operation on the acquisition control, displaying an acquisition interface for acquiring the object recommended by the recommended information.

[0032] An information recommendation device provided by an embodiment of the present application includes:

[0033] An acquisition module, configured to acquire comments made by a target object on a song;

[0034] An emotion recognition module, configured to recognize the emotion of the comment and obtain the emotion category of the target object;

[0035] A display module, configured to display recommended information matching the emotion category of the target object.

[0036] An embodiment of the present application provides an electronic device, including:

[0037] A memory, configured to store executable instructions;

[0038] A processor, configured to implement the information recommendation method provided by the embodiment of the present application when executing the executable instructions stored in the memory.

[0039] An embodiment of the present application provides a computer-readable storage medium, storing computer-executable instructions, configured to implement the information recommendation method provided by the embodiment of the present application when being executed by a processor.

[0040] An embodiment of the present application provides a computer program product, including a computer program or computer-executable instructions, configured to implement the information recommendation method provided by the embodiment of the present application when being executed by a processor.

[0041] The embodiment of the present application has the following beneficial effects:

[0042] On the one hand, by selecting corresponding emotion materials, users can express their emotions towards the target multimedia information more intuitively and richly, which not only enhances user participation but also can more accurately capture users' emotional responses. On the other hand, according to the emotion materials selected by users, recommended information that matches them is triggered, ensuring a high degree of match between the recommended information and users' emotional states, thereby improving the acceptance and conversion rate of the recommended information. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] Figure 1 is a schematic structural diagram of an information recommendation system 100 provided by an embodiment of the present application;

[0044] Figure 2 is a schematic structural diagram of an electronic device 500 provided by an embodiment of the present application;

[0045] Figure 3 is a schematic flowchart of an information recommendation method provided by an embodiment of the present application;

[0046] Figure 4A and Figure 4B is a schematic diagram of an application scenario of an information recommendation method provided by an embodiment of the present application;

[0047] Figure 5 is a schematic flowchart of an information recommendation method provided by an embodiment of the present application;

[0048] Figure 6 is a schematic flowchart of the information recommendation method provided by an embodiment of the present application;

[0049] Figure 7A and Figure 7B is a schematic diagram of an application scenario of the information recommendation method provided by an embodiment of the present application;

[0050] Figure 8 is a schematic flowchart of the information recommendation method provided by an embodiment of the present application;

[0051] Figure 9 is a schematic flowchart of the information recommendation method provided by an embodiment of the present application. Detailed implementation manners

[0052] In order to make the objectives, technical solutions, and advantages of the present application clearer, the present application will be further described in detail below with reference to the accompanying drawings. The described embodiments should not be construed as limiting the present application. All other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the scope of protection of the present application.

[0053] In the following description, "some embodiments" are involved, which describe a subset of all possible embodiments. However, it can be understood that "some embodiments" can be the same subset or different subsets of all possible embodiments, and can be combined with each other without conflict.

[0054] It can be understood that in the embodiments of the present application, data related to user information, etc. (such as comments made by users on songs) are involved. When the embodiments of the present application are applied to specific products or technologies, user permission or consent needs to be obtained, and the collection, use, and processing of relevant data need to comply with relevant laws, regulations, and standards in relevant countries and regions.

[0055] In the following description, the terms "first / second / ..." involved are only used to distinguish similar objects and do not represent a specific order for the objects. It can be understood that "first / second / ..." can be interchanged with a specific order or sequence when permitted, so that the embodiments of the present application described here can be implemented in an order other than that illustrated or described here.

[0056] In the embodiments of the present application, the term "module" or "unit" refers to a computer program with a predetermined function or a part of a computer program, which works together with other related parts to achieve a predetermined goal, and can be fully or partially implemented by using software, hardware (such as a processing circuit or a memory), or a combination thereof. Similarly, a processor (or multiple processors or memories) can be used to implement one or more modules or units. In addition, each module or unit can be a part of an overall module or unit that includes the functions of that module or unit.

[0057] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the technical field to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.

[0058] Before further elaborating on the embodiments of the present application, the nouns and terms involved in the embodiments of the present application are described. The nouns and terms involved in the embodiments of the present application are subject to the following explanations.

[0059] 1) In response to: used to represent the conditions or states on which the executed operations depend. When the dependent conditions or states are met, one or more executed operations can be real-time or can have a set delay; without special instructions, there is no restriction on the execution order of multiple executed operations.

[0060] 2) Emotional material: A type of material that can be used to express the emotions of a user, such as an emoji. Among them, an emoji, as a symbol that is concise and can express rich emotions, has been widely used in many social applications.

[0061] 3) Music playback software: A computer application or a mobile application whose main function is to store, organize, retrieve, and play music files. These software usually support multiple music file formats, such as MP3, WAV, AAC, FLAC, etc., and may have many other functions, such as creating and editing playlists, adjusting sound effects, online streaming music, lyric synchronization display, music library management, track information editing, etc. In addition to the basic playback function, many music playback software also provides various ways for users to interact with music, such as rating, commenting, or sharing.

[0062] Taking the music playing scenario as an example, in the existing music playing application technologies, the ways for users to express their emotional reactions to songs mainly include rating the songs, writing comments, or adding them to playlists, etc. Although these ways can reflect users' preferences to a certain extent, for users' immediate emotional reactions and deep emotional connections, the forms of expression are relatively single and the interactivity is weak. Specifically, the existing technologies mainly rely on text comments or ratings, which often cannot accurately and comprehensively express users' true emotions towards songs. Secondly, users usually make evaluations after listening to the songs. This delayed interaction method limits users' emotional feedback by time and may no longer be so real and strong. In addition, traditional information recommendations (such as advertisement pushes) have nothing to do with users' emotional reactions, resulting in poor push effects of advertisements, that is, the advertisement content felt by users does not match their emotional states, reducing the effectiveness of advertisements.

[0063] In view of this, the embodiments of the present application provide an information recommendation method, device, electronic device, computer-readable storage medium, and computer program product, which can enhance the pertinence and effectiveness of recommended information while improving users' participation and satisfaction. The electronic device provided by the embodiments of the present application will be described below. The electronic device provided by the embodiments of the present application can be implemented as a terminal device or can be jointly implemented by a terminal device and a server. Taking the case where the information recommendation method provided by the embodiments of the present application is jointly implemented by a server and a terminal device as an example for description.

[0064] Exemplarily, refer to Figure 1 , Figure 1 is a schematic diagram of the architecture of the information recommendation system 100 provided by the embodiments of the present application. To realize an application that can enhance the pertinence and effectiveness of recommended information while improving users' participation and satisfaction, such as Figure 1 shown, the information recommendation system 100 includes: a server 200, a network 300, and a terminal device 400. Among them, the network 300 can be a local area network or a wide area network, or a combination of the two. The terminal device 400 is a terminal device associated with the user. A client 410 runs on the terminal device 400. The client 410 can be various types of clients, such as including an audio playback client (such as a music playing software), a video playback client, a live broadcast client, and an instant messaging client, etc.

[0065] In some embodiments, taking the client 410 as an audio playback client as an example, a multimedia information list (such as a playlist) can be displayed in the human-computer interaction interface of the client 410. Then, the client 410 can respond to a playback trigger operation for target multimedia information (such as a song selected by the user from the playlist), and play the target multimedia information in the playback interface, where the playback interface can include an emotion selection control. Subsequently, the client 410 can respond to a trigger operation for the emotion selection control (such as receiving a click operation by the user on the emotion selection control), and display at least one emotion material. Finally, the client 410 can respond to a selection operation for at least one emotion material, and display recommended information matching the selected emotion material in the human-computer interaction interface. In this way, on the one hand, the emotion towards the target multimedia information can be intuitively expressed by selecting the corresponding emotion material, and on the other hand, the recommended information matching the emotion material selected by the user can be triggered, ensuring that the recommended information is highly matched with the user's emotional state, thereby improving the acceptance and conversion rate of the recommended information.

[0066] In some other embodiments, the embodiments of the present application can also be implemented by means of cloud technology. Cloud technology refers to a hosting technology that unifies a series of resources such as hardware, software, and networks within a wide area network or a local area network to achieve data calculation, storage, processing, and sharing.

[0067] Cloud technology is the general term for network technology, information technology, integration technology, management platform technology, and application technology, etc. based on the cloud computing business model. It can form a resource pool, be used as needed, and is flexible and convenient. Cloud computing technology will become an important support. The background services of the technical network system require a large amount of computing and storage resources.

[0068] For example, Figure 1 The server 200 in can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery network (CDN), and big data and artificial intelligence platforms. The terminal device 400 can be a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart speaker, a smart watch, a vehicle-mounted terminal, etc., but is not limited thereto. The terminal device 400 and the server 200 can be directly or indirectly connected through wired or wireless communication methods, and no limitation is made in the embodiments of the present application.

[0069] In some embodiments, the terminal device or the server may also implement the information recommendation method provided in the embodiments of the present application by running various computer-executable instructions or computer programs. For example, the computer-executable instructions may be commands at the microprogram level, machine instructions, or software instructions. The computer program may be a native program or software module in the operating system; it may be a local (Native) application (APPlication, APP), that is, a program that needs to be installed in the operating system to run, such as an audio playback APP; or it may be a small program that can be embedded in any APP, that is, a program that only needs to be downloaded to the browser environment to run. In short, the above computer-executable instructions may be instructions in any form, and the above computer programs may be application programs, modules, or plugins in any form.

[0070] Next, the structure of the electronic device provided in the embodiments of the present application will be further described. Taking the electronic device as a terminal device as an example, see Figure 2 , Figure 2 which is a schematic structural diagram of the electronic device 500 provided in the embodiments of the present application. Figure 2 The electronic device 500 shown includes: at least one processor 510, a memory 550, at least one network interface 520, and a user interface 530. Each component in the electronic device 500 is coupled together through a bus system 540. It can be understood that the bus system 540 is used to realize the connection and communication between these components. In addition to the data bus, the bus system 540 also includes a power bus, a control bus, and a status signal bus. However, for the sake of clear description, in Figure 2 all kinds of buses are labeled as the bus system 540.

[0071] The processor 510 may be an integrated circuit chip with signal processing capabilities, such as a general-purpose processor, a digital signal processor (DSP, Digital Signal Processor), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor may be a microprocessor or any conventional processor, etc.

[0072] The user interface 530 includes one or more output devices 531 that enable the presentation of media content, including one or more speakers and / or one or more visual display screens. The user interface 530 also includes one or more input devices 532, including user interface components that facilitate user input, such as a keyboard, a mouse, a microphone, a touch screen display, a camera, and other input buttons and controls.

[0073] The memory 550 can be removable, non-removable, or a combination thereof. Exemplary hardware devices include solid-state memories, hard disk drives, optical disc drives, etc. The memory 550 optionally includes one or more storage devices that are physically remote from the processor 510.

[0074] The memory 550 includes volatile memory or non-volatile memory, and may also include both volatile and non-volatile memory. The non-volatile memory can be a read-only memory (ROM), and the volatile memory can be a random access memory (RAM). The memory 550 described in the embodiments of the present application is intended to include any suitable type of memory.

[0075] In some embodiments, the memory 550 is capable of storing data to support various operations. Examples of such data include programs, modules, and data structures, or subsets or supersets thereof, which are illustrated below.

[0076] The operating system 551 includes system programs for handling various basic system services and performing hardware-related tasks, such as a framework layer, a core library layer, a driver layer, etc., for implementing various basic services and handling hardware-based tasks;

[0077] The network communication module 552 is used to reach other computing devices via one or more (wired or wireless) network interfaces 520. Exemplary network interfaces 520 include: Bluetooth, Wi-Fi (Wireless Fidelity), and USB (Universal Serial Bus), etc.;

[0078] The presentation module 553 is used to enable the presentation of information (e.g., a user interface for operating peripheral devices and displaying content and information) via one or more output devices 531 associated with the user interface 530 (e.g., a display screen, a speaker, etc.).

[0079] The input processing module 554 is used to detect and translate one or more user inputs or interactions from one of one or more input devices 532.

[0080] In some embodiments, the device provided by the embodiments of the present application can be implemented in software. Figure 2An information recommendation device 555 stored in a memory 550 is shown. It can be software in the form of programs and plugins, etc., and includes the following software modules: a playback module 5551, a display module 5552, a determination module 5553, a division module 5554, an acquisition module 5555, and an emotion recognition module 5556. These modules are logical, so they can be combined or further split arbitrarily according to the functions implemented. It should be noted that, Figure 2 For the convenience of expression, all the above modules are shown at once, but it should not be regarded as excluding the implementation that may only include the playback module 5551 and the display module 5552 in the information recommendation device 555, or the implementation that only includes the acquisition module 5555, the emotion recognition module 5556, and the display module 5552. The functions of each module will be described below.

[0081] Next, the information recommendation method provided in the embodiments of the present application will be specifically described in combination with the exemplary applications and implementations of the terminal device provided in the embodiments of the present application.

[0082] Exemplarily, refer to Figure 3 , Figure 3 which is a flowchart of the information recommendation method provided in the embodiments of the present application, and will be described in combination with Figure 3 the steps shown.

[0083] It should be noted that, Figure 3 the method shown can be executed by various forms of computer programs running on the terminal device, not limited to the client. For example, it can also be the operating system, software modules, scripts, and applets described above. Therefore, the example of the client in the following text should not be regarded as a limitation to the embodiments of the present application. In addition, for the convenience of expression, the terminal device and the client running on the terminal device will not be specifically distinguished in the following text.

[0084] In step 101, in response to a playback trigger operation for target multimedia information, the target multimedia information is played in the playback interface.

[0085] Here, the target multimedia information refers to the multimedia information selected (by the user) from a multimedia information list (such as a playlist or a video list). For example, the target multimedia information can be a song selected by the user from a playlist, or a video selected by the user from a video list. In addition, the playback interface (including the audio playback interface and the video playback interface) can include an emotion selection control. For example, an emotion selection control (such as a mood selection button) can be displayed in the lower right corner of the playback interface.

[0086] In some embodiments, taking the client as an audio playback client as an example, an audio playback client (such as a music playback software) can run on the terminal device associated with the user. In the audio playback client, a playlist matching the keywords input by the user (such as "New Year songs") can be displayed, where the playlist can include multiple songs. When a click operation on any song displayed in the playlist is received, it can jump to the song playback interface corresponding to the clicked song, and play the clicked song (i.e., the target multimedia information) in the song playback interface. In addition, an emotion selection control can be displayed in the lower right corner of the song playback interface.

[0087] In step 102, in response to a trigger operation on the emotion selection control, at least one emotion material is displayed.

[0088] In some embodiments, before displaying at least one emotion material, at least one of the following processes can also be performed: obtaining emotion materials matching the target multimedia information from an emotion material library; obtaining emotion materials with the number of selections greater than a number threshold (such as 50 times) (i.e., popular emotion materials) from the emotion material library; randomly obtaining at least one emotion material from the emotion material library; obtaining emotion materials matching the emotion category of the target object from the emotion material library, where the target object is the audience of the target multimedia information (such as a song selected from a playlist or a video selected from a video list), for example, the target object can be the user listening to the song or the user watching the video.

[0089] Exemplarily, the above-mentioned obtaining of emotion materials matching the target multimedia information from the emotion material library can be achieved in the following way: performing encoding processing on the target multimedia information to obtain a feature vector of the target multimedia information; based on the feature vector, calling an emotion classification model for classification processing to obtain the emotion category corresponding to the target multimedia information; using the emotion materials in the emotion material library that match the emotion category corresponding to the target multimedia information as the emotion materials matching the target multimedia information.

[0090] For example, taking the target multimedia information as a song selected by the user from a playlist as an example, an encoder can be called to perform encoding processing on the song selected by the user to obtain a feature vector of the song. Then, based on the encoded feature vector, a pre-trained emotion classification model can be called for classification processing to obtain the emotion category corresponding to the song. Finally, the emotion materials in the emotion material library that match the emotion category corresponding to the song can be used as the emotion materials matching the song. For example, assuming that the emotion category corresponding to the song is joy, the emotion materials in the emotion material library used to represent the joy emotion can be used as the emotion materials matching the song.

[0091] Exemplarily, the above-mentioned obtaining of the emotional material matching the emotional category of the target object from the emotional material library can be achieved in the following manner: performing image acquisition on the face of the target object to obtain at least one frame of face image; performing emotion recognition based on the at least one frame of face image to obtain the emotional category of the target object; and using the emotional material in the emotional material library that matches the emotional category of the target object as the emotional material that matches the emotional category of the target object.

[0092] For example, taking the target multimedia information as the video selected by the user from the video list as an example, after receiving the click operation of the user on any video in the video list, the built-in (or external) camera of the terminal device can be called to perform image acquisition on the face of the user to obtain at least one frame of face image of the user (such as multiple face images of the user). Then, based on the at least one frame of face image obtained by the acquisition, the emotion classification model can be called to perform classification processing to obtain the emotional category of the user. Finally, the emotional material in the emotional material library that matches the emotional category of the user can be used as the emotional material that matches the emotional category of the user. For example, assuming that the currently recognized emotional material of the user is sadness, the emotional material in the emotional material library used to represent the sad emotion can be used as the emotional material that matches the current emotional category of the user.

[0093] It should be noted that when there is no emotional material in the emotional material library that matches the emotional category of the target object, corresponding emotional material can also be created according to the emotional category of the target object. The embodiments of the present application do not make specific limitations on this.

[0094] In some embodiments, the above-mentioned displaying of at least one emotional material can be achieved in the following manner: displaying an emotional material selection interface; and displaying at least one emotional material in the emotional material selection interface, where the at least one emotional material may include the emotional material that matches the target multimedia information.

[0095] Exemplarily, when the number of the at least one emotional material is multiple, the above-mentioned displaying of at least one emotional material in the emotional material selection interface can be achieved in the following manner: displaying the emotional material that matches the target multimedia information at the middle position of the emotional material selection interface, and displaying other emotional materials in a manner surrounding the emotional material that matches the target multimedia information, where the other emotional materials are the emotional materials other than the emotional material that matches the target multimedia information among the multiple emotional materials, and the display manner of the emotional material that matches the target multimedia information is more prominent than the display manner of the other emotional materials. For example, the size of the emotional material that matches the target multimedia information can be larger than the size of the other emotional materials.

[0096] For example, when the number of at least one emotion material is multiple, the above-mentioned display of at least one emotion material in the emotion material selection interface can also be achieved in the following way: According to the set arrangement order, display multiple emotion materials and the corresponding emotion names for each emotion material in the emotion material selection interface, where the arrangement order includes one of the following: the order from high to low of the number of times selected; the order from near to far of the time when it was last selected from the current time; the order from large to small of the size.

[0097] For example, taking 10 emotion materials as at least one emotion material, which are emotion material 1 to emotion material 10 respectively. Each emotion material corresponds to an emotion. For example, it is assumed that emotion material 1 corresponds to the emotion of joy, emotion material 2 corresponds to the emotion of happiness, emotion material 3 corresponds to the emotion of anger, emotion material 4 corresponds to the emotion of sadness, emotion material 5 corresponds to the emotion of joyfulness, emotion material 6 corresponds to the emotion of panic, emotion material 7 corresponds to the emotion of surprise, emotion material 8 corresponds to the emotion of fear, emotion material 9 corresponds to the emotion of missing, and emotion material 10 corresponds to the emotion of worry. A sorting dimension selection control can be displayed in the emotion material selection interface. When receiving a click operation of the user on the sorting dimension selection control, multiple candidate arrangement orders can be displayed, such as the order from high to low of the number of times selected, the order from near to far of the time when it was last selected from the current time, the order from large to small of the size, etc. Finally, these 10 emotion materials can be displayed in the emotion selection interface according to the arrangement order selected by the user, and the emotion corresponding to the emotion material can be displayed at a position near each emotion material. For example, taking emotion material 1 as an example, the text "joy" can be displayed below emotion material 1 to indicate that emotion material 1 is an emotion material used to express the emotion of joy.

[0098] For example, the above-mentioned at least one emotion material can be N emotion materials, where N is a positive integer greater than 1. Then, the above-mentioned display of at least one emotion material in the emotion material selection interface can also be achieved in the following way: Iteratively execute the following processing for i, where i is an incrementing integer variable and satisfies 1 ≤ i ≤ N - 1: Display the i-th emotion material in the emotion material selection interface; in response to the display duration of the i-th emotion material reaching the display duration threshold (such as 3 seconds), or receiving a switching operation for the i-th emotion material, switch to display the (i + 1)-th emotion material in the emotion material selection interface. That is to say, the embodiment of the present application can display only one emotion material at a time in the emotion material selection interface to facilitate the user's selection.

[0099] For example, taking 10 emotion materials as an example of at least one emotion material, which are emotion material 1 to emotion material 10 respectively. Among them, each emotion material corresponds to an emotion. For example, it is assumed that emotion material 1 corresponds to the emotion of joy, emotion material 2 corresponds to the emotion of happiness, emotion material 3 corresponds to the emotion of anger, emotion material 4 corresponds to the emotion of sadness, emotion material 5 corresponds to the emotion of joyfulness, emotion material 6 corresponds to the emotion of panic, emotion material 7 corresponds to the emotion of surprise, emotion material 8 corresponds to the emotion of fear, emotion material 9 corresponds to the emotion of yearning, and emotion material 10 corresponds to the emotion of worry. Then, emotion material 1 can be first displayed in the emotion material selection interface in the form of a card. When it is detected that the display duration of emotion material 1 reaches the display duration threshold (for example, 3 seconds), or when a switching operation of the user for emotion material 1 is received (for example, a sliding operation of the user for the card where emotion material 1 is located), emotion material 2 can be switched and displayed in the emotion material selection interface, and so on, until emotion material 10 is switched and displayed in the emotion material selection interface.

[0100] It should be noted that when it is detected that the display duration of emotion material 10 in the emotion material selection interface reaches the display duration threshold, emotion material 1 can be switched and displayed again in the emotion material selection interface, or the display of emotion materials can be stopped in the emotion material selection interface. The embodiments of the present application do not make specific limitations on this. In addition, it should also be noted that when a selection operation of the user for any emotion material is received, the subsequent emotion materials may no longer be displayed continuously. For example, it is assumed that the user selects emotion material 5, then the subsequent emotion materials 6 to 10 will no longer be displayed continuously in the emotion material selection interface.

[0101] Exemplarily, when the number of at least one emotion material is multiple, the above-mentioned display of at least one emotion material in the emotion material selection interface can also be achieved in the following way: determine the maximum number of emotion materials that the emotion material selection interface can display according to the size of the emotion material selection interface and the size of the emotion material. For example, the product result of the size of the emotion material selection interface and the size of the emotion material can be used as the maximum number of emotion materials that the emotion material selection interface can display at one time; in response to the number of multiple emotion materials being greater than the maximum number, divide the multiple emotion materials into multiple groups, where the number of emotion materials included in each group is less than or equal to the maximum number; display the emotion materials included in multiple groups in sequence in the emotion material selection interface. For example, when it is detected that the display duration of the emotion materials included in any group in the emotion material selection interface reaches the display duration threshold (for example, 5 seconds), switch to display the emotion materials included in the next group.

[0102] For example, taking at least one emotional material as 20 emotional materials, namely emotional material 1 to emotional material 20, and assuming that the maximum number of emotional materials that can be displayed at one time on the emotional material selection interface is 5, then the above 20 emotional materials can be divided into 4 groups, namely group 1, group 2, group 3 and group 4. Among them, group 1 includes emotional material 1 to emotional material 5, group 2 includes emotional material 6 to emotional material 10, group 3 includes emotional material 11 to emotional material 15, and group 4 includes emotional material 16 to emotional material 20. Then, the 5 emotional materials included in group 1 (i.e., emotional material 1 to emotional material 5) can be first displayed on the emotional material selection interface. When it is detected that the display duration of the 5 emotional materials included in group 1 reaches the display duration threshold (such as 5 seconds), the 5 emotional materials included in group 2 (i.e., emotional material 6 to emotional material 10) can be automatically switched and displayed on the emotional material selection interface, and so on, until the 5 emotional materials included in group 4 (i.e., emotional material 16 to emotional material 20) are switched and displayed on the emotional material selection interface.

[0103] It should be noted that when it is detected that the display duration of the 5 emotional materials included in group 4 on the emotional material selection interface reaches the display duration threshold, the 5 emotional materials included in group 1 can be switched and displayed again, or the display of the emotional materials included in any group on the emotional material selection interface can be stopped. The embodiments of the present application do not make specific limitations on this. In addition, it should also be noted that when a selection operation of the user for the emotional materials included in any group is received, the display of the emotional materials included in the subsequent groups can be stopped on the emotional material selection interface. For example, assuming that a selection operation of the user for emotional material 7 included in group 2 is received, the display of the emotional materials included in group 3 and group 4 can be stopped on the emotional material selection interface.

[0104] In some other embodiments, the above display of at least one emotional material can also be achieved in the following way: at least one emotional material is displayed in the playback interface, where at least one emotional material includes the emotional materials matching the target multimedia information, and the display manner of the emotional materials matching the target multimedia information is more prominent than the display manner of other emotional materials (for example, the size of the emotional materials matching the target multimedia information can be larger than the size of other emotional materials), and other emotional materials are the emotional materials other than the emotional materials matching the target multimedia information among at least one emotional material.

[0105] Exemplarily, when the number of at least one emotional material is multiple, the above display of at least one emotional material in the playback interface can be achieved in the following way: controlling the multiple emotional materials to appear on the playback interface all at once or in sequence, where different emotional materials appear at different positions on the playback interface.

[0106] For example, taking the target multimedia information as a song selected by the user from a multimedia information list (such as a playlist) as an example, refer to Figure 4A , Figure 4A is a schematic diagram of an application scenario of the information recommendation method provided by an embodiment of the present application. As shown in Figure 4A , in the song playing interface 401, an emotion selection control 402 is displayed. When a click operation of the user on the emotion selection control 402 is received, multiple emotion materials can be controlled to appear on the song playing interface 401 at one time, and the size of the emotion material 403 corresponding to the emotion category (for example, assumed to be a joy emotion) of the currently playing song (i.e., the target multimedia information) can be larger than the sizes of other emotion materials.

[0107] In step 103, in response to a selection operation on at least one emotion material, recommended information matching the selected emotion material is displayed.

[0108] In some embodiments, when at least one emotion material is displayed in an emotion material selection interface, the above-mentioned display of recommended information matching the selected emotion material can be achieved in the following manner: moving the selected emotion material to the middle position of the emotion material selection interface, canceling the display of emotion materials other than the selected emotion material, and displaying recommended information matching the emotion category corresponding to the selected emotion material.

[0109] By way of example, taking at least one emotion material as 10 emotion materials as an example, assuming they are emotion material 1 to emotion material 10 respectively, and assuming that emotion material 5 among them is the emotion material matching the target multimedia information. That is to say, the remaining 9 emotion materials (i.e., emotion material 1 to emotion material 4 and emotion material 6 to emotion material 10) can be displayed in the emotion material selection interface in a manner surrounding emotion material 5. When a click operation of the user on emotion material 4 is received (i.e., the user selects emotion material 4 from these 10 emotion materials), emotion material 4 can be moved to the middle position of the emotion material selection interface, and the display of the remaining emotion materials (i.e., emotion material 1 to emotion material 3 and emotion material 5 to emotion material 10) can be canceled, and recommended information matching the emotion category corresponding to emotion material 4 is displayed in the emotion material selection interface. For example, assuming that the emotion category corresponding to emotion material 4 is a joy emotion, an advertisement matching the joy emotion can be displayed below the emotion material selection interface.

[0110] In some other embodiments, when at least one emotional material is displayed in the playback interface, the above-mentioned recommended information matching the selected emotional material can also be implemented in the following manner: switch the display mode of the selected emotional material to a prominent display mode (such as highlighting or flashing display), and display the recommended information matching the emotional category corresponding to the selected emotional material in the playback interface.

[0111] For example, taking the target multimedia information as the song selected by the user from the playlist, refer to Figure 4B , Figure 4B which is a schematic diagram of the application scenario of the information recommendation method provided by the embodiments of the present application. As Figure 4B shown, there are multiple emotional materials displayed in the song playback interface 404. When receiving the click operation of the user on the emotional material 405, the emotional material 405 can be moved to the middle position of the song playback interface 404. Subsequently, the display mode of the emotional material 405 can be further switched to highlighting display, and the remaining emotional materials are cancelled from display in the song playback interface 404, and the recommended information 406 matching the emotional category corresponding to the emotional material 405 is displayed in the song playback interface 404. For example, assuming that the emotional category corresponding to the emotional material 405 is a sad emotion, an advertisement matching the sad emotion can be displayed in the song playback interface.

[0112] In some embodiments, the above-mentioned recommended information matching the selected emotional material can also be implemented in the following manner: display an interaction interface; display the selected emotional material and the recommended information matching the emotional category corresponding to the selected emotional material in the interaction interface. That is to say, in addition to being able to display the recommended information matching the selected emotional material in the playback interface or the emotion selection interface, the recommended information matching the selected emotional material can also be displayed in a separate interaction interface, and the embodiments of the present application do not make specific limitations on this.

[0113] In some other embodiments, the recommended information may include an acquisition control (such as a "Buy Now" button or a "Get Now" button), where the acquisition control is used to acquire the object recommended by the recommended information. Then refer to Figure 5 , Figure 5 which is a schematic flowchart of the information recommendation method provided by the embodiments of the present application. As Figure 5 shown, after executing Figure 3 the step 103 shown, the step 104 shown can also be executed, which will be described in combination with Figure 5 the steps shown. Figure 5 will be described.

[0114] In step 104, in response to the trigger operation on the acquisition control, an acquisition interface for acquiring the object recommended by the recommended information is displayed.

[0115] In some embodiments, taking the acquisition control as the "Get Now" button as an example, in an advertisement that matches the emotional material selected by the user (such as a milk tea advertisement), the "Get Now" button can be carried. When receiving a click operation by the user on the "Get Now" button, it can jump to the milk tea purchase page (i.e., the advertisement landing page) provided by a third-party application (such as a food delivery application), so that the user can receive the corresponding coupon on the milk tea purchase page and then purchase milk tea.

[0116] Continue to combine the following Figure 6 to illustrate the information recommendation method provided by the embodiments of the present application.

[0117] For example, refer to Figure 6 , Figure 6 which is a schematic flowchart of the information recommendation method provided by the embodiments of the present application, and will be illustrated in combination with the steps shown in Figure 6 to illustrate.

[0118] In step 201, obtain the comments made by the target object on the song.

[0119] In some embodiments, taking the target object as user A as an example, a comment button can be displayed on the song playing interface. When receiving a click operation by user A on the comment button, it can jump from the playing interface to the comment interface, and user A can make comments on the currently playing song in the comment interface.

[0120] In step 202, perform emotion recognition on the comment to obtain the emotion category of the target object.

[0121] In some embodiments, following the above example, after obtaining the comments made by user A on the song, an emotion classification model can be called to perform emotion recognition (i.e., emotion classification) on the comments made by user A to obtain the emotion category of user A.

[0122] In step 203, display the recommended information that matches the emotion category of the target object.

[0123] In some embodiments, after obtaining the emotion category of the target object (such as user A), the recommended information (such as an advertisement) that matches the emotion category of the target object can be displayed. For example, an advertisement that matches the emotion category of the target object can be displayed on the song playing interface. For example, assuming that the emotion category of user A is recognized as a happy emotion based on the comments made by user A, the advertisement content that matches the happy emotion can be displayed on the song playing interface.

[0124] In some other embodiments, step 203 may also be implemented in the following manner: display an emotion selection control; in response to a trigger operation on the emotion selection control, display at least one emotion material, where the at least one emotion material includes emotion materials corresponding to the emotion category of the target object; in response to a selection operation on the emotion material corresponding to the emotion category of the target object, display recommended information matching the emotion category of the target object.

[0125] In some embodiments, the above-mentioned display of at least one emotion material may also be implemented in the following manner: display an emotion material selection interface; display at least one emotion material in the emotion material selection interface.

[0126] For example, when the number of the at least one emotion material is multiple, the above-mentioned display of at least one emotion material in the emotion material selection interface may be implemented in the following manner: display the emotion material corresponding to the emotion category of the target object at the middle position of the emotion material selection interface, and display other emotion materials in a manner surrounding the emotion material corresponding to the emotion category of the target object, where the other emotion materials are the emotion materials other than the emotion material corresponding to the emotion category of the target object among the multiple emotion materials, and the display manner of the emotion material corresponding to the emotion category of the target object is more prominent than that of the other emotion materials.

[0127] For example, when the number of the at least one emotion material is multiple, the above-mentioned display of at least one emotion material in the emotion material selection interface may also be implemented in the following manner: display multiple emotion materials and the emotion names respectively corresponding to each emotion material in the emotion material selection interface according to a set arrangement order, where the arrangement order includes one of the following: the order from the highest to the lowest number of times being selected; the order from the nearest to the farthest moment of the last selection to the current moment; the order from the largest to the smallest size.

[0128] For example, the above-mentioned at least one emotion material may be N emotion materials, where N is a positive integer greater than 1, and the above-mentioned display of at least one emotion material in the emotion material selection interface may also be implemented in the following manner: iteratively execute the following process for i, where i is an integer variable and satisfies 1 ≤ i ≤ N - 1: display the i-th emotion material in the emotion material selection interface; in response to the display duration of the i-th emotion material reaching the display duration threshold, or receiving a switching operation on the i-th emotion material, switch to display the (i + 1)-th emotion material in the emotion material selection interface.

[0129] For example, when the number of at least one emotional material is multiple, the above-mentioned display of at least one emotional material in the emotional material selection interface can also be achieved in the following way: according to the size of the emotional material selection interface and the size of the emotional material, determine the maximum number of emotional materials that can be displayed in the emotional material selection interface; in response to the number of multiple emotional materials being greater than the maximum number, divide the multiple emotional materials into multiple groups, wherein the number of emotional materials included in each group is less than or equal to the maximum number; and display the emotional materials included in the multiple groups in turn in the emotional material selection interface.

[0130] In some embodiments, when at least one emotional material is displayed in an emotional material selection interface, the above-mentioned display of recommended information matching the emotional category of the target object can be achieved in the following manner: the emotional material corresponding to the emotional category of the target object is moved to the middle position of the emotional material selection interface, and the emotional material other than the emotional material corresponding to the emotional category of the target object is canceled, and the recommended information matching the emotional category of the target object is displayed in the emotional material selection interface.

[0131] In some embodiments, the above-mentioned display of at least one emotional material can also be achieved in the following way: at least one emotional material is displayed in the playback interface, wherein the display method of the emotional material corresponding to the emotional category of the target object is significantly different from the display method of other emotional materials, and the other emotional materials are emotional materials in at least one emotional material except the emotional material corresponding to the emotional category of the target object.

[0132] For example, when there are multiple emotional materials, the above-mentioned display of at least one emotional material in the playback interface can be achieved by controlling multiple emotional materials to appear at once or sequentially from the playback interface, and different emotional materials appear at different positions from the playback interface.

[0133] In some embodiments, when at least one emotional material is displayed in a playback interface, the above-mentioned display of recommended information that matches the emotional category of the target object can be achieved in the following manner: the display mode of the emotional material corresponding to the emotional category of the target object is switched to a highlight mode (for example, highlight display or flashing display), and the recommended information that matches the emotional category of the target object is displayed in the playback interface.

[0134] In some embodiments, before displaying at least one mood material, at least one of the following processes may also be performed: obtaining mood materials matching the target multimedia information from a mood material library; obtaining mood materials with the number of selections greater than a threshold number from the mood material library; randomly obtaining at least one mood material from the mood material library; obtaining mood materials matching the mood category of a target object from the mood material library, where the target object is the audience of the target multimedia information.

[0135] Exemplarily, the above-mentioned obtaining of mood materials matching the target multimedia information from the mood material library may be implemented in the following manner: performing encoding processing on the target multimedia information to obtain a feature vector of the target multimedia information; based on the feature vector, calling an emotion classification model to perform classification processing to obtain the emotion category corresponding to the target multimedia information; using the mood materials in the mood material library that match the emotion category corresponding to the target multimedia information as the mood materials matching the target multimedia information.

[0136] Exemplarily, the above-mentioned obtaining of mood materials matching the mood category of the target object from the mood material library may be implemented in the following manner: collecting images of the face of the target object to obtain at least one frame of face image; performing emotion recognition based on the at least one frame of face image to obtain the emotion category of the target object; using the mood materials in the mood material library that match the emotion category of the target object as the mood materials matching the emotion category of the target object.

[0137] It should be noted that the emotion category of the target object may also be obtained by performing emotion recognition on the comments made by the target object on the song.

[0138] In some embodiments, the above-mentioned displaying of recommended information matching the emotion category of the target object may also be implemented in the following manner: displaying an interaction interface; displaying in the interaction interface the mood materials corresponding to the emotion category of the target object and the recommended information matching the emotion category of the target object.

[0139] In some embodiments, the above-mentioned recommended information may include an acquisition control, where the acquisition control is used to acquire the object recommended by the recommended information, and then the following process may also be performed: in response to a trigger operation on the acquisition control, displaying an acquisition interface for acquiring the object recommended by the recommended information. The information recommendation method provided in the embodiments of the present application, on the one hand, by selecting corresponding mood materials, users can express their emotions towards the target multimedia information more intuitively and richly, which not only enhances user participation but also can more accurately capture users' emotional responses. On the other hand, according to the mood materials selected by users, the recommended information matching them is triggered, ensuring a high degree of matching between the recommended information and the users' emotional states, thereby improving the acceptance and conversion rate of the recommended information.

[0140] Next, taking the client as a music player software as an example, the exemplary application of the embodiments of the present application in an actual application scenario will be described.

[0141] In existing music player software, the way of interacting with users' emotions is usually relatively single. The main forms are allowing users to rate songs, give likes or leave comments to express their love or feelings for the songs. However, these feedbacks are usually only used as a simple form of interaction, and the combination with advertising content is not obvious enough.

[0142] Specifically, the emotion feedback functions of most current music player software are only limited to simple like, rating or comment functions, without further exploring users' specific emotional experiences, such as joy, sadness, excitement, etc. In addition, the advertising forms in existing music player software are mostly advertising insertions before, during or after songs, or are displayed on the interface of the music player software in the form of pop-ups or banners. This display method may lead to users' neglect or annoyance of the advertisements due to lack of pertinence and interactivity. In addition, although some music player software will push advertisements according to users' play history or preferences, few music player software will adjust the advertising content according to users' real-time emotion feedback, that is, there is a lack of emotion-related advertising push.

[0143] Moreover, the applicant also found during the implementation of the embodiments of the present application that: emoji (corresponding to the above-mentioned emotion materials), as a concise symbol that can express rich emotions, has been widely used in many social applications. However, in music player software, emoji are mostly regarded as part of comments, rather than an independent emotion feedback mechanism, that is, the potential of emoji has not been fully utilized. In addition, even if users give emotion feedback in music player software, these feedbacks rarely have a direct combination with advertisers or their brands, that is, there is a lack of in-depth combination with advertisers, which makes advertisers miss an opportunity to establish an emotional connection with users.

[0144] That is to say, the existing technical solutions mainly focus on traditional advertising display methods and simple user emotion feedback, lacking in-depth exploration of users' emotions and organic combination with advertising content, which limits the advertising effect and fails to fully establish an emotional connection between users and the application.

[0145] In view of this, the embodiments of the present application provide an information recommendation method, which proposes a novel advertisement triggering mechanism, that is, to trigger the incentives of advertisers in real time through the emotional materials (such as emojis) sent by users for songs. Specifically, when a user selects and sends an emoji related to the song while listening to the song, the system will immediately analyze the user's emotion (or sentiment), and trigger the advertisement incentive that matches it. That is, through the emotional feedback of the emoji, users can express their emotions towards the song more intuitively and richly, which not only enhances the user's participation, but also enables the platform to capture the user's emotional response more accurately. In addition, since the advertisement is triggered in real time according to the emoji sent by the user, it is ensured that the advertisement content is highly matched with the user's emotional state, thereby improving the acceptance and conversion rate of the advertisement.

[0146] In addition, the advertisement triggered in the embodiments of the present application is closely combined with the user's emotion. For example, the advertisement form can be closely combined with the user's real-time emotional experience, so that the advertisement can be more personalized and targeted. In addition, advertisers can also set multiple incentive options, so as to dynamically push advertisement incentives that match the user's emotion according to the user's emotion. At the same time, the system can collect the emojis sent by the user and the interaction data between them and the advertisement incentives, which can help advertisers more accurately evaluate and optimize the advertisement effect. In addition, while enjoying music, users can obtain actual incentives through simple emoji emotion interaction, which enhances the stickiness of users to the music playing software and also enhances the user experience. For example, when the user's emotional response receives an incentive response from the advertiser, this positive feedback loop can strengthen the emotional connection between the user and the advertiser, thereby increasing the user's favor and loyalty to the advertiser's brand. And, the technical solution provided by the embodiments of the present application has wide applicability. For example, the advertisement form provided by the embodiments of the present application can be applied to various online music platforms and social applications, creating a win-win value for users and advertisers.

[0147] That is to say, the technical solution provided by the embodiments of the present application aims to provide an advertisement form based on emotion interaction for advertisers and users. By combining the emoji emotion feedback of users for songs and the incentive strategies of advertisers, a win-win advertisement form is created for advertisers and users, which not only enhances the pertinence and effect of the advertisement, but also improves the user's participation and satisfaction.

[0148] The information recommendation method provided by the embodiments of the present application will be specifically described below.

[0149] In some embodiments, refer to Figure 7A , Figure 7A is a schematic diagram of the application scenario of the information recommendation method provided by the embodiments of the present application. As Figure 7AAs shown, when the user opens the playback page 701 of the music playback software (corresponding to the above-mentioned playback interface), a new emoji button 702 (corresponding to the above-mentioned emotion selection control) is added beside the button originally used to give a thumbs up to a song. When a click operation on the emoji button 702 is received from the user, it is possible to jump from the playback page 701 to the mood page 703 (corresponding to the above-mentioned emotion material selection interface), and display the default emoji and other types of emojis that match the currently playing song (corresponding to the above-mentioned target multimedia information) on the mood page 703. For example, the default emoji that matches the currently playing song can be displayed in the middle position of the mood page 703, and other types of emojis can be displayed in a way that surrounds the default emoji, and the size of the default emoji can be larger than the size of other types of emojis. The user can click on the corresponding emoji on the mood page 703 to express their emotions. For example, assume that the user clicks on the default emoji 604 on the mood page 703, then other emojis can be cancelled from display on the mood page 703, and an advertisement blessing 705 (corresponding to the above-mentioned recommended information, for example, a blessing provided by the advertiser of a cola advertisement) that matches the emoji selected by the user (i.e., the default emoji 704) can be displayed on the mood page 703. After the user clicks on the advertisement blessing 705, they can enter the corresponding advertisement landing page.

[0150] In some other embodiments, when the user selects the corresponding emoji on the mood page, the blessing provided by the advertiser can be replaced with an incentive provided by the advertiser. For example, there can be relevant advertiser incentives to guide to the advertisement landing page, such as giving away milk tea, etc.

[0151] Exemplarily, refer to Figure 7B , Figure 7B is a schematic diagram of the application scenario of the information recommendation method provided by the embodiments of the present application. As Figure 7B shown, when the user selects the emoji 706 representing a sad emotion on the mood page 703, the selected emoji 706 by the user can be moved to the middle position of the mood page 703, and other emojis can be cancelled from display. At the same time, an advertisement incentive 707 (corresponding to the above-mentioned recommended information, for example, giving away milk tea) that matches the emoji selected by the user can also be displayed on the mood page 703. After the user clicks on the advertisement incentive 707, they can jump to the corresponding advertisement landing page to receive a coupon or discount coupon for milk tea, etc.

[0152] Next, continue to combine Figure 8 to illustrate the information recommendation method provided by the embodiments of the present application.

[0153] Exemplarily, refer to Figure 8 , Figure 8It is a schematic flowchart of the information recommendation method provided by the embodiments of the present application, which will be described in conjunction with Figure 8 the steps shown.

[0154] In step 301, a song playing interface is displayed.

[0155] In step 302, a mood sending button is displayed in the song playing interface.

[0156] Here, the mood sending button is the Figure 7A emoji button 702 shown in

[0157] In step 303, a click operation on the mood sending button is received.

[0158] In step 304, a mood selection interface is displayed.

[0159] Here, the mood selection panel is the Figure 7A mood page 703 shown in

[0160] In step 305, a mood is selected.

[0161] Here, selecting a mood means selecting the corresponding emoji in the Figure 7A mood page 703 shown in

[0162] In step 306, a mood advertisement is requested. If there is no advertisement, step 307 is executed; if there is an advertisement, step 308 is executed.

[0163] In step 307, a regular mood is sent.

[0164] Here, sending a regular mood means sending the emoji selected by the user.

[0165] In step 308, an entrance for a brand-customized advertisement is displayed.

[0166] Here, displaying an entrance for a brand-customized advertisement means displaying an advertisement blessing 705 as shown in Figure 7A or an advertisement incentive 707 as shown in Figure 7B

[0167] In step 309, a click operation on the entrance for the brand-customized advertisement is received.

[0168] In step 310, an advertisement landing page is opened.

[0169] Next, the information recommendation method provided by the embodiments of the present application will be further described in conjunction with Figure 9

[0170] For example, refer to Figure 9 , Figure 9 ​​It is a schematic flowchart of the information recommendation method provided by an embodiment of this application, which will be described in conjunction with the steps shown in Figure 9 and will be described.

[0171] In step 401, the advertiser creates a mood advertisement at the placement end.

[0172] In step 402, the advertiser uploads relevant materials and selects the corresponding song and mood tags at the placement end.

[0173] In step 403, the placement end sends an advertisement generation request and a binding request to the advertisement engine.

[0174] In some embodiments, the advertiser can select a song and the corresponding mood tags to create a mood advertisement. For example, the advertiser can upload relevant materials to the placement end so that the placement end requests the advertisement engine to generate a mood advertisement and bind it to the corresponding song and mood tags.

[0175] In step 404, the music playback software obtains the emoji selected by the user.

[0176] In step 405, the music playback software requests a mood advertisement from the supply-side platform.

[0177] In step 406, the supply-side platform requests a mood advertisement from the advertisement engine.

[0178] In step 407, the advertisement engine returns a mood advertisement to the supply-side platform.

[0179] In step 408, the supply-side platform returns a mood advertisement to the music playback software.

[0180] In step 409, the music playback software displays an advertisement entry on the mood page.

[0181] In step 410, in response to a click operation on the advertisement entry, the music playback software sends a request to open the advertisement landing page to the supply-side platform.

[0182] In some embodiments, when the user enters the playback page of the music playback software, a mood sending button (i.e., the emoji button 702 shown in Figure 7A can be displayed on the playback page, and the mood sending button can be displayed side by side with the like button. The user can click the mood sending button to select to express different moods on the song. For example, after receiving the click operation of the user on the mood sending button displayed on the playback page, the mood page can be entered, and multiple different types of emojis can be displayed on the mood page. After the user selects the corresponding emoji on the mood page, the music playback software can request the background. If the background returns a mood advertisement, the music playback software can display an additional mood advertisement entry on the mood page (for example, it can be asFigure 7A The advertisement blessing 705 shown or as Figure 7B shown by the advertisement incentive 707), the user can enter the advertisement landing page after clicking on the mood advertisement entrance. In addition, the advertiser can select different songs and mood tags for the promoted products and themes, and provide different conversion capabilities, such as including coupons, benefits, etc.

[0183] In summary, the information recommendation method provided by the embodiments of the present application has the following beneficial effects:

[0184] 1) Enhance user engagement: The technical solution provided by the embodiments of the present application allows users to express their emotions towards songs by sending emojis, providing an intuitive and simple way to increase user interaction and engagement;

[0185] 2) Provide an emotional advertising experience: When users express their emotions through emojis, advertisers can provide more relevant and targeted advertisements based on these emotions, making the advertisement content closer to the actual emotional state of users;

[0186] 3) Improve the conversion rate of advertisements: Through the display of advertisements with emotional matching, it may increase users' interest in the advertisement content and purchase intention, thereby improving the conversion rate of advertisements;

[0187] 4) Increase the memorability of advertisements: Advertisements associated with specific songs and emotional states are more likely to be remembered by users because they are closely related to users' actual experiences;

[0188] 5) Provide rich user data: The emojis sent by users can provide a large amount of data on users' emotions and preferences for advertisers, helping them better understand the target audience and optimize advertising strategies;

[0189] 6) Enhance brand emotional connection: Through advertisements that match users' emotional states, the advertiser's brand can establish a deeper emotional connection with users;

[0190] 7) Encourage users to interact multiple times: Whenever users hear different songs and have different emotional reactions, they may send emojis, thus enabling them to interact with the platform frequently;

[0191] 8) Promote user social sharing: Users may share with friends because of interesting advertisements related to specific songs or emotions, thereby increasing the dissemination effect of advertisements.

[0192] That is to say, the embodiments of the present application not only provide a novel, intuitive and emotional advertising form, but also enhance the connection between users and advertisement content, providing advertisers with more efficient advertising strategies and richer user data.

[0193] Next, the exemplary structure of the information recommendation device 555 provided in the embodiments of the present application implemented as software modules will be further described. In some embodiments, as Figure 2 shown, the software modules in the information recommendation device 555 stored in the memory 550 may include: a playback module 5551 and a display module 5552.

[0194] The playback module 5551 is configured to play target multimedia information in a playback interface in response to a playback trigger operation for the target multimedia information, where the playback interface includes an emotion selection control; the display module 5552 is configured to display at least one emotion material in response to a trigger operation for the emotion selection control; the display module 5552 is further configured to display recommended information matching the selected emotion material in response to a selection operation for at least one emotion material.

[0195] In some embodiments, the display module 5552 is further configured to display an emotion material selection interface; at least one emotion material is displayed in the emotion material selection interface, where the at least one emotion material includes emotion materials matching the target multimedia information.

[0196] In some embodiments, when the number of at least one emotion material is multiple, the display module 5552 is further configured to display the emotion material matching the target multimedia information at the middle position in the emotion material selection interface, and display other emotion materials in a manner surrounding the emotion material matching the target multimedia information, where the other emotion materials are the emotion materials other than the emotion material matching the target multimedia information among the multiple emotion materials, and the display manner of the emotion material matching the target multimedia information is more prominent than that of the other emotion materials.

[0197] In some embodiments, when the number of at least one emotion material is multiple, the display module 5552 is further configured to display multiple emotion materials and the emotion names respectively corresponding to each emotion material in the emotion material selection interface according to a set arrangement order, where the arrangement order includes one of the following: the order from high to low of the number of times being selected; the order from near to far of the moment of the last selection from the current moment; the order from large to small of the size.

[0198] In some embodiments, the at least one emotion material is N emotion materials, where N is a positive integer greater than 1; the display module 5552 is further configured to iteratively execute the following processing, where i is an integer variable and satisfies 1≤i≤N - 1: display the i-th emotion material in the emotion material selection interface; in response to the display duration of the i-th emotion material reaching the display duration threshold, or receiving a switching operation for the i-th emotion material, switch to display the (i + 1)-th emotion material in the emotion material selection interface.

[0199] In some embodiments, when the number of at least one mood material is multiple, the information recommendation device 555 further includes a determination module 5553 and a division module 5554. Among them, the determination module 5553 is configured to determine the maximum number of mood materials that can be displayed on the mood material selection interface according to the size of the mood material selection interface and the size of the mood materials; the division module 5554 is configured to, in response to the number of multiple mood materials being greater than the maximum number, divide the multiple mood materials into multiple groups, where the number of mood materials included in each group is less than or equal to the maximum number; the display module 5552 is further configured to sequentially display the mood materials included in the multiple groups on the mood material selection interface.

[0200] In some embodiments, the display module 5552 is further configured to move the selected mood material to the middle position of the mood material selection interface, cancel the display of mood materials other than the selected mood material, and display recommendation information that matches the mood category corresponding to the selected mood material.

[0201] In some embodiments, the display module 5552 is further configured to display at least one mood material on the playback interface, where the at least one mood material includes a mood material that matches the target multimedia information, and the display manner of the mood material that matches the target multimedia information is more prominent than the display manner of other mood materials, and the other mood materials are the mood materials other than the mood material that matches the target multimedia information among the at least one mood material.

[0202] In some embodiments, when the number of at least one mood material is multiple, the display module 5552 is further configured to control the multiple mood materials to appear on the playback interface all at once or sequentially, and different mood materials appear at different positions on the playback interface.

[0203] In some embodiments, the display module 5552 is further configured to switch the display manner of the selected mood material to a prominent display manner, and display recommendation information that matches the mood category corresponding to the selected mood material on the playback interface.

[0204] In some embodiments, the information recommendation device 555 further includes an acquisition module 5555, which is configured to perform at least one of the following processes before the display module 5552 displays at least one mood material: acquire a mood material that matches the target multimedia information from the mood material library; acquire a mood material whose number of selected times is greater than the number threshold from the mood material library; randomly acquire at least one mood material from the mood material library; acquire a mood material that matches the mood category of the target object from the mood material library, where the target object is the audience of the target multimedia information.

[0205] In some embodiments, the acquisition module 5555 is further configured to perform encoding processing on the target multimedia information to obtain a feature vector of the target multimedia information; based on the feature vector, call an emotion classification model to perform classification processing to obtain an emotion category corresponding to the target multimedia information; and use the emotion material in the emotion material library that matches the emotion category corresponding to the target multimedia information as the emotion material that matches the target multimedia information.

[0206] In some embodiments, the acquisition module 5555 is further configured to collect images of the face of the target object to obtain at least one frame of face image; perform emotion recognition based on the at least one frame of face image to obtain the emotion category of the target object; and use the emotion material in the emotion material library that matches the emotion category of the target object as the emotion material that matches the emotion category of the target object.

[0207] In some embodiments, the display module 5552 is further configured to display an interaction interface; and display the selected emotion material and recommended information that matches the emotion category corresponding to the selected emotion material in the interaction interface.

[0208] In some embodiments, the recommended information includes an acquisition control, where the acquisition control is used to acquire the object recommended by the recommended information; the display module 5552 is further configured to, in response to a trigger operation on the acquisition control, display an acquisition interface for acquiring the object recommended by the recommended information.

[0209] Next, the implementation of the information recommendation device 555 provided in the embodiments of the present application as an exemplary structure of software modules will be further described. In some embodiments, as Figure 2 shown, the software modules stored in the information recommendation device 555 in the memory 550 may include: an acquisition module 5555, an emotion recognition module 5556, and a display module 5552.

[0210] The acquisition module 5555 is configured to acquire comments made by the target object on a song; the emotion recognition module 5556 is configured to perform emotion recognition on the comments to obtain the emotion category of the target object; and the display module 5552 is configured to display recommended information that matches the emotion category of the target object.

[0211] In some embodiments, the display module 5552 is further configured to display an emotion selection control; in response to a trigger operation on the emotion selection control, display at least one emotion material, where the at least one emotion material includes emotion materials corresponding to the emotion category of the target object; and in response to a selection operation on the emotion material corresponding to the emotion category of the target object, display recommended information that matches the emotion category of the target object.

[0212] In some embodiments, the display module 5552 is further configured to display an emotion material selection interface; at least one emotion material is displayed in the emotion material selection interface.

[0213] In some embodiments, when the number of at least one emotion material is multiple, the display module 5552 is further configured to display, at the middle position of the emotion material selection interface, the emotion material corresponding to the emotion category of the target object, and display other emotion materials in a manner surrounding the emotion material corresponding to the emotion category of the target object, where the other emotion materials are the emotion materials other than the emotion material corresponding to the emotion category of the target object among the multiple emotion materials, and the display manner of the emotion material corresponding to the emotion category of the target object is more prominent than that of the other emotion materials.

[0214] In some embodiments, when the number of at least one emotion material is multiple, the display module 5552 is further configured to display, in the emotion material selection interface, multiple emotion materials and the emotion names respectively corresponding to each emotion material in a set arrangement order, where the arrangement order includes one of the following: the order from the highest to the lowest number of times of being selected; the order from the nearest to the farthest moment of the last selection to the current moment; the order from the largest to the smallest size.

[0215] In some embodiments, at least one emotion material is N emotion materials, where N is a positive integer greater than 1; the display module 5552 is further configured to iteratively execute the following process for i, where i is an integer variable and satisfies 1≤i≤N - 1: display the i-th emotion material in the emotion material selection interface; in response to the display duration of the i-th emotion material reaching the display duration threshold, or receiving a switching operation for the i-th emotion material, switch to display the (i + 1)-th emotion material in the emotion material selection interface.

[0216] In some embodiments, when the number of at least one emotion material is multiple, the information recommendation device 555 further includes a determination module 5553 and a division module 5554, where the determination module 5553 is configured to determine the maximum number of emotion materials that can be displayed in the emotion material selection interface according to the size of the emotion material selection interface and the size of the emotion materials; the division module 5554 is configured to, in response to the number of multiple emotion materials being greater than the maximum number, divide the multiple emotion materials into multiple groups, where the number of emotion materials included in each group is less than or equal to the maximum number; the display module 5552 is further configured to sequentially display the emotion materials included in the multiple groups in the emotion material selection interface.

[0217] In some embodiments, the display module 5552 is also used to move the emotional material corresponding to the emotional category of the target object to the middle position of the emotional material selection interface, and cancel the display of emotional materials other than the emotional material corresponding to the emotional category of the target object, and display recommended information matching the emotional category of the target object in the emotional material selection interface.

[0218] In some embodiments, the display module 5552 is also used to display at least one emotional material in the playback interface, wherein the display method of the emotional material corresponding to the emotional category of the target object is significantly different from the display method of other emotional materials, and the other emotional materials are at least one emotional material other than the emotional material corresponding to the emotional category of the target object.

[0219] In some embodiments, when there are multiple emotional materials, the display module 5552 is further used to control multiple emotional materials to appear at once or sequentially from the playback interface, and different emotional materials appear at different positions from the playback interface.

[0220] In some embodiments, the display module 5552 is further used to switch the display mode of the emotional material corresponding to the emotional category of the target object to a highlighted display mode, and display the recommended information matching the emotional category of the target object in the playback interface.

[0221] In some embodiments, the acquisition module 5555 is also used to perform at least one of the following processes: acquiring emotional materials that match the target multimedia information from the emotional material library; acquiring emotional materials that have been selected more than a threshold number of times from the emotional material library; randomly acquiring at least one emotional material from the emotional material library; acquiring emotional materials that match the emotional category of the target object from the emotional material library, wherein the target object is the audience of the target multimedia information.

[0222] In some embodiments, the acquisition module 5555 is also used to encode the target multimedia information to obtain a feature vector of the target multimedia information; based on the feature vector, call the emotion classification model to perform classification processing to obtain the emotion category corresponding to the target multimedia information; and use the emotion material in the emotion material library that matches the emotion category corresponding to the target multimedia information as the emotion material that matches the target multimedia information.

[0223] In some embodiments, the acquisition module 5555 is also used to capture images of the target object's face to obtain at least one frame of facial image; perform emotion recognition based on at least one frame of facial image to obtain the target object's emotion category; and use the emotion material in the emotion material library that matches the target object's emotion category as the emotion material that matches the target object's emotion category.

[0224] In some embodiments, the display module 5552 is further configured to display an interactive interface; in the interactive interface, emotional materials corresponding to the emotional category of the target object and recommended information matching the emotional category of the target object are displayed.

[0225] In some embodiments, the recommended information includes an acquisition control, wherein the acquisition control is used to acquire the object recommended by the recommended information; the display module 5552 is further configured to display an acquisition interface for acquiring the object recommended by the recommended information in response to a trigger operation on the acquisition control.

[0226] It should be noted that the description of the device in the embodiments of the present application is similar to the description of the above method embodiments, and has similar beneficial effects as the method embodiments, so details will not be repeated. For the technical details not described in the information recommendation device provided in the embodiments of the present application, they can be understood according to Figure 3 、 Figure 5 、or Figure 6 any of the descriptions of the drawings.

[0227] The embodiments of the present application provide a computer program product, which includes a computer program or computer-executable instructions, and the computer program or computer-executable instructions are stored in a computer-readable storage medium. The processor of the computer device reads the computer-executable instructions from the computer-readable storage medium, and the processor executes the computer-executable instructions, so that the computer device executes the information recommendation method described above in the embodiments of the present application.

[0228] The embodiments of the present application provide a computer-readable storage medium storing computer-executable instructions, wherein the computer-executable instructions are stored, and when the computer-executable instructions are executed by a processor, the processor will be caused to execute the information recommendation method provided in the embodiments of the present application. For example, as Figure 3 、 Figure 5 、or Figure 6 shown in the information recommendation method.

[0229] In some embodiments, the computer-readable storage medium may be a memory such as FRAM, ROM, PROM, EPROM, EEPROM, flash memory, magnetic surface memory, optical disc, or CD-ROM; it may also be various devices including one or any combination of the above memories.

[0230] In some embodiments, the executable instructions may be in the form of a program, software, software module, script, or code, written in any form of programming language (including compiled or interpreted languages, or declarative or procedural languages), and may be deployed in any form, including being deployed as an independent program or being deployed as a module, component, subroutine, or other unit suitable for use in a computing environment.

[0231] As an example, the executable instructions may be deployed to execute on an electronic device, or on multiple electronic devices located at one location, or on multiple electronic devices distributed at multiple locations and interconnected by a communication network.

[0232] As described above, the above are only embodiments of the present application and are not intended to limit the protection scope of the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and scope of the present application are all included in the protection scope of the present application.

Claims

1. An information recommendation method, characterized in that, The method includes: In response to a playback trigger operation for target multimedia information, playing the target multimedia information in a playback interface, where the playback interface includes an emotion selection control; In response to a trigger operation for the emotion selection control, displaying at least one emotion material; In response to a selection operation for the at least one emotion material, displaying recommended information matching the selected emotion material.

2. The method according to claim 1, wherein The displaying of at least one emotion material includes: Displaying an emotion material selection interface; Displaying at least one emotion material in the emotion material selection interface, where the at least one emotion material includes emotion materials matching the target multimedia information.

3. The method according to claim 2, wherein When the number of the at least one emotion material is multiple, the displaying of at least one emotion material in the emotion material selection interface includes: Displaying an emotion material matching the target multimedia information at the middle position of the emotion material selection interface, and displaying other emotion materials in a manner surrounding the emotion material matching the target multimedia information, where the other emotion materials are emotion materials among the multiple emotion materials except the emotion material matching the target multimedia information, and the display manner of the emotion material matching the target multimedia information is more prominent than that of the other emotion materials.

4. The method according to claim 2, wherein When the number of the at least one emotion material is multiple, the displaying of at least one emotion material in the emotion material selection interface includes: Displaying the multiple emotion materials and the emotion names respectively corresponding to each of the emotion materials in the emotion material selection interface according to a set arrangement order, where the arrangement order includes one of the following: the order from the highest to the lowest number of times selected; the order from the nearest to the farthest moment when last selected to the current moment; the order from the largest to the smallest size.

5. The method according to claim 2, wherein The at least one emotion material is N emotion materials, where N is a positive integer greater than 1; The displaying of at least one emotion material in the emotion material selection interface includes: Iteratively executing the following processing for i, where i is an integer variable and satisfies 1≤i≤N - 1: Displaying the i-th emotion material in the emotion material selection interface; In response to the display duration of the i-th emotion material reaching a display duration threshold, or receiving a switching operation for the i-th emotion material, switching to display the (i + 1)-th emotion material in the emotion material selection interface.

6. The method according to claim 2, wherein When the number of the at least one emotion material is multiple, the displaying of at least one emotion material in the emotion material selection interface includes: Determining the maximum number of emotion materials that can be displayed in the emotion material selection interface according to the size of the emotion material selection interface and the size of the emotion materials; In response to the number of the multiple emotion materials being greater than the maximum number, dividing the multiple emotion materials into multiple groups, where the number of emotion materials included in each group is less than or equal to the maximum number; Sequentially displaying the emotion materials included in the multiple groups in the emotion material selection interface.

7. The method according to any one of claims 2 to 6, characterized in that The display of recommended information matching the selected emotional material includes: The selected emotional material is moved to the middle position of the emotional material selection interface, and the emotional materials other than the selected emotional material are canceled from display, and the recommendation information matching the emotional category corresponding to the selected emotional material is displayed.

8. The method according to claim 1, characterized in that, The displaying of at least one emotional material comprises: At least one emotional material is displayed in the playback interface, wherein the at least one emotional material includes emotional material that matches the target multimedia information, and the display method of the emotional material that matches the target multimedia information is more significant than the display method of other emotional materials, and the other emotional materials are emotional materials in the at least one emotional material except the emotional material that matches the target multimedia information.

9. The method according to claim 8, characterized in that, When the number of the at least one emotional material is plural, displaying at least one emotional material in the playback interface includes: The plurality of emotion materials are controlled to appear at once or sequentially on the playback interface, and different emotion materials appear at different positions on the playback interface.

10. The method according to claim 8 or 9, characterized in that The display of recommended information matching the selected emotional material includes: The display mode of the selected emotional material is switched to a highlight display mode, and recommendation information matching the emotional category corresponding to the selected emotional material is displayed in the playback interface.

11. The method according to any one of claims 1 to 10, characterized in that, Before displaying at least one emotional material, the method further includes: Perform at least one of the following: Acquire emotional materials matching the target multimedia information from an emotional material library; Obtain emotional materials whose number of selections is greater than a threshold from the emotional material library; Randomly obtain at least one emotional material from the emotional material library; Emotional materials matching the emotional category of a target object are acquired from an emotional material library, wherein the target object is an audience of the target multimedia information.

12. The method according to claim 11, wherein The acquiring the emotional material matching the target multimedia information from the emotional material library includes: Performing encoding processing on the target multimedia information to obtain a feature vector of the target multimedia information; Based on the feature vector, calling the emotion classification model to perform classification processing to obtain the emotion category corresponding to the target multimedia information; The emotional material in the emotional material library that matches the emotional category corresponding to the target multimedia information is used as the emotional material that matches the target multimedia information.

13. The method according to claim 11, wherein The step of acquiring the emotion material matching the emotion category of the target object from the emotion material library includes: Capturing the face of the target object to obtain at least one frame of facial image; Performing emotion recognition based on the at least one frame of facial image to obtain an emotion category of the target object; The emotion material in the emotion material library that matches the emotion category of the target object is used as the emotion material that matches the emotion category of the target object.

14. The method according to claim 1, characterized in that, The display of recommended information matching the selected emotional material includes: Display interactive interface; The selected emotional material and recommendation information matching the emotional category corresponding to the selected emotional material are displayed in the interactive interface.

15. The method according to any one of claims 1 to 14, characterized in that the recommended information includes an acquisition control, wherein the acquisition control is used to acquire the object recommended by the recommended information; the method further includes: responding to a trigger operation on the acquisition control, and displaying an acquisition interface for acquiring the object recommended by the recommended information.

16. An information recommendation method, characterized in that, The method includes: acquiring comments made by a target object on a song; performing emotion recognition on the comments to obtain the emotion category of the target object; displaying recommended information matching the emotion category of the target object.

17. An information recommendation device, characterized in that, The device includes: a playing module, configured to respond to a playing trigger operation on target multimedia information and play the target multimedia information in a playing interface, wherein the playing interface includes an emotion selection control; a display module, configured to respond to a trigger operation on the emotion selection control and display at least one emotion material; the display module is further configured to respond to a selection operation on the at least one emotion material and display recommended information matching the selected emotion material.

18. An electronic device, characterized in that, including: a memory, configured to store executable instructions; a processor, configured to implement the information recommendation method according to any one of claims 1 to 15 or claim 16 when executing the executable instructions stored in the memory.

19. A computer-readable storage medium storing computer-executable instructions, characterized in that, When the computer executable instructions are executed by the processor, the information recommendation method according to any one of claims 1 to 15 or claim 16 is implemented.

20. A computer program product, comprising a computer program or computer-executable instructions, characterized in that, When the computer program or computer executable instructions are executed by the processor, the information recommendation method according to any one of claims 1 to 15 or claim 16 is implemented.

Images