Interaction method and device, electronic equipment, storage medium and product
By using an agent to generate messages in the multimedia content playback interface, the problem of low efficiency of users' active search information is solved, automatic information acquisition and interaction are realized, and information acquisition efficiency and user experience are improved.
Patent Information
- Application Number
- CN202480002136.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-04-23
- Publication Date
- 2024-11-26
AI Technical Summary
When browsing multimedia content, users need to actively search or interact to obtain relevant information, resulting in low efficiency in information acquisition, especially due to inexperienced operation or lack of willingness to interact.
In the playback interface of multimedia content, by generating and displaying content-related messages by the agent, users can automatically obtain information and interact with the agent through message controls to improve information acquisition efficiency.
It realizes the automatic provision of relevant information during multimedia content playback, improves the user's information acquisition efficiency, and facilitates users to interact with the agent to learn more about information of interest.
Smart Images

Figure CN119032335A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of terminal technology, and in particular to an interaction method, device, electronic device, storage medium and product. Background Art
[0002] In multimedia applications such as short videos, users can browse multimedia content such as videos, graphic content, and can switch between multiple multimedia content through operations such as switching. For example, if the user is not interested in the current multimedia content, he can quickly switch to the next recommended video. If the user is interested in the current multimedia content, he can interact with the author of the multimedia content by posting comments in the comment area, liking, etc., to express his emotions or learn more about the video. Summary of the invention
[0003] This summary is provided to introduce concepts in a brief form that will be described in detail in the detailed description below. This summary is not intended to identify key features or essential features of the claimed technical solution, nor is it intended to limit the scope of the claimed technical solution.
[0004] According to some embodiments of the present disclosure, an interaction method is provided, including: displaying multimedia content on a playback interface; determining a called object based on the multimedia content; in response to the called object being an intelligent agent, displaying a message sent by the intelligent agent through a message control in the playback interface, the message being obtained by understanding the multimedia content; and displaying a dialogue interface between the user and the intelligent agent in response to a user triggering an operation on the message control.
[0005] According to other embodiments of the present disclosure, an interactive device is provided, including: a first display module, configured to display multimedia content on a playback interface; a determination module, configured to determine a called object based on the multimedia content; a second display module, configured to, in response to the called object being an intelligent agent, display a message sent by the intelligent agent through a message control in the playback interface, the message being obtained by understanding the multimedia content; and a third display module, configured to display a dialogue interface between the user and the intelligent agent in response to the user triggering an operation on the message control.
[0006] According to some embodiments of the present disclosure, an electronic device is provided, comprising: a memory; and a processor coupled to the memory, wherein the processor is configured to execute the interaction method of any embodiment described in the present disclosure based on instructions stored in the memory.
[0007] According to some embodiments of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored. When the program is executed by a processor, the interactive method of any embodiment described in the present disclosure is performed.
[0008] According to some embodiments of the present disclosure, a computer program product is provided. When the computer program product is executed on a computer, the computer is enabled to implement the interactive method of any embodiment described in the present disclosure.
[0009] According to some embodiments of the present disclosure, a computer program is provided, comprising: instructions, which, when executed by a processor, cause the processor to perform the interactive method of any embodiment described in the present disclosure.
[0010] Other features, aspects and advantages of the present disclosure will become apparent from the following detailed description of exemplary embodiments of the present disclosure with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS
[0011] The preferred embodiments of the present disclosure are described below with reference to the accompanying drawings. The drawings described herein are used to provide a further understanding of the present disclosure. Each of the drawings together with the following detailed description is included in this specification and forms a part of the specification, and is used to explain the present disclosure. It should be understood that the drawings described below only relate to some embodiments of the present disclosure and do not constitute a limitation on the present disclosure. In the drawings:
[0012] Figure 1 A flowchart of an interaction method according to some embodiments of the present disclosure is shown.
[0013] Figure 2A and 2B A schematic diagram of a playback interface according to some embodiments of the present disclosure is shown.
[0014] Figure 3 A schematic flow chart of a method for determining a called object according to some embodiments of the present disclosure is shown.
[0015] Figure 4 A schematic flow chart of a method for generating a message according to some embodiments of the present disclosure is shown.
[0016] Figure 5 A flowchart of an interaction method according to some other embodiments of the present disclosure is shown.
[0017] Figure 6 A schematic structural diagram of an interaction device according to some embodiments of the present disclosure is shown.
[0018] Figure 7 A schematic structural diagram of an electronic device according to some embodiments of the present disclosure is shown.
[0019] Figure 8 A schematic diagram of the structure of a computer system according to some embodiments of the present disclosure is shown.
[0020] It should be understood that, for ease of description, the sizes of the various parts shown in the drawings are not necessarily drawn according to the actual proportional relationship. The same or similar reference numerals are used in the various drawings to represent the same or similar parts. Therefore, once an item is defined in one drawing, it may not be further discussed in subsequent drawings. DETAILED DESCRIPTION
[0021] The following will be combined with the drawings in the embodiments of the present disclosure to clearly and completely describe the technical solutions in the embodiments of the present disclosure, but it is obvious that the described embodiments are only part of the embodiments of the present disclosure, rather than all the embodiments. The following description of the embodiments is actually only illustrative and is by no means intended to limit the present disclosure and its application or use. It should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein.
[0022] It should be understood that the various steps recorded in the method embodiments of the present disclosure can be performed in different orders, and / or performed in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown in the execution. The scope of the present disclosure is not limited in this respect. Unless otherwise specifically stated, the relative arrangement, numerical expressions and numerical values of the parts and steps set forth in these embodiments should be interpreted as being merely exemplary and do not limit the scope of the present disclosure.
[0023] The term "include" and its variations used in the present disclosure mean an open term that includes at least the following elements / features but does not exclude other elements / features, that is, "including but not limited to". In addition, the term "include" and its variations used in the present disclosure mean an open term that includes at least the following elements / features but does not exclude other elements / features, that is, "including but not limited to". Therefore, include is synonymous with include. The term "based on" means "based at least in part on".
[0024] References throughout this specification to "one embodiment," "some embodiments," or "an embodiment" mean that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. For example, the term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; and the term "some embodiments" means "at least some embodiments." Furthermore, the appearances of the phrases "in one embodiment," "in some embodiments," or "in an embodiment" in various places throughout this specification do not necessarily all refer to the same embodiment, but may do so.
[0025] It should be noted that the concepts of "first", "second", etc. mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units. Unless otherwise specified, the concepts of "first", "second", etc. are not intended to imply that the objects described in this way must be in a given order in time, space, ranking, or any other manner.
[0026] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".
[0027] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.
[0028] The embodiments of the present disclosure are described in detail below in conjunction with the accompanying drawings, but the present disclosure is not limited to these specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. In addition, in one or more embodiments, specific features, structures or characteristics can be combined in any suitable manner that will be clear from the present disclosure by a person of ordinary skill in the art.
[0029] It should be understood that the present disclosure does not limit how to obtain the image to be applied / processed. In one embodiment of the present disclosure, it can be obtained from a storage device, such as an internal memory or an external storage device. In another embodiment of the present disclosure, a photographic component can be mobilized to shoot. It should be noted that the acquired image can be a captured image or a frame of an image in a captured video, and is not particularly limited to this.
[0030] In the context of the present disclosure, an image may refer to any of a variety of images, such as a color image, a grayscale image, etc. It should be noted that in the context of the present specification, the type of image is not specifically limited. In addition, the image may be any appropriate image, such as an original image obtained by a camera device, or an image that has been subjected to specific processing, such as preliminary filtering, anti-aliasing, color adjustment, contrast adjustment, normalization, etc. It should be noted that the preprocessing operation may also include other types of preprocessing operations known in the art, which will not be described in detail here.
[0031] When browsing multimedia content, if the user is interested in the multimedia content, he can search for other related information on his own, or leave a message to the author of the multimedia content for further understanding. However, these operations need to be initiated by the user. In addition, some users are not proficient in operation or have a weak willingness to actively initiate search or interaction, which leads to low efficiency in information acquisition.
[0032] The present disclosure proposes an interactive method, which can display a message sent by an intelligent agent to a user during the process of displaying multimedia content, and the message is generated based on the multimedia content, so as to automatically provide the user with information related to the interactive multimedia content.
[0033] Figure 1 FIG. 1 is a flow chart showing an interactive method according to some embodiments of the present disclosure. Figure 1 As shown, the interaction method of this embodiment includes steps S102 to S108.
[0034] In step S102, multimedia content is displayed on a play interface.
[0035] The playback interface may include a display window of multimedia content and controls, wherein the display window is used to accommodate the multimedia content. The controls may be located above the display window or arranged side by side with the display window in the playback interface. The controls may include, for example, interactive controls, such as like, favorite, comment, forward, etc.
[0036] The user can control the playback of multimedia content through designated interactive gestures. For example, the playback and pause of multimedia content can be controlled by clicking on the multimedia content, the switching of multimedia content can be controlled by sliding up and down on the multimedia content, and different channels can be switched by sliding left and right on the multimedia content. Of course, these operations can also be triggered by controls in the playback interface, and those skilled in the art can select them as needed.
[0037] In some embodiments, the multimedia content is content in a recommendation stream of multimedia content. A media stream refers to a stream that recommends multimedia content to a user based on a specified recommendation strategy. The multimedia content in the media stream can be displayed in an immersive manner, such as full screen display. The user browses the videos recommended to him / her in sequence by switching the multimedia content.
[0038] In step S104, the called object is determined based on the multimedia content.
[0039] The called object is a function provided by the application for the user to use, such as at least one of an intelligent agent, a sub-application, etc.
[0040] The intelligent agent includes, for example, a robot, a digital human, an intelligent assistant, and a virtual agent of a machine learning model, which is an intelligent object that can automatically reply based on the content input by the user, for example, it can be a conversation robot. The intelligent agent can generate corresponding content based on the conversation sent by other subjects in the conversation scene (other users or other intelligent agents participating in the conversation). The intelligent agent can be implemented in the form of software, hardware, or a combination of software and hardware. The intelligent agent can be implemented based on a machine learning model, for example, based on a large language model (LLM) or a foundation model. The machine learning model can be a generative model, which is used to output target content based on input information. The input information of the generative model includes the processing basis of the generative model in the generation process, such as which information is referenced to perform the generation process, the requirements of the output target content, etc. The generative model includes, for example, a model generated based on text, or a model generated based on an image, and the output of the generative model can include text, image, or a combination of the two. Of course, the input or output of the generative model can also be data of other modalities, such as audio, video, or a combination of multiple types of data. The generative model can be a single-modal model, such as a model that generates text from text (referred to as the "text-to-text model") or a model that generates images from images (referred to as the "image-to-image model"). Alternatively, the generative model can be a cross-modal model, that is, a model whose input and output belong to different modalities, such as a model that generates images from text (referred to as the "text-to-image model"). Alternatively, the input of the generative model can include multiple modalities, and the output can also include multiple modalities.
[0041] Sub-applications are objects in an application that run based on specified logic, including mini-programs, plug-ins, etc. Taking mini-programs as an example, they can include weather mini-programs, shorthand mini-programs, reading mini-programs, etc. Sub-applications can quickly provide users with more functions through the same application.
[0042] Based on the multimedia content, it is determined that the called object that matches the multimedia content can be determined. For example, the called object can be determined through machine understanding information of the multimedia content. The machine understanding information refers to semantic information obtained based on computer processing. For example, the multimedia content can be processed through a machine learning model, and the called object that matches the multimedia content can be determined based on the processing result of the machine learning model.
[0043] In some embodiments, the multimedia content may be parsed to obtain understanding information (i.e., machine understanding information) of the multimedia content, and then the object to be called is determined based on the understanding information. For example, when the candidate objects include agents and sub-applications, it may be determined first whether to call an agent-type object or a sub-application-type object, and then further determined which object to call.
[0044] In some embodiments, at least one of image processing and audio processing is performed on the multimedia content to obtain at least one of image semantic information and audio semantic information of the multimedia content. The above-mentioned image processing and audio processing can be completed by a machine learning model that can support the processing of multimedia data. Then, based on at least one of the image semantic information, audio semantic information, description text of the multimedia content, and labels of the multimedia content, understanding information of the multimedia content can be generated. For example, at least one of the image semantic information, audio semantic information, description text of the multimedia content, and labels of the multimedia content is fused to generate a summary of the multimedia content as understanding information; or, from at least one of the image semantic information, audio semantic information, description text of the multimedia content, and labels of the multimedia content, keywords of the multimedia content are extracted as understanding information; or, the type involved in at least one of the image semantic information, audio semantic information, description text of the multimedia content, and labels of the multimedia content is determined to be the type of the multimedia content as understanding information.
[0045] In step S106, in response to the called object being an agent, a message sent by the agent is displayed in the play interface through a message control, and the message is obtained by understanding the multimedia content. The understanding refers to machine understanding.
[0046] After determining the object to be called, a message to be sent by the agent can be generated based on the multimedia content. For example, the message can be generated based on the understanding information of the multimedia content. In some embodiments, the understanding information is processed using a machine learning model for processing text (such as a "text model"), and the text output by the machine learning model is obtained, and the text is then used to generate the agent's message. In addition to the understanding information, the processing object of the machine learning model for processing text can also include the agent's information (such as setting information) and the information of the user authorized by the user (such as the user's preferences), so that the generated message is more in line with the interaction style of the agent and the user. For example, a life assistant-type agent can send messages in a living language, and a professional knowledge-type agent can express it in a more rigorous language.
[0047] The message control may include only the above message, or may include the identity (e.g., name, avatar, etc.) of the agent and the message. The message control may be suspended on the upper layer of the playback interface and displayed in response to the message being generated to carry the generated message; or it may be fixedly displayed in the playback interface and display the message therein after the message is generated. In some embodiments, the message control may include a dialog box, an icon, or a floating layer, etc.
[0048] In step S108, in response to the user's triggering operation on the message control, a dialogue interface between the user and the agent is displayed.
[0049] After receiving the message sent by the agent, the user can continue to communicate with the agent by triggering the message control. Of course, if the user does not want to continue to communicate with the agent, the message control can also be not triggered. In some embodiments, when the message control is not a fixed control in the playback interface, in response to the user not triggering the message control and the display time of the message control reaching a specified threshold, the message control can be closed so that the user can continue to browse the multimedia content attentively. For example, the message control can be a pop-up window, and if the user does not trigger the pop-up window within the specified threshold time, the pop-up window is closed.
[0050] In the process of playing multimedia content to the user, the above embodiment calls the intelligent agent based on the multimedia content and sends messages related to the multimedia content through the intelligent agent, so that the information related to the multimedia content can be automatically pushed to the user, so that the user can further understand the multimedia content more efficiently. In addition, the user can also conveniently continue to interact with the intelligent agent to learn more information of interest. Therefore, the embodiment of the present disclosure can improve the information acquisition efficiency of the user in the process of browsing multimedia content.
[0051] Figure 2A and 2B Schematic diagram of a playback interface according to some embodiments of the present disclosure is shown. Figure 2A As shown, the playback interface 2 of the multimedia content includes the displayed multimedia content 21, which is, for example, a clip of a movie. In addition, there is a message control 22 suspended in the upper layer of the playback interface 2, and the message control 22 includes the avatar 221 of the agent X and the message 222 "This movie was shot by director A in 2020 and tells a story about..." Message 222 is obtained by machine understanding of the multimedia content. Thus, the user can efficiently obtain information related to the multimedia content currently being browsed. As needed, the message control 22 can be embodied in other forms, for example, it can be an icon, and the content of the message can be further displayed after the icon is triggered; or, it can be a floating layer, a dialog box, etc.
[0052] In some embodiments, the playback interface 2 may further include an input control 23, which may be a text input box, a voice input control, etc. The content input into the input control 23 is sent to the agent for processing. That is, the user may send a message to the agent through the input control 23. The agent may reply to the user based on the received message. For example, a message of the agent is generated based on the received message and the currently played multimedia content.
[0053] In response to the user's triggering operation on the message control 22, the play interface 2 can be as follows: Figure 2B As shown. Figure 2B In the embodiment, a dialogue interface 24 between the user and the agent is displayed on the upper layer of the multimedia content 21, and the dialogue interface includes the content of the message sent by the agent to the user (such as the content of the message 222), and an input control 241. The user can continue to communicate with the agent by triggering the input control 241, for example, continue to ask for relevant information about the multimedia content 21, or send messages of other topics to the agent.
[0054] The process of understanding multimedia content and then generating a message can be triggered automatically or in response to a user's instruction. These two triggering strategies can be used alone or in combination. For example, one triggering method can be used for all multimedia content, or an automatic triggering method can be used for some multimedia content and a manual triggering method can be used for other multimedia content.
[0055] In some embodiments, in response to the display of the multimedia content, the multimedia content is understood. That is, the understanding of the multimedia content can be automatically started without waiting for the user's instruction. As needed, the strategy can be applied to all multimedia content, or the strategy can be applied to selected multimedia content based on the tags of the multimedia content. Figure 2A For example, the message control 22 and the message 222 may be generated and displayed in response to the display of the multimedia content 21, thereby eliminating the need for active user interaction.
[0056] In some embodiments, a message sent by a user to an agent is obtained through an input control; multimedia content is understood based on the instruction information in the message sent by the user. That is, the understanding of the multimedia content is initiated after the user gives an instruction. For example, the user can send instructions to the agent through the input control 23, such as "Who directed this movie?" and "What is the ending of this movie?", so that the understanding of the multimedia content can be triggered in response to the instructions sent by the user, and what kind of message to send to the user can be determined according to the instructions sent by the user. Thus, the processing pressure of the system can be reduced, and the content of the message can be generated more targeted.
[0057] When determining what type of object to call, it can be determined based on whether the user has the intention to continue consuming the multimedia content. Figure 3 An embodiment of a method for determining a called object of the present disclosure is described.
[0058] Figure 3 FIG. 2 is a flow chart showing a method for determining a called object according to some embodiments of the present disclosure. Figure 3 As shown, the determination method of this embodiment includes steps S302 to S304.
[0059] In step S302, based on the multimedia content, it is determined whether the user has an intention to continue consuming the multimedia content.
[0060] Continuing consumption of multimedia content means continuing to perform operations related to the multimedia content after browsing the multimedia content, such as searching for information related to the multimedia content, continuing to ask questions to the intelligent agent about the multimedia content, and so on.
[0061] In some embodiments, it is possible to determine whether the user has the intention to continue consuming the multimedia content by the amount of information, complexity, and information associated with the multimedia content. The amount of information is determined, for example, by the attribute information of the multimedia content, such as duration, the amount of text involved, etc., or it can be identified according to a model for determining the amount of information. Complexity is determined, for example, by the number of topics and the type of topics involved in the multimedia content. The number of topics is positively correlated with complexity, that is, the more topics there are, the more complex the multimedia content is. Certain specified types of topic types have higher complexity, for example, the complexity of topics involving mathematics, physics, etc. is usually higher than the complexity of life-related topics. The information associated with the multimedia content can be determined by searching, and the intention to continue consuming is determined based on the amount of information, complexity, etc. of the searched information. In general, for multimedia content with a large amount of information, high complexity, and a lot of associated information, users are more likely to have the intention to continue consuming.
[0062] In some embodiments, data on continued consumption of multimedia content of certain themes or types may be collected in advance, based on which it is determined whether the user has the intention to continue consuming the current multimedia content. For example, if the user in the application has a large number of continued consumption behaviors for multimedia content of a certain theme or type (for example, the number of continued consumption or the proportion exceeds a specified threshold), then in response to the currently browsed multimedia content belonging to the theme or type, it can also be determined that the user has the intention to continue consuming the currently browsed multimedia content.
[0063] In step S304, in response to the user's intention to continue consuming, an agent is selected from one or more candidate agents as the object to be called based on the matching results of the understanding information of the multimedia content and the one or more candidate agents.
[0064] If the user intends to continue consuming, it means that the user may need to have a deeper understanding of the multimedia content currently being browsed, or further understand information related to the current multimedia content. In this case, the intelligent agent can be called. Thus, in addition to understanding the current multimedia content and sending messages, the intelligent agent can also receive further input from the user and respond to the further input.
[0065] The one or more candidate agents may include different types of agents, such as agents created by the current user, agents created by other users, default agents provided by the application, and emotional agents, tool agents, knowledge agents, etc. An agent matching the multimedia content may be further selected, or a default agent may be directly selected.
[0066] In some embodiments, step S306 may also be included: in response to the user not having the intention to continue consuming, a sub-application is selected from one or more candidate sub-applications as the object to be called. That is, when the user does not have the intention to continue consuming, a mini-program related to the multimedia content may be called to provide the user with more information related to the multimedia content in another way. For example, for a video about extreme weather in a certain place, a weather mini-program may be called for the user, so that the user can quickly check whether the local weather is abnormal.
[0067] The above embodiment can call an object according to whether the user has the intention to continue consuming, so that an object that is more compatible with the current multimedia content can be called, so as to improve the user's interactive experience.
[0068] After browsing multimedia content, users can further consume multimedia content. The types of consumption of multimedia content can include in-depth consumption, extended consumption, and auxiliary understanding consumption. In-depth consumption refers to recommending other functions based on the understanding of the current multimedia content. Extended consumption refers to recommending other related information based on the understanding of the current video. Assisted understanding consumption refers to assisting users in understanding multimedia content with a large amount of information. According to the consumption type, corresponding messages can be further generated. Figure 4 An embodiment of a method for generating a message of the present disclosure is described.
[0069] Figure 4 FIG. 1 is a flow chart showing a method for generating a message according to some embodiments of the present disclosure. Figure 4As shown, the message generating method of this embodiment includes steps S402 to S404.
[0070] In step S402, based on the understanding information of the multimedia content, the consumption type of the multimedia content is determined, where the consumption type includes at least one of in-depth consumption, extended consumption, and auxiliary understanding consumption.
[0071] According to the understanding information of the multimedia content, multiple types of objects associated with the multimedia content can be determined, and then the consumption type can be determined according to these associated objects. Each associated object can correspond to a consumption type, for example, the associated function corresponds to in-depth consumption, the associated information corresponds to extended consumption, and the associated historical browsing record corresponds to auxiliary understanding consumption. In some embodiments, it is necessary to determine whether the multimedia content can provide a certain consumption type, for example, whether the multimedia content has a certain type of associated object, and the consumption type that the multimedia content can provide is used as the consumption type of the multimedia content. In the case where the multimedia content can provide multiple consumption types, the object with the highest adaptability to the multimedia content can be determined from the multiple associated objects according to the degree of association between the associated object and the multimedia content, or the amount of information of the associated object, so as to determine the consumption type that is most suitable for the multimedia content.
[0072] In some embodiments, based on the understanding information of the multimedia content, one or more associated objects of the multimedia content are determined, wherein the one or more associated objects include at least one of the associated functions in the application, the searched associated information, and the associated historical browsing records authorized by the user; according to the degree of association between each type of associated object and the understanding information, a target associated object is determined from the one or more associated objects; and the consumption type corresponding to the target associated object is determined, wherein the associated function corresponds to in-depth consumption, the associated information corresponds to extended consumption, and the associated historical browsing records correspond to auxiliary understanding consumption. The degree of association can be determined based on a machine learning model for determining the degree of association, or it can be determined by determining the similarity between the associated object and the multimedia content. By selecting an associated object of a certain type based on the degree of association and then determining the corresponding consumption type, the determined consumption type can be made to better match the multimedia content.
[0073] In step S404, a message is generated based on the understanding information and consumption type of the multimedia content.
[0074] When the consumption type is in-depth consumption, a message is generated for recommending related functions based on the understanding information of the multimedia content. The related functions are, for example, tools, sub-applications, other agents, etc. Thus, the user can choose to continue communicating with the current agent, or use other functions through the recommendation of the current agent. In this way, the user can use the functions in the application related to the current multimedia content, thereby improving the utilization rate of the functions in the application.
[0075] In the case of extended consumption, based on the understanding of multimedia content, a message describing the associated information is generated. Thus, users can quickly learn more about multimedia, improving the efficiency of information acquisition. For example, if the multimedia content played is a video introducing a TV series, the message generated by the agent can include other film and television works recently starred by the leading actor of the TV series.
[0076] When the consumption type is to assist in understanding consumption, key information of the multimedia content, such as a summary of the multimedia content, may be generated. In some embodiments, messages may also be generated in combination with historically browsed multimedia content, such as generating a summary or comparison of the current multimedia content and historically browsed multimedia content, thereby helping users quickly obtain the main information in the multimedia content.
[0077] In some embodiments, based on the understanding information of the multimedia content in the historical browsing record and the similar information in the understanding information of the displayed multimedia content, summary information of the multimedia content in the historical browsing record and the displayed multimedia content is generated; based on the summary information, a message to be sent by the agent is generated. For example, if the user is currently browsing a video of a certain food, other videos of the same food browsed by the user can be summarized together to extract the key elements of making the food.
[0078] In some embodiments, based on the understanding information of the multimedia content in the historical browsing record and the difference information in the understanding information of the displayed multimedia content, the comparison information of the multimedia content in the historical browsing record and the displayed multimedia content is generated; based on the comparison information, a message to be sent by the agent is generated. For example, if the user is currently browsing a video of a food production with a relatively rich content, the video can be compared with other videos of the same food production browsed by the user to highlight the special techniques used in the current video.
[0079] The above embodiment generates different messages based on the consumption type of multimedia content, so that the generated messages can have a high degree of matching with the multimedia content, thereby improving the user's multimedia content browsing experience.
[0080] In the above embodiments, it is mentioned that the user can actively send messages to the agent while browsing multimedia content. In addition to instructions related to the understanding of multimedia content, the user can also send other types of information to the agent. For example, the user can use the agent to provide feedback on the content recommended in the recommendation stream. Figure 5 An embodiment of the interactive method for adjusting a recommendation strategy of the present disclosure is described.
[0081] Figure 5 FIG. 2 shows a flow chart of an interaction method according to some other embodiments of the present disclosure. Figure 5 As shown, the interaction method of this embodiment includes steps S502 to S504.
[0082] In step S502, it is determined whether the message sent by the user includes the intention to adjust the recommendation strategy. This step can be obtained by semantic analysis, for example, by processing the message sent by the user through a machine learning model with semantic analysis function.
[0083] In step S504, in response to the message sent by the user including the intention to adjust the recommendation strategy, the recommendation strategy of the multimedia content is adjusted based on the message sent by the user.
[0084] When the message sent by the user includes the intention to adjust the recommendation strategy, the message itself may be able to directly deduce the user's adjustment intention, such as "I want to watch more pet videos"; it may also be necessary to combine the currently playing multimedia content to deduce the user's adjustment intention, for example, "I like to watch this type of video, recommend more to me", "this type" needs to be combined with the analysis results of the currently playing multimedia content to determine which type of video the user likes to watch.
[0085] In some embodiments, in response to a message sent by a user including an intention to adjust the recommendation strategy, it is determined whether the message sent by the user includes a reference to the displayed multimedia content; in response to a message sent by a user including a reference to the played multimedia content, the recommendation strategy for the multimedia content is adjusted based on the message sent by the user and the understanding information of the displayed multimedia content. The reference to the displayed multimedia content is, for example, various pronouns, such as "this", "this kind", etc., so that it can be determined that the user's feedback is based on the currently displayed multimedia content. In this embodiment, the basis for adjustment can be determined based on the understanding information, such as the type or label of the currently displayed multimedia content, and then the adjustment direction is determined based on the message sent by the user. For example, "send more videos like this" means adding multimedia content with the type or label of the currently displayed multimedia content.
[0086] Through the above embodiments, users can adjust the recommendation strategy of the recommendation flow by communicating with the intelligent agent, so users can feedback recommendation needs more flexibly and carefully, thereby improving the efficiency of user feedback and user experience.
[0087] The above is an exemplary introduction to the various method embodiments of the present disclosure. The following further describes the apparatus for implementing the methods of the above various embodiments.
[0088] Figure 6 FIG. 2 shows a schematic diagram of the structure of an interactive device according to some embodiments of the present disclosure. Figure 6 As shown, the interactive device 60 of this embodiment includes: a first display module 601, configured to display multimedia content on a playback interface; a determination module 602, configured to determine a called object based on the multimedia content; a second display module 603, configured to display a message sent by the intelligent agent through a message control in the playback interface in response to the called object being an intelligent agent, the message being obtained by understanding the multimedia content; a third display module 604, configured to display a dialogue interface between the user and the intelligent agent in response to the user's triggering operation on the message control.
[0089] In some embodiments, the determination module 602 is further configured to: determine whether the user has the intention to continue consuming the multimedia content based on the multimedia content; in response to the user's intention to continue consuming, select an agent from one or more candidate agents as the object to be called based on the matching results of the understanding information of the multimedia content and one or more candidate agents.
[0090] In some embodiments, the determination module 602 is further configured to: in response to the user not having the intention to continue consumption, select a sub-application from one or more candidate sub-applications as the object to be called.
[0091] In some embodiments, the interactive device 60 also includes a generation module 605, which is configured to: determine the consumption type of the multimedia content based on the understanding information of the multimedia content, the consumption type including at least one of in-depth consumption, extended consumption, and auxiliary understanding consumption; generate a message based on the understanding information of the multimedia content and the consumption type.
[0092] In some embodiments, the generation module 605 is further configured to: determine one or more associated objects of the multimedia content based on the understanding information of the multimedia content, wherein the one or more associated objects include at least one of the associated functions in the application, the searched associated information, and the associated historical browsing records authorized by the user; determine the target associated object from the one or more associated objects according to the degree of association between each type of associated object and the understanding information; determine the consumption type corresponding to the target associated object, wherein the associated function corresponds to in-depth consumption, the associated information corresponds to extended consumption, and the associated historical browsing records correspond to auxiliary understanding consumption.
[0093] In some embodiments, the consumption type is in-depth consumption, and the generation module 605 is further configured to: generate a message for recommending associated functions based on the understanding information of the multimedia content.
[0094] In some embodiments, the consumption type is extended consumption, and the generation module 605 is further configured to: generate a message for describing associated information based on the understanding information of the multimedia content.
[0095] In some embodiments, the consumption type is auxiliary understanding consumption, and the generation module 605 is further configured to: generate summary information of the multimedia content in the historical browsing records and the displayed multimedia content based on the understanding information of the multimedia content in the historical browsing records and the similar information in the understanding information of the displayed multimedia content; and generate a message to be sent by the intelligent agent based on the summary information.
[0096] In some embodiments, the consumption type is auxiliary understanding consumption, and the generation module 605 is further configured to: generate comparison information of the multimedia content in the historical browsing records and the displayed multimedia content based on the understanding information of the multimedia content in the historical browsing records and the difference information in the understanding information of the displayed multimedia content; based on the comparison information, generate a message to be sent by the intelligent agent.
[0097] In some embodiments, the interaction device 60 further includes a comprehension module 606 .
[0098] In some embodiments, the understanding module 606 is configured to understand the multimedia content in response to displaying the multimedia content.
[0099] In some embodiments, the playback interface further includes input controls, and the understanding module 606 is configured to: obtain a message sent by the user to the agent through the input controls; and understand the multimedia content based on the indication information in the message sent by the user.
[0100] In some embodiments, the second display module 603 is further configured to display a message sent by the robot to the user through a dialog box, an icon or a floating layer.
[0101] In some embodiments, the multimedia content is content in a recommendation stream of multimedia content, and the interaction device 60 also includes: an adjustment module 607, configured to: determine whether the message sent by the user includes an intention to adjust the recommendation strategy; in response to the message sent by the user including the intention to adjust the recommendation strategy, adjust the recommendation strategy of the multimedia content based on the message sent by the user.
[0102] In some embodiments, the adjustment module 607 is further configured to: in response to a message sent by a user including an intention to adjust the recommendation strategy, determine whether the message sent by the user includes a reference to the displayed multimedia content; in response to a message sent by the user including a reference to the played multimedia content, adjust the recommendation strategy for the multimedia content based on the message sent by the user and the understanding information of the displayed multimedia content.
[0103] It should be noted that the above-mentioned units are only logical modules divided according to the specific functions implemented by them, and are not used to limit the specific implementation methods. For example, they can be implemented in software, hardware, or a combination of software and hardware. In actual implementation, the above-mentioned units can be implemented as independent physical entities, or can also be implemented by a single entity (for example, a processor (CPU or DSP, etc.), an integrated circuit, etc.). In addition, the above-mentioned units are shown with dotted lines in the drawings to indicate that these units may not actually exist, and the operations / functions implemented by them can be implemented by the processing circuit itself.
[0104] In addition, although not shown, the device may also include a memory, which may store various information generated by the device, various units contained in the device during operation, programs and data for operation, data to be sent by the communication unit, etc. The memory may be a volatile memory and / or a non-volatile memory. For example, the memory may include, but is not limited to, a random access memory (RAM), a dynamic random access memory (DRAM), a static random access memory (SRAM), a read-only memory (ROM), and a flash memory. Of course, the memory may also be located outside the device. Optionally, although not shown, the device may also include a communication unit, which may be used to communicate with other devices. In one example, the communication unit may be implemented in a suitable manner known in the art, such as including communication components such as an antenna array and / or a radio frequency link, various types of interfaces, communication units, etc. It will not be described in detail here. In addition, the device may also include other components not shown, such as a radio frequency link, a baseband processing unit, a network interface, a processor, a controller, etc. It will not be described in detail here.
[0105] Some embodiments of the present disclosure also provide an electronic device. Figure 7 A schematic diagram of the structure of an electronic device according to some embodiments of the present disclosure is shown. For example, in some embodiments, the electronic device 7 can be various types of devices, for example, can include but are not limited to mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. For example, the electronic device 7 can include a display panel for displaying data and / or execution results used in the scheme according to the present disclosure. For example, the display panel can be in various shapes, such as a rectangular panel, an elliptical panel, or a polygonal panel. In addition, the display panel can be not only a flat panel, but also a curved panel, or even a spherical panel.
[0106] like Figure 7 As shown, the electronic device 7 of this embodiment includes: a memory 71 and a processor 72 coupled to the memory 71. It should be noted that Figure 7 The components of the electronic device 7 shown are only exemplary and non-restrictive. The electronic device 7 may also have other components according to actual application requirements. The processor 72 may control other components in the electronic device 7 to perform desired functions.
[0107] In some embodiments, the memory 71 is used to store one or more computer-readable instructions. When the processor 72 is used to execute the computer-readable instructions, the computer-readable instructions are executed by the processor 72 to implement the method according to any of the above embodiments. For the specific implementation of each step of the method and the related explanation content, please refer to the above embodiments, and the repetition will not be repeated here.
[0108] For example, the processor 72 and the memory 71 may communicate with each other directly or indirectly. For example, the processor 72 and the memory 71 may communicate with each other through a network. The network may include a wireless network, a wired network, and / or any combination of a wireless network and a wired network. The processor 72 and the memory 71 may also communicate with each other through a system bus, which is not limited by the present disclosure.
[0109] For example, the processor 72 may be embodied as various appropriate processors, processing devices, etc., such as a central processing unit (CPU), a graphics processing unit (GPU), a network processor (NP), etc.; it may also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The central processing unit (CPU) may be an X86 or ARM architecture, etc. For example, the memory 71 may include any combination of various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The memory 71 may include, for example, a system memory, which may store, for example, an operating system, an application, a boot loader, a database, and other programs. Various applications and various data may also be stored in the storage medium.
[0110] In addition, according to some embodiments of the present disclosure, various operations / processes according to the present disclosure, when implemented by software and / or firmware, can be transmitted from a storage medium or a network to a computer system having a dedicated hardware structure, such as Figure 8 The computer system 80 shown is installed with the programs constituting the software, and when the various programs are installed, the computer system can perform various functions, including the functions described above and the like. Figure 8 A schematic diagram of the structure of a computer system according to some embodiments of the present disclosure is shown.
[0111] exist Figure 8 In the embodiment, the central processing unit (CPU) 801 performs various processes according to the program stored in the read-only memory (ROM) 802 or the program loaded from the storage part 808 to the random access memory (RAM) 803. In the RAM 803, data required when the CPU 801 performs various processes, etc. are also stored as needed. The central processing unit is only exemplary, and it can also be other types of processors, such as the various processors described above. The ROM 802, RAM 803 and the storage part 808 can be various forms of computer-readable storage media, as described below. It should be noted that although Figure 8 ROM 802, RAM 803 and storage device 808 are shown separately in FIG, but one or more of them may be combined or located in the same or different memory or storage modules.
[0112] The CPU 801, the ROM 802, and the RAM 803 are connected to one another via a bus 804. An input / output interface 805 is also connected to the bus 804.
[0113] The following components are connected to the input / output interface 805: an input section 806, such as a touch screen, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output section 807, including a display, such as a cathode ray tube (CRT), a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage section 808, including a hard disk, a magnetic tape, etc.; and a communication section 809, including a network interface card such as a LAN card, a modem, etc. The communication section 809 allows communication processing to be performed via a network such as the Internet. It is easy to understand that although Figure 8 The various devices or modules in the computer system 80 are shown to communicate via the bus 804, but they may also communicate via a network or other means, wherein the network may include a wireless network, a wired network, and / or any combination of wireless networks and wired networks.
[0114] A drive 810 is also connected to the input / output interface 805 as needed. A removable medium 811 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc. is mounted on the drive 810 as needed so that a computer program read therefrom is installed into the storage section 808 as needed.
[0115] In the case where the above-described series of processing is implemented by software, a program constituting the software may be installed from a network such as the Internet or a storage medium such as the removable medium 811 .
[0116] According to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device 809, or installed from a storage device 808, or installed from a ROM 802. When the computer program is executed by the CPU 801, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.
[0117] It should be noted that in the context of the present disclosure, a computer-readable medium may be a tangible medium that may contain or store a program for use by an instruction execution system, device or equipment or used in combination with an instruction execution system, device or equipment. A computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. A computer-readable storage medium may be, for example, but not limited to: an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that may be used by an instruction execution system, device or device or used in combination with it. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, device, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.
[0118] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.
[0119] In some embodiments, a computer program is further provided, comprising: instructions, which, when executed by a processor, cause the processor to execute any of the methods of the above embodiments. For example, the instructions may be embodied as computer program codes.
[0120] In embodiments of the present disclosure, computer program code for performing the operations of the present disclosure may be written in one or more programming languages or combinations thereof, including but not limited to object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" language or similar programming languages. The program code may be executed entirely on a user's computer, partially on a user's computer, as an independent software package, partially on a user's computer, partially on a remote computer, or entirely on a remote computer or server. In situations involving a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).
[0121] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0122] The modules, components or units involved in the embodiments described in the present disclosure may be implemented by software or hardware, wherein the names of the modules, components or units do not, in some cases, limit the modules, components or units themselves.
[0123] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.
[0124] The above descriptions are only some embodiments of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, a technical solution formed by replacing the above features with the technical features with similar functions disclosed in the present disclosure (but not limited to).
[0125] In the description provided herein, many specific details are set forth. However, it is understood that embodiments of the present invention can be implemented without these specific details. In other cases, well-known methods, structures, and techniques are not presented in detail in order not to obscure the understanding of the description.
[0126] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.
[0127] Although some specific embodiments of the present disclosure have been described in detail by way of example, it should be understood by those skilled in the art that the above examples are for illustration only and are not intended to limit the scope of the present disclosure. It should be understood by those skilled in the art that the above embodiments may be modified without departing from the scope and spirit of the present disclosure. The scope of the present disclosure is defined by the appended claims.
Claims
1. An interactive method, comprising: Display multimedia content on the playback interface; Based on the multimedia content, determining a called object; In response to the called object being an agent, in the playback interface, a message sent by the agent is displayed through a message control, wherein the message is obtained by understanding the multimedia content; In response to the user's triggering operation on the message control, a dialogue interface between the user and the agent is displayed.
2. The interactive method according to claim 1, wherein: The determining, based on the multimedia content, the called object comprises: Based on the multimedia content, determining whether the user has an intention to continue consuming the multimedia content; In response to the user's intention to continue consuming, an agent is selected from one or more candidate agents as the object to be called based on the matching result between the understanding information of the multimedia content and the one or more candidate agents.
3. The interactive method according to claim 2, further comprising: In response to the user not having the intention to continue consumption, a sub-application is selected from one or more candidate sub-applications as the object to be called.
4. The interactive method according to any one of claims 1 to 3, further comprising: Determining a consumption type of the multimedia content based on the understanding information of the multimedia content, the consumption type comprising at least one of in-depth consumption, extended consumption, and auxiliary understanding consumption; The message is generated based on the understanding information of the multimedia content and the consumption type.
5. The interactive method according to claim 4, wherein: The determining the consumption type of the multimedia content based on the understanding information of the multimedia content includes: Based on the understanding information of the multimedia content, determining one or more associated objects of the multimedia content, wherein the one or more associated objects include at least one of an associated function in an application, searched associated information, and an associated historical browsing record authorized by the user; determining a target associated object from the one or more associated objects according to the degree of association between each type of associated object and the understanding information; Determine the consumption type corresponding to the target associated object, wherein the associated function corresponds to in-depth consumption, the associated information corresponds to extended consumption, and the associated historical browsing record corresponds to auxiliary understanding of consumption.
6. The interactive method according to claim 5, wherein: The consumption type is in-depth consumption, and the generating the message based on the understanding information of the multimedia content and the consumption type includes: Based on the understanding information of the multimedia content, a message for recommending the associated function is generated.
7. The interactive method according to claim 5 or 6, wherein: The consumption type is extended consumption, and the generating the message based on the understanding information of the multimedia content and the consumption type includes: A message describing the associated information is generated based on the understanding information of the multimedia content.
8. The interactive method according to any one of claims 5 to 7, wherein: The consumption type is auxiliary understanding consumption, and the generating the message based on the understanding information of the multimedia content and the consumption type includes: generating summary information of the multimedia content in the historical browsing record and the displayed multimedia content based on the understanding information of the multimedia content in the historical browsing record and the similar information in the understanding information of the displayed multimedia content; Based on the summary information, the message to be sent by the agent is generated.
9. The interactive method according to any one of claims 5 to 8, wherein: The consumption type is auxiliary understanding consumption, and the generating the message based on the understanding information of the multimedia content and the consumption type includes: generating, based on the understanding information of the multimedia content in the historical browsing record and the difference information in the understanding information of the displayed multimedia content, comparison information of the multimedia content in the historical browsing record and the displayed multimedia content; Based on the comparison information, the message to be sent by the agent is generated.
10. The interactive method according to any one of claims 1 to 9, further comprising: In response to the display of the multimedia content, the multimedia content is understood.
11. The interactive method according to any one of claims 1 to 10, wherein: The playback interface also includes input controls, and also includes: Obtaining, through the input control, a message sent by the user to the agent; The multimedia content is understood based on the indication information in the message sent by the user.
12. The interactive method according to claim 10 or 11, wherein: The displaying of the message sent by the agent through the message control comprises: The message sent by the robot to the user is displayed through a dialog box, an icon or a floating layer.
13. The interactive method according to claim 11 or 12, wherein: The multimedia content is content in a recommendation stream of multimedia content, and the interaction method further includes: determining whether the message sent by the user includes an intention to adjust the recommendation strategy; In response to the message sent by the user including the intention to adjust the recommendation strategy, the recommendation strategy of the multimedia content is adjusted based on the message sent by the user.
14. The interactive method according to claim 13, wherein: The step of responding to the message sent by the user including the intention to adjust the recommendation strategy, and adjusting the recommendation strategy of the multimedia content based on the message sent by the user includes: In response to the message sent by the user including the intention to adjust the recommendation strategy, determining whether the message sent by the user includes a reference to the displayed multimedia content; In response to the message sent by the user including a reference to the multimedia content being played, a recommendation strategy for multimedia content is adjusted based on the message sent by the user and information about the understanding of the displayed multimedia content.
15. An interactive device, comprising: A first display module, configured to display multimedia content on a playback interface; A determination module, configured to determine a called object based on the multimedia content; A second display module is configured to, in response to the called object being an agent, display a message sent by the agent in the playback interface through a message control, wherein the message is obtained by understanding the multimedia content; The third display module is configured to display a dialogue interface between the user and the agent in response to a trigger operation of the user on the message control.
16. An electronic device, comprising: Memory; as well as A processor coupled to the memory, wherein the processor is configured to execute the interaction method according to any one of claims 1 to 14 based on instructions stored in the memory.
17. A computer-readable storage medium having a computer program stored thereon, wherein the program, when executed by a processor, implements the interactive method according to any one of claims 1 to 14.
18. A computer program product, when the computer program product is run on a computer, enables the computer to implement the interactive method according to any one of claims 1 to 14.
19. A computer program comprising: Instructions, which, when executed by a processor, cause the processor to perform the interaction method according to any one of claims 1 to 14.
Citation Information
Cited By
Recommended information processing method and device, electronic equipment, storage medium and product
CN119299417A
Interface interaction method and device, equipment and storage medium
CN119996362A
Method, device and storage medium for interface interaction
CN119996362B
Construction method of message processing system and message processing method and device
CN120567814A
Method for constructing message processing system, message processing method and device
CN120567814B
