Multimedia Agent Messaging With Playback Conversation Controls
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users of multimedia applications face inefficiencies in obtaining information related to the content they are viewing, as they often lack the skills or inclination to actively search or interact with the content, leading to suboptimal information retrieval.
Innovation Solution
An interaction method and device that displays messages from intelligent agents based on multimedia content, allowing users to engage in conversations and receive relevant information automatically, enhancing information acquisition through machine understanding and user interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If users actively search or interact with multimedia content to obtain information, then information retrieval completeness improves, but user effort and time consumption increase
Solution Approach 1:
The system performs automatic understanding and information extraction from multimedia content without requiring user initiation. The agent autonomously analyzes the content, identifies key information, and presents it to the user, making the information retrieval process self-serving rather than user-driven.
Solution Approach 2:
The agent performs preliminary understanding and analysis of the multimedia content before the user needs the information. By pre-processing the content and preparing relevant information in advance, the system eliminates the need for users to spend time searching or interacting to obtain the information.
2Measurement precision
If users actively search or interact with multimedia content, then information retrieval accuracy improves, but operational complexity increases
Solution Approach 1:
The agent autonomously performs the complex task of understanding multimedia content and extracting accurate information without requiring user operations. This transfers the operational complexity from the user to the agent, maintaining high accuracy while preserving user convenience.
Solution Approach 2:
The agent acts as an intermediary between the multimedia content and the user. It handles the complex interaction with the content on behalf of the user, translating complex content understanding into simple, presentable information that the user can consume without effort.
3Ease of operation
If the system provides automatic information retrieval through agents, then user effort decreases, but system complexity increases
Solution Approach 1:
The agent serves as an intermediary layer that handles the complexity of content understanding and information extraction. This intermediary absorbs the system complexity, shielding the user from it while providing simple, effortless interaction.
Solution Approach 2:
The patent replaces manual user operations (mechanical interaction) with automated agent-based processing (intelligent system). This substitution transfers complexity from the user side to the system side, enabling effortless user experience through automated intelligence.
Data Source
AI summary
The present disclosure relates to an interaction method and device, an electronic device, a storage medium and a product, and relates to the field of terminal technology. The interaction method includes: displaying multimedia content in a playing interface; determining an object to be called based on the multimedia content; displaying, in response to the object to be called being an agent, a message sent from the agent through a message control in the playing interface, wherein the message is obtained by understanding the multimedia content; and displaying a conversation interface between the user and the agent in response to a trigger operation of the user on the message control.