Multimedia Interaction System Using Timestamped Index Tags
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current multimedia interaction systems fail to provide users with timely and relevant information about objects of interest within multimedia content, leading to inconvenience and disruption in the user's viewing experience, especially when multiple users with differing preferences watch the same material.
Innovation Solution
An interaction system that includes a display device, a detector, and a database with index tags for video frame images, allowing users to annotate their interests through touch, cursor movements, or audio inputs, which are matched with stored interaction information, enabling the system to provide relevant content without interrupting the viewing experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If users manually search for object information online or in social networks, then they can obtain some related information, but this process is time-consuming and inconvenient, breaking the user's viewing flow
Solution Approach 1:
The system performs preliminary actions by pre-processing multimedia content to identify objects of interest and pre-fetching related information before the user actually needs it. When a user shows interest in an object during playback, the information is already prepared and can be immediately presented, eliminating the need for manual searching and saving significant time.
Solution Approach 2:
The system introduces an intermediary mechanism (the interaction system with detector and processing module) that mediates between the user and the object information. Instead of users directly searching online, the detector captures user interest, the processing module queries the database using extracted features, and results are presented automatically, streamlining the information access process.
2Quantity of substance
If broadcast operators provide a great deal of object information as reading guidance, then users can access more information, but users passively receive too much information they are not interested in, forcing them to filter through irrelevant content
Solution Approach 1:
The system applies local quality by providing customized information based on each user's specific interests and preferences. Rather than presenting the same bulk information to all users, the system analyzes individual user behavior and delivers tailored object information, ensuring each user receives content relevant to their personal interests without being overwhelmed by irrelevant data.
Solution Approach 2:
The system implements dynamics by adapting the information delivery in real-time based on user interactions. The detector continuously monitors user interest, and the processing module dynamically adjusts which object information is presented, when it is presented, and in what format, making the information delivery flexible and responsive to changing user needs rather than static and predetermined.
3Adaptability or versatility
If multiple users watch multimedia material together with different preferences, then diverse information needs arise, but existing player limitations prevent each user from making intuitive selections, potentially disrupting other users' viewing experience
Solution Approach 1:
The system applies segmentation by dividing the user base into individual users with distinct preferences and interests. Each user's interactions are detected and processed separately, allowing the system to maintain multiple personalized information streams simultaneously. This segmentation enables diverse information needs to be accommodated without requiring complex multi-user coordination interfaces.
Data Source
AI summary
The present invention provides an interaction system and an interaction method thereof. The interaction system includes a display device, a detector, a database and a processing module. The display device plays a multimedia material. The detector acquires a comment that a user is watching the multimedia material. The comment includes a timestamp and an annotated position in the multimedia material. The database stores a plurality of interaction information related to the multimedia material. Each piece of interaction information has more than one index tag, and each of the index tag includes a timestamp and an annotated position in the multimedia material. The processing module searches for the index tag, matching the comment acquired by the detector, in the database, and then outputs the content of the interaction information corresponding to the found index tag to at least one electronic device.