Visual Interlock System for Mobile Video Annotation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current TV environments lack flexibility for users to search for information or purchase products during video content viewing, as advertisers face challenges in registering and maintaining product metadata due to space-time constraints, and users' interactive experiences are limited by the inability to seamlessly integrate advertisements with video content.
Innovation Solution
A visual interlock system that allows video content played on a television to be simultaneously displayed on a mobile device, searching for and annotating virtual information related to visual objects with metadata, enabling users to access product information or advertisements through a user-friendly interface.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If advertisers register and maintain product metadata on a separate platform, then product information can be stored and accessed, but users cannot freely search for information or purchase products during video viewing due to space-time constraints
Solution Approach 1:
The patent combines the video playback function with the product information search and purchase functions into an integrated system. The mobile terminal simultaneously displays video content and provides interactive product information access, merging previously separate functions (video viewing and product searching) into a unified user experience that eliminates the need to switch between different platforms or devices.
Solution Approach 2:
The mobile terminal acts as an intermediary device between the video content and the product metadata database. It receives video content, extracts visual objects, searches for corresponding product information in the metadata database, and presents both the video and product information to the user in an integrated manner, facilitating seamless interaction during video viewing.
2Productivity
If advertisements are provided to users coordinated with video content, then advertising effectiveness is improved, but the TV environment lacks structural flexibility for users to search for information or confirm product details
Solution Approach 1:
The system dynamically adapts the advertising presentation based on user interaction. Instead of static advertisements, the mobile terminal provides real-time product information search capabilities, allows users to pause video for product details, and enables flexible navigation between video content and product metadata, making the advertising environment dynamic and adaptable to user needs.
Solution Approach 2:
The mobile terminal serves multiple functions simultaneously: it plays video content, searches for product metadata, displays product information, and enables purchasing operations. This multi-functional device replaces the limited TV environment, providing universal access to both entertainment and commercial transactions within a single platform.
3Ease of operation
If users search for information or visit shopping sites during video viewing, then product purchasing is enabled, but this interferes with another user viewing the same content
Solution Approach 1:
The system segments the user experience into distinct but integrated modes: video viewing mode and product interaction mode. Users can switch between these modes seamlessly, pausing video to search for product information or purchase items, then resuming video playback. This segmentation allows individual users to interact with product information without affecting the continuous video stream available to other users.
Solution Approach 2:
The mobile terminal provides localized product information overlay and search capabilities specific to the visual objects detected in the video content. Instead of disrupting the entire video stream, the system adds localized interactive elements (product information panels, search interfaces) that appear only on the user's mobile device, allowing personalized product interaction while preserving the original video content for all users.
Data Source
AI summary
Embodiments of the present invention provide a visual interlock system for providing product information by displaying video content annotated with virtual information (stored as metadata) such as advertisement information or a social network service (SNS) message from a friend. Specifically, among other things, embodiments of the present invention provide a system that allows a video playing on a television to be simultaneously played on a mobile device. The system searches for virtual information related to a visual object in the video. The virtual information is stored as metadata. The virtual object in the video is annotated with the virtual information. The annotated video is displayed on the user terminal.