Interactive Content Detection with Bounding Overlays in Meeting Video
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In virtual meetings, shared content is typically presented as compressed video, causing metadata for interactive content like links or email addresses to be non-actionable, requiring additional steps such as sending via email or chat, which hinders the presentation workflow.
Innovation Solution
Implementing an interactive content detector using machine learning algorithms to identify and overlay bounding perimeters around interactive content within frames, enabling direct interaction during the meeting.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If shared content is presented as compressed video, then content can be transmitted and displayed, but metadata for interactive content is lost and becomes non-actionable
Solution Approach 1:
The system creates a copy of the interactive content metadata separately from the compressed video stream. The content detector identifies interactive elements in video frames and extracts their metadata (links, email addresses, etc.), preserving this information in a usable format that can be made actionable independently of the video compression process.
Solution Approach 2:
The content detector acts as an intermediary between the compressed video stream and the participant devices. It processes video frames to identify interactive content, extracts metadata, and provides this information to participants in an actionable format, bridging the gap between video display and interaction capability.
2Ease of operation
If presenter sends original content via email or shares links via chat window, then interactive content becomes actionable, but additional steps and overhead are created
Solution Approach 1:
The system merges the video display function with interactive content delivery. Instead of requiring separate email or chat actions, the content detector identifies interactive elements within the video frames and makes them directly accessible to participants through the video interface, combining information delivery and interaction into a single unified process.
Solution Approach 2:
The content detector performs preliminary identification and extraction of interactive content metadata during the video transmission process itself, before participants need to interact with it. This advance preparation eliminates the need for subsequent manual steps like sending emails or copying links from chat windows.
3Loss of information
If presenter allows participants time to write down links or email addresses, then interactive content is captured, but presentation workflow is hindered
Solution Approach 1:
The system provides self-service by automatically detecting, extracting, and making interactive content actionable without requiring participant intervention. Participants don't need to manually write down or record information; the content detector automatically identifies interactive elements and provides them in an usable format, eliminating the need for manual information capture while maintaining presentation flow.
Solution Approach 2:
The content detector provides real-time feedback by identifying and highlighting interactive content as it appears in the video stream. This immediate feedback mechanism allows participants to access interactive elements directly during the presentation without interrupting the workflow for manual recording or note-taking.
Data Source
AI summary
Implementations for detecting interactive content shared during media conferences are described. Initially, a frame to be presented to one or more participants during a media conference is received. Next, interactive content within the frame is identified. A bounding perimeter surrounding the interactive content is determined. At least one action based on the type of interactive content is determined. The bounding perimeter is transmitted for the interactive content within a plurality of frames to enable the at least one action associated with the interactive content.