Client-Side Augmented Reality Overlay for Live Video
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Live events, especially sporting events with long periods of uninterrupted play, are disrupted by advertisements inserted between segments, affecting the viewing experience due to the limitations of server-side virtual product placements which lack personalization and increase processing load on client devices.
Innovation Solution
Client devices are empowered to overlay secondary content, such as advertisements, by receiving region identification and attributes from the server, allowing for personalized and efficient integration of ads into video frames without interrupting the viewing experience, using bounding boxes, homography transformations, and masks to ensure proper occlusion and realistic placement.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If advertisements are inserted between segments of live event, then advertising revenue is generated, but the viewing experience is disrupted
Solution Approach 1:
The system performs preliminary action by pre-identifying occlusion regions in video frames before advertisement insertion. Bounding boxes and masks are pre-calculated to define where advertisements will be placed and how they will interact with video content, enabling seamless integration without disrupting the viewing experience
Solution Approach 2:
The system applies local quality by creating personalized advertisements tailored to specific occlusion regions and user characteristics. Each advertisement is customized for its specific location and the individual user, ensuring relevant content placement that enhances rather than disrupts viewing experience
2Ease of manufacture
If server-side virtual product placements are used, then advertisement integration is achieved, but processing load on client devices increases
Solution Approach 1:
The system extracts the computationally intensive tasks of occlusion region identification, bounding box calculation, and mask generation from client devices and relocates them to the server. The server performs these operations and sends only the resulting parameters to client devices, dramatically reducing client processing requirements
Solution Approach 2:
The server acts as an intermediary that handles the complex processing of video frame analysis and advertisement integration. It processes the occlusion regions and generates the necessary parameters, then delivers prepared advertisement data to client devices for simple rendering, mediating between the video source and client display
3Ease of manufacture
If server-side virtual product placements are used, then advertisement integration is achieved, but personalization capability is limited
Solution Approach 1:
The system makes advertisements adaptive by creating personalized content for each user based on their characteristics and the specific occlusion region. Advertisements are tailored locally to each user's preferences and the contextual requirements of each video frame, enhancing adaptability while maintaining ease of manufacture through server-side processing
Solution Approach 2:
The system introduces dynamics by enabling real-time personalization of advertisements based on user characteristics and contextual factors. Advertisements can be dynamically adjusted for different users viewing the same content, with the server processing these dynamic requirements and delivering customized advertisement data
Data Source
AI summary
Techniques are described for facilitating client-side augmented reality overlay of secondary content during live events. Regions for overlaying secondary content are identified along with attributes for each region. A client device may then used the attributes to overlay secondary content in each region prior to playback.