AR Overlay via Pixel Signal Analysis for Display Positioning
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current interactive media applications fail to effectively allow users to engage with media content instances displayed on devices like televisions using mobile devices, particularly in real-time scenarios such as live events, due to technical challenges in determining the location of the display device within the mobile device's screen.
Innovation Solution
An augmented reality presentation system that captures a video feed of the real-world environment using a mobile device's camera, identifies pixel blocks with varying signal characteristics to determine the position of a display device, and overlays or replaces the media content with augmented reality content without relying on visual markers.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If visual markers are used to determine display device position, then measurement precision is improved, but device complexity and ease of operation deteriorate due to requiring markers to be displayed and detected
Solution Approach 1:
The patent extracts the position determination function from marker-based systems and implements it through direct analysis of video feed pixel characteristics. The system analyzes pixel signal characteristics (brightness, color, position) from the camera feed to identify the display device's position, orientation, and size without requiring any visual markers to be displayed on the screen.
Solution Approach 2:
The patent introduces an intermediary processing layer that analyzes the video feed captured by the camera. Instead of directly detecting markers, the system processes pixel data from the video feed to infer display device characteristics. This intermediary analysis of pixel signal characteristics serves as a mediator between the camera and the position determination function.
2Productivity
If real-time processing is implemented for live events, then productivity is improved, but measurement precision deteriorates due to computational constraints
Solution Approach 1:
The patent applies partial action by focusing computational resources on analyzing only the specific pixel region corresponding to the display device, rather than processing the entire video feed. By identifying and concentrating analysis on the relevant pixel blocks that represent the display device, the system achieves real-time processing while maintaining measurement precision.
Solution Approach 2:
The patent segments the video feed analysis into distinct pixel blocks and identifies which blocks correspond to the display device. This segmentation allows the system to process only the relevant portions of the video feed in real-time, reducing computational complexity while maintaining accuracy in determining display device position and characteristics.
3Reliability
If marker-based detection is used, then reliability is improved, but device complexity worsens due to requiring marker generation and detection systems
Solution Approach 1:
The patent removes the marker generation and detection components from the system architecture. Instead of requiring markers to be displayed and detected, the system directly analyzes the inherent pixel characteristics of the video feed to determine display device position. This extraction of the marker-based approach simplifies the overall system while maintaining reliability through direct pixel analysis.
Solution Approach 2:
The system uses the display device's own visual output (the pixels being displayed) as the basis for detection. By analyzing the pixel signal characteristics from the camera feed that correspond to what is being displayed on the screen, the system enables the display device to essentially identify itself through its own visual content, eliminating the need for separate marker systems.
Data Source
AI summary
An exemplary system directs a camera included within a mobile device to capture a video feed, directs the mobile device to display the video feed within a display screen of the mobile device, and identifies a plurality of adjacent pixel blocks within the display screen that have signal characteristics that uniformly vary by more than a threshold amount over a predetermined time period. Based on the uniformly varying signal characteristics, the system determines that a pixel region constituted by the pixel blocks corresponds to a position of a display device within a field of view of the camera. The system identifies a media content instance being displayed by the display device, identifies augmented reality content associated with the media content instance, and directs the mobile device to display the augmented reality content within the pixel region of the display screen.