Touch Screen Video Compositing for Glare-Free Remote Demonstration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Demonstrating interaction with a touch-sensitive screen over a video stream is challenging, especially when the viewer is remote, as existing methods result in a less pristine, glare-filled, and confusing view of the screen due to spatial aliasing, color inaccuracies, and obstruction by the user's hand.
Innovation Solution
A method that composites a high-resolution video stream of the device's screen with a live video stream from an external camera, positioning the camera to capture gestures while using physical or digital filtering to remove the screen content, ensuring a clear, high-quality view of the screen and user interactions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If an external camera is used to capture the screen content, then user interaction gestures can be shown, but the screen view becomes less pristine, glare-filled, and color-inaccurate due to spatial aliasing
Solution Approach 1:
The system segments the video feed into two separate sources: a high-resolution screen capture showing pristine screen content, and a separate camera feed showing user gestures. These segmented views are then combined through compositing to produce a unified output that maintains high quality for both screen content and gesture visibility.
Solution Approach 2:
The system merges two distinct video streams (screen capture and camera feed) into a single composite video stream. The screen capture provides high-quality, glare-free display content while the camera feed overlays user gestures, creating a unified demonstration that preserves screen image quality while showing interaction.
2Ease of operation
If the camera captures both screen content and user hand, then interaction can be shown, but the screen view is obstructed by the user's hand
Solution Approach 1:
The system separates the capture of screen content and user gestures into two independent video streams. The screen capture stream maintains unobstructed, high-resolution view of all screen content, while the camera stream captures user hand gestures. These segmented streams are then composited with the hand portion overlaid on the screen content.
Solution Approach 2:
The system uses video compositing technology as an intermediary to combine the screen capture and camera feeds. This intermediary process selectively overlays only the user hand portion from the camera feed onto the screen capture, maintaining full visibility of screen content while adding gesture information.
3Device complexity
If a single camera view is used to show both screen and gestures, then the setup is simple, but the resulting video is less pristine and confusing
Solution Approach 1:
Instead of using a single camera, the system segments the video acquisition into two separate capture methods: direct screen capture for pristine, high-resolution display content, and external camera for gesture capture. This segmentation allows each source to be optimized for its specific purpose, avoiding the quality degradation that occurs with a single camera approach.
Solution Approach 2:
The system merges the advantages of two different capture methods by combining the high-quality screen capture with the gesture-capturing camera feed. The compositing process integrates these merged streams to produce a unified video that maintains the pristine quality of screen content while incorporating clear views of user interactions.
Data Source
AI summary
First video showing content displayed on a touch sensitive screen is combined with second video from a camera showing a user's interaction with the touch sensitive screen. The second video is filtered (digitally or physically) to prevent the camera from capturing the content of the touch sensitive screen. Combining the first video with the second video creates a combined video containing both a high quality image of the graphic user interface of an application appearing on the touch sensitive screen as well as how a person operating the application is gesturing and otherwise touching the touch sensitive screen when interacting with the application.