Wide-Angle Video Conferencing With Camera-Based Surface Input
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing techniques for managing live video communication sessions are cumbersome and inefficient, often requiring multiple key presses or keystrokes, wasting user time and device energy, particularly in battery-operated devices.
Innovation Solution
A method and system for managing live video communication sessions using a computer system with display generation components, cameras, and input devices, which detects user inputs and modifies the displayed image based on the position of the input relative to the cameras, allowing for faster and more efficient interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If existing techniques are used to manage live video communication sessions, then the interface can display video content, but the operation becomes cumbersome and time-consuming requiring multiple key presses
Solution Approach 1:
The system automatically detects user inputs from the camera feed and performs actions without requiring manual key presses. The surface detection and interaction mechanisms enable the interface to serve itself by interpreting visual data and executing commands autonomously, eliminating the need for cumbersome keyboard operations.
Solution Approach 2:
The patent replaces mechanical keyboard input with optical detection mechanisms. Cameras capture visual data of user inputs (such as writing on surfaces), and computer vision algorithms process this data to interpret commands, substituting physical key presses with visual-based control methods.
2Use of energy by moving object
If existing techniques are used to manage live video communication sessions, then the interface can function, but device energy is wasted due to complex operations
Solution Approach 1:
The system performs automatic surface detection, gesture recognition, and command execution without requiring complex user interactions. This self-service capability reduces the computational overhead associated with processing multiple manual inputs and simplifies the overall interface management, thereby conserving device energy.
Solution Approach 2:
The patent extracts the essential control functions from complex manual operations and implements them through automated visual recognition. By separating the detection and interpretation functions from manual input requirements, the system reduces interface complexity and associated energy consumption.
3Ease of operation
If existing techniques are used, then video communication can be maintained, but user cognitive burden increases due to complex interface interactions
Solution Approach 1:
The interface automatically detects and interprets user intentions through visual data, eliminating the need for users to navigate complex menus or remember specific key sequences. This self-service approach reduces cognitive load by making the system adapt to natural user behaviors rather than requiring users to adapt to system constraints.
Solution Approach 2:
The patent introduces visual recognition technology as an intermediary between the user and the video communication system. This intermediary layer translates natural physical actions (like writing on a surface) into digital commands, bridging the gap between intuitive user gestures and system requirements without increasing cognitive burden.
Data Source
Figure 1A
Figure 1B
Figure 2
AI summary
The present disclosure relates to embodiments for a video communication interface for managing content, such as documents placed on a surface of a desk, that is shared during a video communication session.