AR Gaze Control for Multi-Device Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing user input mechanisms for controlling computing devices often require direct interaction with the device's user interface, limiting the ability to control devices without full knowledge of the interface or its operations, and do not facilitate seamless interaction with multiple devices.
Innovation Solution
An augmented reality head-mounted device equipped with a gaze detector and camera that determines a gaze vector and sends control signals to a computing device based on user input, allowing users to interact with multiple devices in a unified manner without needing specific user input mechanisms for each device.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If traditional user input mechanisms are used to control computing devices, then direct interface interaction is required, but this limits the ability to control devices without full knowledge of the interface and does not facilitate seamless interaction with multiple devices
Solution Approach 1:
The augmented reality head-mounted device serves as a universal control interface for multiple computing devices. The gaze detector, camera, and communication interface work together to enable a single device to control various displays (televisions, monitors, tablets, smartphones) without requiring separate input mechanisms for each device, thus achieving multi-functionality and versatility.
Solution Approach 2:
The augmented reality head-mounted device acts as an intermediary between the user and multiple computing devices. It captures gaze vectors and wearer inputs, processes this information, and translates it into control signals that can be sent to different computing devices, thereby mediating the interaction and eliminating the need for direct interface knowledge.
2Ease of operation
If direct interface interaction is required for device control, then specific user input mechanisms are needed for each device, but this increases the complexity of interaction and limits natural user input
Solution Approach 1:
The patent replaces traditional mechanical input mechanisms (keyboards, mice, touchscreens) with a gaze-based control system. The gaze detector tracks eye movements and determines gaze vectors, while the camera captures wearer inputs such as hand gestures. This substitution enables more natural, intuitive control without requiring physical contact with device interfaces.
Solution Approach 2:
The augmented reality head-mounted device captures and processes wearer inputs automatically without requiring manual configuration or direct device interaction. The system self-adjusts by tracking gaze vectors and interpreting wearer inputs, then autonomously generates and sends appropriate control signals to computing devices, making the interaction process seamless and natural.
Data Source
Figure 1A
Figure 1B~1C
Figure 2
AI summary
An augmented-reality device includes a gaze detector, a camera, and a communication interface. The gaze detector determines a gaze vector of an eye of a wearer of the head-mounted device. The camera images a physical space including a display of a computing device. The communication interface sends a control signal to the computing device in response to a wearer input. The control signal indicates a location at which the gaze vector intersects the display and useable by the computing device to adjust operation of the computing device.