Eyewear Shared AR Object Manipulation via Gaze Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality technologies for eyewear devices lack the ability to enable seamless interactive experiences between multiple users for shared group object manipulation tasks, where users can control virtual objects based on their gaze direction and generate verbal commands for interaction.
Innovation Solution
The implementation of eyewear devices equipped with visible-light cameras, infrared cameras, and eye tracking systems that allow users to manipulate virtual objects in a shared virtual scene by tracking eye gaze direction and position, enabling synchronized interaction and control through a network-connected system.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If eyewear devices implement multiple cameras and sensors for AR experiences, then the functionality and interactivity of the system is improved, but the device complexity increases
Solution Approach 1:
The patent combines multiple cameras (visible-light and infrared) and sensors into integrated eyewear devices that work together to provide comprehensive AR functionality. The visible-light cameras capture environmental scenes while infrared cameras track eye movements, and these systems are merged to enable gaze-controlled virtual object manipulation without requiring separate complex control systems for each function.
Solution Approach 2:
The eyewear devices are designed with multi-functional capabilities where the same hardware components serve multiple purposes. The visible-light cameras both capture environmental scenes for AR overlay and provide data for depth perception. The infrared cameras track eye position for control while also providing gaze direction information. This multi-functionality reduces the need for separate dedicated components for each function.
2Ease of operation
If eyewear devices add eye tracking systems for precise control, then the ease of operation is improved, but the device complexity increases
Solution Approach 1:
The eye tracking system enables the eyewear device to automatically determine user intent and control parameters based on natural eye movements without requiring additional manual inputs. The system self-adjusts virtual object positions and interactions based on gaze direction, eliminating the need for separate control mechanisms and making the device easier to operate through intuitive natural interaction.
Solution Approach 2:
The patent replaces traditional mechanical control interfaces (buttons, knobs, touchscreens) with optical and biological sensing mechanisms. Instead of requiring physical manipulation of controls, the system uses infrared cameras to detect eye movements and translates these biological signals into control commands, simplifying the user interface while adding sophisticated control capabilities.
3Adaptability or versatility
If eyewear devices enable shared group tasks with multiple users, then the adaptability and interaction capability is improved, but the network connectivity and synchronization complexity increases
Solution Approach 1:
The patent segments the AR experience into independent but synchronized components for each user. Each eyewear device independently renders its own view of the shared virtual scene based on local gaze position, while network synchronization coordinates the experiences across multiple devices. This segmentation allows each user to have personalized interaction while maintaining overall system coherence without requiring complex centralized control.
Solution Approach 2:
The network synchronization system implements feedback mechanisms where each user's gaze-based control actions are transmitted to other users' devices, creating a coordinated shared experience. The system continuously monitors and adjusts the virtual scene rendering based on real-time gaze data from multiple users, ensuring synchronized interaction while maintaining low latency through adaptive feedback loops.
Data Source
AI summary
Eyewear providing an interactive augmented reality experience between two users of eyewear devices to perform a shared group object manipulation task. During the shared group task, each user of the eyewear controls movement of a respective virtual object in a virtual scene based on a portion of the virtual scene the user is gazing at. Each user can also generate a verbal command to generate a virtual object that interacts with one or more of the other virtual objects.