AR Media Capture Interface Using Eye and Hand Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for capturing and displaying media in augmented and virtual reality environments are cumbersome, inefficient, and create a significant cognitive burden on users, often requiring complex inputs and leading to energy wastage in battery-operated devices.
Innovation Solution
The implementation of improved methods and interfaces that provide intuitive media capture and display through a display generation component, utilizing cameras and input devices, including touch-sensitive displays, eye-tracking, and hand-tracking components, to reduce the number and complexity of user inputs, and enhance the human-machine interface.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional methods for capturing and displaying media are used in augmented and virtual reality environments, then the media capture process can be completed, but the process becomes cumbersome and creates a significant cognitive burden on users
Solution Approach 1:
The system automatically detects user intent through eye tracking and hand tracking without requiring explicit menu navigation or complex inputs. The media capture interface adapts to user behavior patterns, providing contextual actions and automated workflows that eliminate the need for users to manually configure capture parameters or navigate complex menus.
Solution Approach 2:
The patent replaces traditional mechanical input methods (buttons, switches, manual menu navigation) with optical sensing systems (eye tracking, hand tracking). This substitution allows the system to interpret user intent through natural gestures and gaze direction, significantly simplifying the media capture process while reducing cognitive burden.
2Productivity
If conventional media capture interfaces are implemented, then media can be captured, but the process requires a series of complex inputs that waste time and energy
Solution Approach 1:
The system performs preliminary actions by pre-configuring capture parameters based on detected user intent. When the system detects that a user is looking at a specific object or area, it automatically prepares the capture settings, focuses the camera, and readies the recording function before the user actually initiates capture, eliminating delays associated with manual configuration.
Solution Approach 2:
The media capture process maintains continuity by keeping the capture function actively monitored and ready based on user behavior. The system continuously tracks user gaze and hand movements, maintaining capture readiness states without requiring the user to re-initiate or reconfigure settings between capture actions, thereby reducing overall process time.
3Use of energy by moving object
If conventional media capture methods are used, then media capture functionality is provided, but energy is wasted in battery-operated devices due to inefficient processes
Solution Approach 1:
The system employs periodic sampling of user inputs and environmental data rather than continuous full-power processing. The eye tracking and hand tracking systems operate in periodic cycles, activating high-precision tracking only when capture intent is detected or during active capture phases, while using lower-power modes during transitional or idle states, thus reducing overall energy consumption while maintaining capture speed.
Data Source
AI summary
The present disclosure generally relates to techniques and user interfaces for capturing media, displaying a preview of media, displaying a recording indicator, displaying a camera user interface, and/or displaying previously captured media.