XR Media Capture Interface With Gaze Targeting and Fewer Inputs
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing user interfaces for interacting with augmented and virtual reality environments are cumbersome, inefficient, and complex, leading to a significant cognitive burden on users and excessive energy consumption, particularly in battery-operated devices.
Innovation Solution
Implementing computer systems with enhanced input methods and interfaces that utilize cameras, touch-sensitive displays, eye-tracking, and hand-tracking components to provide intuitive and efficient interactions, including stereoscopic media capture and gaze-based targeting, to reduce the number and nature of user inputs and enhance feedback.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional user interfaces are used for interacting with augmented and virtual reality environments, then the system can display virtual elements, but the interaction becomes cumbersome and requires multiple inputs creating cognitive burden
Solution Approach 1:
The system provides real-time visual feedback by displaying the captured physical environment through the camera viewport, allowing users to understand the connection between their physical actions and digital responses. This feedback mechanism reduces cognitive burden by making the interaction relationship explicit and intuitive.
Solution Approach 2:
The system automatically captures and processes the physical environment through the camera without requiring explicit user commands for each action. The capture process serves itself by continuously monitoring and processing the environment, reducing the number of manual inputs needed.
2Adaptability or versatility
If multiple input methods are implemented to improve interaction capability, then the system becomes more versatile, but the device complexity and power consumption increase
Solution Approach 1:
The camera viewport serves multiple functions: it displays the captured physical environment for user reference, provides the basis for spatial mapping, and enables interaction guidance. This multi-functionality reduces the need for separate dedicated components for each function, thereby managing power consumption while maintaining versatility.
Solution Approach 2:
The system periodically updates the display and processing based on detected user interactions and environmental changes, rather than continuously processing at maximum capacity. This periodic action maintains interaction capability while significantly reducing average power consumption.
3Loss of information
If detailed visual feedback is provided to help users understand input-device response connection, then interaction clarity improves, but the display requirements and processing load increase
Solution Approach 1:
The system provides detailed visual feedback locally at the camera viewport where the user needs to see the connection between inputs and responses. The feedback is concentrated in the relevant visual field rather than distributed throughout the entire display system, reducing overall processing load while maintaining information clarity.
Data Source
AI summary
Electronic devices provide extended reality experiences. In some embodiments, a media capture user interface is displayed, including a capture guide. In some embodiments, gaze information is used for targeting. In some embodiments, a virtual object is manipulated.