Voice-Controlled XR Window Layout for 3D Display Organization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Managing multiple application windows on wearable devices, such as XR devices, becomes challenging as they are added, leading to difficulties in organizing and interacting with the displayed content effectively.
Innovation Solution
The wearable device utilizes voice input to identify user intent and rearrange application windows based on natural language processing, gaze detection, and historical preferences, allowing for intuitive management of virtual objects in a three-dimensional space.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If multiple application windows are added to the display, then the functionality and productivity of the XR device are improved, but the difficulty of organizing and interacting with the displayed content increases
Solution Approach 1:
The patent replaces manual mechanical interaction (dragging, dropping, resizing with hands or controllers) with voice-based acoustic control. Users can rearrange windows by speaking commands like 'move window A to position B' or 'resize window C', eliminating the need for precise manual manipulation in three-dimensional space and simplifying the organization process as windows are added.
Solution Approach 2:
The patent introduces voice commands as an intermediary between the user and the window management system. Instead of directly manipulating windows with hands or controllers, users speak natural language instructions that are processed by the system, which then executes the appropriate rearrangement actions. This intermediary layer simplifies the interaction model and makes window management more intuitive.
2Measurement precision
If manual methods are used to rearrange application windows in three-dimensional space, then precise control over window position and size is achieved, but the time and effort required for organization increases
Solution Approach 1:
The patent replaces time-consuming manual dragging and dropping operations with rapid voice command execution. A single spoken instruction can move a window to its desired position and resize it simultaneously, reducing the time required from multiple manual adjustments to a single verbal action. The system interprets voice commands and executes precise positioning and sizing operations automatically.
Solution Approach 2:
The system uses gaze detection to identify which window the user is looking at, pre-selecting it before the voice command is fully processed. This preliminary identification of the target window reduces the time required for command execution, as the system already knows which window to manipulate when the voice instruction is received, eliminating the need for additional selection steps.
3Productivity
If application windows are densely packed on the display, then the productivity and information density are improved, but the visibility and accessibility of individual windows decrease
Solution Approach 1:
The patent implements dynamic window management where window sizes, positions, and visibility are automatically adjusted based on user interactions and system state. When windows are added or rearranged via voice commands, the system dynamically recalculates optimal layouts to maintain appropriate spacing and visibility, preventing permanent overcrowding while maximizing information density. This dynamic adjustment ensures that windows remain accessible without sacrificing productivity.
Data Source
AI summary
According to at least one implementation, a method includes receiving voice input from a user of a device and determining that the voice input satisfies at least one criterion associated with a first configuration of virtual objects on a display of the device. The method further includes changing the first configuration of the virtual objects to a second configuration of the virtual objects in response to the voice input satisfying the at least one criterion.