Gaze-Activated Location Display and Voice Task Execution
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for presenting location-related information and executing tasks on portable devices are not convenient, as they often require users to navigate through multiple steps, such as logging into email or finding specific apps, and relying solely on voice commands can be awkward and unnatural.
Innovation Solution
The system allows users to present location-related information and execute tasks by gazing at a device, shaking it, or using voice commands combined with gaze or gesture inputs, enabling simpler and more natural interactions, such as determining destinations for autonomous vehicles or products for purchase based on user records.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If location-related information is automatically presented on device display, then information delivery effectiveness is improved, but user annoyance increases due to unwanted pop-ups
Solution Approach 1:
The system allows the device to automatically present location-related information without requiring user initiation through email login or app navigation. The device serves itself by detecting user presence and automatically displaying relevant information when the user looks at the device.
Solution Approach 2:
The system changes the display state parameter from always-on or automatic pop-up to conditional display based on detected user gaze. The display remains off or in standby mode until the system detects that the user is looking at the device, at which point it activates to show location-related information.
2Reliability
If multiple interaction steps are required (login, find app, open mail), then system security and control are improved, but operation complexity increases
Solution Approach 1:
The system extracts and removes the unnecessary intermediate steps (email login, app navigation, mail opening) from the information access process. Only the essential function of presenting location-related information is retained, achieved through gaze detection and automatic display activation.
Solution Approach 2:
The system performs preliminary detection of user gaze direction and presence before activating the display. This preliminary action allows the system to prepare and automatically present location-related information before the user would otherwise need to navigate through multiple steps to access it.
3Ease of operation
If voice commands are used for task execution, then hands-free operation is improved, but naturalness decreases due to repetitive device naming
Solution Approach 1:
The system accepts partial voice inputs that do not require complete device naming. Instead of requiring users to repeatedly say the full device name, the system uses gaze detection to identify the target device and accepts simpler voice commands, reducing the excessive action of repeating device names.
Solution Approach 2:
The system introduces gaze detection as an intermediary mechanism between the user and the voice command system. The gaze direction serves as a mediator that identifies which device the user intends to interact with, allowing voice commands to be simpler and more natural without requiring explicit device naming.
Data Source
AI summary
Systems and methods for presenting information and executing a task. In an aspect, when a user gazes at a display of a standby device, location related information is presented. In another aspect, when a user utters a voice command and gazes or gestures at a device, a task is executed. In another aspect, a voice input, a gesture, and user information are used to determine a destination for a trip or a product for a purchase. In another aspect, a voice input and user information are used to determine a destination when a user hails a vehicle.