Gaze and Gesture Interaction for Location Information Access
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for presenting location-related information and executing tasks on portable devices are not convenient, as they often require users to manually navigate through apps or emails, and voice commands can be awkward and repetitive.
Innovation Solution
Implementing a system that allows users to present location-related information and execute tasks by gazing at a device, shaking it, or using voice commands, with the option to address devices without mentioning their names, leveraging gaze detection and voice recognition technologies for precise targeting.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If location-related information is transmitted via email or apps, then information delivery is achieved, but user convenience deteriorates due to multiple steps required to access the information
Solution Approach 1:
The system pre-processes and prepares location-related information for delivery before the user actually needs it. When a user enters a location, the system proactively retrieves and prepares relevant information (ads, event materials, class messages, flight info) in advance, so that when the user gazes at the device or shakes it, the information is immediately available for presentation without requiring the user to manually search through emails or apps.
Solution Approach 2:
The patent introduces a gaze detection system and device shaking detection as intermediary mechanisms between the user and the information. Instead of directly accessing emails or apps, the user simply gazes at the device or shakes it, and the system mediates by detecting these actions and automatically presenting the pre-prepared location-related information, eliminating the need for manual navigation through multiple steps.
2Ease of operation
If a device automatically presents information by popping up windows, then information accessibility is improved, but user experience deteriorates due to annoyance
Solution Approach 1:
The system uses gaze detection and device shaking detection as feedback mechanisms to determine when the user actually wants to see information. Instead of automatically popping up windows that may annoy users, the system waits for explicit user feedback through gaze or shaking actions, then presents information only at those moments, ensuring the user wants to see it before displaying it.
Solution Approach 2:
The system empowers the user to control information presentation through natural actions like gazing or shaking the device. The user serves themselves by initiating the information display process through these simple actions, rather than the system imposing information on the user through automatic window popping. This gives the user control and prevents unwanted interruptions.
3Adaptability or versatility
If voice commands are used to execute tasks, then task execution capability is improved, but ease of operation deteriorates due to repetitive and awkward commands
Solution Approach 1:
The patent merges multiple input modalities - voice commands, gaze detection, and device shaking - into a unified interaction system. Instead of relying solely on repetitive voice commands, the system combines them with natural gestures (gazing at the device or shaking it) to create a more versatile and natural interaction method. For example, a user can shake the device to activate voice command mode, or use gaze to select from command options, reducing the need for repetitive verbal repetitions.
Data Source
AI summary
Systems and methods for presenting information and executing a task. In an aspect, when a user gazes at a display of a standby device, location related information is presented. In another aspect, when a user utters a voice command and gazes at a device, a task is executed. In some aspects, device names and/or gestures are detected and utilized for implementing tasks. In some other aspects, a voice input, a gesture, and/or user information is used to determine a user command inside an autonomous vehicle.