Interactive Element Identification for Indirect Input Devices
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional electronic devices without cursor indications or traditional input modes, such as those using voice commands, air actions, or optical inputs, struggle to recognize and interact with interactive content like clickable links or dynamic media, as they lack visual cues for determining interactive elements.
Innovation Solution
A system that identifies interactive elements on traditional devices by tracking user interactions on cursor-based devices and storing them in a data store, then uses similarity measures to determine interactive elements on non-traditional devices, providing selectable options like vocal clues or visual feedback for indirect input devices to enable interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If cursor indications and traditional input modes are used to identify interactive content, then ease of operation is improved, but adaptability to non-traditional devices deteriorates
Solution Approach 1:
The system creates a data store containing copies of interactive content elements identified from traditional cursor-based devices. These copies preserve the interactive properties and metadata of the original elements, enabling non-traditional devices to access and interact with the same content without requiring cursor indications or traditional input modes.
Solution Approach 2:
The system introduces an intermediary processing layer that receives content from traditional devices, identifies interactive elements, stores them in a data store, and retrieves them for non-traditional devices. This intermediary mechanism enables communication and interaction between devices with different input modalities without requiring direct compatibility.
2Ease of operation
If visual cues like colored text or cursor actions are used to indicate interactive content, then ease of operation is improved, but adaptability to indirect input devices deteriorates
Solution Approach 1:
The system creates copies of interactive content elements with preserved metadata indicating their interactive nature. These copies are stored in a data store and can be retrieved by indirect input devices, which then provide alternative visual feedback mechanisms such as highlighting or annotations to indicate interactive elements, replacing the need for traditional cursor-based visual cues.
Solution Approach 2:
The system changes the parameters of visual feedback by storing and retrieving interactive element properties in a device-agnostic format. This allows the same interactive content to be presented with different visual indicators suitable for different device types, including indirect input devices that rely on alternative visual feedback mechanisms rather than traditional cursor-based indication.
3Ease of operation
If rich media with different colors and highlights is used for interactive content, then ease of operation is improved, but reliability of interaction recognition deteriorates
Solution Approach 1:
The system creates structured copies of interactive content elements that preserve not only the visual properties like colors and highlights but also the underlying interactive metadata. This structured copying ensures that the interactive nature of elements is reliably identified and maintained across different device types, preventing misinterpretation of rich media elements.
Solution Approach 2:
The system implements a feedback mechanism where interactive content elements are identified, stored with their properties in a data store, and then retrieved with confirmation of their interactive status. This feedback loop ensures that the system can reliably determine which elements are interactive and provide appropriate visual indicators, maintaining interaction accuracy even with rich media content.
Data Source
AI summary
A system configured to determine interactive elements for non-traditional computing devices is disclosed. The system receives a portion of a webpage with a first interactive element and an element identifier. The system determines that a threshold number of interactive actions are associated with a second interactive element in a data store. The threshold number of interactive actions indicates that the second interactive element is selectable to perform an action in response to an interaction by a user. The system determines that the first interactive element is similar to the second interactive element by a similarity measure. The system provides to a computer, a selectable option associated with the element identifier of the first interactive element. The selectable option is for selection by an indirect input to the computer and for causing the action associated with the first interactive element upon the selection of the selectable option.