Wearable Hand-Projected Interface for Message Composition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Wearable multimedia devices face limitations in user interaction due to the small surface area of a user's hand, such as the palm, which restricts the complexity and number of user interfaces that can be projected and interacted with, thereby limiting the applications that rely on these interfaces for input and output.
Innovation Solution
A wearable multimedia device with a projector subsystem that projects a virtual interface onto a user's hand, allowing for intuitive message composition and transmission by separating user input into recipient and content entry followed by application/service selection, using gestures or voice commands detected by cameras and microphones, and presenting available applications based on recipient availability and historical data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a laser projected virtual interface is used on a user's hand, then user interaction capability is improved, but the limited surface area restricts the number and types of interactions
Solution Approach 1:
The virtual interface is segmented into multiple functional zones or regions that can be independently interacted with. This allows complex interfaces to be divided into manageable sections, each serving specific functions, thereby overcoming the limitation of small surface area while maintaining ease of operation.
Solution Approach 2:
The interface utilizes multiple dimensions beyond just the two-dimensional surface area of the hand. This includes temporal dimensions (sequential interactions), spatial layers (overlapping translucent interfaces), and gesture-based depth perception, effectively expanding the interaction capacity without requiring more physical surface area.
2Productivity
If the message composition interface receives application selection input first, then transmission method can be determined, but the user may lose track of message content and make errors
Solution Approach 1:
The interface prepares and displays available application options in advance, but delays the requirement for user selection until after the message content is fully composed. This preliminary preparation of options ensures efficient transmission when the user is ready, while maintaining input accuracy by keeping the user focused on content creation first.
Solution Approach 2:
The system automatically manages the state of message composition and application selection, tracking what has been completed and what remains. This self-service approach reduces cognitive load on the user, preventing them from losing track of their train of thought while ensuring accurate input through systematic progress tracking.
3Extent of automation
If the wearable device performs operations for erroneous user input, then the device responds to user commands, but computational resources are wasted on unnecessary operations
Solution Approach 1:
The system implements feedback mechanisms that allow users to review and confirm their inputs before execution, or to easily cancel and correct erroneous commands. This feedback loop enables the device to respond to user commands while providing opportunities to prevent wasteful operations, balancing automation with resource efficiency.
Solution Approach 2:
The interface incorporates preliminary checks and confirmation steps that prevent erroneous operations from being executed. By implementing anti-action measures before the actual operation occurs, the system maintains high automation for valid commands while avoiding wasteful computational expenditure on erroneous inputs.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enhances user interaction efficiency by reducing errors and resource expenditure, allowing users to focus on message content rather than selection of transmission methods, and optimizing resource usage by minimizing unnecessary operations.
Implementation Method 1
the projector subsystem can project light onto a surface (e.g., a surface of a user's hand, such as the user's palm) according to a particular spatial and/or temporal pattern, such that the user perceives a VI with one or more user interface elements
Implementation Method 2
Three-dimensional (3D) depth sensors (e.g., a time of flight (TOF) camera) can be used to detect user gestures that are interacting with one or more VI elements projected on the surface
Data Source
AI summary
Systems, methods, devices and non-transitory, computer-readable storage mediums are disclosed for a wearable multimedia device and cloud computing platform with an application ecosystem for processing multimedia data captured by the wearable multimedia device. In an embodiment, a wearable multimedia device presents a user interface for composing a message. The device receives a first user input indicating a recipient of the message and first data for inclusion in the message. In response, the device presents at least the recipient and the first data in a first user interface element of the user interface. Further, subsequent to receiving the first user input, the device receives a second user input indicating a selection of a first application or service from a plurality of applications or services presented in a second user interface element of the user interface. Subsequently, the device transmits the message to the recipient using the first application or service.


