Wearable Computer Eye Tracking Proactive Assistance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional personal computers and digital assistants lack the ability to see what a user is looking at, limiting their proactive assistance capabilities, as they rely on user input rather than real-time visual feedback, and existing attempts at natural user interfaces have not adequately addressed this visual aspect.
Innovation Solution
A wearable computer system with a Smartcamera that uses eye tracking to capture and follow the user's visual attention, allowing interaction through eye and hand gestures, voice, and providing feedback, enabling the device to anticipate user needs and offer assistance proactively.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a personal assistant uses traditional input methods (keyboard, mouse, voice), then it can process user commands, but it cannot see what the user is looking at, limiting proactive assistance capabilities
Solution Approach 1:
The patent combines multiple sensing modalities (eye tracking camera, head tracking sensors, voice recognition) into a unified personal assistant system. The eye tracking camera captures the user's visual attention, head tracking sensors monitor head orientation, and voice recognition processes verbal commands, merging these inputs to create a comprehensive understanding of user intent and enable proactive assistance.
Solution Approach 2:
The patent introduces an intermediary processing layer that receives raw data from eye tracking cameras, head tracking sensors, and voice recognition systems, then processes and integrates this information to determine user attention and intent. This intermediary layer translates physical eye movements and head orientations into meaningful contextual information for the personal assistant.
2Loss of information
If a wearable computer captures the user's field of view continuously, then it can record what the user sees, but it requires the user to split attention between the recording process and enjoying the experience
Solution Approach 1:
The wearable computer performs self-service by automatically capturing and processing visual information without requiring user intervention. The system autonomously monitors eye movements, adjusts recording parameters, and manages data storage, freeing the user from needing to consciously control the recording process while still capturing the full visual experience.
Solution Approach 2:
The system performs preliminary actions by pre-processing visual data in real-time, pre-selecting relevant frames based on eye gaze detection, and pre-organizing captured content before the user needs to review it. This preliminary processing reduces the cognitive load on the user by having the system prepare and organize content in advance.
Data Source
AI summary
An embodiment of a Wearable Computer with Natural User Interface apparatus includes a first portable unit for data gathering and communicating feedback and a second portable unit for processing the at least gathered data from the first unit. The first portable unit includes an eyeglass frame, at least one first optical unit disposed on the eyeglass frame for capturing at least one scene image corresponding to a field of view of a user, at least one second optical unit disposed on the eyeglass frame for capturing at least one eye image corresponding to at least a portion of at least one eye of the user, at least one microphone to allow the user to communicate via voice, at least one speaker to allow the user to receive feedback via voice, at least one visible light source to allow the user to receive feedback via light signals, at least one motion sensor to monitor the head movements of the user, and at least one first processor to at least receive data from the data gathering units in the first portable unit and at least manage the communication with the second portable unit. The second portable unit is in communication with the first portable unit and includes at least one second processor configured for receiving the at least data from the first processor and decoding a pre-defined command from the user and executing at least one command in response to the received command. At least one of the processors will determine a direction within the field of view to which the at least one eye is directed based upon the at least a history of one eye image, and generates a command or a subset of the at least one scene image based on the determined direction. At least one of the processors will provide a feedback to the user to acknowledge the user command received. In one embodiment, the Wearable Computer will function as a driver assistant and in another embodiment as a cameraman.