Smart Glass Camera View Alignment Using Eye Tracking Feedback

Solution Overview

Problem

Existing wearable devices with cameras often capture images and videos that do not align with the user's field of view due to inconsistent camera angles, requiring manual adjustments that may not be feasible without a display or user attention.

Innovation Solution

Employing eye tracking and gesture recognition to identify the user's region of interest, providing non-invasive feedback through haptic actuators and voice signals to align the camera field of view with the user's intended focus.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a display is provided to show camera field of view for manual adjustment, then alignment accuracy is improved, but device complexity and user attention requirements increase

Engineering Contradiction:

Improvealignment accuracyVSAvoiddevice complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The system automatically detects the user's region of interest using eye tracking and gesture recognition, and autonomously adjusts the camera field of view without requiring manual user input or display feedback. The smart glass performs the alignment function itself by processing user gaze and hand gestures to determine the region of interest, then automatically repositioning the camera to capture that region.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The patent replaces the mechanical display-based feedback system with automated optical and computational systems. Instead of using a display to show camera field of view and requiring manual adjustment, the system uses eye tracking to detect gaze direction, gesture recognition to identify region of interest, and automated camera control to adjust the field of view, substituting mechanical user interaction with automated sensing and actuation.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If manual adjustment of camera position is required, then alignment accuracy is improved, but ease of operation deteriorates

Engineering Contradiction:

Improvealignment accuracyVSAvoidease of operation

Core Design Contradiction:

Measurement precisionVSEase of operation

Solution Approach 1:

The system automatically detects the user's region of interest using eye tracking and gesture recognition, and autonomously adjusts the camera field of view without requiring manual user input or display feedback. The smart glass performs the alignment function itself by processing user gaze and hand gestures to determine the region of interest, then automatically repositioning the camera to capture that region.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The system provides feedback to the user through haptic actuators and voice signals to indicate alignment status and guide the user's region of interest selection. This feedback mechanism helps the user understand the system's perception of their intent and confirms when the camera field of view is properly aligned with the region of interest.

Inventive Principle:

Principle #23Feedback

3Measurement precision

If display real estate is used for hardware adjustments, then alignment accuracy is improved, but user enjoyment is reduced

Engineering Contradiction:

Improvealignment accuracyVSAvoiduser enjoyment

Core Design Contradiction:

Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The system automatically detects the user's region of interest using eye tracking and gesture recognition, and autonomously adjusts the camera field of view without requiring manual user input or display feedback. The smart glass performs the alignment function itself by processing user gaze and hand gestures to determine the region of interest, then automatically repositioning the camera to capture that region.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The patent replaces the mechanical display-based feedback system with automated optical and computational systems. Instead of using a display to show camera field of view and requiring manual adjustment, the system uses eye tracking to detect gaze direction, gesture recognition to identify region of interest, and automated camera control to adjust the field of view, substituting mechanical user interaction with automated sensing and actuation.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS12501150B2User interface to select field of view of a camera in a smart glass

Publication Date: 2025.12.16 META PLATFORMS TECHNOLOGIES LLC

AI summary

A wearable device for use in immersive reality applications is provided. The wearable device has a frame including an eyepiece to provide a forward-image to a user, a first forward-looking camera mounted on the frame, the first forward-looking camera having a field of view within the forward-image, a sensor configured to receive a command from the user, the command indicative of a region of interest within the field of view, and an interface device to indicate to the user that a field of view of the first forward-looking camera is aligned with the region of interest. Methods of use of the device, a memory storing instructions and a processor to execute the instructions to cause the device to perform the methods of use, are also provided.