Gaze-Controlled Camera Zoom and Direction Adjustment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video capture systems, such as wearable cameras, struggle to automatically adjust zoom and capture direction to focus on objects of interest, especially in dynamic environments like sports events, leading to lower-quality videos and difficulty in tracking fast-moving objects.
Innovation Solution
A system and method for a head-mounted computing device that uses a camera direction control element, such as a MEMS scanning mirror, and a camera zoom control element, such as a liquid lens, to automatically adjust the capture direction and zoom based on the user's detected gaze angle, allowing for real-time adaptation to the user's focus.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If a wearable camera is used to capture video with a large field of view, then the user can see more of the environment, but the user cannot automatically adjust zoom and capture direction to focus on objects of interest
Solution Approach 1:
The camera system performs self-adjustment of capture direction and zoom level by detecting the user's gaze angle and automatically modifying camera parameters, eliminating the need for manual operation while maintaining focus on objects of interest
Solution Approach 2:
The system uses gaze detection to obtain feedback about user attention, then uses this feedback to automatically adjust camera settings, creating a closed-loop control system that adapts to user intent in real-time
2Manufacturing precision
If the user manually adjusts the camera to capture objects of interest, then the video quality improves, but the user's ability to enjoy the event is interfered with
Solution Approach 1:
The camera system autonomously monitors and adjusts capture parameters based on detected gaze patterns, eliminating the need for continuous manual intervention while maintaining high video quality throughout the event
3Speed
If head pose tracking is used to follow the user's head orientation, then the capture direction can be adjusted, but it cannot accurately track fast-moving objects when the user's gaze differs from head direction
Solution Approach 1:
The system replaces mechanical head pose tracking with optical gaze detection, substituting a direct mechanical measurement system with an optical field-based detection method that can more accurately determine user attention direction independent of head orientation
4Device complexity
If the wearable camera maintains a fixed zoom level, then the device complexity is reduced, but the video quality decreases in dynamic environments
Solution Approach 1:
The camera system transitions from a static fixed zoom implementation to a dynamic zoom control mechanism that automatically adjusts focal length based on detected gaze patterns and scene analysis, enabling adaptive optimization of video quality for different viewing scenarios
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables the capture of high-quality videos by automatically adjusting the camera settings to match the user's intended focus, improving the ability to track objects of interest, especially in fast-paced environments, while allowing the user to fully engage with the event.
Implementation Method 1
a camera direction control element, such as a MEMS scanning mirror, to automatically adjust the capture direction
Implementation Method 2
a camera zoom control element, such as a liquid lens, to automatically adjust the zoom
Data Source
AI summary
Systems, methods, and apparatuses are described for causing a camera of a head-mounted computing device to capture a first video, the head-mounted computing device comprising a camera direction control element for controlling a capture direction of the camera, and a camera zoom control element for controlling zoom of the camera. One or more objects in the captured first video may be identified based on a detected gaze angle of a user wearing the head-mounted computing device. A target location in an environment may be determined, and based on such target location, the capture direction and zoom of the camera may be adjusted using the camera direction control element and the camera zoom control element, respectively. The camera may capture, based on the adjusted capture direction and the adjusted zoom of the camera, a second video using the camera of the head-mounted computing device.


