Aerial Searchlight Control via Gaze Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current searchlight control systems for aerial vehicles are cumbersome, limiting the degree of freedom of movement and increasing the workload for operators during night search and rescue operations, which can hinder the effectiveness of search missions.
Innovation Solution
A searchlight control system that utilizes multimodal interactions, including a head-mounted display for augmented/virtual reality, gaze tracking, and voice recognition, to provide intuitive control of searchlights, allowing greater freedom of movement and reducing operator workload.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If traditional hand grip controllers and searchlight control panels are used, then searchlight control function is achieved, but operator workload increases and degree of freedom of movement is limited
Solution Approach 1:
The patent replaces mechanical control interfaces (hand grip controllers, control panels) with optical and neural interfaces. The system uses camera images to detect operator gaze direction and head movements, converting optical signals into searchlight control commands. This substitution eliminates the need for physical control devices, thereby reducing operator workload and increasing freedom of movement while maintaining searchlight control functionality.
Solution Approach 2:
The patent introduces an intermediary processing system that includes image processing units and gaze tracking modules. This intermediary layer captures camera images, processes them to determine gaze direction and head movements, and translates these into searchlight control instructions. The intermediary system acts as a bridge between the operator's natural behaviors and the searchlight control functions, eliminating the need for direct mechanical interaction.
2Adaptability or versatility
If multiple control interfaces are provided, then searchlight control functionality is enhanced, but operator attention is divided and workload increases
Solution Approach 1:
The patent creates a universal control system where a single gaze tracking interface can control multiple searchlight functions including beam direction, intensity, and focus. The system determines various searchlight control parameters based on gaze direction and head movements, allowing one interface to perform multiple control roles. This multi-functionality maintains adaptability while reducing the number of separate control devices needed, thereby decreasing operator workload.
Solution Approach 2:
The system enables self-service control where the searchlight automatically adjusts its parameters based on the operator's gaze direction and head movements. The gaze tracking system continuously monitors operator behavior and autonomously translates it into appropriate searchlight control actions without requiring manual intervention. This self-service mechanism reduces operational complexity and workload while maintaining full control versatility.
3Measurement precision
If hand grip controllers are used for searchlight control, then control precision is achieved, but operator mobility is restricted
Solution Approach 1:
The patent substitutes mechanical hand grip controllers with optical gaze tracking and head movement detection. The system uses camera images to precisely determine gaze direction and head position, converting these optical measurements into accurate searchlight control commands. This substitution maintains control precision while completely eliminating the physical constraints imposed by hand grip controllers, thereby enhancing operator mobility and freedom of movement.
Solution Approach 2:
The patent transitions from three-dimensional mechanical control (hand grip controllers with multiple axes) to two-dimensional optical measurement (gaze direction and head movement in visual field). The system captures gaze direction as angular data and head movements as positional data, converting spatial control into dimensional data processing. This dimensional change maintains precision while removing physical mobility constraints.
Data Source
Figure 1
Figure 2
AI summary
Systems and methods described herein provide one or more processors configured to execute program instructions to cause the one or more processors to receive camera images of a scene including a portion being lit by the searchlight, receive terrain data from a terrain database, generate an augmented/virtual reality scene based on the camera images and the terrain data, display, via a headset display, the augmented/virtual reality scene, track gaze and head movement using headset sensors, output tracking data based on tracked gaze and head movement, and output instructions for controlling at least one function of the searchlight based on the tracking data.