Remote Avionics Display Gesture Recognition via Local Context
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Remote display units connected to cockpit-based flight deck display systems struggle with gesture recognition due to lack of window context information, leading to latency and delayed reaction times.
Innovation Solution
A remote avionics display device that includes a communications interface to receive pixel data from a source graphics generator, a touch-sensitive display surface for user interaction, and a touch controller that correlates contact points with preloaded or dynamically received window context data to identify potential gestures and send them to the source device for processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the remote display unit relies on the source graphics generator for gesture recognition, then the system can function with existing hardware, but latency increases and reaction time is delayed
Solution Approach 1:
The patent applies preliminary action by preloading window context data into the remote display unit's memory before use. This allows the remote unit to immediately have access to the information needed for gesture recognition without needing to request it from the source graphics generator at the moment of interaction, thereby reducing latency while maintaining accurate gesture recognition.
2Ease of operation
If the remote display unit has no window context data, then the hardware remains simple, but the unit cannot effectively interpret touch point data
Solution Approach 1:
The patent preloads window context data into the remote display unit's memory before use. This allows the remote unit to immediately have access to the information needed for gesture recognition without needing to request it from the source graphics generator at the moment of interaction, thereby reducing latency while maintaining accurate gesture recognition.
3Loss of time
If the remote display unit processes gestures locally with window context data, then reaction time improves, but the device requires additional memory and processing capability
Solution Approach 1:
The patent preloads window context data into the remote display unit's memory before use. This allows the remote unit to immediately have access to the information needed for gesture recognition without needing to request it from the source graphics generator at the moment of interaction, thereby reducing latency while maintaining accurate gesture recognition.
Data Source
AI summary
A remote avionics display device connected to a source graphics generator device receives image data from the source device and presents an avionics display via a touch-sensitive display surface. The avionics display includes a set of display windows, each display window having a size and function defined by window context data. Touch sensors detect user contact points on the display surface. The remote ADD translates the sensed contact points into potential command/control gestures by correlating the contact points with window context data to determine which display window each contact is located and to which gesture each contact or set of contacts corresponds based on the window context data and current touch data structures for the appropriate display window. The remote ADD sends sensed contact points and the corresponding potential gesture data back to the source graphics generator.