Optical Flow Based Head-Mounted Display Activity Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Computing devices struggle to adapt user interfaces dynamically based on the user's activity, such as operating a vehicle, without obstructing the field of view or causing distractions, as existing systems lack effective methods to determine and respond to the user's activity in real-time.
Innovation Solution
A computing device equipped with an interface that receives image data to determine optical flow, identifying activities like vehicle operation, and adjusts the display settings accordingly, such as minimizing the user interface, sending calls to voicemail, and disabling text messages, to ensure safe and distraction-free operation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If the user interface is displayed prominently on the HMD, then the user can access information and interact with the device, but the user's field of view is obstructed and distractions increase during vehicle operation
Solution Approach 1:
The user interface dynamically adapts its display characteristics based on detected optical flow patterns. When vehicle operation is detected through specific optical flow analysis, the system automatically modifies UI behavior (minimizing display, redirecting notifications) without requiring manual user intervention, thus resolving the contradiction between information accessibility and distraction reduction
Solution Approach 2:
The system continuously analyzes optical flow from the imaging device and uses this feedback to adjust UI display parameters in real-time. The optical flow analysis provides feedback about the user's activity state, which triggers appropriate UI adaptations to balance information delivery with safety considerations
2Adaptability or versatility
If the HMD displays comprehensive user interface information, then the device functionality is fully accessible, but user safety is compromised during vehicle operation due to increased distractions
Solution Approach 1:
The system performs preliminary optical flow analysis to detect vehicle operation conditions before critical safety issues arise. By continuously monitoring optical flow patterns that indicate vehicle operation, the system proactively adjusts UI behavior in advance, maintaining both functionality and safety through anticipatory adaptation
Solution Approach 2:
The system changes key parameters of the user interface (display visibility, notification routing, interaction modes) based on optical flow-derived activity detection. When vehicle operation is detected, parameters such as UI opacity, notification delivery timing, and interaction responsiveness are automatically adjusted to prioritize user safety while preserving essential device functionality
3Adaptability or versatility
If the system provides real-time activity recognition, then the user interface can adapt dynamically, but the computational processing requirements and system complexity increase
Solution Approach 1:
The system extracts only the essential optical flow features needed for activity recognition (such as motion patterns indicative of vehicle operation) rather than processing complete image data. This extraction approach enables real-time activity recognition with reduced computational complexity by focusing on discriminative motion characteristics
Solution Approach 2:
The system replaces complex full-image-processing mechanisms with optimized optical flow analysis algorithms that are computationally more efficient. By substituting traditional computer vision approaches with optical flow-based activity recognition, the system achieves real-time adaptability with lower processing requirements
Data Source
AI summary
A computing device includes an interface configured to receive image data that is indicative of a field-of-view (FOV) that is associated with a head-mountable display (HMD). The computing device also includes a computing system configured to determine optical flow from the image data and to determine, based on the optical flow, whether or not the HMD is associated with operation of a vehicle. Further, the computing device is configured to control the HMD to display information in a first mode, if the HMD is associated with the operation of the vehicle, and to control the HMD to display information in a second mode, if the HMD is not associated with the operation of the vehicle.