Vehicle Control Input Assistance via Hand-Relative Camera View
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
As the number and complexity of vehicle control inputs increase, operators face difficulty in locating them without distraction, especially in adverse conditions, which can compromise safety.
Innovation Solution
A vehicle operating system that uses a camera to provide a second perspective view of control inputs relative to the operator's hand position, allowing the operator to locate controls without diverting attention from the road, by processing camera signals and displaying a virtual camera view fixed to the forearm or wrist.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If control inputs are positioned within the 20 degree cone to minimize operator distraction, then operator safety is improved, but the operator cannot easily locate and access the control inputs without moving their gaze
Solution Approach 1:
The system creates a virtual copy of the control input area through a camera view displayed on a screen. This virtual representation allows the operator to see and interact with control inputs without physically moving their gaze to the actual controls, resolving the contradiction between safety (maintaining forward gaze) and accessibility (locating controls).
Solution Approach 2:
The camera and display system act as an intermediary between the operator and the physical control inputs. Instead of directly viewing and manipulating controls, the operator interacts with a virtual representation, which mediates the interaction and eliminates the need to shift gaze while maintaining full control accessibility.
2Loss of information
If the camera view is fixed relative to the control input, then the operator can see the control location, but the view does not reflect the operator's hand position making it difficult to locate the specific control to activate
Solution Approach 1:
The system adds a new dimension to the camera view by incorporating depth information through hand detection. Instead of a simple 2D fixed view, the system processes hand position data to dynamically adjust the camera perspective, creating a multi-dimensional view that shows both control location and hand position relationship.
Solution Approach 2:
The system implements feedback by detecting hand position and using that information to adjust the camera view accordingly. The view changes based on hand location, providing real-time feedback that helps the operator understand the relationship between their hand and the control inputs, making it easier to locate and activate specific controls.
3Device complexity
If a fixed camera view is used, then the system complexity is low, but the operator cannot intuitively understand the spatial relationship between their hand and the control input
Solution Approach 1:
The system transitions from a static fixed camera view to a dynamic view that adapts based on hand position. The camera parameters (such as angle, zoom, or perspective) change dynamically as the hand moves, providing an intuitive representation of the hand-control spatial relationship while maintaining relatively simple system architecture.
Data Source
Figure 1
Figure 2~3
Figure 4~5
AI summary
A vehicle operating system that assists a vehicle operator (12) with locating a control input (14) of a vehicle device so as to minimize operator distraction when operating the vehicle device. The system includes a camera (16) having a first perspective view of the control input, a display (22) readily observed by the operator, and a processor (18) configured to process a signal from the camera to determine a hand position of a hand approaching the control input and output a display signal having a second perspective view of the control input that is dependent on the operator's hand position relative to the control input. The second perspective view corresponds to that of a virtual camera attached to the operator's forearm or wrist, and so provides a perspective view that is substantially fixed relative to the hand.