Remote Machine Control With Context-Aware Projected Operator Feedback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Operators of remotely controlled work machines, such as demolition robots, face distractions and challenges in assimilating information while controlling the machine, needing improved focus on the task and reduced distractions to ensure safe and efficient operation.
Innovation Solution
A context-sensitive control system that projects operator-supporting information visually within the operator's field of vision, using location sensors and projection technology to provide contextual feedback based on the operator's position and the work machine's status, allowing the operator to maintain focus on the machine without needing to switch attention between the work machine and the remote control interface.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If the operator monitors multiple pilot lights, gauges and indicators on the remote control interface, then the operator receives comprehensive machine status information, but the operator becomes distracted and loses focus on the work machine
Solution Approach 1:
The patent introduces a camera as an intermediary device that captures visual information from the work machine and transmits it to the operator's remote control unit. This intermediary system allows the operator to see the machine's operational status, arm position, and work area through video feed, replacing the need to monitor multiple physical indicators and gauges on the control panel. The camera acts as a mediator between the machine's actual state and the operator's perception, maintaining comprehensive information transfer while eliminating visual distractions from the control interface.
2Loss of information
If the operator switches attention between the work machine and the remote control interface, then the operator can monitor both the machine and control indicators, but the operator's focus on the work task is reduced
Solution Approach 1:
The patent merges the control interface information with the visual field of the work machine by superimposing control data, status indicators, and machine parameters directly onto the video feed displayed on the remote control unit. This merging allows the operator to see both the work machine and all necessary control information simultaneously in a single visual display, eliminating the need to switch attention between separate sources. The control information is integrated into the operator's primary visual focus area.
3Loss of information
If multiple indicators and gauges are provided on the remote control unit, then comprehensive feedback is given to the operator, but the interface complexity and distractions increase
Solution Approach 1:
The patent applies local quality by selectively displaying different types of information in different regions or layers of the video feed based on operational context. Critical safety information and active warnings are displayed with higher prominence in specific zones of the display, while routine status information is shown in less prominent areas. The system dynamically adjusts which information is displayed where based on the current operational state, providing comprehensive feedback without uniformly cluttering the entire interface.
Data Source
AI summary
The invention relates to a context-sensitive control system, comprising a work machine controllable by remote control, a remote control unit with an operator interface which enables an operator walking next to the work machine to control the work machine via operator commands, a projection means enabling projection of information for the operator; a communicator configured to receive context-sensitive information in response to signal data from transducers and sensors of the work machine and to communicate the information to the projection means configured to project context-sensitive information onto a projection surface in such a way that the information becomes visually visible to the operator.