Remote Machine Control Interface With Orientation and Depth Cues
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Remote operators of industrial machines face challenges in sensing the machine's orientation and position relative to its environment, as video feeds often fail to convey depth or relative position effectively, leading to reduced awareness and precision in operation.
Innovation Solution
A remote operation system that displays video feeds from cameras of industrial machines alongside a dynamically updated control interface, aligned with the machine's components, using telematics data from sensors to provide indicators for orientation, motion, and position, enhancing the operator's awareness and precision.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If video feeds are used for remote operation, then the operator can see the machine's surroundings, but the operator cannot accurately perceive the machine's orientation and depth
Solution Approach 1:
The patent introduces an augmented reality interface that acts as an intermediary between the video feed and the operator. This interface overlays graphical indicators (such as orientation markers, depth cues, and position indicators) directly onto the video feed, providing the missing orientation and depth information without replacing the visual feed itself. The intermediary layer enriches the information content while maintaining the natural visual context.
Solution Approach 2:
The patent adds dimensional information to the two-dimensional video feed by incorporating augmented reality elements that represent three-dimensional spatial relationships. Orientation indicators show angular relationships, depth markers indicate distance, and positional overlays provide spatial context, effectively adding depth and orientation dimensions to the flat video image to compensate for the operator's reduced spatial awareness.
2Loss of information
If traditional instrument panels are used, then the operator receives machine status data, but the operator lacks situational awareness of the machine's position in the environment
Solution Approach 1:
The patent merges the instrument panel data with the video feed by overlaying machine status indicators, orientation markers, and position information directly onto the visual field. This integration combines the detailed machine status data from traditional instruments with the environmental context from the video feed, creating a unified display that provides both situational awareness and operational data simultaneously.
Solution Approach 2:
The patent transforms two-dimensional instrument panel data into spatially contextualized information by positioning graphical indicators at their corresponding locations within the video feed. Orientation data is displayed as angular markers relative to the machine's position, and position information is overlaid at the appropriate spatial coordinates, giving the operator intuitive spatial understanding of machine status within the environmental context.
3Device complexity
If video feeds alone are provided, then the system remains simple, but the operator's precision and safety are reduced
Solution Approach 1:
The patent applies partial augmentation by selectively overlaying only the most critical orientation and position indicators onto the video feed, rather than providing complete machine status data. This partial action approach adds essential safety-critical information (orientation markers, depth cues, position indicators) while keeping the interface relatively simple and avoiding information overload, thus improving reliability without excessive complexity.
Data Source
AI summary
The present technology is directed generally to industrial machine remote operation systems, devices, and methods. In some embodiments, an industrial machine remote operation system configured in accordance with embodiments of the present technology includes a control interface including one or more elements associated with remote operation of an industrial machine. In at least some embodiments, the control interface can include one or more indicators associated with motion and/or an orientation of the machine. Additionally, or alternatively, the control interface can include one or more indicators associated with motion and/or orientation of a component of the machine, such as a machine work tool.