Remote Machine Control via Predicted Virtual Position Display
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Remote control of machines in harsh or remote environments faces challenges due to time delays in video data transmission, leading to synchronization issues between the operator's visual display and the machine's actual movements, and the inability to predict the machine's position during communication link losses.
Innovation Solution
A system that generates a virtual image of the machine's predicted position based on its actual position, operating parameters, and time delay, allowing operators to control machines more accurately by displaying both the actual and predicted positions on a remote control console.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If video data is transmitted in real-time from the machine to the remote control console, then the operator can observe the machine's current position, but time delays and communication link losses cause the displayed position to become outdated and inaccurate
Solution Approach 1:
The system performs preliminary action by predicting the machine's future position based on current position, operating parameters, and historical movement patterns. This prediction is displayed to the operator before the actual position update arrives, allowing the operator to see where the machine will be rather than where it was, thereby compensating for transmission delays and maintaining position accuracy perception.
Solution Approach 2:
The system creates a virtual copy of the machine's position display that can be independently manipulated and updated. This virtual position copy is generated through prediction algorithms and can be updated without waiting for actual position data transmission, allowing the display to remain synchronized with the operator's control actions even during communication delays.
2Loss of energy
If the operator controls the machine based on outdated video data, then communication bandwidth requirements are reduced, but the operator's ability to accurately control machine movements deteriorates
Solution Approach 1:
The system performs preliminary position prediction using the machine's current state and historical data, generating predicted position information in advance. This allows the display to show meaningful position information even when actual position updates are delayed or lost, maintaining control accuracy without requiring continuous high-bandwidth communication.
Solution Approach 2:
The system implements feedback by continuously comparing predicted position with actual position data when available, and using this comparison to refine future predictions. This feedback mechanism ensures that the virtual position display remains accurate and responsive to the operator's control inputs, maintaining ease of operation with reduced communication requirements.
3Productivity
If bandwidth reduction techniques are used to compress video information, then data transmission efficiency improves, but the system still experiences lag and cannot account for machine operation during communication outages
Solution Approach 1:
The system performs preliminary action by calculating and storing predicted position trajectories based on current operating parameters and historical movement patterns. When communication outages occur, these pre-calculated predictions can be displayed without requiring real-time data transmission, ensuring control continuity and reliability during outages while maintaining high data transmission efficiency during normal operation.
Solution Approach 2:
The system implements beforehand cushioning by maintaining a buffer of predicted position information that can be displayed during communication outages. This buffer acts as a cushion that prevents complete loss of display functionality during outages, ensuring that the operator can continue to control the machine with reasonable accuracy even when real-time data transmission is interrupted.
Data Source
AI summary
Systems and methods for remotely controlling machines includes generating, on a display device associated with a remote control console, a first image associated with a position of the machine at a first time period. A virtual position of the machine is estimated based at least on the first position and at least one operating parameter associated with the machine. A virtual image of the machine relative to the first image is generated on the display device, the virtual image of the machine corresponding to the estimated virtual position of the machine.