Remote Machine Control via Real-Time Simulation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing remote machine control systems for heavy equipment are limited by high costs and large bandwidth requirements due to the need for multiple cameras and live video feeds, which restrict visibility and operational efficiency, especially in harsh environments.
Innovation Solution
A machine simulation and control system that uses real-time data from various sensors to simulate the worksite and machine operations, providing a user interface with multiple, selectable 3D viewpoints and operational parameters, allowing remote control without the need for extensive live video feeds.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If multiple cameras are mounted on the machine to improve visibility and provide different view angles, then the visual representation quality is improved, but the system cost increases and component life decreases due to harsh environment
Solution Approach 1:
The patent creates a virtual copy of the worksite environment using simulation software that replicates the physical workspace, machine tools, and operational parameters. This virtual model allows the remote operator to view the work environment from multiple angles and perspectives without requiring multiple physical cameras on the machine.
Solution Approach 2:
The patent replaces the mechanical camera system with a computational simulation system. Instead of using multiple physical cameras to capture visual data, the system uses sensors to collect operational data and feeds this into simulation software that generates visual representations of the worksite and machine operations.
2Ease of operation
If live video feed is transmitted in real-time to provide visual representation of the worksite, then the operator can control the machine remotely, but the bandwidth requirement increases and operating cost increases
Solution Approach 1:
The patent transmits data about the virtual copy rather than transmitting actual video feeds. The simulation system processes sensor data locally and sends compressed operational parameters and rendered images of the virtual environment, which require significantly less bandwidth than live video streams from multiple cameras.
Solution Approach 2:
The patent extracts only the essential operational data from the worksite environment using sensors, and uses simulation software to generate the visual representation. This extraction approach sends only necessary data over the network rather than transmitting complete video feeds, reducing bandwidth requirements while maintaining remote control functionality.
3Device complexity
If minimal visual representation is provided showing only machine components, then the system cost is reduced, but the operator cannot properly control engagement with the surrounding environment
Solution Approach 1:
The patent creates a comprehensive virtual copy of the entire worksite environment including the physical workspace, machine tools, and surrounding conditions. This virtual model provides the remote operator with complete environmental awareness and contextual information needed for proper machine control, while keeping the actual hardware minimal.
Solution Approach 2:
The simulation system serves multiple functions simultaneously: it visualizes the worksite environment, displays machine operational status, provides contextual information about surrounding conditions, and enables remote control all through a single integrated system rather than requiring separate systems for each function.
Data Source
AI summary
A simulation and control system for a machine is disclosed. The simulation and control system may have a user interface configured to display a simulated environment. The machine simulation and control system may also have a controller in communication with the user interface and a remotely located machine. The controller may be configured to receive from the machine real-time information related to operation of the machine at a worksite. The controller may also be configured to simulate the worksite, operation of the machine, and movement of a machine tool based on the received information. The controller may further be configured to provide to the user interface the simulated worksite, operation, and movement in the simulated environment.