Work Machine Operation Simulation Using Archived Work Images
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Operators with little experience in operating work machines lack effective means to gain operational experience by simulating skilled operators' techniques.
Innovation Solution
A work assisting server that accumulates and stores time-series images of work machine operations in a database, allowing operators to simulate and improve their techniques by referencing stored images and performing operations at a virtual work site.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If operators with little experience operate work machines directly in real work environments, then they gain practical operational experience, but they may make operational errors causing safety issues or inefficiency
Solution Approach 1:
The system performs preliminary action by capturing and storing work environment images and operation data before operators need to apply them. Experienced operators' work environments and operations are recorded in advance and stored in a database, allowing inexperienced operators to study and simulate these scenarios beforehand, thereby reducing safety risks during actual operations.
Solution Approach 2:
The system creates copies of real work environments through captured images and operation data. Instead of directly exposing inexperienced operators to real work sites, the system generates virtual copies of work environments that can be stored, replayed, and analyzed, allowing operators to learn from replicated scenarios without real-world risks.
2Ease of operation
If operators simulate operations using stored work environment images, then they can improve operation techniques without real-world risks, but they require access to a comprehensive database of work environments
Solution Approach 1:
The system achieves universality by creating a multi-functional database that stores various types of work environment images and operation data from different work sites, machines, and operators. This comprehensive database serves multiple purposes: training inexperienced operators, analyzing operation techniques, comparing different approaches, and providing reference materials for various operational scenarios.
Solution Approach 2:
The system introduces an intermediary database that mediates between real work environments and operator training. Instead of direct interaction with real work sites, the database acts as an intermediary layer that captures, stores, and provides access to work environment information, enabling safe simulation while preserving the integrity and comprehensiveness of operational data.
3Loss of information
If the system stores comprehensive time-series images of work environments, then operators can perform detailed simulations and analysis, but the data storage and management complexity increases
Solution Approach 1:
The system applies segmentation by dividing work environment data into distinct time-series segments and categories. Captured images and operation data are organized chronologically and by work type, allowing for efficient storage, retrieval, and analysis of specific operational phases without managing the entire dataset as a single complex unit.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A server and so forth are provided that enable an operator to gain experience in operation by a simulation while referring to a situation of an operation of a work machine by the operator himself/herself or another operator. A second operator can designate one time series of work environment images from archives registered in a database 102 through a remote input interface 210. Accordingly, the second operator can browse the time series of the designated work environment images on a remote output interface 220. The second operator can cause the remote output interface 220 to output a time series of simulation images which represent an action manner and an environment changing manner of a work machine at a virtual work site in accordance with a simulation operation manner in a remote operation mechanism 211.