Remote Work Machine Video Overlay for Visibility-Based Operator Support
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The operability of remote operation devices is compromised when the number of support displays is either excessive or insufficient, as it affects the user's ability to effectively operate a work machine, leading to deteriorated performance.
Innovation Solution
A remote operation device with a visibility determination unit that assesses the work area's visibility and a display determination unit that selectively superimposes appropriate support displays on the video feed from the work machine, enhancing user support without overwhelming the user with excessive information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the number of support displays is increased to provide sufficient user support, then the user support capability is improved, but the video visibility deteriorates
Solution Approach 1:
The system dynamically changes the parameters of support displays (number, position, size, transparency) based on video visibility conditions. When visibility is poor, more or larger support displays are shown; when visibility is good, fewer or smaller support displays are shown, thus adapting the support level to current viewing conditions.
Solution Approach 2:
The support display configuration is made dynamic rather than static. The system continuously monitors video visibility and adjusts the support displays in real-time, allowing the interface to adapt to changing operational conditions and maintain optimal balance between support and visibility.
2Ease of operation
If the number of support displays is increased to improve user support, then the operability is improved, but the device complexity increases
Solution Approach 1:
The system adjusts support display parameters (quantity, position, transparency) based on detected work area visibility and operational context, providing appropriate support information without consistently displaying all possible displays, thus reducing perceived complexity while maintaining operability.
Solution Approach 2:
The system automatically determines which support displays to show based on analysis of video visibility and operational state, eliminating the need for users to manually configure display settings. The interface self-adjusts to provide optimal support without user intervention.
3Illumination intensity
If the number of support displays is decreased to improve video visibility, then the video visibility is improved, but the user support capability deteriorates
Solution Approach 1:
The system dynamically adjusts support display parameters based on real-time video visibility assessment. When visibility is poor, the system compensates by showing more or larger support displays; when visibility is good, it reduces support displays, thus maintaining support capability across varying visibility conditions.
4Productivity
If the number of support displays is decreased to reduce processing load, then the processing efficiency is improved, but the user support capability deteriorates
Solution Approach 1:
The system dynamically adjusts the number and complexity of support displays based on operational context and visibility conditions, processing only the necessary information at each moment rather than continuously processing all possible displays, thus optimizing processing efficiency while maintaining adequate support.
Data Source
AI summary
A remote operation device for enabling a user to remotely operate a work machine includes a visibility determination unit configured to determine visibility of a work area where the work machine is located, a display determination unit configured to determine, based on the visibility of the work area, one or more support displays to be superimposed on a video of the work area captured by the work machine, and a presentation unit configured to present, to the user, the video of the work area on which the one or more support displays are superimposed.