Forklift Remote Operation Display With Command and State Overlay
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing remote operation systems for forklifts lack sufficient information display for operators performing remote operations, as they rely solely on remote images without providing instrument information related to the forklift's movement.
Innovation Solution
A remote operation system that includes an image capturing device on the forklift, a head-mounted image display device for the operator, a command reception device, and a synthesized remote image generation device. This system generates a synthesized remote image by combining command display images and action display images with the remote image captured by the forklift's image capturing device, allowing the operator to view essential operation information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If only remote image is displayed on head-mounted type image display device, then device complexity is reduced, but information completeness deteriorates
Solution Approach 1:
The patent merges the remote image from the image capturing device with command display images and action display images to create a synthesized remote image. This combination integrates multiple information sources (remote view, command status, forklift state) into a single composite image that is displayed on the head-mounted device, thereby providing complete instrument information without requiring separate display devices.
Solution Approach 2:
The patent overlays command display images and action display images onto the remote image in a layered composition. The command display image shows operation commands and their status, while the action display image shows forklift action states, both integrated into the spatial context of the remote image. This multi-layered approach provides comprehensive information within the same visual field.
2Reliability
If comprehensive information is provided to operator, then operational safety is improved, but ease of operation deteriorates
Solution Approach 1:
The synthesized remote image is segmented into distinct functional regions: the remote image portion showing the environment, the command display image portion showing operation commands and their receipt status, and the action display image portion showing forklift action states. Each segment serves a specific informational purpose, allowing the operator to quickly locate and interpret different types of information without overwhelming visual clutter.
Solution Approach 2:
The command display image provides visual feedback to the operator about which commands have been received and executed by the forklift. The action display image provides feedback about the current state of forklift actions. This feedback mechanism enhances operational safety by confirming command execution while maintaining ease of operation through intuitive visual indicators.
3Loss of information
If multiple images are synthesized and displayed, then information completeness is improved, but loss of time deteriorates
Solution Approach 1:
The command display image and action display image are generated and prepared in advance based on received commands and forklift state data, before being synthesized with the remote image. This preliminary preparation of information layers reduces the processing time required during actual operation, as the individual components are already formatted and ready for composition.
Data Source
AI summary
A remote operation system 1 includes: an image capturing device 20, provided at a forklift F; a head-mounted type image display device 10, mounted to a head of an operator O; a command reception device 11, receiving a remote operation command by the operator O; and a synthesized remote image generation device 12A, obtaining a content of the remote operation command received by the command reception device 11, an action state of the forklift F acting according to the remote operation command, and a remote image captured by the image capturing device 20, and generating a synthesized remote image by synthesizing a command display image indicating the content of the remote operation command and an action display image indicating the action state of the forklift F into the remote image. The head-mounted type image display device 10 displays the generated synthesized remote image before eyes of the operator O.