Forklift Remote Operation Display With Command and Action Overlay
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current remote operation systems for forklifts lack sufficient information display for operators, limiting their ability to perform efficient remote operations as they do not provide comprehensive instrument information related to the forklift's movement.
Innovation Solution
A remote operation system that includes an image capturing device at the forklift, a head-mounted image display device for the operator, a command reception device, and a synthesized remote image generation device, which combines command and action state information into a single image displayed to the operator, enhancing their visibility and control.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If a remote operation system displays only remote images on a head-mounted device, then the operator can view the forklift environment, but the operator lacks comprehensive instrument information for effective remote operation
Solution Approach 1:
The patent merges the remote image display function with the instrument information display function into a single integrated head-mounted display system. The synthesized remote image combines both the live camera feed from the forklift and overlaid instrument data (speed, direction, operational status), allowing the operator to access both environmental awareness and vehicle status information simultaneously without requiring separate display devices.
2Reliability
If the system provides comprehensive instrument information to the operator, then the operator gains better control awareness, but the information display becomes complex and overwhelming
Solution Approach 1:
The patent applies local quality by selectively displaying different types of instrument information in specific regions of the synthesized remote image. Critical information such as speed and directional indicators are positioned in locations that do not obstruct the operator's view of the forklift environment, while less critical information is displayed in peripheral areas. This spatial differentiation ensures that important data is easily accessible without creating visual clutter.
3Loss of information
If the system integrates command and action state information into the remote image, then the operator receives abundant information, but the image processing complexity increases
Solution Approach 1:
The system performs preliminary action by pre-processing and organizing command and action state information before integrating it into the synthesized remote image. The control unit retrieves relevant instrument data from the forklift's control system, formats and structures this information in advance, and then overlays it onto the remote image. This pre-organization of data reduces the computational complexity of the final synthesis process and ensures that information is presented in a consistent, easily interpretable format.
Data Source
Figure 1~2
Figure 3
Figure 4
AI summary
A remote operation system (1) includes: an image capturing device (20), provided at a forklift (F); a head-mounted type image display device (10), mounted to a head of an operator (O); a command reception device (11), receiving a remote operation command by the operator (O); and a synthesized remote image generation device (12A), obtaining a content of the remote operation command received by the command reception device (11), an action state of the forklift (F) acting according to the remote operation command, and a remote image captured by the image capturing device (20), and generating a synthesized remote image by synthesizing a command display image indicating the content of the remote operation command and an action display image indicating the action state of the forklift (F) into the remote image. The head-mounted type image display device (10) displays the generated synthesized remote image before eyes of the operator (O).