Remote Crane Hook Prediction for Delayed Image Display
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In remote operations of autonomous vehicles, particularly cranes, there are challenges in accurately displaying the position of the crane hook due to delays in image display, difficulty in grasping distance, and potential misjudgment of positional relationships with surrounding objects, which can lead to unpredictable movements and safety hazards.
Innovation Solution
A method that outputs prediction region information based on delay information and the position of moving objects in images, using a remote operation support device to enhance operator support by predicting the likely presence of objects in the image.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If real-time image display is implemented in remote operation, then operational responsiveness is improved, but image processing and transmission delays cause inaccurate position display
Solution Approach 1:
The system performs preliminary calculation of the predicted position based on the moving object's current position and expected displacement during the display delay period. This preliminary action compensates for the inevitable delay between image capture and display, allowing the operator to see the correct future position rather than the past position.
Solution Approach 2:
The system continuously updates the predicted position information based on real-time feedback about the moving object's actual position and movement characteristics. This feedback mechanism ensures that the displayed position remains accurate even as conditions change during the delay period.
2Ease of operation
If operators manually operate cranes based on delayed images, then operational flexibility is maintained, but distance perception and positional relationship judgment become difficult
Solution Approach 1:
The predicted position information acts as an intermediary element between the delayed image and the operator's decision-making process. It bridges the information gap caused by delays, providing the operator with accurate spatial awareness without restricting manual operational flexibility.
Solution Approach 2:
The system uses visual differentiation (such as color changes or highlighting) to indicate the predicted position of moving objects on the displayed image. This visual enhancement helps operators quickly and accurately perceive distance and positional relationships without affecting their manual control capability.
3Device complexity
If crane hook position is displayed with delay, then system simplicity is maintained, but collision risk with surrounding objects increases
Solution Approach 1:
The system calculates and displays the predicted position of the crane hook in advance, before the actual position is captured. This preliminary display allows operators to anticipate the hook's location and take preventive action to avoid collisions with surrounding objects, maintaining system simplicity while improving safety.
Solution Approach 2:
By displaying predicted positions that account for future movements, the system performs preliminary anti-action against potential collisions. The operator can see where the hook will be and preemptively adjust operations to prevent harmful interactions with surrounding objects.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A method of remote control according to the present disclosure includes outputting prediction region information indicating a region, in an image, in which a moving object is predicted to be likely to be present based on delay information indicating a time from when the image is captured to when the image is drawn and a position of the moving object caught in the image.