Autonomous Vehicle Gesture Recognition for Port Worker Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In port logistics, the transition to autonomous vehicles poses challenges in remote control and monitoring due to the absence of a driver, making it difficult to manage and coordinate operations effectively, especially when issues arise, potentially leading to port shutdowns.
Innovation Solution
An apparatus and method utilizing an infrared camera module, light sensing module, and gesture analyzer to interpret hand signals from a worker, allowing for real-time control of autonomous vehicles through a display system, enabling commands like stopping, driving, or changing movement paths.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If autonomous driving technology is introduced to replace workers in yards, then productivity and safety are improved, but the ability to handle unexpected issues and adapt to real-time situations deteriorates
Solution Approach 1:
A worker wearing a light rod acts as an intermediary between the control center and the autonomous vehicle. The worker can visually signal the vehicle using the light rod (different colors indicate different commands), providing real-time adaptability while maintaining autonomous operation. This resolves the contradiction by keeping the system automated yet capable of handling unexpected situations through a simple visual communication channel.
2Ease of operation
If remote monitoring through a control center is used to collaborate with yard truck drivers, then coordination is improved, but real-time control and response to immediate situations deteriorate
Solution Approach 1:
The light rod worn by the worker serves as a direct visual intermediary between the worker and the autonomous vehicle, eliminating the delay inherent in remote monitoring systems. The vehicle's camera captures the light rod's color and direction, providing instant communication without needing to route through a control center, thus achieving both coordination and real-time response.
Solution Approach 2:
The patent replaces the mechanical/telecommunicative system of remote monitoring with an optical system. The light rod uses visible light colors (red, yellow, green) to transmit commands directly to the vehicle's camera, substituting complex remote communication infrastructure with a simple optical signal that provides immediate real-time control.
3Productivity
If the entire port is operated automatically, then productivity is improved, but the risk of complete shutdown when issues occur increases
Solution Approach 1:
The light rod acts as a manual override intermediary that workers can use to immediately intervene in autonomous vehicle operations when issues arise. This maintains the automated system for normal operations while providing a simple, reliable fallback mechanism that prevents complete shutdowns by enabling human intervention at the vehicle level.
Solution Approach 2:
The system incorporates a pre-established communication channel (the light rod) that serves as a cushion against complete system failure. By having this visual signaling mechanism in place beforehand, the system is prepared to handle unexpected issues without disrupting overall port operations, thus maintaining reliability while preserving automation.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enhances transportation efficiency by allowing workers to control autonomous vehicles using hand signals, mitigating issues like path interference and simulation delays, thereby preventing port shutdowns and improving operational reliability.
Implementation Method 1
an infrared camera module configured to output video frames by capturing infrared light incident on the infrared camera module
Implementation Method 2
a light sensing module configured to output a third signal in response to sensing a laser emitted from the light rod
Data Source
AI summary
A method performed in an autonomous vehicle for an interaction with a worker is provided. The method includes storing video frames output by capturing an outside of the autonomous vehicle, identifying a command of the worker based on the video frames, controlling a message indicating the command of the worker to be displayed on a display, performing at least one control operation for performing the command of the worker, and controlling a message indicating the at least one control operation to be displayed on the display.