Projected Vehicle Path Overlay for Faster Teleoperation Guidance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Autonomous vehicles face challenges in navigating complex situations, such as obstructions, where AI systems cannot assess intentions of other road users, and teleoperation can be time-consuming due to the need for manual path planning and high latency in video streams.
Innovation Solution
A system that receives a video stream from a vehicle, determines a projected path based on input steering angles and distances, and displays an overlay in the video stream using spatial and pixel coordinates, allowing tele-operators to visualize and adjust the path more efficiently, enabling faster and smoother vehicle navigation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If teleoperation is used to control autonomous vehicles in complex situations, then vehicle control capability is improved, but operation time increases due to manual path planning and video stream latency
Solution Approach 1:
The system performs preliminary path planning by calculating the projected path based on current vehicle state and teleoperator input before the teleoperator sees the video stream. The path is pre-computed and ready for immediate visualization and confirmation, eliminating the need for manual path drawing during live operation.
Solution Approach 2:
The system introduces an intermediary computational layer that translates teleoperator input (steering angle, distance) into a projected path visualization. This intermediary processing happens automatically, reducing the cognitive load and time required for the teleoperator to manually plan and adjust paths during live video review.
2Measurement precision
If manual path planning is performed during teleoperation, then path accuracy is improved, but path planning time increases
Solution Approach 1:
The system performs self-service by automatically calculating the projected path based on the vehicle's current state and the teleoperator's input parameters. The computational system serves itself by generating the path visualization without requiring manual path drawing or adjustment by the teleoperator, thus maintaining accuracy while reducing time.
Solution Approach 2:
The system replaces the mechanical/manual path planning process with an automated computational system. Instead of the teleoperator manually drawing or adjusting paths, the system uses algorithms to calculate and visualize the projected path automatically, substituting manual mechanical operations with automated computational processes.
3Speed
If video stream latency is reduced for real-time control, then response time is improved, but video quality and processing accuracy may deteriorate
Solution Approach 1:
The system performs preliminary path calculation using the latest available vehicle state data before the video stream is fully processed and displayed. By pre-computing the projected path with current kinematic information, the system achieves real-time responsiveness without waiting for complete video frame processing, thus maintaining both speed and accuracy.
Data Source
AI summary
A system may receive a video stream from a camera of a vehicle in a transportation network. The system may also receive an input indicating pixel coordinates in the video stream. The system may display an overlay in the video stream based on the pixel coordinates. The overlay may include a visualization of a projected path of the vehicle. The system may determine, from the pixel coordinates, spatial coordinates of the projected path of the vehicle in the transportation network. The spatial coordinates may be relative the transportation network or the camera. The system may transmit information to the vehicle based on a selection of the overlay. The information may be configured to cause the vehicle to follow the projected path according to the spatial coordinates.