Remote Driving Video Display Using Operator Attention Scope
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Remote driving operators face challenges in effectively displaying multiple sets of traveling videos around a vehicle on a limited display area, leading to increased operational and monitoring loads due to varying attention directions and scopes, which can result in inadequate video display and increased operator workload.
Innovation Solution
A method and system that acquire and display traveling videos from multiple cameras on a remote driving vehicle, specifying the attention direction or scope of the operator based on driving operations, vehicle state, and operator motion to prioritize video display on a display device, allowing for dynamic adjustment of video angles and highlighting relevant areas.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If multiple sets of traveling video are displayed to reflect all directions around the vehicle, then the information completeness is improved, but the display area limitation causes the visual recognition quality to deteriorate
Solution Approach 1:
The display system segments the multiple video feeds by priority, dividing them into highlighted videos (reflecting attention direction) and non-highlighted videos. The highlighted videos occupy prominent display areas with higher visual recognition quality, while non-highlighted videos are displayed in次要 areas. This segmentation resolves the contradiction by ensuring that the most critical information receives the best visual presentation.
Solution Approach 2:
Different display qualities are assigned to different video regions based on their importance. Videos reflecting the attention direction are displayed with higher quality and prominence in key areas of the display device, while other videos are displayed with lower prominence. This local quality differentiation ensures that limited display resources are allocated efficiently to maximize both information completeness and visual recognition quality where needed.
2Loss of information
If the display shows all video directions equally, then the information coverage is improved, but the operator's attention scope cannot be properly reflected and workload increases
Solution Approach 1:
The display system dynamically adjusts which videos are highlighted and their display positions based on real-time detection of the operator's attention direction and scope. As the operator's attention changes, the system automatically reconfigures the video display to match, rather than requiring the operator to manually adjust or scan through all videos. This dynamic adaptation reduces operator workload while maintaining comprehensive information coverage.
Solution Approach 2:
The system uses feedback from sensors detecting the operator's attention direction and scope to automatically adjust the video display configuration. This closed-loop feedback mechanism ensures that the display always reflects the operator's current attention state, providing relevant information coverage without requiring excessive operator effort to monitor all directions.
3Area of stationary object
If the display area is used to show maximum video coverage, then the range of visible directions is improved, but the stable visual recognition of critical areas deteriorates
Solution Approach 1:
The display area is segmented into stable primary display regions for highlighted videos and secondary regions for other videos. The highlighted videos that reflect the operator's attention direction are consistently positioned in stable, easily recognizable areas of the display device. This segmentation maintains stable visual recognition for critical areas while still providing broad video coverage across the entire display surface.
Data Source
AI summary
A method according to the present disclosure comprises acquiring a plurality sets of traveling video recorded by a plurality of cameras capturing a plurality of directions equipped in a remote driving vehicle, acquiring information regarding at least one of driving operation by a remote driving operator, a traveling state of the remote driving vehicle, and motion of the remote driving operator, specifying an attention direction or an attention scope of the remote driving operator for a situation around the remote driving vehicle based on acquired information, displaying at least one of the plurality sets of traveling video reflecting the attention direction or the attention scope on a display device, and performing display based on the attention direction or the attention scope.