Virtual Viewpoint Obstacle Notification for Vehicle Imaging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional obstacle detection systems fail to accurately present the position of obstacles to users, leading to potential overlooking of hazards, especially when obstacles are positioned higher than the ground surface, as the detection range is superimposed on captured images without clear indication of actual obstacle positions.
Innovation Solution
An image processing device that acquires captured images and positional information from radar devices, generates a virtual viewpoint image, and composites a notification image with the virtual viewpoint image, adjusting the display format to emphasize obstacles above the ground surface, ensuring accurate positioning and detection.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Difficulty of detecting and measuring
If a detection range is superimposed on a captured image to present obstacle detection results, then the detection capability is improved, but the position recognition accuracy of obstacles deteriorates
Solution Approach 1:
The notification image is segmented into multiple regions corresponding to different spatial zones (e.g., left, center, right areas). By dividing the detection range into distinct segments and assigning different visual characteristics to each segment, the system enables users to accurately locate obstacles within specific regions while maintaining comprehensive detection coverage.
Solution Approach 2:
Different visual properties are applied to different parts of the notification image based on obstacle position and characteristics. For example, obstacles in critical zones may be highlighted with different colors or intensities compared to those in less critical zones, providing localized information that improves position recognition without compromising overall detection capability.
2Device complexity
If a simple detection range overlay is used, then the device complexity is reduced, but the information completeness deteriorates
Solution Approach 1:
The system transitions from a two-dimensional captured image to a three-dimensional virtual viewpoint image by calculating and displaying obstacles from an elevated perspective. This dimensional transformation provides depth information and spatial relationships that are not visible in the original 2D captured image, enabling users to understand obstacle positions and heights more comprehensively without significantly increasing device complexity.
Solution Approach 2:
A virtual viewpoint image serves as an intermediary representation between the raw captured image and the final obstacle detection information. This intermediate layer processes and reorganizes visual data to highlight obstacle positions and characteristics, providing complete position information while maintaining relatively simple device architecture through software-based image processing.
Data Source
AI summary
An image processing device according to an embodiment includes an image acquisition unit, an information acquisition unit, a generation unit, a composition unit, a determination unit, and a display control unit. The image acquisition unit acquires a captured image where an image of an environment of a vehicle is captured by an image-capturing device. The information acquisition unit acquires positional information regarding a detected position of an obstacle that exists in an environment of the vehicle. The generation unit generates a virtual viewpoint image where an environment of the vehicle is viewed from a virtual viewpoint, based on the captured image. The composition unit composites a notification image that provides notification of existence of the obstacle at the detected position with the virtual viewpoint image. The display control unit controls a display format of the notification image that is composited with the virtual viewpoint image, based on the positional information.