Side-Camera Route Imaging to Prevent 3D Object Distortion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing driving assistance systems distort three-dimensional objects in captured images due to viewpoint conversion, leading to elongation and discomfort for the user.
Innovation Solution
A driving assistance device that cumulatively stores images from side cameras with vehicle information, extracts and synthesizes only lateral regions, and generates a route surrounding image without distorting three-dimensional objects by projecting onto curved surfaces.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If viewpoint conversion is performed to display overhead or bird's-eye view images from virtual viewpoints, then visibility of the surrounding environment is improved, but three-dimensional objects are displayed distorted and stretched
Solution Approach 1:
The patent applies curvature by using a curved projection surface (specifically a spherical or cylindrical surface) instead of a flat plane for viewpoint conversion. This allows three-dimensional objects to be projected onto a curved surface that better preserves their spatial relationships and prevents the stretching and distortion that occurs with flat projections. The curved surface adapts to the three-dimensional nature of the objects, maintaining their original shapes while still providing comprehensive surrounding environment visibility.
2Loss of information
If captured images are displayed directly without distortion correction, then the original image data is preserved, but the user experiences discomfort due to lens distortion
Solution Approach 1:
The patent applies parameter changes by adjusting the projection parameters and transformation functions used in viewpoint conversion. By modifying the mathematical parameters of the projection process (such as projection distance, field of view angles, and transformation matrices), the system can correct lens distortion while preserving the essential image data. This allows the images to be visually corrected for user comfort without completely altering the underlying captured information.
3Area of stationary object
If wide-angle lenses are used to eliminate blind spots and capture wider areas, then the coverage area is increased, but the captured images become distorted
Solution Approach 1:
The patent uses a curved projection surface to counteract the distortion introduced by wide-angle lenses. The curved surface (spherical or cylindrical) naturally accommodates the wide field of view while maintaining proper spatial relationships and reducing the barrel distortion characteristic of wide-angle lenses. This allows the system to preserve the expanded coverage area achieved by wide-angle lenses while correcting the associated image distortion through the geometric properties of the curved projection surface.
Data Source
AI summary
A driving assistance device includes: an image storage unit configured to cumulatively store captured images, each obtained by capturing an image of a surrounding environment by an imaging device provided in a vehicle, in association with vehicle information when capturing the respective captured images; an image synthesizing unit configured to synthesize the cumulatively stored captured images based on the vehicle information to generate a route surrounding image indicating a surrounding environment along a route on which the vehicle travels; and an image display unit configured to display the route surrounding image along a route on which the vehicle is currently traveling. The imaging device is provided to capture an image of a region including a side region located laterally with respect to the vehicle. The image storage unit extracts and stores only a part, which includes the side region, in the captured image captured by the imaging device.