Periphery Display Control Device for Realistic Virtual Viewpoint Imaging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing periphery display control devices face issues with distortion or extension of three-dimensional objects when displaying a vehicle's movement to a target position, particularly when transitioning from a virtual viewpoint to a bird's-eye view, leading to a lack of realism and reduced effectiveness in two-screen displays.
Innovation Solution
A periphery display control device that generates a virtual viewpoint image by setting a virtual viewpoint and gazing point based on the relative angle of the target position to the vehicle's movement direction, maintaining their distance and height, and outputting this image to a display device, preventing distortion or extension of surrounding objects and enhancing realism.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a bird's-eye view image is displayed to show the own vehicle position, then it is easy to understand the positional relationship between the own vehicle and surrounding objects, but distortion or extension of three-dimensional objects becomes noticeable and the image lacks realism
Solution Approach 1:
The patent combines both the bird's-eye view image and the virtual viewpoint image into a single composite display. The bird's-eye view provides accurate positional relationships while the virtual viewpoint image overlays realistic three-dimensional object representations, merging the advantages of both viewing modes to simultaneously achieve positional accuracy and visual realism.
Solution Approach 2:
The virtual viewpoint image acts as an intermediary layer that mediates between the bird's-eye view image and the user's perception. It provides a realistic representation of three-dimensional objects that overlays the bird's-eye view, allowing users to perceive both the accurate positional information and realistic object appearance without the distortion issues of pure bird's-eye view.
2Reliability
If a virtual viewpoint image is generated by changing the viewpoint position to reduce distortion, then the image maintains realism, but when the own vehicle approaches the target position, the image changes to a bird's-eye view image and loses realism
Solution Approach 1:
The patent dynamically adjusts the virtual viewpoint position based on the own vehicle's movement state. When the vehicle is moving, the virtual viewpoint is positioned to maintain a realistic view; when the vehicle stops or approaches the target, the viewpoint transitions smoothly to a bird's-eye view. This dynamic adjustment allows the system to adapt to different movement phases while maintaining image realism during the movement process.
Solution Approach 2:
The system changes the viewpoint parameters (position and angle) based on the vehicle's movement state and distance to the target. By continuously adjusting these parameters, the system maintains optimal realism during movement while transitioning to bird's-eye view when appropriate, achieving both realism and display adaptability through parameter optimization.
3Adaptability or versatility
If two-screen display is performed with bird's-eye view image and virtual viewpoint image, then both views are provided, but since they finally have substantially the same content, the merit of two-screen display is reduced
Solution Approach 1:
The patent segments the display into two distinct functional areas: the bird's-eye view image occupies one screen or region providing accurate positional information, while the virtual viewpoint image occupies another region providing realistic visual representation. This segmentation ensures that both views maintain their unique informational value throughout the movement process, preventing content redundancy and maximizing the effectiveness of the two-screen display.
Data Source
AI summary
A periphery display control device includes: an image acquisition unit acquiring captured image data obtained by imaging a periphery of an own vehicle; a target acquisition unit acquiring a target position to which the own vehicle moves; an image generation unit generating a virtual viewpoint image while moving, based on a relative angle of the target position with respect to a movement direction of the own vehicle when moving to the target position, at least one of a virtual viewpoint set at a position facing the target position across the own vehicle and a gazing point when facing an area including at least one of the own vehicle and the target position from the virtual viewpoint in a state where a distance between and heights of the virtual viewpoint and the gazing point are maintained; and an output unit outputting the virtual viewpoint image to a display device.