Dynamic Virtual Projection Plane for Vehicle Video Synthesis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video synthesis systems for vehicle cameras often distort 3D objects when transforming and synthesizing videos, making it difficult to display objects of interest naturally, as they fail to effectively adjust the virtual projection plane and viewpoint to account for the shape and position of specific subjects.
Innovation Solution
A video synthesis device and method that dynamically adjusts the virtual projection plane and viewpoint based on the position and shape of an object of interest, using a detecting unit to determine the object's position and a transforming/synthesizing unit to perform coordinate conversion and blending, reducing distortion by setting the virtual viewpoint within a predetermined angle range relative to the object's position.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If a fixed virtual projection plane is used for video synthesis, then the synthesis process is simple, but 3D objects become distorted and unnatural
Solution Approach 1:
The patent applies dynamics by making the virtual projection plane adjustable rather than fixed. The system dynamically changes the shape and position of the virtual projection plane based on the detected position and shape of objects of interest, allowing the synthesis process to adapt to different scenarios while maintaining both simplicity and naturalness.
Solution Approach 2:
The patent changes parameters of the virtual projection plane (shape, position, orientation) based on object characteristics. By adjusting these parameters according to the detected object's position and shape, the system achieves natural representation of 3D objects without overly complicating the synthesis process.
2Manufacturing precision
If the virtual projection plane is adjusted to reduce distortion of a specific object, then that object is displayed naturally, but other objects may become distorted
Solution Approach 1:
The patent applies local quality by making different parts of the virtual projection plane have different properties. Specifically, the portion of the projection plane corresponding to the object of interest is adjusted to match its shape and position, while other portions remain unchanged. This allows specific objects to be displayed naturally without affecting the representation of other objects.
3Area of stationary object
If multiple camera videos are synthesized with different virtual viewpoints, then comprehensive coverage is achieved, but processing complexity increases
Solution Approach 1:
The patent uses dynamics to adjust the virtual projection plane and viewpoint settings dynamically based on the detected object of interest. This allows the system to achieve comprehensive coverage by focusing computational resources on adjusting only the relevant portions of the synthesis process, rather than uniformly processing all camera inputs with equal complexity.
Data Source
Figure 1
Figure 2A~2C
Figure 3
AI summary
A projection condition is decided according to a position of a detected object of interest when a virtual space is formed, and an image is projected, and a way in which an image is viewed is improved. A video display system performs a video conversion process on a video of a camera mounted on a vehicle and displays a resulting video, and includes a plurality of cameras, a detecting unit that detects an object of interest around the vehicle based on information or the like acquired through the plurality of cameras, other sensors, or a network, a transforming/synthesizing unit that transforms and synthesizes the videos photographed by the plurality of cameras using a shape of a virtual projection plane, a virtual viewpoint, and a synthesis method which are decided according to position information of the object of interest detected by the detecting unit, and a display unit that displays the video that is transformed and synthesized by the transforming/synthesizing unit.