Virtual Object Area Positioning in Multi-Camera Virtual Viewpoint Imaging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
There is a risk that a subject in a virtual viewpoint image may overlap with a virtual object area, leading to the advertisement or virtual object not being displayed due to movement of the subject or virtual viewpoint.
Innovation Solution
The system includes a first identifying unit for determining the three-dimensional position of a specific object from multiple camera directions, a second identifying unit for determining the three-dimensional position of a virtual viewpoint, and a determining unit that positions a virtual object area based on the specific object's and virtual viewpoint's positions to prevent overlap.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If a virtual object area is displayed in a predetermined area of the virtual viewpoint image, then advertisement information can be displayed to the virtual viewpoint image, but the subject and the virtual object area may overlap due to movement of the subject or virtual viewpoint, causing the advertisement not to be displayed
Solution Approach 1:
The patent applies dynamics by making the virtual object area's position and size adjustable rather than fixed. The determining unit dynamically calculates the virtual object area's position and size based on real-time information about the subject's three-dimensional position and the virtual viewpoint's three-dimensional position, allowing the advertisement area to adapt to movements of either the subject or the viewpoint to maintain reliable visibility
Solution Approach 2:
The patent changes parameters by modifying the position and size of the virtual object area based on calculated three-dimensional positions. The determining unit adjusts these parameters dynamically to ensure the virtual object area does not overlap with the subject, thereby maintaining advertisement visibility while adapting to changing spatial relationships
2Stability of the object's composition
If the virtual object area position is fixed in the virtual viewpoint image, then the advertisement can be consistently displayed, but the subject may move into the advertisement area due to subject movement or virtual viewpoint movement
Solution Approach 1:
The patent transforms the static fixed position approach into a dynamic adaptive approach. Instead of maintaining a fixed virtual object area position, the system dynamically calculates and adjusts the position and size based on real-time three-dimensional position data of the subject and virtual viewpoint, preventing overlap while maintaining display consistency
Solution Approach 2:
The patent implements feedback by continuously monitoring the three-dimensional positions of the subject and virtual viewpoint, using this information to adjust the virtual object area's position and size. This closed-loop approach ensures the advertisement area adapts to prevent overlap with the subject while maintaining stable and reliable display
Data Source
AI summary
It is an object of the present invention to reduce a possibility that a subject (specific object) of a virtual viewpoint image and a virtual object area overlap. To achieve the object, the present invention comprises a first identifying unit for identifying a three-dimensional position of the specific object captured respectively from different directions by a plurality of cameras; a second identifying unit for identifying a three-dimensional position of a virtual viewpoint related to generation of the virtual viewpoint image based on captured images obtained by the plurality of cameras; and a determining unit for determining a position of the virtual object area to which a virtual object to be displayed in the virtual viewpoint image is disposed, based on the three-dimensional position of the specific object identified by the first identifying unit and the three-dimensional position of the virtual viewpoint identified by the second identifying unit.