Virtual Viewpoint Image Generation for Interchangeable Objects
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing systems struggle to display multiple virtual objects appropriately in a virtual viewpoint image, especially when they are displayed interchangeably in a single region, leading to issues where some objects may not be included or displayed correctly due to changes in the virtual camera's position and orientation.
Innovation Solution
An image processing system that acquires the visual field of a virtual camera and tracks the display times of multiple virtual objects within this field, generating a virtual viewpoint image that includes one of the objects based on their display times, ensuring each object is appropriately displayed by determining display priorities and arranging them effectively within the virtual advertisement frames.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple virtual objects are displayed interchangeably in a single display region, then the advertising effectiveness is improved, but it becomes difficult to determine which object to display when the virtual camera position changes
Solution Approach 1:
The system pre-calculates display times for each virtual object before actual display occurs. By determining in advance how long each object should be displayed based on virtual camera position and orientation, the system eliminates the complexity of real-time decision-making while maintaining effective advertising display.
Solution Approach 2:
The display time of each virtual object is dynamically adjusted based on the virtual camera's position and orientation. Objects that are more visible or prominently positioned in the visual field are displayed for longer periods, while less visible objects are displayed for shorter periods, creating a dynamic display strategy that adapts to camera movement.
2Adaptability or versatility
If the virtual camera position and orientation change, then the viewing perspective is improved, but some virtual objects may not be included in the visual field
Solution Approach 1:
The system pre-calculates the display time for each virtual object based on predicted virtual camera positions and orientations. By determining in advance which objects will be visible and for how long, the system ensures reliable object visibility regardless of camera movement, while still maintaining flexible viewing perspectives.
Solution Approach 2:
The system uses the virtual camera's position and orientation as feedback to adjust which virtual objects are displayed and for how long. This feedback mechanism ensures that objects remain visible and appropriately displayed even as the camera moves, maintaining reliable object visibility across different viewing perspectives.
Data Source
AI summary
An image processing system includes one or more memories storing instructions, and one or more processors that execute the instructions to acquire a visual field of a virtual camera that changes in position relative to a region where a first virtual object and a second virtual object are displayed interchangeably, acquire, during a time in which the region is in the visual field of the virtual camera, a first display time indicating a time during which the first virtual object is displayed in the region and a second display time indicating a time during which the second virtual object is displayed in the region, and generate, based on the first display time and the second display time, a virtual viewpoint image corresponding to the virtual camera, wherein the virtual viewpoint image includes one of the first virtual object and the second virtual object.