Movement-Based Object Color Rendering for Texture-Stable Virtual Views
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for generating virtual viewpoint videos can result in noticeable texture changes when the image capturing apparatus closest to the virtual viewpoint switches, leading to an unnatural user experience.
Innovation Solution
An information processing apparatus that selects a determination method for object color in virtual viewpoint videos based on the movement of the virtual viewpoint or the object, using either virtual-viewpoint-dependent or virtual-viewpoint-independent rendering to minimize texture changes and enhance the naturalness of the video.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If image capturing apparatus closest to virtual viewpoint is selected for coloring, then high-definition virtual viewpoint video is achieved, but noticeable texture changes occur when apparatus switching happens
Solution Approach 1:
The patent applies dynamics by making the determination method adaptable to changing conditions. The system dynamically selects between virtual-viewpoint-dependent and virtual-viewpoint-independent rendering methods based on the movement state of the virtual viewpoint or object, ensuring optimal performance across different scenarios while maintaining both high definition quality and texture consistency
Solution Approach 2:
The patent changes the parameter of rendering determination method based on movement conditions. When movement exceeds a threshold, virtual-viewpoint-independent rendering is used to maintain texture consistency; when movement is within threshold, virtual-viewpoint-dependent rendering is used to achieve high-definition quality. This parameter switching resolves the contradiction between video definition and texture stability
2Manufacturing precision
If virtual-viewpoint-dependent rendering is used, then high-definition video quality is achieved, but unnatural texture changes occur during viewpoint switching
Solution Approach 1:
The patent implements feedback by continuously monitoring the movement amount of the virtual viewpoint or object and using this information to select the appropriate rendering method. This feedback mechanism ensures that virtual-viewpoint-dependent rendering is only used when it won't cause harmful texture discontinuities, thus achieving high-definition quality without unnatural texture changes
Solution Approach 2:
The patent applies preliminary anti-action by proactively switching to virtual-viewpoint-independent rendering when movement exceeds the threshold, preventing texture discontinuity before it occurs. This anticipatory approach eliminates the harmful effect of unnatural texture changes during viewpoint switching
Data Source
AI summary
An information processing apparatus is provided. A determination method for determining a color of an object in a virtual viewpoint video, which includes the object and is generated based on a captured image obtained by capturing an image of the object, is selected based on a movement of a virtual viewpoint corresponding to the virtual viewpoint video or a movement of the object. The virtual viewpoint video, which includes the object, is generated through determining the color of the object in the virtual viewpoint video with the selected determination method.