Virtual Viewpoint Data Group Generation for 3D Object Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Generating multiple viewpoint images of a free viewpoint image is cumbersome and difficult, especially when multiple performers face different directions, making it hard to fully grasp the image from a single viewpoint.
Innovation Solution
An image processing device and method that determines a virtual-viewpoint data group corresponding to user operations and generates virtual viewpoint images of a 3D object from various virtual viewpoints, allowing users to easily capture and display images from different angles using a swipe or similar operation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If multiple viewpoint images are generated manually by changing viewpoints one by one, then comprehensive representation of 3D objects from different angles is achieved, but the operation becomes troublesome and time-consuming
Solution Approach 1:
The patent uses virtual cameras to capture images of 3D objects from multiple viewpoints automatically. Instead of manual viewpoint changing, the system creates virtual camera instances at different positions and angles, which automatically render the complete set of viewpoint images without manual intervention, thus resolving the contradiction between comprehensive representation and operational simplicity
Solution Approach 2:
The patent replaces manual mechanical viewpoint changing with automated computational rendering. The virtual camera system uses software-based rendering to generate multiple viewpoint images automatically, substituting the manual mechanical process of physically moving cameras or adjusting viewpoints with a computational approach that achieves the same result much more efficiently
2Ease of operation
If a single viewpoint image is used, then the operation is simple, but it is difficult to fully grasp the free viewpoint image when multiple performers face different directions
Solution Approach 1:
The patent segments the complete 3D scene into multiple viewpoint images, each representing a specific perspective. By dividing the full viewpoint space into discrete virtual camera positions, the system provides comprehensive information about all performers and their orientations while maintaining simple access through virtual camera control, resolving the contradiction between operational simplicity and information completeness
3Manufacturing precision
If free viewpoint images are used to represent multiple performers facing different directions, then comprehensive scene representation is achieved, but it becomes difficult to store and manage multiple viewpoint images
Solution Approach 1:
The patent creates a universal virtual camera system that can generate viewpoint images from any position and angle. This multi-functional system handles all types of viewpoint requirements through a single unified approach, simplifying the management of multiple viewpoint images while maintaining accurate scene representation of performers in different orientations
Data Source
AI summary
Provided are an image processing device and an image processing method that enable simple generation of a plurality of viewpoint images of a free viewpoint image. The image processing device determines, corresponding to a user operation, a virtual-viewpoint data group including respective pieces of data of a plurality of virtual viewpoints to a predetermined 3D object, and generates, for the plurality of virtual viewpoints, respective virtual viewpoint images each as an image of the 3D object viewed from a corresponding virtual viewpoint.