3D Data Masking for Virtual Camera Defect Hiding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional 3D data generation methods often result in partially defective data when a subject is cut off, leading to a feeling of strangeness when combined with 3D backgrounds.
Innovation Solution
An image generation apparatus and method that acquire 3D data and detect defective areas, then generate mask data based on the movable range of a virtual camera and the defective area, ensuring the defective area is not visible within the camera's range.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If 3D data is generated using conventional methods, then the data can be acquired efficiently, but defective areas appear when subjects are cut off, causing a feeling of strangeness
Solution Approach 1:
The patent applies preliminary action by generating mask data in advance based on the movable range of the virtual camera and the defective area of the 3D data. The mask data is prepared beforehand to cover defective areas, so when the virtual camera moves within its range, the defective areas are automatically hidden without requiring real-time detection or correction during rendering.
2Reliability
If mask data is generated to cover defective areas, then the feeling of strangeness is reduced, but additional processing steps are required
Solution Approach 1:
The patent applies segmentation by dividing the 3D data processing into distinct components: the original 3D data, the defective area identification, the virtual camera movable range determination, and the mask data generation. This segmentation allows each component to be processed independently and combined, managing complexity through modular processing steps.
3Reliability
If the defective area is masked to be invisible in the movable range of the virtual camera, then seamless integration with 3D backgrounds is achieved, but the mask data generation requires precise calculation
Solution Approach 1:
The patent applies local quality by generating mask data with specific properties tailored to the defective area and the virtual camera's movable range. The mask data is not uniformly applied but is precisely localized to cover only the defective areas within the camera's viewing range, maintaining high quality in visible regions while hiding defects where needed.
Data Source
AI summary
An image generation apparatus includes one or more memories storing instructions; and one or more processors that, upon execution of the stored instructions, are configured to operate as a first acquisition unit configured to acquire 3D data and a defective area of the 3D data, a second acquisition unit configured to acquire a movable range of a virtual camera, and a generation unit configured to generate mask data based on the movable range of the virtual camera and the defective area such that the defective area is not visible in the movable range of the virtual camera.