VR Video Generation from Scanned 3D Models
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies fail to generate videos with a strong sense of realism when using captured images and three-dimensional model data of target objects in virtual spaces.
Innovation Solution
An image processing method that generates three-dimensional model data from scanned images of a model from multiple directions, processes this data, adds effects, and creates display data for a virtual reality video, allowing for realistic representation in a virtual space.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If three-dimensional model data is generated from captured images and used in virtual space, then the video can be generated with the target object, but the sense of realism is insufficient
Solution Approach 1:
The patent creates a three-dimensional model that copies the physical characteristics, textures, and appearance of the target object from captured images. This digital replica is then used in the virtual space to maintain visual fidelity and realism while enabling flexible video generation without the physical object
Solution Approach 2:
The patent adjusts various parameters of the three-dimensional model including lighting conditions, material properties, and spatial positioning to enhance the sense of realism. By modifying these parameters, the virtual representation more closely matches the actual visual characteristics of the target object
2Manufacturing precision
If multiple scanned images from multiple directions are used to generate three-dimensional model data, then the accuracy and realism of the model is improved, but the processing complexity and time increase
Solution Approach 1:
The patent divides the three-dimensional model into multiple primitives (geometric shapes) that can be independently processed and mapped with textures from different scanned images. This segmentation allows the complex model to be built from simpler components, reducing processing complexity while maintaining overall accuracy
Solution Approach 2:
The patent transitions from two-dimensional scanned images to a three-dimensional virtual space representation. By mapping textures from multiple directional images onto three-dimensional primitives, the system creates a comprehensive spatial model that leverages additional dimensional information to improve accuracy
3Reliability
If three-dimensional model data is processed and effects are added to enhance realism, then the visual quality of the VR video is improved, but the processing time and computational resources increase
Solution Approach 1:
The patent performs preliminary processing of the three-dimensional model data including geometry refinement and texture mapping before the actual video rendering. Effects are pre-calculated and prepared in advance, reducing the computational burden during real-time video generation and decreasing overall processing time
Data Source
Figure 1A~1C
Figure 2
Figure 3
AI summary
An image processing method for generating display data for displaying a virtual reality (VR) video on an external display device (140, 156) includes: generating, using a processing unit (101), first three-dimensional model data of a model from a plurality of scanned images generated by scanning an exterior of the model from a plurality of directions using a scanner unit (110), processing the first three-dimensional model data using the processing unit (101), adding an effect to the processed first three-dimensional model data using the processing unit (101), and generating display data including the first three-dimensional model data to which the effect is added.