3D Conversion Module Spatial Information Extraction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for generating 3D views from 2D pictures are time-consuming and impractical for real-time error checking during photography, as they require significant data processing and transmission between devices.
Innovation Solution
An electronic device with a 3D conversion module that collects spatial information by sampling and scaling down 2D motion pictures, allowing for real-time 3D view generation by extracting features and depths from a second motion picture while the first is being photographed, reducing processing time and data volume.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If 3D views are generated from original 2D pictures using external servers and complete data transmission, then conversion accuracy is improved, but processing time and data transmission volume increase significantly
Solution Approach 1:
The patent segments the 2D video into key frames and non-key frames, processing only key frames to extract spatial information. This segmentation allows the system to maintain 3D conversion accuracy while significantly reducing processing time and data transmission volume, as non-key frames are handled more efficiently using the extracted spatial information.
Solution Approach 2:
The patent performs preliminary extraction of spatial information (depth maps, camera positions, feature points) from key frames before processing non-key frames. This preliminary action enables faster processing of subsequent frames while maintaining conversion accuracy, as the heavy computational work is done in advance on a representative subset of frames.
2Reliability
If spatial information is extracted from all frames of 2D video, then 3D view quality is improved, but device processing load and time consumption increase
Solution Approach 1:
The patent divides the video frames into key frames and non-key frames, extracting detailed spatial information only from key frames. This segmentation maintains 3D view quality by ensuring critical frames are fully processed while improving productivity by using a more efficient processing approach for non-key frames.
Solution Approach 2:
The patent applies different processing quality levels to different frame types: full spatial information extraction for key frames and optimized processing for non-key frames. This local quality approach ensures 3D view quality is maintained where most needed while improving overall processing speed.
3Measurement precision
If complete 2D picture data is transmitted to external servers for 3D conversion, then conversion accuracy is improved, but data transmission volume and network dependency increase
Solution Approach 1:
The patent extracts only the essential spatial information (depth maps, camera positions, feature points) from key frames locally on the user terminal, rather than transmitting complete picture data to external servers. This extraction approach maintains conversion accuracy while dramatically reducing data transmission volume and eliminating network dependency for the processing step.
Solution Approach 2:
The patent enables the user terminal to perform 3D conversion processing locally by extracting spatial information from video frames captured by its own camera. This self-service approach eliminates the need to transmit data to external servers, reducing data transmission volume to zero for the conversion process while maintaining accuracy.
4Productivity
If real-time 3D view generation is implemented, then user experience is improved, but processing complexity and computational requirements increase
Solution Approach 1:
The patent segments video processing into key frame extraction and non-key frame processing, allowing real-time generation of 3D views by focusing computational resources on key frames while using simplified processing for other frames. This segmentation makes real-time processing feasible despite increased complexity.
Solution Approach 2:
The patent applies partial processing to non-key frames, using the spatial information extracted from key frames to generate 3D views for frames that require less detailed processing. This partial action approach enables real-time processing capability while managing device complexity through selective processing intensity.
Data Source
Figure 1
Figure 2
Figure 3A~3B
AI summary
An image processing method is provided, including the operations of collecting a first motion picture, extracting spatial information about at least a part of frames forming the first motion picture, and reflecting the extracted spatial information to generation of a 3D view corresponding to the first motion picture.