3D Video Letterbox Margin Detection via Frame Packing Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional letterbox detection methods for 2D video inputs are not suitable for 3D video inputs, leading to incorrect detection and removal of letterbox margins in 3D video frames, which disrupts the desired 3D viewing experience.
Innovation Solution
A method and apparatus for detecting and removing letterbox margins in 3D video frames by determining the frame packing type, selecting appropriate image regions, and using this information to identify and remove letterbox margins, allowing for proper scaling to full screen resolution without disturbing the 3D content.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional letterbox detection method for 2D video is applied to 3D video input, then the detection process is simple, but the detection accuracy is poor and letterbox margins are incorrectly identified
Solution Approach 1:
The patent divides the 3D video frame into multiple image regions based on frame packing types (side-by-side, top-and-bottom, column-interleaved, row-interleaved). By segmenting the frame according to the specific 3D packing structure, the system can accurately identify which regions contain actual video content versus letterbox margins, resolving the detection accuracy issue without requiring overly complex processing.
Solution Approach 2:
The patent performs preliminary determination of the frame packing type before conducting letterbox margin detection. This preliminary action establishes the correct interpretation framework for the 3D video structure, enabling subsequent accurate identification of letterbox margins without requiring complex real-time analysis during the detection phase.
2Area of stationary object
If letterbox margins are removed from 3D video frames, then the viewing area is increased, but the 3D content structure is disturbed and viewing experience is degraded
Solution Approach 1:
The patent segments the 3D video frame into distinct image regions based on frame packing type, allowing precise identification of letterbox margin locations. This segmentation enables removal of only the actual letterbox margins while preserving the integrity of the 3D content regions, thus increasing viewing area without disturbing the 3D structure.
Solution Approach 2:
The patent applies different processing treatments to different regions of the 3D video frame according to their specific characteristics. Letterbox margin regions are identified and removed, while content regions maintain their original structure and quality. This localized processing ensures that viewing area is maximized while 3D content integrity is preserved.
3Manufacturing precision
If conventional letterbox detection is performed on each frame independently, then the processing is straightforward, but the aspect ratio preservation is incorrect for 3D video
Solution Approach 1:
The patent performs preliminary determination of the frame packing type for the 3D video sequence before processing individual frames. This preliminary action establishes the correct aspect ratio calculation basis, allowing subsequent frame processing to maintain accurate aspect ratios without requiring complex per-frame analysis, thus preserving both precision and efficiency.
Solution Approach 2:
The patent creates a universal processing approach that handles multiple 3D video frame packing types (side-by-side, top-and-bottom, column-interleaved, row-interleaved) through a unified methodology. By determining the frame packing type once and applying the corresponding processing rules consistently across all frames, the system maintains accurate aspect ratio preservation while ensuring efficient batch processing.
Data Source
AI summary
A letterbox margin processing method includes: receiving a three-dimensional (3D) video input; determining a frame packing type corresponding to the 3D video input; selecting a first image region from a target frame according to the determined frame packing type, wherein the target frame is derived from the 3D video input; and detecting letterbox margins within the first image region.