Plenoptic Video Motion Vector Encoding Under Microlens Blocking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional video encoding and decoding methods for plenoptic cameras fail to accurately handle light rays that are blocked from reaching the image sensor, leading to incorrect motion vectors and impaired image quality or efficiency.
Innovation Solution
A method and apparatus that calculate and encode horizontal and vertical displacements of image blocks using unit intervals, adaptively set motion vector resolution, and perform interpolation to decode pixel values, considering light ray movements on the microlens array plane.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional motion detection is used to find displacement of light rays, then motion vectors can be calculated, but incorrect motion vectors are obtained when light rays are blocked by microlenses
Solution Approach 1:
The patent segments the image sensor plane into multiple regions corresponding to different microlenses. By dividing the search space into discrete regions associated with each microlens, the method systematically handles light ray blocking patterns, improving motion vector accuracy in plenoptic camera sequences where conventional single-region search fails.
Solution Approach 2:
The patent introduces an intermediary mapping between microlens positions and image sensor regions. This intermediary structure allows the encoder to predict which microlenses will block light rays at different time instants, enabling accurate motion vector calculation even when light paths are obstructed, thereby resolving the contradiction between measurement precision and reliability.
2Device complexity
If light ray displacement is calculated without considering microlens blocking, then encoding process is simple, but large errors occur in restored images
Solution Approach 1:
The patent performs preliminary calculation of microlens blocking patterns before motion detection. By pre-determining which microlenses will block light rays at reference and current time instants, the encoder can restrict motion search to valid regions, avoiding incorrect matches. This preliminary action maintains reasonable encoding complexity while significantly improving image restoration accuracy.
Solution Approach 2:
The patent applies different processing strategies to different regions of the image sensor plane based on local microlens blocking characteristics. Regions affected by blocking use specialized motion detection, while unaffected regions use conventional methods. This localized approach balances complexity and accuracy by applying enhanced processing only where necessary.
3Productivity
If conventional motion vector encoding is used, then encoding speed is maintained, but encoding efficiency is seriously impaired due to blocked light rays
Solution Approach 1:
The patent dynamically adjusts the motion search process based on detected light ray blocking patterns. When blocking is detected in certain regions, the search strategy is dynamically modified to account for the blocked paths. This dynamic adaptation maintains encoding speed by avoiding exhaustive searches while preventing information loss through accurate motion vector selection in blocked regions.
Data Source
AI summary
A method of encoding a video according to an embodiment of the present invention comprises the steps of: calculating horizontal and vertical displacements of an image block on the basis of a unit horizontal interval and a unit vertical interval; encoding a motion vector corresponding to the image block using the horizontal and vertical displacements; and encoding the unit horizontal interval and the unit vertical interval.