Plenoptic Video Motion Vectors With Microlens Interval Correction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional video encoding and decoding methods for plenoptic cameras fail to accurately handle light rays blocked by microlenses, leading to incorrect motion vectors and impaired image quality or efficiency.

Innovation Solution

A method and apparatus that calculate and encode horizontal and vertical displacements of image blocks using unit intervals, adaptively set motion vector resolution, and perform interpolation to correct for light ray blockages, enhancing encoding efficiency and reducing complexity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional motion detection is used to find displacement of light rays, then motion vectors can be obtained, but incorrect motion vectors occur when light rays are blocked by microlenses

Engineering Contradiction:
Improvemotion vector accuracyVSAvoidimage quality
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent applies preliminary action by calculating horizontal and vertical unit intervals between microlenses before motion detection. This pre-calculated interval information is then used to correct motion vectors, preventing the incorrect motion vector problem caused by light ray blockage. The unit intervals are computed in advance and stored for use during the motion compensation process.

Inventive Principle:
Principle #10Preliminary action

2Productivity

If motion vectors are calculated without considering microlens blockage, then encoding can proceed, but encoding efficiency and image quality are seriously impaired

Engineering Contradiction:
Improveencoding efficiencyVSAvoidimage quality
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent implements feedback by using the calculated unit horizontal and vertical intervals to correct motion vectors after initial motion detection. The correction process uses the relationship between light ray displacement and microlens intervals to adjust motion vectors, ensuring accurate prediction blocks are generated. This feedback mechanism maintains both encoding efficiency and image quality.

Inventive Principle:
Principle #23Feedback

3Device complexity

If light ray displacement is not corrected for microlens intervals, then encoding is simpler, but large errors occur in restored images

Engineering Contradiction:
Improveencoding complexityVSAvoidimage restoration accuracy
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The patent applies segmentation by dividing the light ray displacement calculation into two components: the motion-detected displacement and the microlens interval correction. The unit horizontal and vertical intervals represent the periodic structure of microlens effects, and by segmenting the correction process, the patent achieves accurate image restoration without excessive complexity.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS20260025524A1Method for encoding and decoding video and apparatus thereof
Publication Date: 2026.01.22 RES & BUSINESS FOUND SUNGKYUNKWAN UNIV
  • US20260025524A1 patent drawing
  • US20260025524A1 patent drawing
  • US20260025524A1 patent drawing

AI summary

A method of encoding a video according to an embodiment of the present invention comprises the steps of: calculating horizontal and vertical displacements of an image block on the basis of a unit horizontal interval and a unit vertical interval; encoding a motion vector corresponding to the image block using the horizontal and vertical displacements; and encoding the unit horizontal interval and the unit vertical interval.