VR Content Transmission Distortion Correction via Depth-Based Rearrangement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for transmitting and receiving VR content face challenges in configuring and rendering 360-degree images without distortion, particularly due to differences in depth values captured by fisheye lenses, leading to misalignment and distortion in the stitched regions.

Innovation Solution

A method involving a transmitter that detects the overlapped regions of images captured by multiple fisheye lenses, generates parameters to adjust the arrangement and size of these regions, and transmits this metadata to a receiver, which decodes and rearranges the images to compensate for distortion, ensuring a distortion-free 360-degree image rendering.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of moving object

If images captured by multiple fisheye lenses are stitched together to form 360-degree VR content, then the field of view coverage is improved, but distortion occurs in the overlapped regions due to depth value differences

Engineering Contradiction:
Improvefield of view coverageVSAvoidimage alignment precision
Core Design Contradiction:
Area of moving objectVSManufacturing precision

Solution Approach 1:

The patent applies preliminary action by detecting overlapped regions and generating rearrangement information before final image rendering. The transmitter identifies regions where depth value differences cause misalignment and pre-calculates correction parameters, which are then transmitted to the receiver for application during content assembly, preventing distortion before it manifests in the final VR content.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements local quality by applying different processing treatments to different regions of the 360-degree content. Specifically, overlapped regions are identified and subjected to special rearrangement operations based on depth values, while non-overlapped regions maintain their original characteristics. This localized approach corrects distortion only where necessary without affecting the entire image.

Inventive Principle:
Principle #3Local quality

2Manufacturing precision

If the overlapped regions are rearranged based on depth values to remove distortion, then the image quality is improved, but additional processing steps and metadata transmission are required

Engineering Contradiction:
Improveimage alignment precisionVSAvoidprocessing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent extracts the essential correction information from complex depth value analysis by generating compact rearrangement information that captures only the necessary adjustment parameters for overlapped regions. This extracted metadata is transmitted separately from the main content, allowing the receiver to apply corrections without processing the entire image dataset, thus reducing overall system complexity.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent introduces rearrangement information as an intermediary element between the captured images and the final rendered content. This intermediary metadata layer carries the correction parameters derived from depth value analysis, enabling the receiver to perform precise local adjustments without requiring complex real-time processing of the original multi-lens image data.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentEP3501171B1Method and apparatus for transmitting and receiving virtual reality content
Publication Date: 2023.03.01 SAMSUNG ELECTRONICS CO LTD
  • EP3501171B1 patent drawingFigure 1~2A
  • EP3501171B1 patent drawingFigure 2B
  • EP3501171B1 patent drawingFigure 3

AI summary

A method for transmitting virtual reality (VR) content by a device is provided. The method includes obtaining at least two images captured from a target, arranging the at least two images and projecting the at least two images onto a planar surface to configure a 360-degree image corresponding to the VR content, detecting an overlapped region of the at least two images projected and generating rearrangement information about the overlapped region, and transmitting the rearrangement information and the at least two images.