Adaptive Filtering for Panoramic Video Zigzag Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

360-degree panoramic videos experience a zigzag effect during rendering due to high-frequency components in regions away from the primary perspective, leading to a poor user experience, as existing mapping techniques result in uneven resolution and increased bit rate requirements.

Innovation Solution

An adaptive filtering method is employed, dividing secondary perspective regions into sub-regions based on high-frequency component distribution and applying specific filter templates to smooth these components, thereby reducing the zigzag effect and improving visual quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If regional mapping is used to map 360-degree panoramic video, then compression rate is improved and transmission smoothness is enhanced, but regions with low mapping pixel values produce high-frequency components that cause zigzag effect during rendering

Engineering Contradiction:
Improvecompression rateVSAvoidzigzag effect
Core Design Contradiction:
ProductivityVSObject-affected harmful factors

Solution Approach 1:

The patent applies different quality levels to different regions of the panoramic video. The primary perspective region maintains high resolution and minimal filtering to preserve detail, while secondary perspective regions apply adaptive filtering to reduce high-frequency components that cause zigzag effects. This local differentiation resolves the contradiction by allowing compression in less critical regions without compromising the overall viewing experience.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent dynamically adjusts filtering parameters based on the perspective region and high-frequency component distribution. By changing the filtering strength and type according to local characteristics, the system achieves better compression while controlling zigzag effects in regions where they are most problematic, without unnecessarily degrading image quality in primary viewing areas.

Inventive Principle:
Principle #35Parameter changes

2Object-affected harmful factors

If adaptive filtering is applied to secondary perspective regions, then high-frequency components are reduced and zigzag effect is prevented, but image sharpness may be degraded

Engineering Contradiction:
Improvezigzag effectVSAvoidimage sharpness
Core Design Contradiction:
Object-affected harmful factorsVSManufacturing precision

Solution Approach 1:

The patent applies filtering selectively only to secondary perspective regions where zigzag effects are most problematic, while leaving the primary perspective region unfiltered or minimally filtered. This localized approach ensures that sharpness is preserved in the most important viewing area while still achieving zigzag reduction in peripheral regions.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent applies partial filtering action rather than uniform filtering across the entire image. By applying filtering only to specific secondary regions and not to the primary perspective region, the system achieves sufficient zigzag reduction without excessive filtering that would degrade overall image sharpness.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS10846823B2Image processing method, apparatus and machine-readable media
Publication Date: 2020.11.24 ALIBABA GROUP HOLDING LTD
  • US10846823B2 patent drawing
  • US10846823B2 patent drawing
  • US10846823B2 patent drawing

AI summary

Embodiments of the present application provide a method and an apparatus, and a machine readable media for image processing. The method includes obtaining a panoramic video image, where the panoramic video image is determined based on a perspective mapping, and the panoramic video image includes a primary perspective region and at least one secondary perspective region; dividing the secondary perspective region into at least two sub-regions based on distribution information of high-frequency components in the secondary perspective region; determining respective filter templates of the sub-regions, and filtering the sub-regions using the respective filter templates; and determining a filtered panoramic video image.