Point Cloud Camera Offset Signaling for Preferred 3D Views

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing video coding systems require users to manually adjust camera positions and angles to view 3D point clouds, leading to an undesirable user experience due to the lack of predefined preferred viewing positions and angles.

Innovation Solution

Implement mechanisms to signal preferred viewing positions and angles by encoding camera offsets and rotations, allowing users to select desired viewing positions and angles during decoding.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If users manually adjust camera positions and angles in PCC videos, then viewing flexibility is improved, but user experience deteriorates due to the lack of predefined preferred viewing positions and angles

Engineering Contradiction:

Improveviewing flexibilityVSAvoiduser experience

Core Design Contradiction:

Adaptability or versatilityVSEase of operation

Solution Approach 1:

The encoder pre-calculates and signals camera offsets and rotations for multiple preferred viewing positions before the user views the content. This preliminary action provides users with ready-to-use viewing configurations, eliminating the need for manual adjustment while maintaining viewing flexibility through multiple pre-defined options.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system changes camera parameters (position offsets and rotation angles) by signaling multiple sets of camera offsets and corresponding rotations for different preferred viewing positions. This allows the decoder to switch between different viewing configurations based on user selection, resolving the contradiction between flexibility and ease of operation.

Inventive Principle:

Principle #35Parameter changes

2Adaptability or versatility

If multiple camera positions and angles are signaled in the bitstream, then viewing options are improved, but data size increases

Engineering Contradiction:

Improveviewing optionsVSAvoiddata size

Core Design Contradiction:

Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

Instead of signaling complete camera position and orientation data for multiple views, the system signals camera offsets relative to a default position and corresponding rotations. This parameter-based approach provides multiple viewing options while keeping the data size manageable through efficient representation.

Inventive Principle:

Principle #35Parameter changes

3Ease of operation

If camera offsets and rotations are encoded and decoded, then predefined viewing positions are improved, but processor usage increases

Engineering Contradiction:

Improvepredefined viewing positionsVSAvoidprocessor usage

Core Design Contradiction:

Ease of operationVSUse of energy by moving object

Solution Approach 1:

The camera offsets and rotations are pre-calculated and signaled in the bitstream during encoding, so the decoder only needs to apply these pre-computed values without performing complex real-time calculations. This preliminary computation reduces processor usage at decode time while still providing predefined viewing positions.

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS12632991B2Signaling camera parameters in point cloud coding

Publication Date: 2026.05.19 HUAWEI TECH CO LTD

AI summary

A video coding mechanism is disclosed. The mechanism includes receiving a bitstream comprising a plurality of two dimensional (2D) patches in an atlas frame and a camera offset for a camera. The patches are decoded and converted to a three dimensional (3D) patch coordinate system to obtain a point cloud frame. An offset matrix is determined based on the camera offset. The offset is then applied matrix to the point cloud frame.