Point Cloud Visibility Map for Adaptive V-PCC Bandwidth

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In video-based point cloud compression (V-PCC), high-definition display requires acquiring entire objects including invisible portions, leading to unnecessary bit rate increase and network bandwidth inefficiency, as existing methods uniformly compress data across all projection planes without adapting to viewing direction.

Innovation Solution

An information processing device generates an identification region map using normal vector orientation and object outline information to determine visible and invisible regions, allowing for adaptive stream selection and distribution based on the viewing position, reducing unnecessary data acquisition.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If uniform compression is applied to all projection planes in V-PCC, then definition in all directions is equal, but bit rate increases unnecessarily and network bandwidth utilization deteriorates

Engineering Contradiction:
Improvedefinition in all directionsVSAvoidbit rate
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent applies local quality by differentiating compression treatment across different spatial regions. Visible regions (front-facing surfaces) are compressed with higher quality settings while invisible regions (back-facing surfaces) use lower quality settings. This is achieved by calculating visibility determination for each projection plane based on viewing position, then applying region-specific compression parameters to match local visibility requirements.

Inventive Principle:
Principle #3Local quality

2Measurement precision

If high-definition display is performed by acquiring entire objects including invisible portions, then viewing quality is maintained, but network bandwidth utilization deteriorates

Engineering Contradiction:
Improveviewing qualityVSAvoidnetwork bandwidth utilization
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent extracts and transmits only the necessary visible portions of the point cloud data based on calculated visibility regions. By determining which projection planes correspond to visible surfaces from the viewing position, the system extracts only those data streams needed for high-definition display, excluding invisible portions entirely from transmission.

Inventive Principle:
Principle #2Taking out (Extraction)

3Productivity

If viewing direction adaptive distribution is implemented by dividing streams for each projection plane, then network bandwidth utilization improves, but device complexity increases due to stream identification requirements

Engineering Contradiction:
Improvenetwork bandwidth utilizationVSAvoidstream identification complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent performs preliminary calculation of visibility determination and identifies the necessary divided streams before the actual streaming process. By pre-calculating which projection planes are visible from the given viewing position and preparing the identification region map in advance, the system reduces the complexity of real-time stream identification and selection during playback.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11983914B2Information processing device and information processing method for point cloud data compression
Publication Date: 2024.05.14 SONY GROUP CORP
  • US11983914B2 patent drawing
  • US11983914B2 patent drawing
  • US11983914B2 patent drawing

AI summary

Provided is a generation unit that generates an identification region map indicating whether or not each divided object data is visible from each position in a three-dimensional space by using information regarding orientation of a normal vector dividing an object in the three-dimensional space and information regarding an outline of the object.