Volumetric Video Transparency Control via Metadata Ranges

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current volumetric video technologies lack a solution to control rendering effects such as transparency, color filtering, or blurring in a way that balances content producer requirements with viewer expectations, potentially leading to narrative inconsistencies or undesirable disocclusions.

Innovation Solution

The method involves obtaining an atlas image representing a 3D scene, packing patch pictures, and associating metadata with rendering effects, allowing users to modify rendering effects within specified value ranges, with options for applying new values to specific objects or bounding boxes, enabling flexible management of rendering effects like transparency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If users are allowed to freely modify rendering effects such as transparency in volumetric video, then user interaction and customization are improved, but narrative consistency and visual quality may deteriorate due to undesirable disocclusions

Engineering Contradiction:
Improveuser control over rendering effectsVSAvoidnarrative consistency
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent applies parameter changes by introducing metadata that defines specific parameter ranges (minimum and maximum values) for rendering effects such as transparency. This allows the system to dynamically adjust rendering parameters within controlled boundaries, enabling user interaction while preventing values that would cause narrative inconsistencies or undesirable disocclusions. The metadata-driven approach ensures that parameter modifications remain within acceptable limits defined by content producers.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent implements preliminary action by pre-defining acceptable ranges for rendering effects in the metadata before the user interacts with the content. Content producers establish minimum and maximum values for transparency and other rendering parameters in advance, creating constraints that guide subsequent user interactions. This preliminary configuration ensures that any user-modified rendering effect will maintain narrative consistency while still allowing flexibility within the predefined bounds.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If content producers impose strict controls on rendering effects, then narrative consistency is maintained, but user flexibility and interaction are reduced

Engineering Contradiction:
Improvenarrative consistencyVSAvoiduser control over rendering effects
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent applies dynamics by transforming static, all-or-nothing control into a dynamic, flexible system. Instead of completely restricting user control or allowing unlimited freedom, the system dynamically adjusts rendering effects within metadata-defined ranges. Users can modify rendering parameters in real-time within acceptable boundaries, and the system responds by applying changes that maintain narrative consistency. This dynamic approach balances producer constraints with user flexibility.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent enables parameter changes within controlled ranges rather than fixing parameters absolutely. By defining minimum and maximum values in metadata, the system allows users to change rendering parameters (such as transparency levels) within acceptable bounds. This approach maintains narrative consistency while providing meaningful user control, as users can explore variations within the defined parameter space without risking narrative breakdown.

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If transparency effects are applied to remove objects in volumetric video, then visual customization is enhanced, but visual quality may deteriorate due to disocclusions

Engineering Contradiction:
Improveobject removal capabilityVSAvoidvisual quality
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent applies parameter changes by controlling transparency levels through metadata-defined ranges rather than allowing complete object removal. By setting appropriate minimum and maximum transparency values, the system enables visual customization while preventing excessive transparency that would cause disocclusions and degrade visual quality. This parameter-based control allows subtle transparency effects that enhance customization without compromising the integrity of the volumetric video.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20240013475A1Transparency range for volumetric video
Publication Date: 2024.01.11 INTERDIGITAL CE PATENT HOLDINGS SAS
  • US20240013475A1 patent drawing
  • US20240013475A1 patent drawing
  • US20240013475A1 patent drawing

AI summary

Methods, devices and video data encoding a volumetric 3D scene are disclosed. The user is allowed to modify values of rendering effects for some objects of the 3D scene in ranges provided by the content creator or the broadcaster. Metadata describing the possibilities of modifications, the concerned objects and authorized ranges of values are associated with the payload content. On the decoding side, according to these metadata an interface is provided to the user for modifying the values in the authorized ranges.