Point Cloud Encoding with Multi-Track Frame Rate Adaptation

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing point cloud encoding and decoding technologies face challenges in efficiently managing point cloud media tracks with different frame rates, leading to inefficient data transmission and presentation, particularly in scenarios where network bandwidth and device performance vary.

Innovation Solution

The method involves encoding point cloud data into multiple bitstreams with different frame rates, encapsulating these as media tracks with frame rate indication information, and using a decoding apparatus to select and merge tracks based on device performance and user requirements, thereby optimizing frame rates for efficient transmission and presentation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple point cloud media tracks with different frame rates are transmitted, then the adaptability to different network bandwidths and device performances is improved, but the network bandwidth consumption increases

Engineering Contradiction:

Improveadaptability to different network bandwidths and device performancesVSAvoidnetwork bandwidth consumption

Core Design Contradiction:

Adaptability or versatilityVSLoss of energy

Solution Approach 1:

The patent segments point cloud data into multiple media tracks with different frame rates (e.g., high frame rate track and low frame rate track). This allows the system to provide multiple quality levels so that users can select appropriate tracks based on their network conditions and device capabilities, thereby improving adaptability while controlling bandwidth consumption by not transmitting all tracks simultaneously.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent implements partial action by allowing users to selectively request and decode only the necessary media tracks based on their specific needs. Instead of transmitting all possible frame rate tracks continuously, the system provides tracks on demand, reducing unnecessary bandwidth consumption while maintaining the ability to serve diverse user requirements.

Inventive Principle:

Principle #16Partial or excessive action

2Adaptability or versatility

If point cloud data is encoded into multiple bitstreams with different frame rates, then the flexibility in encoding and decoding is improved, but the complexity of managing multiple media tracks increases

Engineering Contradiction:

Improveflexibility in encoding and decodingVSAvoidcomplexity of managing multiple media tracks

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent divides the point cloud data into separate media tracks organized by frame rate, with each track containing points encoded at a specific temporal resolution. This segmentation allows the decoder to independently manage each track and selectively process only the necessary ones, reducing the complexity of handling multiple frame rates while maintaining encoding flexibility.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent implements preliminary action by pre-organizing and pre-labeling media tracks with their respective frame rate characteristics before transmission. This allows the decoding system to quickly identify and select appropriate tracks without performing complex real-time analysis, thereby reducing operational complexity while preserving encoding versatility.

Inventive Principle:

Principle #10Preliminary action

3Measurement precision

If frame rate indication information is carried in file encapsulation information, then the accuracy of frame rate identification is improved, but the size of encapsulation information increases

Engineering Contradiction:

Improveaccuracy of frame rate identificationVSAvoidsize of encapsulation information

Core Design Contradiction:

Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent applies local quality by incorporating frame rate indication information at specific localized positions within the encapsulation structure (such as in track headers or key frames) rather than throughout the entire data stream. This targeted approach ensures accurate frame rate identification where needed while minimizing the overall increase in encapsulation information size.

Inventive Principle:

Principle #3Local quality

Solution Approach 2:

The patent utilizes parameter changes by encoding frame rate information using efficient data representations (such as logarithmic scaling or delta encoding) that maintain precision while reducing the number of bits required. This allows accurate frame rate identification with minimal overhead in the encapsulation information.

Inventive Principle:

Principle #35Parameter changes

Data Source

PatentUS12118760B2Point cloud encoding and decoding method and apparatus, computer-readable medium, and electronic device

Publication Date: 2024.10.15 TENCENT TECHNOLOGY (SHENZHEN) CO LTD

AI summary

The present subject matter relates to point cloud encoding and decoding methods and apparatuses. A point cloud file transmitted by a data source is received. The point cloud file comprises point cloud media tracks having the same point cloud content and point cloud media tracks having different frame rates. File encapsulation information of the point cloud media tracks are parsed to obtain frame rate indication information carried in the file encapsulation information. The frame rate indication information indicates frame rates of the point cloud media tracks. A point cloud media track with a designated frame rate is selected and decoded from the point cloud file according to the frame rate indication information carried in the file encapsulation information.