ATSC 3.0 Broadcast for Volumetric AR Data Delivery

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Live AR content streaming over IP channels faces significant bandwidth and latency challenges, especially for mobile AR devices with data restrictions, as existing techniques struggle to efficiently deliver view-independent 3D data overlays.

Innovation Solution

The proposed solution leverages the ATSC 3.0 broadcast infrastructure to transmit temporarily encoded volumetric data, allowing for view-independent 3D data overlays by using existing digital TV channels, which enables efficient delivery of AR content by dividing the data into seed, full frame, and frame-to-frame phases, optimizing bandwidth usage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If live AR content is streamed over IP channels to mobile devices, then AR content delivery is enabled, but bandwidth consumption increases and latency increases

Engineering Contradiction:
ImproveAR content deliveryVSAvoidbandwidth consumption
Core Design Contradiction:
Ease of operationVSQuantity of substance

Solution Approach 1:

The patent segments AR content into three distinct data types: seed data (initial 3D model), full frame data (complete volumetric updates), and frame-to-frame data (incremental updates). This segmentation allows receivers to efficiently process only the necessary data for their specific needs, reducing overall bandwidth consumption while enabling scalable AR content delivery to multiple devices simultaneously.

Inventive Principle:
Principle #1Segmentation

2Ease of operation

If live AR content is streamed over IP channels to mobile devices, then AR content delivery is enabled, but latency increases

Engineering Contradiction:
ImproveAR content deliveryVSAvoidlatency
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The patent implements preliminary action by first transmitting seed data containing the initial 3D model structure before sending full frame or frame-to-frame updates. This allows receivers to prepare their rendering environments in advance and progressively build AR content as data arrives, significantly reducing perceived latency and enabling faster AR content delivery to mobile devices.

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If view-independent 3D data overlays are delivered to multiple users, then AR content accessibility is improved, but data transmission volume increases

Engineering Contradiction:
ImproveAR content accessibilityVSAvoiddata transmission volume
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The patent implements a dynamic data transmission strategy where the type of data sent (seed, full frame, or frame-to-frame) is adaptively determined based on receiver capabilities, current AR content state, and network conditions. This dynamic approach enables view-independent 3D data overlay delivery to multiple users with different device capabilities while optimizing data transmission volume by sending only necessary updates to each receiver.

Inventive Principle:
Principle #15Dynamics

4Manufacturing precision

If photorealistic 3D volumetric data is transmitted, then AR content quality is improved, but bandwidth requirements increase

Engineering Contradiction:
ImproveAR content qualityVSAvoidbandwidth requirements
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The patent implements periodic action by transmitting photorealistic 3D volumetric data in structured phases: initial seed data transmission, followed by periodic full frame updates, and continuous frame-to-frame incremental updates. This periodic transmission approach maintains high AR content quality with photorealistic 3D volumetric data while managing bandwidth requirements through efficient data phase management and incremental updates rather than continuous high-bandwidth streaming.

Inventive Principle:
Principle #19Periodic action

Data Source

PatentUS11695488B2ATSC over-the-air (OTA) broadcast of public volumetric augmented reality (AR)
Publication Date: 2023.07.04 SONY INTERACTIVE ENTERTAINMENT LLC
  • US11695488B2 patent drawing
  • US11695488B2 patent drawing
  • US11695488B2 patent drawing

AI summary

Techniques are described for using the Advanced Television Systems Committee (ATSC) 3.0 television protocol to deliver volumetric information for presentation on various displays using ATSC over-the-air communications channels.