Aggregated Video Frame Transmission for AR Headsets

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional motion tracking systems in augmented and virtual reality headsets face challenges with camera coverage gaps and inefficient data transmission from multiple cameras over limited-bandwidth channels.

Innovation Solution

The method involves combining frames from multiple video streams into a single image, including metadata, and transmitting this image via a single transmission channel, which can be a limited-bandwidth channel like a USB cable, to efficiently transmit video data from multiple cameras attached to a wearable headset.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If multiple cameras are added to eliminate coverage gaps, then camera coverage is improved, but data transmission efficiency deteriorates due to limited bandwidth

Engineering Contradiction:
Improvecamera coverage areaVSAvoiddata transmission efficiency
Core Design Contradiction:
Area of stationary objectVSProductivity

Solution Approach 1:

The patent combines multiple video frames from different cameras into a single composite image for transmission. Instead of sending separate video streams from each camera over the limited-bandwidth channel, the system merges them into one aggregated image data structure, reducing the total data transmission load while maintaining coverage from all camera viewpoints.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent embeds multiple camera frames within a single composite image structure. Each camera's frame is nested as a component within the larger aggregated image, allowing efficient packaging and transmission of multiple video sources through a single data container over the bandwidth-constrained channel.

Inventive Principle:
Principle #7Nested doll (Nesting)

2Loss of information

If multiple video streams are transmitted separately, then data completeness is improved, but transmission bandwidth requirement increases

Engineering Contradiction:
Improvevideo data completenessVSAvoidtransmission bandwidth
Core Design Contradiction:
Loss of informationVSQuantity of substance

Solution Approach 1:

The system merges multiple video streams into a single aggregated image transmission. By combining the data from multiple cameras into one composite structure, the patent reduces the number of separate transmission channels needed while preserving all video information through systematic organization of frames within the aggregated image.

Inventive Principle:
Principle #5Merging (Combining)

3Productivity

If frames from multiple cameras are combined into a single image, then transmission efficiency is improved, but processing complexity increases

Engineering Contradiction:
Improvetransmission efficiencyVSAvoidprocessing complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the composite image into distinct frame regions, each corresponding to a specific camera. By organizing the aggregated image with clearly defined segments for each camera's frame, the system simplifies the processing required to create and decode the composite image, making it easier to manage the complexity of handling multiple video streams.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary data structure that facilitates the combination of multiple frames. This intermediate representation serves as a bridge between the raw video streams and the final transmitted image, simplifying the processing by providing a standardized format for integrating frames from different cameras before transmission.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10536666B1Systems and methods for transmitting aggregated video data
Publication Date: 2020.01.14 META PLATFORMS TECHNOLOGIES LLC
  • US10536666B1 patent drawing
  • US10536666B1 patent drawing
  • US10536666B1 patent drawing

AI summary

A system for transmitting camera data may include (i) identifying at least two streams of video data that are each produced by a different video source, (ii) receiving a set of at least two frames of video data that includes exactly one frame from each of the at least two streams of video data, (iii) placing, within an image, the set of at least two frames of video data received from the at least two streams of video data, and (iv) transmitting the image that includes the set of at least two frames of video data received from the at least two streams of video data via a single transmission channel. Various other apparatuses, systems, and methods, are also disclosed.