AR Headset Video Management Engine for Memory-Constrained Streaming

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current Augmented Reality (AR) systems lack real-time streaming and annotation capabilities between users, particularly for AR headsets, which are underutilized due to a lack of developer focus and available apps that leverage their unique features.

Innovation Solution

An AR system that includes wearable devices with headsets, controllers, and a server for data communication, featuring video and image management engines to handle file sizes, authentication, and sensor data, enabling real-time Point of View (POV) streaming with annotated information between multiple users across wearable and non-wearable devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If video data is stored in local memory of wearable device, then real-time streaming capability is improved, but device memory capacity is limited and cannot handle large files

Engineering Contradiction:
Improvereal-time streaming capabilityVSAvoidvideo file size capacity
Core Design Contradiction:
SpeedVSQuantity of substance

Solution Approach 1:

The patent introduces a server as an intermediary between wearable devices for storing and managing video data. The video management engine transfers video files exceeding local memory capacity to the server, which acts as a mediator that enables unlimited video storage while maintaining real-time streaming capability on resource-constrained wearable devices.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If image data is displayed on wearable device, then user interaction is improved, but image processing complexity increases when handling large images

Engineering Contradiction:
Improveuser interaction capabilityVSAvoidimage processing complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The image management engine divides large images into smaller tiles that can be processed and displayed on wearable devices with limited resources. This segmentation approach maintains user interaction capability while reducing the computational complexity and memory requirements for handling large images on resource-constrained devices.

Inventive Principle:
Principle #1Segmentation

3Adaptability or versatility

If multiple users connect through server, then communication capability is improved, but network data transmission requirements increase

Engineering Contradiction:
Improvemulti-user communication capabilityVSAvoidnetwork data transmission volume
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The system extracts and stores large video files on the server rather than transmitting them continuously between users. This allows multiple users to connect and interact in real-time with minimal network bandwidth consumption, as the server handles file storage and management while users only exchange control signals and metadata.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS10459534B2System and method for large data augmented reality applications on smartglasses
Publication Date: 2019.10.29 THIRDEYE GEN INC
  • US10459534B2 patent drawing
  • US10459534B2 patent drawing
  • US10459534B2 patent drawing

AI summary

An augmented reality system for communication between a plurality of user devices. The system includes a wearable device with a headset, controller, display, camera, earphone and microphone. The controller has a local memory with a maximum video file size. The camera records video data for storage in the local memory. A server is configured for data communication with the plurality user devices, the server has a server memory and plurality of user accounts. The server is configured to establish data connection between the wearable device and at least one other user device. A video management located is configured to determine whether the video data stored in the local memory equals the maximum video file size and in this event, the video management engine is configured to transfer the video data to the server for storage in the server memory and delete the video data from the local memory.