Augmented Reality Overlay for Mobile Video

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video capturing technologies are limited to capturing only what is visible to the operator, failing to incorporate additional relevant information or interactive content into the video stream, such as augmented reality elements, without the need for barcodes or tags.

Innovation Solution

A mobile computing device with an augmented reality application that detects real-world trigger items using visual, audio, and metadata, and overlays user-generated augmented reality content, such as videos, animations, or links, onto the video stream in real-time, utilizing a network of servers for content delivery and recognition.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If traditional video capturing devices are used, then the video content is limited to what is visible to the operator, but adding augmented reality content would enhance the video experience with additional information and interactive elements

Engineering Contradiction:
Improvevideo content enrichmentVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent introduces a server system as an intermediary between the mobile computing device and the augmented reality content delivery. The server receives video frames, processes them to identify trigger items, and returns augmented video frames with overlaid content. This mediator approach allows the mobile device to remain relatively simple while still achieving sophisticated AR functionality through networked processing.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If augmented reality content is overlaid onto video streams in real-time, then interactive content is added without barcodes or tags, but processing time and computational resources are consumed

Engineering Contradiction:
Improveuser interaction simplicityVSAvoidprocessing time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system performs preliminary actions by pre-defining trigger items and their associated augmented reality content on the server side. When a video frame is received, the server compares it against pre-stored trigger item databases to identify matches, then retrieves pre-prepared augmented content for overlaying. This preliminary preparation significantly reduces real-time processing requirements.

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If user-generated content is created and shared in the augmented reality environment, then community interaction and content diversity are enhanced, but content management and distribution complexity increases

Engineering Contradiction:
Improvecontent diversityVSAvoidcontent management complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements self-service functionality where users can easily create their own augmented reality scenarios by selecting trigger items and associating them with content of their choice. The system automatically handles the complex tasks of content storage, indexing, and distribution through the server infrastructure. Users simply upload content and specify trigger conditions, and the system manages the rest, making content creation accessible without requiring technical expertise.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS9338589B2User-generated content in a virtual reality environment
Publication Date: 2016.05.10 HEWLETT PACKARD DEVELOPMENT COMPANY LP
  • US9338589B2 patent drawing
  • US9338589B2 patent drawing
  • US9338589B2 patent drawing

AI summary

The systems and methods allow users of mobile computing devices to generate augmented reality scenarios. Augmented reality content is paired with a real world trigger item to generate the augmented reality scenario. The augmented reality content is overlaid onto frames on a video when a trigger item is detected. Each mobile computing device may have an augmented reality application resident on the mobile computing device to allow a user to generate the augmented reality scenarios.