Augmented Reality Messaging via Marker-Based 3D Video Mapping

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for sending audio-visual messages are limited in impact, as they often rely on static images and lack the ability to create immersive experiences, failing to effectively convey the sender's environment or context.

Innovation Solution

The method involves capturing a 2D video in front of a green screen, removing the green background to create a transparent alpha channel, assigning a unique identifier, and using augmented reality protocols to display the video over a marker, allowing the video to be mapped in 3D space, creating the illusion of the person standing perpendicular to the marker, and optionally combining with other 3D elements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If standard video messaging is used, then the message can be sent easily, but the visual impact and immersion are limited

Engineering Contradiction:
Improvevisual impactVSAvoidmessage delivery system
Core Design Contradiction:
Illumination intensityVSDevice complexity

Solution Approach 1:

The patent transitions from 2D video messaging to 3D augmented reality messaging by mapping the video content onto a calibration marker in three-dimensional space. This allows the recipient to view the message from different angles and creates an immersive experience where the sender appears to stand in front of the marker, adding spatial depth and visual impact to the message delivery system.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Manufacturing precision

If a green screen is used to remove background, then the sender can be isolated cleanly, but the processing complexity increases

Engineering Contradiction:
Improvebackground removal accuracyVSAvoidvideo processing system
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent employs chroma key technology by having the sender stand in front of a green screen background. The green color is easily distinguishable and can be removed through color-based segmentation, allowing clean isolation of the sender from the background. This approach achieves high background removal accuracy while keeping the processing relatively simple due to the distinct color contrast.

Inventive Principle:
Principle #32Color changes

3Adaptability or versatility

If 3D elements are added to enhance immersion, then the message becomes more engaging, but the system complexity increases

Engineering Contradiction:
Improvemessage immersionVSAvoidaugmented reality system
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent uses a calibration marker as an intermediary object that mediates between the 2D video content and the 3D display environment. The marker serves as a reference frame that enables the system to map and position the sender's video image in three-dimensional space, creating the illusion that the sender is standing in front of the marker. This intermediary simplifies the complexity of direct 3D mapping while achieving immersive effects.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS8823807B2Methods and apparatus for enhanced reality messaging
Publication Date: 2014.09.02 SCHINKER ROBERT
  • US8823807B2 patent drawing
  • US8823807B2 patent drawing
  • US8823807B2 patent drawing

AI summary

The present invention provides a method for delivering an enhanced reality message. The method includes sending a medium containing a code or indicia corresponding to a recorded video to a recipient, said video including an altered “green screen” background. A web server is operated to send the recorded video including the altered “green screen” background to a recipient's computer when the corresponding code or indicia is received from the client computer. The method also includes superimposing the recorded, altered video over an image acquired by a webcam of the recipient's computer, and to position the recorded video on the display screen dependent upon the location of a special marker on an object seen by the webcam.