Mirror Display with 6-DOF Wand Tracking and Visual Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current interactive display systems, such as the 'magic mirror' concept, lack the ability to track specific articles like the Harry Potter wand with IR retroreflective tips and provide visual feedback to users, especially children, and do not incorporate facial recognition for guest identification or unique wand ID, limiting user engagement and experience in theme parks and beyond.

Innovation Solution

A system that includes a mirror display capable of multiple modes of operation, integrating object tracking in 6 degrees of freedom, facial recognition, and wireless power for active wands, providing visual feedback and allowing for guest identification, enabling enhanced user interaction and experience across various environments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If a passive wand with IR retroreflective tip is used for tracking, then the system can detect wand movements, but the system cannot provide visual feedback to users about their wand paths

Engineering Contradiction:
Improvevisual feedback on wand pathVSAvoidsystem complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent implements visual feedback by displaying the tracked wand path on a screen or display device. The system captures images of the wand tip, processes the position data, and renders a visual representation of the path taken, allowing users to see their spell-casting movements in real-time or replay them later.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent introduces an intermediary processing system that includes image processing algorithms and path reconstruction software. This intermediary layer transforms the raw image data from the camera into meaningful visual feedback, bridging the gap between the passive wand tracking and the user's visual understanding of their movements.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If facial recognition and guest identification systems are added to the mirror display, then user engagement is enhanced, but device complexity increases

Engineering Contradiction:
Improveguest identification capabilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The mirror display device is designed to perform multiple functions: it serves as a reflective surface, a display screen, a facial recognition system, and a wand tracking interface. By integrating these diverse functionalities into a single device, the system enhances user engagement without proportionally increasing complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent combines the mirror, display screen, camera systems for facial recognition, and wand tracking components into an integrated apparatus. The mirror display acts as a central hub that coordinates multiple subsystems, allowing guest identification and wand tracking to work together seamlessly.

Inventive Principle:
Principle #5Merging (Combining)

3Measurement precision

If 6 DOF tracking is implemented for the wand, then tracking precision is improved, but the difficulty of detecting and measuring increases

Engineering Contradiction:
Improvewand tracking precisionVSAvoidtracking complexity
Core Design Contradiction:
Measurement precisionVSDifficulty of detecting and measuring

Solution Approach 1:

The patent extends tracking from 2 DOF (X and Y coordinates) to 6 DOF by adding depth (Z axis), orientation angles (pitch, yaw, roll), and potentially temporal dimensions. This is achieved through multi-camera setups or stereo vision systems that can calculate three-dimensional position and orientation from multiple viewing angles.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent replaces complex mechanical tracking systems with optical-based detection using cameras and image processing algorithms. Instead of mechanical encoders or physical markers on the wand, the system uses computer vision to detect the wand tip position and calculate 6 DOF parameters through mathematical processing of visual data.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enhances user engagement by providing real-time visual feedback on wand movements, facilitates guest identification, and extends interactive experiences beyond theme parks into hotels, restaurants, and homes, enabling theme park-wide games and interactions.

Implementation Method 1

guests may purchase a Harry Potter Wand constructed in accordance with the pending application comprising an infrared (IR) retroreflective tip

Methodology Applied
Scientific EffectRetroreflection: Retroreflector

Implementation Method 2

These playing areas include hidden IR LEDs for emitting IR tracking energy that is retroreflected off the tip of the wand, where the retroreflected energy is then detected by a camera filtered to receive the IR energy

Methodology Applied
Scientific EffectInfrared radiation: Infrared Radiation

Data Source

PatentUS10719134B2Interactive object tracking mirror-display and entertainment system
Publication Date: 2020.07.21 AMAN JAMES ANDREW
  • US10719134B2 patent drawing
  • US10719134B2 patent drawing
  • US10719134B2 patent drawing

AI summary

A mirror-display is taught for use in a destination such as a theme park or hotel that allows a guest to move an article such as a wand in front of the mirror-display, where the movements are tracked and interpreted as commands. Visual movement feedback of the article is provided to help train the guests. The mirror-display can act as a full mirror, but then switch into a half-mirror mode where the guest sees their partial reflection along with output from the display, or a transparent mode where the guest does not see their reflection. Output includes secret messages only viewable to guests wearing glasses that are controllably detected and synchronized with the display output. The mirror-display comprises means for automatically determining guest identity and for exchanging commands and information with either or both of a local or global eco-system.