Handheld Projector Marker Tracking for Immersive Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Handheld projectors face challenges in developing interaction techniques that accommodate movement, as projected imagery moves and distorts with user hand movement, and existing solutions like IR transmitters can be costly and aesthetically distracting.
Innovation Solution
The method involves detecting markers embedded in a display surface using infrared ink, allowing the handheld projector to project animated objects relative to these markers, enabling gestural control and immersive interaction by blending virtual characters with the physical environment without the need for expensive IR transmitters.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional IR transmitters are used for tracking, then tracking reliability is improved, but cost increases and aesthetic appearance deteriorates
Solution Approach 1:
The patent replaces expensive IR transmitters with inexpensive printed markers that can be mass-produced at low cost. These markers use simple reflective or contrast-based patterns that are detected by the projector's camera, eliminating the need for costly active transmitters while maintaining adequate tracking reliability for the application.
Solution Approach 2:
The patent creates a visual copy or representation of the tracking target using printed markers that reflect or absorb light in detectable patterns. Instead of using physical IR transmitters, the system uses 2D printed patterns that replicate the essential tracking information needed, allowing the camera to detect position and orientation through image processing rather than receiving active IR signals.
2Reliability
If traditional IR transmitters are used for tracking, then tracking reliability is improved, but aesthetic appearance deteriorates
Solution Approach 1:
The patent applies different visual properties to different parts of the marker. The marker contains both visually appealing decorative elements and functional tracking patterns in specific locations. The tracking-critical regions use high-contrast patterns detectable by the camera, while other regions can be aesthetically designed to blend with the surrounding environment or application context.
Solution Approach 2:
The patent uses color and contrast variations in the printed marker patterns to encode tracking information. Different colors or brightness levels in specific patterns allow the camera to distinguish tracking features from the background while maintaining aesthetic appearance. The marker can change its visual appearance based on lighting conditions or be designed with colors that are visually pleasing to humans but provide strong contrast for machine detection.
3Device complexity
If projected imagery is used without hidden markers, then device complexity is reduced, but measurement precision deteriorates
Solution Approach 1:
The patent pre-places markers on the projection surface before the projection begins. These markers are positioned at known locations and orientations, allowing the system to establish a reference coordinate system in advance. The camera detects these pre-positioned markers to determine the surface geometry and orientation, which then guides the projection alignment without requiring complex real-time adjustment mechanisms.
Solution Approach 2:
The patent introduces printed markers as an intermediary element between the projector and the projection surface. These markers serve as a mediating reference that the camera can easily detect to infer surface properties. Instead of directly analyzing the complex geometry of the projection surface, the system uses the simpler, high-contrast marker patterns as intermediaries to extract position and orientation information with higher precision.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach provides effective gestural control and immersive interaction by using hidden infrared markers, allowing virtual characters to respond to physical objects and environments, enhancing user experience in applications like games and storytelling without the cost or aesthetic issues of traditional IR transmitters.
Implementation Method 1
detecting a marker embedded in a display surface
Data Source
AI summary
Techniques for presenting display frames projected using a handheld projector. Embodiments detect a marker embedded in a display surface. A first display frame is projected onto the display surface from the handheld projector, where the first display frame projects, on the display surface, one or more animated objects positioned relative to the detected marker embedded in the display surface. Embodiments generate one or more subsequent display frames projected from the handheld projector, where at least a first one of the animated objects in the one or more subsequent display frames is positioned relative to the detected marker embedded in the display surface.