Augmented Interface Authoring With Self-Calibrated Projection Sensing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current systems for authoring augmented reality interfaces in workspaces lack calibrated projection and sensor systems, which are essential for effective interaction and feedback, and existing human-machine interfaces are inflexible and do not adequately support operator guidance or measurement in performing processes.

Innovation Solution

A method and system that includes a calibrated projector and sensor system for projecting imagery and detecting operator interactions, allowing for the creation of interactive surfaces that receive input and display workspace information, enabling predictive user interfaces and robust touch detection through depth, intensity, and other sensors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If projection devices and sensor devices are manually calibrated before use, then measurement precision is improved, but loss of time increases due to the manual calibration process

Engineering Contradiction:
Improvecalibration precisionVSAvoidcalibration time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs automatic self-calibration by projecting calibration patterns and using the sensor device to capture and analyze the projected imagery, automatically computing calibration parameters without human intervention. This eliminates manual calibration steps while maintaining precision through algorithmic correction of projection-sensor coordinate mappings.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system performs calibration automatically during system initialization or setup phase before actual operation begins. By pre-computing calibration parameters and storing them for later use, the system eliminates the need for repeated manual calibration during operation, thus saving time while ensuring measurement precision is established beforehand.

Inventive Principle:
Principle #10Preliminary action

2Productivity

If existing human-machine interfaces are used to facilitate machine automation and control, then productivity is improved, but adaptability worsens because they are inflexible in physical and virtual domains

Engineering Contradiction:
Improveautomation efficiencyVSAvoidinterface flexibility
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The interface transitions from static physical buttons and fixed computer displays to dynamic projected imagery that can be repositioned, resized, and reconfigured in real-time based on operator needs and workspace conditions. The projection device enables the interface to adapt its physical location and virtual content dynamically, providing both automation efficiency and flexibility.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The projected interface serves multiple functions simultaneously - it can display control panels, provide procedural guidance, show real-time sensor data, and accept operator input through gesture recognition. This multi-functional capability replaces multiple separate interface components while maintaining productivity and enhancing adaptability through a single versatile system.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Adaptability or versatility

If projection devices project imagery continuously, then adaptability is improved for real-time interaction, but use of energy increases

Engineering Contradiction:
Improvereal-time interaction capabilityVSAvoidprojection energy consumption
Core Design Contradiction:
Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The projection device operates in periodic cycles, projecting imagery only when operator presence is detected or interaction is required. The sensor device continuously monitors the workspace and triggers projection events only when needed, reducing energy consumption while maintaining real-time interaction capability through event-driven operation.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The sensor device provides continuous feedback about operator presence, gestures, and workspace conditions. This feedback loop enables the system to activate projection only when operator interaction is detected, dynamically adjusting energy consumption based on actual usage needs while preserving full interactivity when operators are present.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10895868B2Augmented interface authoring
Publication Date: 2021.01.19 TULIP INTERFACES INC
  • US10895868B2 patent drawing
  • US10895868B2 patent drawing
  • US10895868B2 patent drawing

AI summary

Methods, systems, and apparatuses relating to augmented-reality interfaces. Features of the present invention rely on robust touch detection methods, touch detection methods, calibration methods, and integrated projector and sensor apparatuses.