Trigger Zones for Object Detection in Projected Surfaces

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Integrated computing devices face challenges in providing a natural and intuitive interaction experience due to limitations in detecting and responding to objects and gestures within their display areas, particularly in distinguishing between active and passive objects and user interactions.

Innovation Solution

An integrated processing and projection device equipped with a projector, RGB camera, infrared emitter, and detector, which defines trigger zones within a detection area to provide object-specific feedback through projection, audible, or active feedback, utilizing a processor to integrate sensor data for accurate object and gesture detection.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple sensors (RGB camera, infrared emitter, infrared detector, depth camera) are integrated to improve object and gesture detection accuracy, then measurement precision and detection capability are improved, but device complexity increases

Engineering Contradiction:
Improveobject and gesture detection accuracyVSAvoidsensor integration complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines multiple sensors (RGB camera, infrared emitter, infrared detector, and depth camera) into a single integrated processing and projection device. This merging of sensors allows the system to detect both active and passive objects and user gestures with high accuracy by fusing data from different sensor types, while managing the complexity through unified processing architecture.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The integrated sensor system serves multiple functions: detecting passive objects, detecting active objects, recognizing user gestures, and providing spatial awareness. This multi-functionality allows a single sensor integration to address various detection needs, improving measurement precision across different interaction scenarios without requiring separate specialized systems for each function.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If trigger zones are defined in the detection area to provide object-specific feedback, then adaptability and user experience are improved, but device complexity increases

Engineering Contradiction:
Improveobject-specific feedback capabilityVSAvoidtrigger zone processing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The detection area is divided into multiple trigger zones with specific functions and characteristics. Each trigger zone can be configured to respond to different object types, gestures, or interaction patterns. This segmentation allows the system to provide targeted, object-specific feedback by determining which trigger zone an object enters or interacts with, enhancing adaptability while managing complexity through modular zone definitions.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Trigger zones are pre-configured with specific response behaviors and feedback mechanisms before runtime. The system establishes the detection area and defines trigger zones in advance, associating each zone with predetermined feedback actions. This preliminary configuration reduces real-time processing complexity while maintaining high adaptability, as the system only needs to determine which pre-defined zone is activated rather than making complex decisions in real-time.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables accurate identification and interaction with both active and passive objects, enhancing the user experience by providing context-specific feedback within the display area, improving the overall interaction and feedback mechanisms.

Implementation Method 1

an infrared emitter and infrared detector

Methodology Applied
Scientific EffectInfrared radiation emission: Infrared Radiation

Implementation Method 2

RGB camera, emitter and detector establish a detection area

Methodology Applied
Scientific EffectLight reflection: Reflection

Data Source

PatentUS10306193B2Trigger zones for objects in projected surface model
Publication Date: 2019.05.28 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10306193B2 patent drawing
  • US10306193B2 patent drawing
  • US10306193B2 patent drawing

AI summary

An integrated processing and projection device suitable for use on a supporting surface includes a processor and a projector designed to provide a display on the supporting surface proximate to the device. Various sensors enable object and gesture detection in a detection area in the display area. Trigger zones are defined in the detection area such that interaction of an object or human limb in the detection zone provides object and zone specific feedback by the integrated processing and projection device. The feedback can be provided in the projection area or may be provided as audible or active feedback to a device having active feedback capabilities.