Touchless HCI Zone of Restriction for Wobble Noise Cancellation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current human-computer interaction (HCI) technologies lack effective methods for interpreting human gestures in three-dimensional environments, particularly for touchless interactions, as they do not account for the physical plane and natural wobble of human appendages, leading to noise and inaccurate gesture interpretation.

Innovation Solution

A touchless HCI system that utilizes a virtual surface and zone of restriction in three-dimensional space, employing a camera, gesture engine, physics engine, and action interpretation engine to process user movements, generate clean gesture data, and determine dynamic variables for interpreting actions such as select, hover, drag, and swipe, while compensating for natural wobble through mathematical constructs like the zone of restriction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If touchless interaction is implemented in three-dimensional environment, then physical controller is eliminated and natural gestures are enabled, but noise from human arm wobble causes inaccurate gesture interpretation

Engineering Contradiction:
Improvenatural gesture interactionVSAvoidgesture recognition accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent introduces a virtual surface as an intermediary between the user and the computer system. This virtual surface serves as a reference plane that mediates the interpretation of gestures, allowing the system to distinguish between intentional movements and natural arm wobble by comparing gesture trajectories against the virtual surface plane.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system dynamically changes parameters such as the zone of restriction boundaries and gesture recognition thresholds based on the detected arm wobble characteristics. By adapting these parameters in real-time, the system maintains accurate gesture recognition despite the natural variability in human arm movement.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If zone of restriction is defined to eliminate wobble noise, then gesture recognition accuracy is improved, but system complexity increases

Engineering Contradiction:
Improvegesture recognition accuracyVSAvoidsystem architecture complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The virtual surface serves multiple functions simultaneously: it acts as a reference plane for gesture interpretation, defines the zone of restriction boundaries, and provides a visual feedback mechanism to users. This multi-functionality reduces the need for separate components and simplifies the overall system architecture.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system uses the user's own arm movement characteristics to automatically define the zone of restriction. By analyzing the natural wobble pattern and adapting the restriction zone accordingly, the system eliminates the need for manual calibration or complex external configuration, thereby reducing system complexity.

Inventive Principle:
Principle #25Self-service

3Measurement precision

If dynamic variables are analyzed to determine interpreted actions, then gesture interpretation accuracy is improved, but processing time increases

Engineering Contradiction:
Improveaction interpretation accuracyVSAvoidgesture processing delay
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary analysis of gesture data by comparing movements against the pre-defined virtual surface and zone of restriction before final action interpretation. This preliminary filtering eliminates obvious wobble patterns early in the processing pipeline, reducing the computational burden of subsequent analysis and minimizing processing delay.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The gesture recognition process is segmented into distinct stages: initial gesture detection, virtual surface comparison, zone of restriction validation, and final action interpretation. By dividing the processing into segments, the system can optimize each stage independently and process gestures more efficiently without sacrificing accuracy.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10599212B2Navigation of a virtual plane using a zone of restriction for canceling noise
Publication Date: 2020.03.24 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10599212B2 patent drawing
  • US10599212B2 patent drawing
  • US10599212B2 patent drawing

AI summary

A touchless human computer interface (HCI) provides a virtual surface in three-dimensional space and a zone of restriction for defining a level of sensitivity to movements in order to cancel noise that may be caused by natural wobble of a human appendage. The touchless HCI may receive input regarding a user movement, process the input to generate clean gesture data and analyze at least one dynamic variable to determine an interpreted action based upon a relationship of the clean gesture data with respect to the virtual surface.