Mixed-Input Pointing Device Seamless Free Space Surface Transition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional pointing devices struggle to seamlessly transition between free space and surface inputs, leading to tedious interactions and reduced precision in controlling augmented reality and computer display objects, as free space tracking lacks precision and is hindered by reduced field of view when near surfaces.

Innovation Solution

A mixed-input pointing device that integrates free space and surface input capabilities, using a combination of sensors and cameras to track movement data in both environments, allowing for unified control of interface objects with intelligent transition between inputs and providing haptic feedback for enhanced interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If free space tracking is used for controlling interface objects, then ease of operation is improved, but measurement precision deteriorates

Engineering Contradiction:
Improveease of operationVSAvoidmeasurement precision
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent combines free space tracking and surface tracking into a single integrated pointing device. The device includes both free space tracking components (e.g., cameras, sensors) and surface tracking components (e.g., touch-sensitive surface, pressure sensors), allowing the system to seamlessly switch between tracking modes based on the user's interaction context. This merging resolves the contradiction by providing the ease of operation of free space tracking while maintaining the precision of surface tracking when needed.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent implements dynamic switching between free space tracking and surface tracking modes. The system dynamically determines which tracking mode to use based on the user's interaction context, such as whether the pointing device is hovering over a surface or being used in free space. This dynamic adaptation allows the system to optimize both ease of operation and measurement precision according to the current usage scenario.

Inventive Principle:
Principle #15Dynamics

2Ease of operation

If free space tracking is used near surfaces, then ease of operation is improved, but field of view is reduced

Engineering Contradiction:
Improveease of operationVSAvoidfield of view
Core Design Contradiction:
Ease of operationVSArea of stationary object

Solution Approach 1:

The patent segments the tracking functionality into separate free space tracking components and surface tracking components. The free space tracking components (e.g., cameras positioned to capture hand gestures) and surface tracking components (e.g., touch-sensitive surface detectors) operate independently but are integrated into a unified system. This segmentation allows each component to optimize its performance for its specific function, with the surface tracking component maintaining a wide field of view when the device is near a surface.

Inventive Principle:
Principle #1Segmentation

3Device complexity

If conventional pointing devices are used, then device complexity is low, but ease of operation deteriorates due to tedious transitions between input modes

Engineering Contradiction:
Improvedevice complexityVSAvoidease of operation
Core Design Contradiction:
Device complexityVSEase of operation

Solution Approach 1:

The patent merges multiple input modes (free space pointing, surface touching, pressure sensing) into a single integrated pointing device. The device includes integrated sensors, processors, and output mechanisms that work together to provide seamless transitions between input modes without requiring the user to switch between multiple separate devices or complex manual procedures.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent implements self-service through automatic mode switching. The system automatically detects the user's interaction context (e.g., whether the device is hovering over a surface or being used in free space) and automatically switches between free space tracking and surface tracking modes without requiring explicit user commands or complex manual transitions, thereby improving ease of operation while maintaining manageable device complexity.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10203781B2Integrated free space and surface input device
Publication Date: 2019.02.12 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10203781B2 patent drawing
  • US10203781B2 patent drawing
  • US10203781B2 patent drawing

AI summary

In various embodiments, methods and systems for implementing integrated free space and surface inputs are provided. An integrated free space and surface input system includes a mixed-input pointing device for interacting and controlling interface objects using free space inputs and surface inputs, trigger buttons, pressure sensors, and haptic feedback associated with the mixed-input pointing device. Free space movement data and surface movement data are tracked and determined for the mixed-input pointing device. An interface input is detected for the mixed-input pointing device transitioning from a first input to a second input, such as, from a free space input to a surface input or from the surface input to the free space input. The interface input is processed based on accessing the free space movement data and the surface movement data. An output for the interface input is communicated from the mixed-input pointing device to interact and control an interface.