Asymmetric Mapping for Mixed Modality User Interfaces

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current user interfaces struggle to seamlessly integrate tactile and non-tactile input methods, such as 2D and 3D gestures, to provide an intuitive and efficient cursor control experience, especially when dealing with varying levels of motion difficulty and spatial awareness.

Innovation Solution

A mixed modality user interface system that receives signals from both tactile and non-tactile devices, segments predefined areas into multiple regions, assigns mapping ratios based on motion direction and region location, and dynamically adjusts cursor movement on a display to compensate for motion difficulty, using a combination of 2D and 3D sensing technologies.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a uniform mapping ratio is used for cursor movement across the entire input area, then the system is simple to implement, but it fails to account for varying motion difficulty in different regions

Engineering Contradiction:
Improvecursor control accuracyVSAvoidmapping system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The input area is divided into multiple regions with different mapping ratios. The system segments the continuous input space into discrete zones, each with its own mapping characteristics, allowing differential control sensitivity across the input area without requiring a completely complex adaptive system.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different regions of the input area are assigned different mapping ratios based on their specific characteristics. This local differentiation allows the system to optimize cursor control accuracy in each region while maintaining overall system manageability through region-based rather than point-by-point customization.

Inventive Principle:
Principle #3Local quality

2Productivity

If the mapping ratio is increased to improve cursor movement speed, then productivity increases, but motion precision deteriorates

Engineering Contradiction:
Improvecursor movement speedVSAvoidcursor positioning accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The mapping ratio is made dynamic and context-dependent rather than fixed. The system automatically adjusts the mapping ratio based on the current region and direction of motion, allowing the cursor movement characteristics to adapt to user needs and task requirements in real-time.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the mapping ratio parameter based on spatial location and motion direction. By varying this key parameter across different regions and directions, the system optimizes the balance between movement speed and positioning accuracy for different operational contexts.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If asymmetric mapping ratios are applied based on direction and region, then cursor control accuracy improves, but the system complexity increases

Engineering Contradiction:
Improvecursor positioning accuracyVSAvoidmapping algorithm complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system segments the input space into regions and directions, applying different mapping ratios to each segment. This segmentation approach manages complexity by organizing the asymmetric mapping into discrete, manageable categories rather than requiring continuous complex calculations for every point and direction.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Asymmetric mapping ratios are applied locally based on region and direction characteristics. This localized approach improves cursor positioning accuracy in specific contexts while keeping the overall system complexity manageable through region-based rather than globally complex algorithms.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS9229534B2Asymmetric mapping for tactile and non-tactile user interfaces
Publication Date: 2016.01.05 APPLE INC
  • US9229534B2 patent drawing
  • US9229534B2 patent drawing
  • US9229534B2 patent drawing

AI summary

A method, including receiving, by a computer, a sequence of signals indicating a motion of a hand of a user within a predefined area, and segmenting the area into multiple regions. Responsively to the signals, a region is identified in which the hand is located, and a mapping ration is assigned to the motion of the hand based on a direction of the motion and the region in which the hand is located. Using the assigned mapping ratio, a cursor on a display is presented responsively to the indicated motion of the hand.