Motion Tracking User Interface for Hands-Free Focus Transition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing input devices for computer systems, such as mice and keyboards, require users to interrupt tasks or use a spare hand for operation, limiting freedom and accessibility for tasks that require both hands or for users with disabilities.

Innovation Solution

A method using video cameras to track object motion, allowing users to transition focus and manipulate content on a display without physical input devices, enabling hands-free interaction by using head or object motion to select and control windows and graphical icons in two-dimensional and three-dimensional environments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional input devices (mouse, keyboard) are used, then the computer system can be operated, but the user must interrupt tasks or use a spare hand, reducing freedom and accessibility

Engineering Contradiction:
Improvehands-free operationVSAvoidinput device requirement
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent replaces mechanical input devices (mouse, keyboard) with an optical tracking system that uses a video camera to detect and track user head movements. This substitution eliminates the need for physical input devices, enabling hands-free operation while maintaining system control capability

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces a video camera as an intermediary device that captures visual information about user head position and movements. This intermediary translates physical head movements into digital signals that control the computer interface, bridging the gap between natural human movement and digital system control

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If a video camera is used to track head motion, then hands-free interaction is enabled, but the system requires additional hardware and processing complexity

Engineering Contradiction:
Improvehands-free interaction capabilityVSAvoidvideo camera and tracking system
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent makes the video camera serve multiple functions: it acts as both a standard camera for capturing images and as a motion tracking device for controlling the computer interface. This multi-functionality reduces the need for separate dedicated tracking hardware, thereby reducing overall system complexity

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system uses the video camera to automatically track and interpret user intent based on head movements without requiring manual configuration or calibration. The tracking algorithm automatically processes visual data to determine user focus and control commands, reducing the burden on the user and simplifying system operation

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10401951B2Motion tracking user interface
Publication Date: 2019.09.03 APPLE INC
  • US10401951B2 patent drawing
  • US10401951B2 patent drawing
  • US10401951B2 patent drawing

AI summary

A method to transition focus of a display corresponding to an object's motion tracked by a video camera or like device is disclosed. In one implementation, the display shows one or more windows or user interfaces on the display. The object's motion can be used to select one of the windows or user interfaces on the display and manipulate content presented in the window or user interface. In another implementations, the object's motion can manipulate a three-dimensional graphical icon in a three-dimensional display environment, for example, by rotating it. In another implementation, the method further tracks motion of a second object and shifts focus of the display corresponding to the motion of the second object. In another implementation, a second display may be added to mirror the focus transition corresponding to the object's motion.