3D Finger Motion Detection Without Markers in User Interface

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing user interface devices for 3D imaging struggle with accurately detecting finger motion due to the need for gloves with markers, which can lead to false pinching motion detection and lack of depth position detection, resulting in cumbersome user experience and inaccurate input operations.

Innovation Solution

A user interface device that measures 3D coordinates of fingers using a sensor unit and a motion detecting unit to accurately detect finger motion without markers, allowing for intuitive operations such as pinching, moving, deleting, enlarging, and turning objects in a 3D display space by analyzing finger motion models and pinching motion models.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a glove with markers is used for detection, then pinching motion can be detected, but false detection occurs and depth position cannot be detected

Engineering Contradiction:
Improvepinching motion detection accuracyVSAvoiddetection accuracy
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent extracts the markers from the glove and places them directly on the fingertips instead. This allows the sensor unit to detect marker positions without requiring the user to wear a glove, eliminating false detection caused by glove movement while maintaining pinching motion detection capability

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent transitions from 2D marker detection to 3D marker detection by using a sensor unit that measures both planar positions and depth positions of markers. This dimensional enhancement enables accurate detection of pinching motion in three-dimensional space, resolving the limitation of previous 2D-only detection systems

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If markers are placed on fingertips, then 3D coordinates can be measured, but the system becomes more complex

Engineering Contradiction:
Improve3D coordinates measurementVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The sensor unit is designed to perform multiple functions: detecting marker positions, calculating 3D coordinates, and determining pinching motion. By consolidating these functions into a single device, the patent reduces overall system complexity while maintaining high measurement precision

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent uses virtual markers (software-generated visual indicators) that correspond to physical markers on fingertips. These virtual markers are displayed on the display unit and tracked by the sensor unit, creating a simplified interface that reduces physical hardware complexity while enabling precise 3D coordinate measurement

Inventive Principle:
Principle #26Copying

Data Source

PatentUS10466880B2User interface device and display object operating method
Publication Date: 2019.11.05 PANASONIC INTELLECTUAL PROPERTY CORP OF AMERICA
  • US10466880B2 patent drawing
  • US10466880B2 patent drawing
  • US10466880B2 patent drawing

AI summary

A user interface device includes: a display unit which displays a two-dimensional or a three-dimensional display object in a display space; a sensor unit which measures 3D coordinates of fingers of a user in the display space; a motion detecting unit which detects motion of the fingers of the user relative to the display object based on the 3D coordinates of the fingers of the user measured by the sensor unit; and a display control unit which changes display content displayed by the display unit, according to a detection result obtained by the motion detecting unit.