Finger-Pointing Gesture Detection Using Wrist Geometry

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current systems face challenges in accurately detecting a viewer selected by an artist using natural and intuitive motions, often requiring unnatural gestures, which burdens the artist and affects the interactive experience.

Innovation Solution

An information processing apparatus and method that detects an object selected by a user with a finger-pointing gesture, utilizing a detection unit that identifies the selected object based on a first extension line extending from a line segment connecting the wrist position to a perpendicular line from the arm base, allowing for accurate and intuitive selection.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If a sensor-based detection method is used to detect viewer selection, then the system can automatically detect selection motions, but the artist is required to perform unnatural motions which burdens the operation

Engineering Contradiction:
Improveautomatic detection of selection motionVSAvoidnaturalness of selection motion
Core Design Contradiction:
Extent of automationVSEase of operation

Solution Approach 1:

The patent replaces traditional sensor-based mechanical detection systems with a vision-based detection system using cameras and image processing. This substitution allows for more natural gesture recognition by capturing visual information of the artist's pointing motions rather than relying on restrictive sensor-based mechanical detection, thereby improving ease of operation while maintaining automation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an intermediary detection unit that processes the artist's selection motion through multiple reference points (wrist position, arm base position) and geometric calculations (extension lines, perpendicular lines). This intermediary processing layer translates natural human gestures into accurate viewer selection without requiring the artist to perform unnatural motions, resolving the contradiction between automation and ease of operation.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Extent of automation

If traditional sensor-based detection is used, then the system can detect selection motion, but accurate detection of the selected viewer becomes difficult

Engineering Contradiction:
Improvedetection of selection motionVSAvoidaccuracy of selected viewer detection
Core Design Contradiction:
Extent of automationVSMeasurement precision

Solution Approach 1:

The patent segments the detection process into multiple independent components: detecting wrist position, detecting arm base position, calculating extension lines, and determining the selected viewer. This segmentation allows each component to be optimized independently, improving overall detection accuracy while maintaining automated operation.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from simple 2D sensor detection to 3D spatial detection by incorporating depth information and calculating extension lines in three-dimensional space. By using multiple reference points and projecting selection lines through 3D space, the system achieves more accurate viewer detection while maintaining automated operation.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS11907434B2Information processing apparatus, information processing system, and information processing method
Publication Date: 2024.02.20 SONY GROUP CORP
  • US11907434B2 patent drawing
  • US11907434B2 patent drawing
  • US11907434B2 patent drawing

AI summary

To provide an information processing apparatus (100) including: a detection unit (110) that detects an object selected by a user with a finger-pointing gesture as a selected object, in which the detection unit detects the selected object on the basis of a first extension line extending from a first line segment connecting a first reference point indicating a position of a wrist of a hand of the user corresponding to the finger-pointing gesture and a second reference point corresponding to a height of the wrist on a first perpendicular line perpendicularly extending from a base of an arm of the user corresponding to the finger-pointing gesture to a floor surface toward a wrist side.