Hand Pairing for Multi-User Gesture Input via Arm Approach Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing techniques for distinguishing between multiple users' hands during gesture-based operation inputs are limited, particularly when the number of users exceeds two and when arm entries come from arbitrary directions, making it impractical to accurately pair left and right hands in various operation contexts.

Innovation Solution

An information processing apparatus and method that includes an image acquisition unit, a hand detector, and a pairing unit to detect and pair left and right hands from images of an operation surface, using base positions of arms and palm orientations to accurately pair hands for each user, even in scenarios with multiple users and arbitrary arm directions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the operation area is divided into two right and left areas to distinguish between driver and passenger, then the distinction between two persons can be performed, but the number of distinguishable persons is limited and arm entry from arbitrary direction cannot be coped with

Engineering Contradiction:
Improvenumber of distinguishable personsVSAvoidcomplexity of area division
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The operation surface is divided into multiple regions based on arm approach directions rather than fixed left-right areas. The hand detector identifies hands and the pairing unit determines user identity by tracking arm approach directions from the image, allowing unlimited numbers of distinguishable persons regardless of entry direction.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Instead of dividing the operation area into static zones, the system uses the dimension of arm approach direction (angle/orientation) to identify users. By detecting the direction from which arms approach the operation surface, the system can distinguish users based on their entry trajectories rather than spatial zones.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If hand-based operation inputs from multiple users are accepted, then the usability is enhanced, but accurate pairing of left and right hands becomes difficult

Engineering Contradiction:
Improvemulti-user operation capabilityVSAvoidaccuracy of hand pairing
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The pairing unit continuously monitors the operation surface image to track hand positions and arm approach directions. By using feedback from the image acquisition unit about which hand approached from which direction, the system accurately pairs left and right hands belonging to the same user, even when multiple users are present.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The pairing unit acts as an intermediary between the hand detector and the operation input processing. It receives hand detection results, uses arm approach direction information as a mediating factor to identify users, and then pairs hands accordingly before the operation inputs are processed.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11789543B2Information processing apparatus and information processing method
Publication Date: 2023.10.17 SONY GROUP CORP
  • US11789543B2 patent drawing
  • US11789543B2 patent drawing
  • US11789543B2 patent drawing

AI summary

The present disclosure relates to an information processing apparatus, an information processing method, and a program capable of, when accepting hand-based operation inputs from a plurality of users, performing appropriate pairing of left and right hands for each user.An image of an operation surface from above is acquired, the operation surface being configured to accept a hand-based operation input from users, left and right hands of the users and arms corresponding to the respective hands are detected from the image, a base position of one of the arms is set as a benchmark position, a base position of the arm that is closest adjacent along a periphery of the operation surface is set as a reference position when the one of the arms is a left hand, and pairing of the hand of the arm at the benchmark position and the hand of the arm at the reference position is performed. The present disclosure can be applied to an information processing system.