Camera Gesture Recognition Using Multi-Feature Point Switching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies require users to position their fingers over a controller, limiting their movement and usability during input operations.

Innovation Solution

A computer system that uses a camera unit to acquire information from a user's imaged field, extracts feature points, and recognizes gestures in real space, allowing input without a physical controller by referencing different feature points for gesture recognition.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a controller is used for contactless input, then device operation is enabled without physical contact, but user movement is limited and controller position is constrained

Engineering Contradiction:
Improvecontactless operationVSAvoiduser movement freedom
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent replaces the mechanical controller system with an optical recognition system. Instead of requiring users to interact with a physical controller device, the system uses a camera to capture images of the user's hands and automatically recognizes gestures through image processing, thereby eliminating the need for mechanical interaction while maintaining contactless operation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an image processing system as an intermediary between the user and the device control. The camera captures hand gestures and the image processing unit translates these visual inputs into control commands, serving as a mediator that enables natural, unrestricted user movement while maintaining precise control capability.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If feature points are extracted for gesture recognition, then input accuracy is improved, but system complexity increases

Engineering Contradiction:
Improvegesture recognition accuracyVSAvoidprocessing system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the hand gesture recognition process into distinct feature points (such as fingertips, joint positions, and palm center). By dividing the complex gesture recognition task into identification of these key feature points and their relative positional relationships, the system achieves high recognition accuracy while keeping the processing complexity manageable through structured analysis.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS20260030929A1Computer system, method, and program
Publication Date: 2026.01.29 SONY INTERACTIVE ENTERTAINMENT LLC
  • US20260030929A1 patent drawing
  • US20260030929A1 patent drawing
  • US20260030929A1 patent drawing

AI summary

Provided is a computer system for control based on input from a user, the computer system including at least one memory for storing a program code and at least one processor for executing an operation in accordance with the program code. The operation includes acquiring information associated with an imaged field including the user, extracting feature points of a body of the user on the basis of the information, receiving input from the user on the basis of the feature points, recognizing a gesture performed by the body of the user in a real space, by a first method on the basis of the information, and recognizing the gesture in response to recognition of a specific gesture determined beforehand, by a second method that refers to a feature point different from the feature point referred to by the first method at a time of reception of input from the user.