Dynamic Virtual Operation Region for Hand Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing hand-motion detection systems for operation devices lack the ability to seamlessly transition the virtual operation region as the user's hand moves outside the initial detection area, limiting continuous operation and intuitive control.

Innovation Solution

An information processing apparatus that includes a camera for imaging the user, a hardware processor to execute computer programs, and a virtual operation region within the camera's imaging range, which detects the user's hand and adjusts the virtual operation region's position to follow the hand's movement, allowing continuous operation without returning to the initial region.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a fixed virtual operation region is set within the camera's imaging range, then the operation device can receive operations within a defined area, but the user cannot perform continuous operation when the hand moves outside the initial detection area

Engineering Contradiction:
Improvecontinuous operation capabilityVSAvoidoperation region flexibility
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The virtual operation region is transformed from a fixed static structure to a dynamic one that automatically tracks and adapts to the user's hand position. The region moves and adjusts its boundaries in real-time based on hand detection, allowing continuous operation without requiring the user to return to an initial detection area.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system implements feedback by continuously monitoring the user's hand position through camera imaging and using this information to adjust the virtual operation region. The region responds to hand movement by expanding or shifting its boundaries, creating an adaptive operation space that follows the user's interactions.

Inventive Principle:
Principle #23Feedback

2Adaptability or versatility

If the virtual operation region is expanded to cover the entire imaging range, then the user can operate from any position, but the precision of hand motion detection and operation mapping is reduced

Engineering Contradiction:
Improveoperation region coverageVSAvoidhand motion detection precision
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The virtual operation region dynamically adjusts its size and position based on real-time hand detection. When the hand is detected within a specific area, the region is localized to that area for precise operation mapping. When the hand moves, the region follows accordingly, maintaining both coverage and precision through adaptive adjustment rather than a fixed expanded boundary.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS20240331325A1Information processing apparatus, information processing method, and recording medium
Publication Date: 2024.10.03 PANASONIC AUTOMOTIVE SYST CO LTD
  • US20240331325A1 patent drawing
  • US20240331325A1 patent drawing
  • US20240331325A1 patent drawing

AI summary

An information processing apparatus includes a processor connected to a memory. The processor receives, from a camera, an image obtained by imaging a user being an operator. The processor sets, within an imaging range of the camera, a virtual operation region for receiving an operation onto a device. The processor detects a hand of the user on the basis of the image. The processor operates the device in accordance with a moving direction of the hand of the user in a case where the hand of the user has been detected from the virtual operation region. The processor changes a position of the virtual operation region to follow a position of the hand of the user in a case where the position of the hand of the user has moved from an inside of the virtual operation region to an outside of the virtual operation region.