Virtual Hand Interface for Natural Object Grasping

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current virtual reality systems lack natural and intuitive methods for interacting with virtual objects, particularly in expressing grab types, as they rely on script-based object manipulation and limited input devices like 2D mice and 6DOF space navigators, which do not effectively accommodate diverse object shapes and sizes.

Innovation Solution

A virtual object manipulating apparatus and method that includes a corresponding point searching unit, grab type recognizing unit, and virtual grab type determining unit, utilizing sensors like touch, pressure, and rotation sensors to identify corresponding points and adjust grab types based on object shapes and sizes, with a database storing reference objects and grab types to enhance natural interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If menu-based object grab is used with a 2D mouse, then object selection is possible, but the method is limited to predetermined objects and requires script learning

Engineering Contradiction:
Improveobject selection easeVSAvoidobject type flexibility
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent creates a virtual copy of the user's hand within the virtual environment that can grasp objects. This virtual hand copy enables natural grasping motions to be transferred to virtual objects, eliminating the need for script-based selection methods while supporting diverse object types through intuitive hand movements.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces the mechanical 2D mouse pointing system with a virtual hand grasping mechanism. Instead of using cursor-based selection that requires learning scripts, the system substitutes a natural hand-grasping interface that works with various object types through intuitive physical gestures.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If 6DOF space navigator is used, then 3D manipulation capability is provided, but natural grab type expression is limited

Engineering Contradiction:
Improve3D manipulation capabilityVSAvoidgrab type expression
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent creates a virtual hand copy that mirrors the user's actual hand movements and grasping gestures. This copy enables natural grab type expression by translating real-world hand motions into corresponding virtual grasping actions, making 3D manipulation more intuitive than space navigator controls.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent implements a dynamic virtual hand that can adapt its grasping behavior based on the object being manipulated. The virtual hand dynamically adjusts its pose and grasping force to match the object's shape and properties, enabling natural grab type expression across diverse object types.

Inventive Principle:
Principle #15Dynamics

3Adaptability or versatility

If cyberglove is used to transfer hand motion, then 3D manipulation is enabled, but the system complexity increases

Engineering Contradiction:
Improvehand motion transferVSAvoidinput apparatus complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent creates a universal virtual hand interface that can perform multiple manipulation functions without requiring specialized hardware like cybergloves. The virtual hand serves as a multi-functional tool that handles various object types and grasping motions through a single unified interface, reducing overall system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces a virtual hand as an intermediary between the user and virtual objects. This intermediary translates user intentions into natural grasping motions without requiring complex hardware sensors, simplifying the input apparatus while maintaining versatile hand motion transfer capabilities.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Measurement precision

If virtual hand is created and grabbed onto virtual object, then grab type is determined, but corresponding point search complexity increases

Engineering Contradiction:
Improvegrab type determination accuracyVSAvoidpoint search process
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent pre-establishes the virtual hand's structure and grasping capabilities before interaction with objects. By preparing the virtual hand's grasping modes and contact point algorithms in advance, the system can quickly determine grab types during interaction without performing complex real-time searches, thus improving precision while managing complexity.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent extracts and focuses on key contact points between the virtual hand and object rather than searching the entire object surface. By identifying and isolating the most relevant grasping points, the system achieves accurate grab type determination while reducing the computational complexity of point search operations.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentEP2184667B1Apparatus and method for manipulating a virtual object
Publication Date: 2019.12.04 SAMSUNG ELECTRONICS CO LTD
  • EP2184667B1 patent drawingFigure 1
  • EP2184667B1 patent drawingFigure 2(a)~2(c)
  • EP2184667B1 patent drawingFigure 3

AI summary

Disclosed is a virtual object manipulating apparatus and method. The virtual object manipulating apparatus connects a virtual object in a 3D virtual world with a virtual object manipulating apparatus, senses a grab signal from a user, and determines a grab type of the virtual object based on the sensed grab signal and the connection between the virtual object and the virtual object manipulating apparatus.