Virtual Object Mode Switching via Thumbnail Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Switching operation modes for virtual objects in virtual spaces using natural human motions is cumbersome due to the need for additional controller operations, which deviates from natural human gestures.
Innovation Solution
An information processing system that captures images of a user's thumb to detect the presence and orientation of a thumbnail, switching the operation mode for virtual objects to a movement or rotation mode based on the visibility and orientation of the thumbnail, allowing for natural hand gestures to control virtual object positioning.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a controller is used to switch operation modes for virtual objects, then the mode switching function is achieved, but the operation becomes cumbersome and deviates from natural human gestures
Solution Approach 1:
The patent replaces the mechanical controller-based mode switching system with an optical gesture recognition system. The imaging device captures hand images, and the processor automatically recognizes gestures (such as pinching motions) to switch operation modes, eliminating the need for physical controller operations and restoring natural hand movement as the control mechanism.
2Productivity
If additional controller operations are required for mode switching, then precise control is achieved, but the switching speed and efficiency decrease
Solution Approach 1:
The system performs preliminary gesture recognition by continuously monitoring hand positions and orientations through image capture. When a gesture indicating mode switching intent is detected (such as a specific hand configuration), the system proactively switches modes before the user would need to perform additional controller actions, thereby reducing switching time and improving operational efficiency.
Data Source
AI summary
An information processing system includes at least one processor configured to: acquire a captured image including an image of a thumb of a user; and switch an operation mode for a virtual object disposed within a virtual space to a specific mode for positionally changing the virtual object if the captured image includes an image of a nail of the thumb or an image that enables estimation of presence of the nail of the thumb.