Camera-Based AR Hand Gestures for Precise Virtual Object Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality (AR) systems face limitations in precise interaction with virtual objects due to sub-optimal user experiences from on-device interactions like touch input, which lack granularity and precision, especially in industrial and spatial placement scenarios.
Innovation Solution
Implementing hand-movement based interactions using a device's camera to recognize hand gestures, associating each gesture with specific interactions in the AR environment, allowing for finer control over object location, orientation, and size changes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If touch input on device screen is used for AR object interaction, then device complexity is reduced, but measurement precision and manufacturing precision of object placement deteriorate
Solution Approach 1:
The patent introduces an intermediary system consisting of external cameras and gesture recognition software that mediates between the user and the AR objects. Instead of direct touch input on the device screen, the system captures hand gestures through external cameras, processes them through gesture recognition algorithms, and translates them into precise AR object manipulations. This intermediary layer enables high-precision control while keeping the device itself relatively simple.
2Adaptability or versatility
If standardized hand gestures are implemented across devices, then adaptability improves, but device complexity increases due to gesture recognition systems
Solution Approach 1:
The patent implements a universal gesture recognition system that can be applied across multiple devices and AR applications. By establishing a standardized set of hand gestures that work consistently across different platforms, the system achieves multi-functionality and broad adaptability. The gesture vocabulary and recognition algorithms are designed to be device-agnostic, allowing the same gestures to control AR objects whether on smartphones, tablets, or AR headsets.
Data Source
AI summary
This document discloses techniques, apparatuses, and systems for hand-movement based interactions with augmented reality (AR) objects. A set of hand gestures is determined, where each hand gesture is associated with a respective interaction with a virtual object in an AR environment. An environment is captured within the field of view of a viewfinder and included within an AR environment having a virtual object. A hand gesture is performed in the field of view of the viewfinder is captured. The captured hand gesture is determined to correspond to a particular hand gesture from the set of hand gestures. As a result, a particular interaction associated with the particular hand gesture is performed on an object within the augmented reality environment. In doing so, an AR engine can effectively interact with objects in an AR environment using hand gestures.