AR Hand Interaction Control Using Monocular Size-Based Distance Estimation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Accurate estimation of the distance between a user's hand and an electronic apparatus using a monocular camera is challenging, leading to imprecise interactions with virtual objects in augmented reality environments.
Innovation Solution
An electronic apparatus that includes a camera and a processor to detect a user's hand, identify hand interactions based on hand size, and utilize memory-stored feature information to enhance accuracy in estimating hand size and distance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Volume of moving object
If a monocular camera is used for miniaturization and cost saving, then device size and cost are reduced, but depth sensing capability and measurement precision deteriorate
Solution Approach 1:
The patent introduces an intermediary object with known dimensions into the scene to serve as a reference for scale estimation. This intermediary acts as a mediator between the monocular camera and the target object, enabling the system to infer depth and size information that would otherwise be unavailable from a single 2D image view.
Solution Approach 2:
The patent uses a simple, inexpensive marker or reference object with predetermined dimensions as an intermediary. This reference object can be a basic geometric shape or pattern that is easy to manufacture and detect, providing cost-effective depth estimation without requiring complex or expensive depth sensing hardware.
2Device complexity
If only two-dimensional image data from a monocular camera is used, then device complexity is reduced, but interaction precision and reliability deteriorate
Solution Approach 1:
The patent performs preliminary detection and identification of the intermediary object before proceeding with hand interaction detection. By first establishing the scale reference through the intermediary object, the system prepares the necessary depth and size information in advance, enabling more reliable and precise interaction recognition subsequently.
Solution Approach 2:
The patent replaces complex mechanical or hardware-based depth sensing mechanisms with a computational approach using 2D image analysis and geometric reasoning. Instead of using multiple cameras or active depth sensors, the system uses software-based methods to infer three-dimensional information from two-dimensional images through mathematical relationships and reference objects.
Data Source
AI summary
An electronic apparatus and a controlling method thereof are provided. The electronic apparatus providing augmented reality (AR) content includes a display, a camera and a processor configured to display augmented reality (AR) content through the display, detect a hand of a user from image obtained through the camera, and identify a first interaction of the hand with the AR content based on a size of the hand, wherein the size of the hand is obtained based on the information about an object provided through the display.