Relative Gesture Recognition for Mobile Content Association
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users face difficulties in efficiently associating and retrieving additional content with photos or videos on mobile devices, as existing methods are time-consuming and cumbersome, especially when dealing with multiple target objects.
Innovation Solution
The techniques involve detecting relative gestures on mobile devices to interact with target objects, using embedded identifiers like barcodes or patterns, to efficiently associate, disassociate, and play back media, allowing for simultaneous interaction with multiple objects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If traditional methods are used to associate and retrieve content with photos or videos, then the process is thorough and complete, but it is time-consuming and cumbersome
Solution Approach 1:
The patent replaces manual mechanical operations (clicking, navigating menus, dragging files) with gesture-based controls. Users can associate content with target objects by performing gestures such as swiping, pinching, or rotating the device, eliminating the need for time-consuming menu navigation and file management operations.
Solution Approach 2:
The system automatically detects target objects in the environment using camera and sensor data, then enables users to associate content with these objects through simple gestures. The system handles the complex tasks of content retrieval, association, and synchronization automatically, requiring minimal user intervention beyond the initial gesture.
2Ease of operation
If manual methods are used to interact with multiple target objects, then each object can be processed individually, but the process becomes cumbersome and time-consuming
Solution Approach 1:
The patent implements a universal gesture recognition system that can identify and differentiate multiple gesture types (swipe, pinch, rotate, shake) and apply them consistently across different target objects. This multi-functional gesture system simplifies user interaction while handling diverse content association tasks through a single unified interface.
Solution Approach 2:
The system introduces an intermediary gesture recognition layer between the user and the content management system. This intermediary translates various physical gestures into standardized digital commands, simplifying the interaction model while maintaining the ability to perform complex content association operations across multiple target objects.
3Productivity
If existing content management methods are used, then content can be stored and retrieved, but the process is cumbersome and not efficient for multiple objects
Solution Approach 1:
The system performs preliminary actions by automatically detecting and indexing target objects in the environment before user interaction. When users perform gestures, the content is already prepared and ready for immediate association or retrieval, eliminating the need for manual searching or navigation through file systems.
Solution Approach 2:
The patent replaces traditional mechanical content management operations (file browsing, menu selection, drag-and-drop) with gesture-based controls. Users can retrieve content by performing simple gestures toward target objects, and the system automatically handles the complex retrieval and display operations, significantly improving both speed and convenience.
Data Source
AI summary
In an example method, a target object is detected via a camera in a mobile device based on an embedded identifier on the target object. Sensor data of the mobile device is tracked to estimate a relative location or a relative orientation of the mobile device in relation to the target object. A relative gesture is detected via the mobile device based on the relative location or the relative orientation of the mobile device. One or more actions are performed in response to detecting the relative gesture.