Gesture-Based Communication Service Using Multi-Sensor Fusion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current user interfaces for mobile electronic devices lack intuitive and convenient methods for data transmission and reception based on gestures, limiting user experience and interaction efficiency.
Innovation Solution
A method and apparatus that detect and recognize various gestures using motion information such as shape, acceleration, and direction from multiple devices, allowing for synchronized event generation and communication service performance when corresponding gestures are identified within a specific time frame, utilizing sensors like optical and electromyogram sensors.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If gesture-based communication service is implemented between devices, then user interaction convenience and intuitiveness are improved, but device complexity and sensor requirements increase
Solution Approach 1:
The patent implements a universal gesture recognition system where multiple types of sensors (optical, electromyogram, acceleration, direction) can detect various gestures (hand shapes, muscle movements, device motions). This multi-functional approach allows a single gesture-based communication framework to handle diverse interaction scenarios, improving ease of operation while managing device complexity through standardized processing protocols.
Solution Approach 2:
The patent introduces an intermediary gesture recognition system that mediates between physical user actions and digital communication events. The system acts as a mediator by translating various physical gestures into standardized digital signals that can be processed by communication protocols, thereby improving user interaction convenience without directly increasing core device complexity.
2Measurement precision
If multiple types of motion information are detected for gesture recognition, then gesture recognition accuracy is improved, but detection difficulty and processing complexity increase
Solution Approach 1:
The patent merges multiple detection modalities (optical sensors for hand shape, electromyogram sensors for muscle movement, acceleration sensors for device motion, direction sensors for orientation) into a unified gesture recognition system. By combining these different sensor types, the system achieves high gesture recognition accuracy through multi-source data fusion, while the integrated architecture manages detection complexity through coordinated sensor operation.
Solution Approach 2:
The patent employs a composite sensing approach where multiple sensor types work together to detect gestures. Similar to composite materials combining different properties, the system combines optical, electrical, and mechanical sensing capabilities to achieve comprehensive gesture detection, improving recognition accuracy while distributing detection tasks across specialized sensor components.
3Reliability
If synchronized gesture detection between multiple devices is implemented, then communication service reliability is improved, but coordination complexity and time synchronization requirements increase
Solution Approach 1:
The patent implements a feedback mechanism where devices exchange motion information and gesture detection status in real-time. This feedback loop allows devices to coordinate their gesture detection and recognition processes, ensuring synchronized operation and reliable communication service. The feedback system manages coordination complexity by providing continuous status updates and enabling adaptive adjustment of detection parameters across devices.
Solution Approach 2:
The patent employs preliminary action by pre-establishing gesture recognition protocols and synchronization mechanisms before actual communication occurs. Devices prepare their sensor systems and coordinate their detection timelines in advance, ensuring that when gestures are performed, the synchronized detection and recognition processes run smoothly. This preliminary coordination reduces real-time complexity while maintaining high reliability.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables convenient and intuitive data transmission and reception among devices, providing a more subtle and engaging user experience by recognizing and combining gestures to perform intended events, enhancing user interaction and communication services.
Implementation Method 1
The first shape information and the second shape information may be each detected at the first device and the second device, respectively, with at least one from among an optical sensor and an electromyogram sensor
Implementation Method 2
The first shape information and the second shape information may be each detected at the first device and the second device, respectively, with at least one from among an optical sensor and an electromyogram sensor
Implementation Method 3
the first motion comprises at least one from among: first shape information of a part of a body of a first user of the first device; first acceleration information with respect to the first device
Data Source
AI summary
A method and an apparatus for performing gesture-based communication service are provided, in which a first device detects a first motion, and when the first motion corresponds to a first gesture that belongs to a gesture group, receives information about a second motion from a second device. The first device may perform an event that corresponds to a combination of the first and second gestures, when the received information corresponds to the second gesture that belongs to the gesture group.