Mobile Phone Gesture Recognition for Audio Conferencing Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conferencing systems lack the ability to convey body language, making audio-only communications unidirectional and limiting the ability of speakers to receive feedback on listener engagement and approval/disapproval.

Innovation Solution

Incorporating a motion detector into mobile phones or earpieces to capture head and hand gestures, which are then transmitted to the speaker, allowing for bidirectional communication of approval, disapproval, or neutral feedback through audio or visual cues.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If audio-only conferencing is used, then device complexity is reduced and ease of operation is improved, but loss of information increases due to inability to convey body language

Engineering Contradiction:
Improvebody language informationVSAvoidconferencing system complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent introduces motion detectors as intermediary devices that capture body language gestures and convert them into transmittable signals. These detectors act as mediators between the physical gestures and the digital communication channel, enabling body language information to be conveyed without fundamentally changing the audio conferencing architecture.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the need for complex video transmission systems with simpler motion detection technology. Instead of capturing and transmitting full video streams which would require high bandwidth and complex processing, the system uses motion detectors to capture only the essential gesture information, substituting a mechanical vision system with a simpler motion sensing approach.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Loss of information

If motion detectors are added to capture gestures, then loss of information is reduced by conveying body language, but device complexity increases

Engineering Contradiction:
Improvegesture informationVSAvoidmobile phone complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent integrates motion detectors into existing mobile phones, making the device multi-functional. The same mobile phone that handles audio communication now also captures motion data, eliminating the need for separate gesture capture devices and reducing overall system complexity despite adding new capabilities.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent combines the motion detection functionality with the existing mobile phone infrastructure. Rather than creating separate systems for audio conferencing and gesture capture, the invention merges these functions into a single integrated platform where the mobile phone serves both purposes.

Inventive Principle:
Principle #5Merging (Combining)

3Productivity

If bidirectional communication of body language is implemented, then communication effectiveness is improved, but loss of time increases due to processing and transmitting gesture data

Engineering Contradiction:
Improvecommunication effectivenessVSAvoidgesture processing time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent extracts only the essential gesture information needed for communication feedback rather than transmitting complete motion data. By taking out only the relevant body language signals (such as head nods, hand gestures indicating agreement or disagreement), the system reduces processing time while maintaining communication effectiveness.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent implements partial action by selectively capturing and transmitting only certain types of gestures that carry meaningful communication value. Rather than processing all motion data equally, the system focuses on significant gestures that convey approval, disapproval, or other communicative intent, reducing overall processing time.

Inventive Principle:
Principle #16Partial or excessive action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables speakers to receive real-time feedback on listener engagement, allowing them to adjust their speech or discussion based on non-verbal cues, enhancing the interactive nature of audio conferences.

Implementation Method 1

a mobile phone (or an earpiece that communicates with a mobile phone or telephone base unit) incorporates a built-in motion detector

Methodology Applied
Scientific EffectMotion detection: Accelerometer

Data Source

PatentUS8817061B2Recognition of human gestures by a mobile phone
Publication Date: 2014.08.26 CISCO TECHNOLOGY INC
  • US8817061B2 patent drawing
  • US8817061B2 patent drawing
  • US8817061B2 patent drawing

AI summary

In one embodiment, a method includes electronically detecting a gesture of a user listening to a speaker via a communication device, and generating an audible and/or visual response that corresponds to the gesture. The audible and/or visual response is then communicated to the speaker. It is emphasized that this abstract is provided to comply with the rules requiring an abstract that will allow a searcher or other reader to quickly ascertain the subject matter of the technical disclosure.