Cloud Gesture Recognition via Distributed Sensor Fusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing communication systems face challenges in efficiently transferring and synchronizing data between devices connected to wireless networks, as they are largely unaware of each other's presence, making data transfer a cumbersome process.

Innovation Solution

A 'gesture paradigm' that recognizes and processes gestures performed by users holding devices in a cloud computing environment, allowing these gestures to produce predefined results by utilizing various input and output capabilities such as accelerometers, video recognition, and wireless communication, enabling device users to interact with each other and affect outputs across connected devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If devices are connected within private local networks or Internet, then network connectivity is established, but devices are largely unaware of each other's presence making data transfer cumbersome

Engineering Contradiction:
Improvedevice awarenessVSAvoiddata transfer process
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent introduces a server as an intermediary that maintains presence information about devices in the network. Instead of devices directly discovering each other, the server acts as a mediator that tracks device presence and enables data transfer, thus resolving the contradiction between reliable device awareness and ease of data transfer operation

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If multiple sensors are used for gesture detection, then gesture recognition accuracy is improved, but system complexity increases

Engineering Contradiction:
Improvegesture recognition accuracyVSAvoidsensor system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines data from multiple sensors (accelerometer, gyroscope, magnetometer, barometer, microphone, camera) into a unified gesture recognition system. By merging sensor inputs and processing them collectively to recognize gestures, the system achieves high measurement precision while managing complexity through integrated processing rather than separate systems

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent makes mobile devices universal by equipping them with multiple sensor types that serve various functions - acceleration detection, rotation detection, magnetic field sensing, pressure detection, audio capture, and visual recording. This multi-functionality allows a single device to perform diverse gesture recognition tasks, improving accuracy without proportionally increasing complexity

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Facilitates seamless interaction and data transfer between devices by interpreting and executing gestures in real-time, enhancing the user experience through multi-dimensional experiences and social interactions within a cloud computing environment.

Implementation Method 1

accelerometers

Methodology Applied
Scientific EffectAccelerometer: Accelerometer

Implementation Method 2

gyrometers

Methodology Applied
Scientific EffectGyroscope: Gyroscope

Implementation Method 3

video recognition

Methodology Applied
Scientific EffectVideo recognition: Image Processing

Data Source

PatentUS9557817B2Recognizing gesture inputs using distributed processing of sensor data from multiple sensors
Publication Date: 2017.01.31 PENINSULA TECH VENTURES
  • US9557817B2 patent drawing
  • US9557817B2 patent drawing
  • US9557817B2 patent drawing

AI summary

The techniques discussed herein contemplate methods and systems for providing, for example, interactive virtual experiences that are initiated or controlled using user gestures. In embodiments, the techniques provide for gestures performed by users holding devices to be recognized and processed in a cloud computing environment such that the gestures produce a predefined desired result. According to one embodiment, a server communicates with a first device in a cloud computing environment, wherein the first device can detect surrounding devices, and an application program is executable by the server, wherein the application program is controlled by the first device and the output of the application program is directed by the server to one of the devices detected by the first device.