Gesture-Based Remote Control Using MEMS Motion Sensors

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional remote controls with numerous buttons can be frustrating to use, especially for users with disabilities or in low-light conditions, as they require manual searching for specific buttons to perform functions like pausing a movie or answering a phone, which can lead to user frustration and difficulty in operating audiovisual devices.

Innovation Solution

A gesture-based remote control that incorporates motion sensing technology, using microelectromechanical systems (MEMS) sensors to generate command signals for controlling audiovisual devices by sensing movements such as taps and gestures, allowing users to control functions like volume, playback, and channel changes without physically pressing buttons.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional remote controls with numerous buttons are used to provide expanded functionality, then the device can control many different apparatus and functions, but the ease of operation deteriorates as users must manually search for specific buttons

Engineering Contradiction:
ImprovefunctionalityVSAvoidease of operation
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent replaces the mechanical button-pressing system with a motion sensing system using accelerometers and gyroscopes. Users perform gestures such as pointing the remote at the desired function or making circular motions, and the motion sensors detect these gestures to trigger corresponding commands, eliminating the need to physically locate and press specific buttons among many.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces motion sensors and gesture recognition algorithms as intermediaries between the user and the remote control functions. Instead of direct button interaction, the user's hand movements are captured by accelerometers and gyroscopes, processed through gesture recognition software, and translated into control signals, providing an indirect but more intuitive interface.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Illumination intensity

If remote controls operate in low-light conditions, then the device can be used during nighttime or in dark environments, but the ease of operation deteriorates as users cannot see the buttons to locate them

Engineering Contradiction:
Improveillumination intensityVSAvoidease of operation
Core Design Contradiction:
Illumination intensityVSEase of operation

Solution Approach 1:

The patent replaces the visual-button-pressing system with a motion-based interaction system that does not require visual input. Accelerometers and gyroscopes detect hand gestures and pointing movements regardless of lighting conditions, allowing users to operate the remote by physical motion rather than visual identification of buttons.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Adaptability or versatility

If remote controls are designed with many small buttons to provide comprehensive control, then the device can perform numerous functions, but the device complexity increases making the interface more difficult to navigate

Engineering Contradiction:
ImprovefunctionalityVSAvoiddevice complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent extracts the physical buttons from the remote control interface, retaining only the essential motion sensing components (accelerometers and gyroscopes). This removes the visual and physical complexity of numerous buttons while preserving full functionality through gesture-based command input.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent substitutes the mechanical button array with electronic motion sensing. The accelerometers and gyroscopes capture three-dimensional hand movements, which are then interpreted by software to execute various commands, replacing the need for physical buttons while maintaining comprehensive control capabilities.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables intuitive and accessible control of audiovisual devices through gestures, reducing user frustration and improving usability for individuals with disabilities, especially in low-light conditions, by allowing movement-based input for common functions.

Implementation Method 1

A motion sensor, such as a microelectromechanical systems (MEMS) sensor, is carried by the body. Motion circuitry is carried by the body and is operably connected the motion sensor.

Methodology Applied
Scientific EffectAcceleration sensing: Accelerometer

Implementation Method 2

The remote control is moved in a chosen manner. The movement of the remote control is sensed.

Methodology Applied
Scientific EffectGravity sensing: Gravitation

Implementation Method 3

In some examples the moving step is carried out by tapping the remote control. In some examples the moving step comprises sensing vibration.

Methodology Applied
Scientific EffectVibration detection: Vibration

Data Source

PatentUS8482678B2Remote control and gesture-based input device
Publication Date: 2013.07.09 TAIWAN SEMICONDUCTOR MANUFACTURING CO LTD
  • US8482678B2 patent drawing
  • US8482678B2 patent drawing
  • US8482678B2 patent drawing

AI summary

A remote control controls an audiovisual apparatus, such as a TV, using conventional physical inputs, such as buttons, or by controlled movement of the remote control. Circuitry connected to the physical inputs generates command signals for receipt by and operation of the apparatus. The command signals, such as On or Change Channel, correspond to control functions for the apparatus. The remote control also includes a motion sensor and motion circuitry connected to one another and constructed to generate at least some of the command signals when the body has been moved in predetermined manners for receipt by and operation of the apparatus. The remote control can therefore be operated using either the physical inputs or by moving the remote control in at least one of the predetermined manners. In some examples the motion sensor comprises a MEMS sensor.