Gaming Controller with Inertial Sensors and Voice Input

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing gesture input devices for computing systems face challenges in precise object tracking, particularly when objects are partially blocked, leading to errors and user inconvenience with wearable gloves.

Innovation Solution

A controller device with an accelerometer, vibrational feedback, LED illumination, and wireless communication, integrated with a translucent plastic object and inertial sensors, allowing for reliable tracking and intuitive user interaction through movement and voice commands.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If visual gesture input devices are used for computing systems, then user interaction capability is improved, but tracking precision deteriorates when objects are partially blocked

Engineering Contradiction:
Improveuser interaction capabilityVSAvoidtracking precision
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent introduces an intermediary tracking system that uses multiple cameras and sophisticated image processing algorithms to overcome the limitation of single-camera tracking. The multi-camera setup acts as an intermediary that captures objects from multiple angles simultaneously, preventing blocking issues and maintaining tracking precision even when objects are partially obscured from any single viewpoint.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent transitions from two-dimensional single-camera tracking to three-dimensional multi-camera tracking. By adding spatial dimensions through multiple camera viewpoints, the system can reconstruct object positions and trajectories in 3D space, eliminating the blocking problem inherent in single-plane tracking and significantly improving measurement precision.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If wearable gesture gloves are used for input, then interaction flexibility is improved, but user convenience deteriorates due to continuous removal and putting on

Engineering Contradiction:
Improveinteraction flexibilityVSAvoiduser convenience
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent extracts the tracking function from wearable gloves and relocates it to the environment through fixed cameras. By taking out the tracking capability from the user's body and placing it in the surrounding environment, the system maintains interaction flexibility through gesture recognition while eliminating the inconvenience of wearing and removing gloves.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent enables the tracking system to serve itself by using environmental cameras and automated image processing rather than requiring user attachment of wearable devices. The system automatically detects and tracks gestures in the field of view, providing hands-free operation that improves user convenience while maintaining interaction flexibility.

Inventive Principle:
Principle #25Self-service

3Device complexity

If single-camera tracking is used, then device complexity is reduced, but tracking reliability deteriorates when objects are blocked

Engineering Contradiction:
Improvedevice complexityVSAvoidtracking reliability
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent segments the tracking function across multiple independent camera units rather than relying on a single complex camera system. Each camera independently tracks objects from its own viewpoint, and the system integrates these segmented tracking data streams to produce reliable overall tracking results, preventing single-point failures when objects are blocked from any single view.

Inventive Principle:
Principle #1Segmentation

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables precise and convenient tracking of interface objects, reducing errors and user discomfort, while providing a versatile input method for computing systems.

Implementation Method 1

The controller body further has an accelerometer for detecting translational or rotational movement of the controller body

Methodology Applied
Scientific EffectInertial sensing: Accelerometer

Implementation Method 2

an LED device defined to illuminate the object

Methodology Applied
Scientific EffectLight emission: Light Emitting Diode

Implementation Method 3

a vibrational device for providing vibration

Methodology Applied
Scientific EffectMechanical vibration: Vibration

Data Source

PatentUS11731044B2Voice command controller for communicating with a gaming system
Publication Date: 2023.08.22 SONY INTERACTIVE ENTERTAINMENT LLC
  • US11731044B2 patent drawing
  • US11731044B2 patent drawing
  • US11731044B2 patent drawing

AI summary

A system and controller are provided. In one example, the system includes a controller for playing a video game. The controller includes input buttons for controlling interaction during play of the video game. The controller includes an inertial sensor for detecting translational or rotational movement of the controller and a vibrational device. A voice input device is associated with the controller. A wireless communication circuit of the controller is provided for communicating data between the controller and a local computing device. The local computing device is connectable to a network. The data includes control responsive to presses of said input buttons or control received from said voice input device.