Adaptive Input Detection Using Multi-Sensor Fusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing devices face challenges in accurately detecting user inputs due to insufficient or improperly configured sensors, particularly in noisy or high-motion environments, where audio sensors may struggle to reliably detect directional audio commands.

Innovation Solution

The device determines its operating conditions and switches between a first mode using two or more audio sensors and a second mode using at least one audio sensor combined with one or more non-audio sensors, such as touch or image sensors, to facilitate input detection based on ambient noise and motion levels.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If audio sensors are used to detect operation inputs, then input detection is enabled, but detection reliability deteriorates in noisy or high-motion environments

Engineering Contradiction:
Improveinput detection reliabilityVSAvoidambient noise and motion interference
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent introduces an intermediary mechanism that combines audio sensor data with non-audio sensor data (such as touch sensors, cameras, or motion sensors) to mediate the detection process. This intermediary approach allows the system to cross-validate inputs and distinguish between genuine user commands and spurious signals caused by noise or motion, thereby improving detection reliability in challenging environments.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent implements a universal input detection system that can operate in multiple modes by utilizing different sensor types depending on environmental conditions. The system can switch between audio-only detection, multi-sensor detection, or alternative detection methods based on the operating context, ensuring reliable input detection across diverse scenarios including noisy and high-motion environments.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If multiple sensors are deployed to improve detection accuracy, then input detection accuracy is improved, but device complexity increases

Engineering Contradiction:
Improveinput detection accuracyVSAvoidsensor configuration complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent employs a dynamic sensor selection mechanism that adapts the number and type of sensors activated based on real-time environmental assessment. Rather than continuously operating all sensors, the system dynamically adjusts sensor configuration based on detected conditions (e.g., noise levels, motion intensity), thereby achieving high detection accuracy when needed while minimizing device complexity and energy consumption during normal operation.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent utilizes parameter changes in sensor operation modes to balance accuracy and complexity. By adjusting operational parameters such as sensor sensitivity thresholds, activation criteria, and data fusion methods based on environmental conditions, the system achieves high measurement precision without requiring all sensors to operate at full capacity simultaneously, thus reducing overall device complexity.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If sensors are optimized for specific directions, then detection precision in those directions is improved, but adaptability to various input directions deteriorates

Engineering Contradiction:
Improvedirectional detection precisionVSAvoidinput direction adaptability
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent creates a universal detection system where sensors are configured to detect inputs from multiple directions by combining data from various sensor types with different spatial sensitivities. The system integrates audio sensors with directional capability, touch sensors with spatial mapping, and motion sensors with omnidirectional detection, enabling precise input detection across all directions while maintaining adaptability to diverse user interaction scenarios.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10185543B2Method, apparatus and computer program product for input detection
Publication Date: 2019.01.22 NOKIA TECHNOLOGIES OY
  • US10185543B2 patent drawing
  • US10185543B2 patent drawing
  • US10185543B2 patent drawing

AI summary

In an example embodiment, a method, apparatus and computer program product are provided. The method includes determining one or more operating conditions of a device. A selection of a mode of operation of the device from at least a first mode and a second mode is facilitated based on the one or more operating conditions of the device. In the first mode, the device is configured to detect an operation input received from an audio source based on two or more audio sensors of the device. In the second mode, the device is configured to detect the operation input based on at least one of the two or more audio sensors and at least one non-audio sensor of the device.