Smart Speaker Ultrasonic Gesture Control for Accessible Operation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Smart sound boxes lack user-friendly control options for individuals with blindness or hearing disabilities, relying on voice or external remote controllers, which limits their accessibility and user experience.

Innovation Solution

The sound box emits ultrasonic signals and uses a built-in microphone to detect the moving trajectory of external objects, allowing users to control it through body movements without additional equipment, thereby enhancing accessibility and reducing costs.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If voice control or external remote controllers are used, then the sound box can be operated, but accessibility for individuals with blindness or hearing disabilities is limited

Engineering Contradiction:
ImproveAccessibilityVSAvoidUser experience
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent replaces voice-based acoustic control and external remote control with a mechanical movement-based control system. The ultrasonic sensor detects the movement trajectory of external objects (user's hand or body), and the processor translates this mechanical movement into control instructions, enabling individuals with hearing or speech impairments to operate the sound box through simple physical movements.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The sound box uses its own built-in ultrasonic sensor and microphone to detect movement trajectories, eliminating the need for external remote controllers. The system serves itself by utilizing internal components for both detection and control processing, thereby expanding accessibility without requiring additional external devices.

Inventive Principle:
Principle #25Self-service

2Ease of operation

If external remote controllers are used, then control functionality is provided, but device complexity and cost increase

Engineering Contradiction:
ImproveControl functionalityVSAvoidSystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent merges the control functionality into the sound box itself by integrating the ultrasonic sensor, movement trajectory acquisition module, and control instruction determination module within the sound box's existing structure. The built-in microphone and speaker are utilized for ultrasonic signal emission and reception, combining multiple functions into a single device and eliminating the need for separate remote controllers.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The ultrasonic sensor and microphone serve dual purposes: they function as standard audio components for normal sound box operation and simultaneously serve as movement detection sensors for the new control mechanism. This multi-functionality reduces the need for additional specialized components, thereby reducing overall system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Ease of operation

If external remote controllers are used, then control is enabled, but cost increases

Engineering Contradiction:
ImproveControl capabilityVSAvoidCost
Core Design Contradiction:
Ease of operationVSQuantity of substance

Solution Approach 1:

The sound box utilizes its own built-in ultrasonic sensor and microphone for movement detection and control, eliminating the need to purchase and distribute external remote controllers to users. This self-service approach reduces material costs by reusing existing internal components for dual purposes.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system creates a virtual model of the user's movement trajectory through ultrasonic detection and processes this digital representation to generate control instructions. This copying approach allows complex control functionality to be achieved through software processing of sensor data rather than through complex hardware controllers.

Inventive Principle:
Principle #26Copying

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This method improves user convenience and flexibility by enabling control through body movements, expanding the user base to include individuals with disabilities and reducing the need for external controllers, while also reducing costs by utilizing internal components for ultrasonic emission and reception.

Implementation Method 1

emitting an ultrasonic signal, and receiving a reflected ultrasonic signal reflected by an external object

Methodology Applied
Scientific EffectUltrasonic signal reflection: Reflection

Implementation Method 2

acquiring a moving trajectory of the external object according to the reflected ultrasonic signal

Methodology Applied
Scientific EffectUltrasonic detection: Ultrasound

Data Source

PatentUS11614540B2Method and apparatus for controlling sound box
Publication Date: 2023.03.28 BEIJING XIAOMI MOBILE SOFTWARE CO LTD
  • US11614540B2 patent drawing
  • US11614540B2 patent drawing
  • US11614540B2 patent drawing

AI summary

A method for controlling a sound box, includes: in response to the sound box being in a standby state, emitting an ultrasonic signal, and receiving a reflected ultrasonic signal reflected by an external object; acquiring a moving trajectory of the external object according to the reflected ultrasonic signal; and determining a target operation instruction to be executed according to the moving trajectory of the external object.