Display Speaker Feedback Control for Echo and Sound Leakage

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Electronic devices face challenges in providing high-quality audio output without occupying space, particularly when using displays as sound emitters, as they often suffer from echo issues and sound leakage due to the unique vibration characteristics of the display, which are difficult to accurately represent for feedback and cancellation.

Innovation Solution

Incorporating a vibration sensor coupled to the display to generate a vibration sensor signal that accurately represents the acoustic output, allowing for feedback loops to improve audio quality and cancel echo signals, while also using additional actuators to cancel vibrations on other surfaces to prevent sound leakage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If a display is used as a sound emitter to replace traditional speakers, then the display area can be maximized and space occupied by audio components is reduced, but echo issues and sound leakage occur due to the unique vibration characteristics of the display

Engineering Contradiction:
Improvedisplay areaVSAvoidecho and sound leakage
Core Design Contradiction:
Area of stationary objectVSObject-generated harmful factors

Solution Approach 1:

The patent implements feedback control by using vibration sensors to detect the actual vibration characteristics of the display, comparing them with desired characteristics, and adjusting the actuator input signals to minimize differences. This closed-loop system addresses echo and sound leakage by continuously optimizing the display's vibration behavior based on real-time measurements.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent applies preliminary anti-action by using active noise cancellation techniques where anti-phase vibration signals are generated in advance to counteract expected echo and sound leakage from the display. The system predicts harmful vibrations and applies opposing forces before the harmful effects fully manifest.

Inventive Principle:
Principle #9Preliminary anti-action

2Reliability

If vibration sensors and feedback control systems are added to improve audio quality and echo cancellation, then audio output quality is enhanced, but device complexity increases

Engineering Contradiction:
Improveaudio output qualityVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies multi-functionality by designing the vibration sensor system to serve multiple purposes: characterizing display vibration properties for audio enhancement, detecting echo conditions for cancellation, and monitoring overall display behavior. This single sensor system performs what would traditionally require multiple separate subsystems.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system implements self-service by using the display itself as both the sound emitter and the vibration sensing element. The display's inherent structural characteristics provide the feedback needed for control, eliminating the need for entirely separate characterization systems and reducing overall device complexity.

Inventive Principle:
Principle #25Self-service

3Object-generated harmful factors

If additional actuators are added to cancel vibrations on other surfaces, then sound leakage is minimized, but device complexity and space usage increase

Engineering Contradiction:
Improvesound leakageVSAvoidactuator system complexity
Core Design Contradiction:
Object-generated harmful factorsVSDevice complexity

Solution Approach 1:

The patent merges functions by integrating multiple vibration control objectives into a unified feedback control system. The same actuator that drives the display for audio output is also used to cancel vibrations on coupled surfaces, eliminating the need for separate actuators and reducing system complexity.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent applies segmentation by dividing the vibration control into frequency-dependent zones, where different actuator strategies are applied to different frequency ranges and surface areas. This allows targeted cancellation of sound leakage from specific surfaces without requiring actuators on every surface.

Inventive Principle:
Principle #1Segmentation

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution enhances audio quality by providing accurate feedback and echo cancellation, allowing for better sound emission from the display while minimizing sound leakage from other surfaces, thus optimizing space usage in electronic devices.

Implementation Method 1

a vibration sensor physically coupled to the display and configured to sense the vibration of the display due to the actuator and to output a vibration sensor signal proportional to the vibration of the display

Methodology Applied
Scientific EffectVibration sensing: Vibration

Implementation Method 2

an actuator physically coupled to the display and configured to cause vibration of the display in response to an audio signal that is an input to the actuator

Methodology Applied
Scientific EffectElectromechanical conversion: Electromagnetic Induction

Implementation Method 3

the processor is configured to generate an echo reference signal based on the vibration sensor signal. The echo reference signal corresponds to a representation of an acoustic output of the display

Methodology Applied
Scientific EffectSignal conversion: Piezoelectric Effect

Implementation Method 4

the processor is configured to cancel at least part of an echo signal included within a microphone input signal received by a microphone where the processor is configured to cancel the at least part of the echo signal based on the echo reference signal

Methodology Applied
Scientific EffectEcho cancellation: Echo

Data Source

PatentUS11450305B2Feedback control for calibration of display as sound emitter
Publication Date: 2022.09.20 QUALCOMM INC
  • US11450305B2 patent drawing
  • US11450305B2 patent drawing
  • US11450305B2 patent drawing

AI summary

Aspects of the disclosure relate to using a display as a sound emitter and may relate to an electronic device including a display. In particular a vibration sensor such as an accelerometer is physically coupled to the display and senses display vibration to provide a high accuracy feedback loop with respect to representing actual audio output from the display. The electronic device includes an actuator physically coupled to the display and configured to cause vibration of the display in response to an audio signal. The electronic device further includes a vibration sensor physically coupled to the display and configured to output a vibration sensor signal proportional to the vibration of the display due to the actuator. The electronic device further includes a processor operably coupled to the vibration sensor. The processor is configured to adjust the audio signal based on the vibration sensor signal from the vibration sensor.