Personalized, real-time audio processing

Abstract

An apparatus and method for real-time audio processing employs a gaze detection sensor to detect a direction of a user's gaze and output a gaze signal corresponding to the detected direction of the user's gaze. A digital signal processing unit responds to a plurality of signals corresponding to a plurality of sounds received at the apparatus, and the determined direction of gaze to identify a signal of interest from the plurality of signals using the gaze signal. The signal of interest is processed for output to the user. In embodiments, a microphone array provides the plurality of signals. An imaging sensor may work with either the microphone array or the gaze detection sensor to identify the signal of interest.

Description

TECHNICAL FIELD[0001]This application relates generally to the field of audio processing and in particular, sound detection and enhancement.BACKGROUND[0002]There are many environments where the ability to hear and distinguish a certain noise or sounds from others in the environment is important. For example, in a crowded lecture theater, an audience member listening to a speaker / lecturer may encounter noise from a variety of sources. These could include noise sources inside the theater, such as air conditioning or other ventilation, cellphones of other audience members, people talking or shuffling papers during the speaker / lecturer's presentation, and the like. Noise also could come from outside the lecture theater (e.g. traffic, hallway voices, custodians operating cleaning equipment, and the like). In such environments, a listener's ability to discern or hear desired sounds from others can be diminished. In addition, as a speaker or listener moves about the lecture theater, the so...

AI Technical Summary

Problems solved by technology

For example, in a crowded lecture theater, an audience member listening to a speaker / lecturer may encounter noise from a variety of sources.

For example, if the listener is sitting too close to the speaker, or a set of audio speakers, the sound level may be too high.

Alternatively, if the listener is too far away from the sound sources, the sound level may be too low.

Other noisy environments, such as parties, busy public streets, and stadiums also present hearing challenges.

Such systems do not take into account factors which may, for example, make an otherwise low-level signal a desired signal.

Relative positioning and sound levels in other environments can represent similar issues to those encountered in a lecture hall or theater.

Any kind of crowded room, as for example at a party or reception in which two people might wish to converse in a room full of other conversations and unrelated noise; a busy public street or crowded public transportation vehicle; or even an office with cubicles can present listening challenges.

However, this approach likely would be less reliable because the desired sound source on which the listener may be focusing may not be the loudest source.

Signals that do not meet the persistence threshold may be considered to be unwanted noise.

Signals not having a weighted sum that meets or exceeds the respective weighted reference factor may be considered as unwanted noise.

Looking away in such circumstances may change the sound source.

Images