Systems and methods for steering speaker array and microphone array with encoded light rays

Abstract

Described is a way to steer speaker array or microphone array based on direction outputs of tiny light sensors attached to TV viewers, noisy-environment workers, or AR / VR system users. More specifically, a light projector is disposed on a ceiling, which sends out different sequential on / off signals for each pixel. Two light sensors are attached to each speaker array or microphone array, and one or more light sensors are attached to each user. Because each projector pixel corresponds to a specific direction, when a light sensor receives sequential signal from the projector, the light sensor can determine its direction corresponding to the projector and report that to the central station. With the speaker / microphone array direction and user direction known, the system can generate proper phase shifts for different speaker signals and generate directional sound for each individual. Similarly, the central station can determine phase shifts for combining audios from different microphones.

Description

BACKGROUND OF THE INVENTIONTechnical Field[0001]The disclosed embodiments relate in general to acoustic systems and, more specifically, to systems and methods for steering speaker array and microphone array with encoded light rays.Description of the Related Art[0002]When a TV viewer wants to enjoy a show without interfering with other family members or different TV viewers prefer different volume levels, traditional headphones or earbuds are still not very convenient. In ubiquitous high quality augmented reality or virtual reality (AR / VR) environment, or high-noise environment with multiple participants, or high-end teleconferencing environment with multiple attendees and multiple video feeds, traditional sound capture approaches are insufficient to capture clean desired sound. Similarly, traditional sound generation approaches are also insufficient to generate clean directional sound, like humans experience in the real-world environment. In an AR / VR environment, if headsets' direct...

AI Technical Summary

Benefits of technology

This solution improves audio quality by accurately directing sound to individual users, reducing noise and discomfort, and reducing bandwidth and power consumption in AR / VR environments, while eliminating the need for multiple high-quality microphones and earplugs, providing a more natural user experience.

Problems solved by technology

When a TV viewer wants to enjoy a show without interfering with other family members or different TV viewers prefer different volume levels, traditional headphones or earbuds are still not very convenient.

In ubiquitous high quality augmented reality or virtual reality (AR / VR) environment, or high-noise environment with multiple participants, or high-end teleconferencing environment with multiple attendees and multiple video feeds, traditional sound capture approaches are insufficient to capture clean desired sound.

Similarly, traditional sound generation approaches are also insufficient to generate clean directional sound, like humans experience in the real-world environment.

In an AR / VR environment, if headsets' directions cannot match well with proper sound effect, consequently AR / VR participants may get confused or feel uncomfortable.

Images