Spatial audio session channel

Abstract

The invention relates to a spatial audio session channel. A selection join indication is received that a wearer of a head-mounted device joins a session channel, the session channel having a first target audio signal, the first target audio signal containing isolated speech of a first speaker. In response, the first target audio signal is spatially reproduced as a left speaker driver signal and a right speaker driver signal that are to respectively drive a left speaker and a right speaker of the first audio system. Other aspects are also described and claimed to be protected.

Description

[0001] This patent application claims the benefit of the earlier filing date of U.S. Provisional Patent Application No. 63 / 586,288, filed on September 28, 2023. Technical Field

[0002] One aspect of the present disclosure relates to digital audio signal processing techniques that enable a wearer of a headset to have a more comfortable listening experience by being able to hear what another speaker is saying during a conversation in a noisy ambient environment. Other aspects are also described and claimed. Background Art

[0003] In noisy environments, such as in restaurants, bars, airplanes, or buses, it is laborious to carry on a conversation with someone nearby because it is difficult to hear and understand what the other person is saying. One solution that can alleviate this labor is to wear headphones that passively isolate the wearer from the noisy environment while actively reproducing the other person's speech through the headphones' speakers in a so-called pass-through function. This selective reproduction of sounds in the surrounding environment can be achieved by applying beamforming signal processing to the output of a microphone array in the headphones, which focuses sound pickup in the forward direction where other speakers are assumed to be located (while attenuating or suppressing pickup of sounds from other directions). The resulting beamformed audio signal then drives the headphone speakers to accomplish the pass-through function. Summary of the invention

[0004] It is desirable to enable wearers of headphones with transparency capabilities to more easily conduct conversations with one or more other speakers in a noisy acoustic environment in everyday life. Various aspects of a more immersive transparency capability with a spatialized audio conversation channel are described.

[0005] The above summary does not include an exhaustive list of all aspects of the present disclosure. It is contemplated that the present disclosure includes all systems and methods that can be practiced by all suitable combinations of the various aspects summarized above and disclosed in the detailed description below and specifically pointed out in the claims section. Such combinations may have specific advantages not specifically set forth in the above summary of the invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0006] In the various figures of the accompanying drawings, several aspects of the present disclosure are illustrated by way of example and not limitation. It should be noted that reference to "one" or "an" aspect in the present disclosure is not necessarily the same aspect, and it means at least one. In addition, for the sake of brevity and to reduce the total number of drawings, a given drawing may be used to illustrate features of more than one aspect of the present disclosure, and for a given aspect, not all elements in the drawing may be required.

[0007] Figure 1is a diagram of a first audio system in which various aspects of the present disclosure may be implemented.

[0008] Figure 2 is a diagram of a case in which there is also a second audio system used by other speakers.

[0009] Figure 3 is a flow chart illustrating various versions of a method for spatial audio rendering of conversation channels. DETAILED DESCRIPTION

[0010] Figure 1 is a block diagram of elements of an audio system in which aspects of the present disclosure may be implemented. The system has a digital processor 5 configured or programmed, for example, according to instructions stored in a non-transitory machine-readable medium (not shown) (e.g., solid-state memory) to perform the following operations for alleviating the wearer's listening difficulty in a noisy ambient environment. Figure 1 The surrounding environment depicted in the example of has a first speaker (labeled "Other Speaker") that is located in the wearer's real environment, such as in the same room or car as the wearer. The surrounding environment is noisy because there are interferences that can be heard by the wearer, such as other conversations (two conversations are shown as an example), and other sources of interference, such as music.

[0011] In the example shown, the processor 5 is integrated in the housing of the head-mounted device 1 worn by the wearer (e.g., a person or user). In this case, the head-mounted device 1 is a headset having a left earphone 6b and a right earphone 6a worn at the left and right ears, respectively. As shown, the earphones 6a, 6b are circumaural and fixed to each other by the bridge portion above the wearer's head. Each earphone 6a, 6b has at least one speaker 4 located at the ear, several microphones, including one or more external microphones (e.g., a reference microphone 2 configured to directly pick up ambient sound and a voice microphone 3 located near the wearer's mouth) and one or more internal microphones (not shown) configured to directly pick up the sound at the entrance of the ear canal or in the ear canal. The audio system therefore has a left instance of the speaker 4 (left speaker) and a right instance of the speaker 4 (right speaker), which will spatially reproduce the sound of the target audio signal, as described in more detail below. Additional sensors may be present in the head mounted device 1, such as accelerometers (e.g., for bone conduction pickup of the wearer's voice) and gyroscopes (e.g., as part of an inertial measurement unit, used as part of an inertial head tracking subsystem), the outputs of which may be used in some aspects described below to spatially reproduce the target audio signal. In addition, although not shown, in another example of the first audio system, its external microphone may be in a companion device 8 of the head mounted device 1, such as a smart watch worn by the wearer or a smart phone belonging to the wearer.

[0012] Another form of head-mounted device 1 (not shown) is an augmented reality (AR) headset, whose form factor can be goggles, glasses, or a helmet. The wearer can see other speakers (e.g., along with the rest of the real environment) via the display panel of the AR headset (e.g., through AR glasses, or through a camera image produced by an outward and forward-facing camera of the AR headset and displayed by the display panel). In one instance, the AR headset has no earphones, and spatial reproduction of the target audio signal is performed through left and right instances of the speaker 4, which are extra-ear speakers in the housing of the AR headset, such as attached to the temples of a pair of see-through AR glasses or attached to a headband against the wearer's left and right temples.

[0013] In a variant of the AR headset-based version of the audio system, the spatial reproduction of the target audio signal is performed by a right speaker and a left speaker respectively integrated in the housing of the earphones 6a, 6b. In this case, the earphones 6a, 6b may be physically separated from the AR headset, while the wearer wears both. An example of one of the earphones 6a, 6b suitable for this purpose is in Figure 1. In this variation, the wearer wears both the AR headset and the earphones 6a, 6b as part of the audio system, and the audio system reproduces the sound of the target audio signal through the speakers in the earphones 6a, 6b. Some of the audio signal processing (as discussed below) that controls and generates the target audio signal may be performed by a processor in the AR headset, and some may even be performed by a processor in the companion device 8.

[0014] The operations of the audio system (described below) can be performed in several ways, which are part of the method for spatial audio reproduction of the conversation channel. In one instance, they are performed entirely by a single microprocessor, which can be within the housing of the head-mounted device 1 (e.g., an AR headset, or a combination of an AR headset and a separate pair of earphones 6a, 6b); in other instances, they can be performed in a distributed manner, with some operations performed by a microprocessor in the head-mounted device 1 and other operations performed by a microprocessor in the companion device 8. The companion device 8 can be, for example, a smartphone that belongs to the wearer and transmits the results of the spatial audio reproduction (e.g., left and right speaker driver signals) to the head-mounted device 1, where they are converted into sounds at the wearer's ears. It is noted here that the operations described below and indicated as being performed by "the processor" or "the processor" may be distributed across multiple microprocessors, for example, some are performed by a microprocessor in the companion device 8, while others are performed by a microprocessor in the head-mounted device 1, and yet others may be performed by, for example, a server to which the companion device 8 or the head-mounted device 1 is connected via the Internet.

[0015] Now refer to Figure 3 , which is a flow chart for illustrating various versions and specific aspects of the spatial audio reproduction method of the present invention. The method may begin at operation 21, where the processor receives an opt-in indication from a wearer of the head mounted device 1 to join a conversation channel. The conversation channel may be a data structure including one or more target audio signals in digital form or as separate bit streams, the one or more target audio signals including a first target audio signal containing isolated speech of a first speaker. Figure 1 In the example of , this would be the speech of the other speaker. In addition, the conversation channel contains metadata for each target audio signal, including the direction of the other speaker (e.g., relative to the forward center axis of the head mounted device 1).

[0016] The opt-in indication may be a selection made by the wearer, for example, through virtual assistant software that prompts the wearer, executed in the head mounted device 1 or in the companion device 8. The actual command from the wearer may be received by the virtual assistant software by touch (operated through the touch screen of the companion device 8) or voice (through the microphone of the head mounted device 1).

[0017] In one aspect, a first target audio signal is generated by processing the output of a microphone array in the first audio system by a first audio system. The first audio system includes an instance of a head-mounted device 1 worn by a wearer, and optionally includes a matching device 8 for the wearer. The first target audio signal can be a monophonic audio signal with metadata, such as the voice of another speaker, which metadata, for example, at least indicates the azimuth direction toward the sound source, which is expected to be the other speaker. The processing of the microphone array output to isolate the voice of the other speaker can also be informed by the output from other sensors in the head-mounted device 1. For example, consider the case where the head-mounted device 1 has a camera subsystem facing forward or outward (as opposed to an inward-facing camera subsystem, such as part of an eye tracking subsystem, which is aimed at the wearer's eyes). The image captured by the outward-facing camera subsystem can be processed to detect the time point when another speaker (and in particular the other speaker) faces the wearer, as well as the arrival azimuth direction of the other speaker's voice. This information means that at the current time, the front axis of the microphone array is in the arrival direction of the other speaker's voice. This information can also be used as an automatic opt-in indication that the wearer should join a conversation channel, or it can signal a virtual assistant to prompt the wearer. This information can also be used to isolate the speech of other speakers, such as by performing pickup beamforming on the output of the microphone array to produce a narrow pickup beam centered on a central axis, or by informing a speech separation machine learning model of the expected direction of arrival.

[0018] In one example, the processing of the output of the microphone array (for producing a first target signal) is as follows. The processor executes a direction detection algorithm that outputs an azimuth and optionally also an elevation as a target direction of a speech source relative to the wearer's head (on which the head mounted device 1 is worn). Subsequently, the target direction is provided to a speech isolation algorithm that processes the output of the microphone array to produce a first target audio signal. The speech isolation algorithm may include, for example, a sound pickup beamforming algorithm that suppresses sounds from directions other than the target direction. A machine learning model may also be part of the speech separation algorithm. When spatial audio reproduction uses the target direction to reproduce the first target audio signal, the wearer will perceive the isolated speech to be coming from the target direction, which is expected to be the direction of other speakers. Note that in some instances, the other speakers are behind the wearer, and in this case, the wearer should perceive the isolated speech to be coming from behind them.

[0019] As an alternative, the first target audio signal (derived from the microphone array in the head mounted device) may be in an Ambisonics format and accompanied by metadata indicating at least the azimuth direction towards a sound source in the sound scene, which is expected to be the other speaker.

[0020] On the other hand, now referring to Figure 2 , the first target audio signal is generated by a second audio system that digitally processes the output of one or more microphones in the second audio system and transmits the resulting bit stream wirelessly (e.g., via radio frequency waves represented by a lightning symbol) in real time for reception by the first audio system. The second audio system may include another instance of the head-mounted device 1 worn by the other speaker, and optionally another instance of the supporting device 8 belonging to the other speaker. Alternatively, the second audio system may not have any head-mounted device 1; for example, the second audio system itself may be just another instance of the supporting device 8, such as a smart watch or smart phone of the other speaker whose microphone is picking up the voice of the other speaker nearby. The processing of the second audio system that produces the first target audio signal can be described as "self-voice" processing, which isolates the voice of the other speaker from other sounds in the surrounding environment (such as, as illustrated in the figure, the conversation of other people nearby). Self-voice processing may, for example, include output from bone conduction pickup in the second audio system (if such a sensor is available, for example, in the instance of the head-mounted device 1 worn by the other speaker).

[0021] In response to receiving the opt-in indication, the first target audio signal is then spatially audio reproduced (operation 23) as left and right speaker driver signals that will drive left and right speakers of the first audio system, respectively. In one example, these left and right speaker driver signals are binaural signals (generated by a binaural reproduction algorithm) that include the effects of a head-related transfer function (HRTF) filter selected for the wearer.

[0022] Subsequently, the processor may receive a selection exit indication that the wearer has left the conversation channel (operation 25). In response, the processor may stop reproducing the first target audio signal in the first audio system so that, for example, the wearer will no longer hear the isolated voice of the other speaker reproduced by the left speaker driver and the right speaker driver of the first audio system.

[0023] If in the first audio system, the head-mounted device 1 is an AR headset, and the first speaker (other speaker) is in the wearer's real environment and can be seen or invisible through the display panel of the AR headset (if the other speaker is behind the wearer), the following features can be added to the first audio system to provide a spatial or more immersive conversation experience via the transparency function of the first audio system.

[0024] In one feature, the processor determines whether the wearer's head is in the direction of a speech source in the surrounding environment (also referred to as a target direction). This may be based on the processor i) using an inward-facing camera of the AR headset to detect the wearer's gaze, ii) processing images from a forward-facing or outward-facing camera of the AR headset to detect the faces of other speakers, or both i) and ii), and optionally using other inputs, such as acoustic-based processing of a microphone array. In response to determining that the wearer's head direction is in the target direction, the processor may generate a selection indication, and in response thereto, the virtual assistant may prompt the wearer to decide whether to join the conversation channel. In one example of this feature, after generating the opt-in indication, the processor uses only acoustic-based processing of the output of the microphone array to track the target direction of the speech source (which may change) in real time to inform subsequent spatial audio reproduction (operation 23). For example, an acoustic arrival direction continuous tracking algorithm is performed instead of gaze processing or outward-facing camera processing, which advantageously reduces the power consumption of the head-mounted device 1 or the supporting device 8. Here, the processor also tracks the wearer's head direction in real time and thus provides both a tracked direction of the wearer's head and a tracked direction of arrival to spatially reproduce the conversation channel.

[0025] The processor recognizes and tracks the faces of other speakers in images captured in real time by the AR headset's externally facing camera subsystem. Figure 3 Operation 23) in now includes reproducing the first target audio signal as a point source, positioned on the tracked face of the other speaker, using the first spatial audio filter. In other words, the virtual position of the point source used to spatially reproduce the first target audio signal corresponds to or is the position of the tracked face of the other speaker. Subsequently, while reproducing the first target audio signal, the spatial audio filter is configured or updated in real time based not only on the position of the tracked face of the other speaker, but also based on the determined changed position of the wearer. In one instance, the processor continuously determines the changing position of the wearer in real time by processing the output of one or more sensors in the first audio system using visual odometry technology or visual simultaneous localization and mapping technology, or uses ultra-wideband time-of-flight positioning technology to sense the position of other speakers. As a result, the transparency function of the first audio system provides the wearer with a more immersive conversation experience even when the wearer begins to move around.

[0026] although Figure 1 A single other speaker is shown (or a first speaker whose isolated speech is in the conversation channel), but the conversation channel can be configured to also include a second target audio signal containing the isolated speech of a second other speaker (not shown). The second other speaker (or second speaker) is also in the wearer's real environment and will be visible via the display panel of the wearer's AR headset. As with the first target audio signal described above, the second target audio signal can be generated in one of two ways: it can be generated by a third audio system (e.g., a head-mounted device 1 worn by the second speaker together with an instance of a companion device such as a smart phone belonging to the second speaker, or only an instance of a companion device that is a smart phone (e.g., see Figure 2 )) is produced by processing the output of one or more microphones in a third audio system and is subsequently received by the first audio system wirelessly from the third audio system; or, it may be produced by the first audio system processing the output of a microphone array in the first audio system to isolate the second speaker's speech from other sounds in the surrounding environment of the first audio system.

[0027] In both of the above scenarios, in response to receiving an opt-in indication, the processor may begin tracking the face of the other speaker in an image captured in real time by an outward-facing camera subsystem of the AR headset. In addition, a second target audio signal is reproduced as a point source using a second spatial audio filter, which is positioned on the tracked face of the second speaker (visible via the display panel of the AR headset). In addition, the second spatial audio filter is configured or updated in real time (while spatially reproducing the second target audio signal) based on the changing position of the wearer. In this way, when there are two other speakers in the conversation channel, the wearer continues to enjoy the conversation channel in an immersive manner.

[0028] In one aspect, the second audio system and the third audio system each send metadata with their respective second target audio signals and third target audio signals, the metadata including the dynamic range or average voice level of the speech of the first other speaker and the second other speaker, respectively. This information can be used by a processor in the first audio system, for example, to adjust the playback level of each of the first target audio signal and the second target audio signal. For example, if the first speaker has a much louder voice than the second speaker, then in operation 23, the processor uses the metadata during reproduction to bring the two voice levels closer to each other, which avoids the second speaker's softer voice being overwhelmed.

[0029] In another aspect related to controlling the playback level of other speakers' voices, consider the case where the wearer is wearing an AR headset. In this case, the processor may be configured to detect when the wearer gazes at the face of a first speaker via the display panel of the AR headset (using the output of the eye tracking subsystem and by tracking the position of the first speaker's face in an image from the externally facing camera subsystem). In response, the processor enables the wearer to manually adjust the playback level of the first target audio signal (but it does not automatically change the playback level). The playback level is then adjusted by the processor based on the setting of a virtual variable level control element presented on the display panel of the AR headset or a physical variable level control element in the first audio system (e.g., a volume control button in a companion device or in the AR headset). Once the wearer has stopped staring at the face of the first speaker, the processor removes the manual playback level adjustment feature, and the playback level previously set by the wearer remains unchanged (for the first target audio signal).

[0030] Another aspect related to controlling the playback level of other speakers' voices, in the case where the wearer is wearing an AR headset, is a manual override feature. Here, the default operating mode can be that when the processor detects that the wearer is staring at the face of the first speaker (via the display panel of the AR headset), it first responds by automatically changing (without any explicit input from the wearer) to increase or decrease the playback volume of the first target audio signal. Subsequently, the processor enables the wearer to manually override the automatic change via a virtual control element displayed on the display panel or via a physical control element in the first audio system. In other words, after the initial automatic change in the playback level, the processor responds to the wearer's request to increase or decrease the playback level (which it detects via the virtual control element or the physical control element).

[0031] And in another aspect related to controlling the playback level of the other speaker's voice, the processor automatically changes (or adjusts) the playback volume of the first target audio signal using a direct sound path parameter that describes a direct sound path from the first speaker to the AR headset. The direct sound path parameter can be determined by the processor, such as calculating (estimating) the distance from the first speaker to the AR headset (e.g., using an image generated by an externally facing camera subsystem).

[0032] It is understood that the use of personally identifiable information should be subject to privacy policies and practices that are deemed to meet or exceed industry or government requirements for maintaining user privacy. Specifically, personally identifiable information or data should be managed and processed to minimize the risk of unintentional or unauthorized access or use, and the nature of the authorized use should be clearly stated to the user.

[0033] To assist the Patent Office and any reader of any patent issuing in this application in interpreting the appended claims, Applicants wish to note that they do not intend for any of the appended claims or claim elements to invoke 35 U.S.C. § 112(f) unless the words “means for” or “step for” are expressly used in a particular claim.

[0034] Although certain aspects have been described and illustrated in the drawings, it should be understood that these aspects are merely illustrative of the invention and not restrictive, and the invention is not limited to the specific constructions and arrangements shown and described, as various other modifications may occur to those skilled in the art. Figure 1 A head mounted device 1 having a headset with earphones 6a, 6b attached is depicted, but as described above, the head mounted device 1 may alternatively be an AR headset with an external ear speaker attached. Therefore, the description is to be regarded as exemplary rather than limiting.

Claims

1. A method for spatial audio rendering of a conversation channel in a first audio system having a head mounted device, the method comprising the following operations performed by a digital processor in the first audio system: receiving an opt-in indication from a wearer of the head mounted device to join a conversation channel, wherein the conversation channel includes a first target audio signal including isolated speech of a first speaker, the first target audio signal i) generated by processing the output of one or more microphones in a second audio system and subsequently received by the first audio system wirelessly from the second audio system, or ii) generated by the first audio system processing the output of the microphone array in the first audio system; and In response to receiving the opt-in indication, the first target audio signal is spatially audio rendered as left and right speaker driver signals that will drive left and right speakers of the first audio system, respectively.

2. The method of claim 1, wherein the head mounted device is an augmented reality headset or an AR headset, and the first speaker is in the wearer's real environment.

3. The method of claim 2, wherein the left speaker and the right speaker are out-of-ear speakers in a housing of the AR headset.

4. The method according to claim 2, wherein in addition to the AR headset, the first audio system further comprises a left earphone housing and a right earphone housing, and the left speaker and the right speaker are respectively integrated in the left earphone housing and the right earphone housing.

5. The method according to claim 2, further comprising: Detecting that the wearer is gazing at the face of the first speaker, and in response, enabling the wearer to manually adjust a playback level of the first target audio signal via a virtual variable level control element displayed on a display panel or via a physical variable level control element in the first audio system.

6. The method according to claim 2, further comprising: detecting that the wearer is gazing at the face of the first speaker, and in response, without input from the wearer, making an automatic change to increase or decrease a playback volume of the first target audio signal; as well as The wearer is enabled to manually override the automatic changes via virtual control elements displayed on a display panel or via physical control elements in the first audio system.

7. The method according to claim 2, further comprising: determining direct sound path parameters from the first talker to the AR headset; as well as The direct sound path parameter is used to adjust a playback volume of the first target audio signal.

8. The method according to claim 2, further comprising: determining a changed position of the wearer of the AR headset by processing outputs of one or more sensors in the first audio system using visual odometry techniques or visual simultaneous localization and mapping techniques, and wherein the spatial audio rendering comprises The first target audio signal is spatially rendered as a point source using a first spatial audio filter, the point source being located on a face of the first speaker, and the first spatial audio filter is configured according to the changing position of the wearer of the AR headset while spatially rendering the first target audio signal.

9. The method of claim 8, wherein the conversation channel further comprises a second target audio signal, the second target audio signal comprising an isolated speech of a second speaker, the second target audio signal i) generated by processing the output of one or more microphones in a third audio system and subsequently received by the first audio system wirelessly from the third audio system, or ii) generated by the first audio system processing the output of the microphone array in the first audio system, The method further comprises In response to receiving the opt-in indication, the second target audio signal is spatially audio rendered as the left speaker driver signal and the right speaker driver signal.

10. The method according to claim 9, further comprising: determining a changed position of the face of the first speaker, and wherein the spatial audio rendering comprises The first spatial audio filter is configured according to the varying position of the face of the first speaker.

11. The method of claim 10, wherein the first target audio signal is generated by one or more microphones in the second audio system and subsequently received by the first audio system wirelessly, and determining the changed position of the face of the first speaker comprises: The position of the first speaker is sensed using ultra-wideband time-of-flight positioning technology.

12. The method of claim 10, wherein the second speaker is in the wearer's real environment and is i) depicted in a camera image of the real environment being displayed by a display panel of an AR headset, or ii) visible to the wearer through the display panel of the AR headset, and the spatial audio rendering further comprises: The second target audio signal is spatially rendered as another point source using a second spatial audio filter, wherein the another point source is positioned on the face of the second speaker, wherein the face of the second speaker is displayed by or visible through the display panel of the AR headset, and the second spatial audio filter is configured according to the changing position of the wearer while spatially rendering the second target audio signal.

13. The method according to claim 1, further comprising: Metadata is received from the second audio system, wherein the metadata includes a dynamic range or an average voice level of the first speaker's speech, and a playback level of a first target audio signal is adjusted using the metadata.

14. The method of claim 1, wherein the first target audio signal is generated by processing the output of the microphone array in the first audio system, the processing comprising: performing direction detection, the direction detection outputting the azimuth and elevation of a speech source or a target direction relative to the wearer's head; as well as providing the target direction to a speech isolation algorithm, the speech isolation algorithm processing the output of the microphone array to produce the first target audio signal, And wherein the spatial audio rendering uses the target direction to render the first target audio signal so that the wearer perceives that the isolated speech comes from the target direction.

15. The method according to claim 14, further comprising determining whether a head orientation of the wearer of the head mounted device is in the target direction based on i) detecting a gaze of the wearer using an inward-facing camera of the AR headset, ii) processing images from a forward-facing camera of the AR headset, or both i) and ii); and The opt-in indication is generated in response to determining that the wearer's head orientation is in the target direction.

16. The method according to claim 15, further comprising: After generating the opt-in indication, acoustic-based processing of the output of the microphone array alone is used to track the target direction of the speech source while tracking the wearer head direction to inform the spatial audio rendering.

17. The method of claim 1, wherein the head mounted device is a pair of headphones.

18. The method of claim 1, further comprising: receiving an opt-out indication from the wearer of the head mounted device to leave the conversation channel; as well as In response to the opt-out indication, rendering of the first target audio signal in the first audio system is stopped.

19. An audio system comprising a processor and a memory having stored therein instructions, the instructions programming the processor to: receiving an opt-in indication from a wearer of a head mounted device in a first audio system to join a conversation channel, wherein the conversation channel includes a first target audio signal including isolated speech of a first speaker, the first target audio signal i) generated by processing the output of one or more microphones in a second audio system and subsequently received by the first audio system wirelessly from the second audio system, or ii) generated by the first audio system processing the output of the microphone array in the first audio system; and In response to receiving the opt-in indication, the first target audio signal is spatially audio rendered as left and right speaker driver signals that will drive left and right speakers of the first audio system, respectively.

20. The audio system of claim 19, wherein the processor comprises a first microprocessor in an augmented reality headset or AR headset.

21. The audio system of claim 20, wherein the processor comprises a second microprocessor in a companion device to the AR headset.

22. The audio system of claim 19, wherein the processor comprises a first microprocessor in a headset.

23. The audio system of claim 22, wherein the processor comprises a second microprocessor in a companion device to the headset.

Images