SYSTEM AND METHOD FOR PROVIDING AUGMENTED AUDIO - Patent application
The system uses peripheral speakers and binaural devices to create separate listening zones with enhanced bass and upper range content, addressing the challenge of providing distinct audio to vehicle passengers while maintaining environmental awareness.
Patent Information
- Application Number
- JP2023526638
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2020-10-30
- Filing Date
- 2021-10-25
- Publication Date
- 2024-11-12
- Estimated Expiration
- 2041-10-25
AI Technical Summary
Vehicle audio systems struggle to provide distinct audio content to different passengers while maintaining an open path to the environment, especially for drivers who need to hear external sounds, and existing solutions like headphones isolate users from their surroundings.
A system with peripheral speakers and binaural devices, controlled by a controller, creates separate listening zones with enhanced bass content and time-aligned upper range content using array configurations and filters, ensuring each passenger receives tailored audio without isolation from their environment.
The system provides passengers with louder bass content in their respective zones and time-aligned upper range content, enhancing the audio experience while allowing users to interact with their surroundings, particularly beneficial for drivers.
Smart Images

Figure 0007581509000001 
Figure 0007581509000002 
Figure 0007581509000003
Abstract
Description
[Technical field]
[0001] (CROSS REFERENCE TO RELATED APPLICATIONS) This application claims priority to U.S. patent application Ser. No. 17 / 085,600, filed Oct. 30, 2020, and entitled “Systems and Methods for Providing Augmented Audio,” the entire disclosure of which is incorporated herein by reference. [Background technology]
[0002] The present disclosure relates generally to systems and methods for providing enhanced audio in a vehicle cabin, and more particularly to a method for enhancing the bass response of at least one binaural device disposed in the vehicle cabin. Summary of the Invention [Means for solving the problem]
[0003] All embodiments and features mentioned below can be combined in any technically possible manner.
[0004] According to one aspect, a system for providing enhanced audio in a vehicle includes a plurality of speakers arranged around a passenger compartment of the vehicle; and a controller, the controller configured to receive a first content signal and a second content signal, drive the plurality of speakers according to a first array configuration such that a bass content of the first content signal is generated in a first listening zone within the passenger compartment, and drive the plurality of speakers according to a second array configuration such that a bass content of the second content signal is generated in a second listening zone within the passenger compartment, wherein in the first listening zone a magnitude of the first bass content is greater than a magnitude of the second bass content, and wherein in the second listening zone a magnitude of the second bass content is greater than a magnitude of the first bass content.
[0005] In one embodiment, the controller is configured to time-align, in the first listening zone, the generation of first bass content with the generation of upper range content of the first content signal by the first binaural device, and to time-align, in the second listening zone, the generation of second bass content with the generation of upper range content of the second content signal by the second binaural device.
[0006] In one embodiment, the controller is further configured to output a first upper range of the first content signal to the first binaural device and to output a second upper range of the second content signal to the second binaural device.
[0007] In one embodiment, the controller is configured to receive at least one of the first bass content and the second bass content from the first mobile device.
[0008] In one embodiment, in the first listening zone, the loudness of the first bass content exceeds the loudness of the second bass content by 3 decibels, and in the second listening zone, the loudness of the second bass content exceeds the loudness of the first bass content by 3 decibels.
[0009] In one embodiment, a first listening zone is positioned around a first seating position within the vehicle and a second listening zone is positioned around a second seating position within the vehicle.
[0010] In one embodiment, the controller forms the first array configuration and the second array configuration by implementing a plurality of filters, and the controller is configured to adjust at least one of the plurality of filters according to the error signal.
[0011] In one embodiment, the controller forms the first array configuration and the second array configuration by implementing a plurality of filters, the plurality of filters being selected from a set of stored filters according to parameters representative of a configuration of the vehicle cabin.
[0012] In one embodiment, the system further includes a first binaural device and a second binaural device, and the controller is configured to provide the upper range content of the first audio signal to the first binaural device such that the first binaural device generates the upper range content of the first audio signal in the first listening zone, and to provide the upper range content of the second audio signal to the second binaural device such that the second binaural device generates the upper range content of the second audio signal in the second listening zone.
[0013] In one embodiment, the controller is configured to time-align, in the first listening zone, the generation of first bass content with the generation of upper range content of the first content signal by the first binaural device, and to time-align, in the second listening zone, the generation of second bass content with the generation of upper range content of the second content signal by the second binaural device.
[0014] In one embodiment, the time alignment in at least one of the first listening zone or the second listening zone is determined automatically according to at least one microphone signal.
[0015] In one embodiment, the first binaural device and the second binaural device are each selected from one of a set of speakers located in a headrest or an open-ear wearable.
[0016] According to another aspect, a method for providing enhanced audio to a user in a vehicle includes receiving a first content signal and a second content signal; driving a plurality of speakers arranged around a passenger compartment of the vehicle in a first array configuration such that a bass content of the first audio signal is generated in a first listening zone within the passenger compartment; and driving the plurality of speakers according to a second array configuration such that a bass content of the second audio signal is generated in a second listening zone within the passenger compartment, wherein in the first listening zone a magnitude of the first bass content is greater than a magnitude of the second bass content and wherein in the second listening zone a magnitude of the second bass content is greater than a magnitude of the first bass content.
[0017] In one embodiment, the generation of the first bass content is time-aligned with the generation of the upper range content of a first content signal by a first binaural device in a first listening zone, and the generation of the second bass content is time-aligned with the generation of the upper range content of a second content signal by a second binaural device in a second listening zone.
[0018] In one embodiment, the time alignment in at least one of the first listening zone or the second listening zone is determined automatically according to at least one microphone signal.
[0019] In one embodiment, the method further comprises outputting the first upper range to a first binaural device and outputting the second upper range to a second binaural device.
[0020] In one embodiment, at least one of the first bass content and the second bass content is received from a first mobile device.
[0021] In one embodiment, in the first listening zone, the loudness of the first bass content exceeds the loudness of the second bass content by 3 decibels, and in the second listening zone, the loudness of the second bass content exceeds the loudness of the first bass content by 3 decibels.
[0022] In one embodiment, a first listening zone is positioned around a first seating position within the vehicle and a second listening zone is positioned around a second seating position within the vehicle.
[0023] In one embodiment, the method further includes adjusting at least one filter of the plurality of filters according to the error signal, the plurality of filters forming a first array configuration and a second array configuration.
[0024] In one embodiment, the method further includes selecting a plurality of filters from the set of stored filters according to parameters representative of a configuration of the vehicle cabin, the plurality of filters forming a first array configuration and a second array configuration.
[0025] The details of one or more implementations are set forth in the accompanying drawings and the description below. Other features, objects, and advantages will become apparent from the description and drawings, and from the claims.
[0026] In the drawings, like reference numbers generally refer to the same parts throughout the different views. Also, the drawings are not necessarily to scale, emphasis instead generally being placed upon illustrating the principles of various aspects. [Brief description of the drawings]
[0027] [Figure 1A] 1 illustrates an audio system for providing enhanced audio within a vehicle cabin, according to one embodiment. [Figure 1B] 1 illustrates an audio system for providing enhanced audio within a vehicle cabin, according to one embodiment. [Diagram 2] 1 illustrates an open-ear wearable, according to one embodiment. [Diagram 3] 1 illustrates an open-ear wearable, according to one embodiment. [Figure 4] 1 illustrates a flowchart of a method for providing enhanced audio in a vehicle cabin, according to one embodiment. [Diagram 5] 1 illustrates an audio system for providing augmented, spatialized audio within a vehicle cabin, according to one embodiment. [Figure 6] 1 illustrates a flowchart of a method for providing augmented, spatialized audio in a vehicle cabin, according to one embodiment. [Figure 7A] 1 illustrates a crossover plot according to one embodiment. [Figure 7B] 1 illustrates a crossover plot according to one embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0028] Vehicle audio systems that include only surround speakers are limited in their ability to provide different audio content to different passengers: while a vehicle audio system may be arranged to provide separate zones of bass content with sufficient separation, the same cannot be said for upper range content, whose wavelengths are too short to adequately create separate listening zones with independent content using only surround speakers.
[0029] The leakage of upper range content between listening zones can be solved by providing each user with a wearable device such as headphones. If each user wears a pair of headphones, a separate audio signal can be provided to each user with minimal sound leakage. However, the minimal leakage comes at the cost of isolating each passenger from the environment, which is undesirable in a vehicle situation. This is especially true for the driver, who needs to be able to hear sounds in the environment, such as sounds generated by emergency vehicles or the voices of passengers, but also for the rest of the passengers, who typically want to be able to engage in a conversation and interact with each other.
[0030] This can be solved by providing each user with a binaural device, such as an open-ear wearable or near-field speakers, such as headrest speakers, that provide separate upper range audio content to each passenger, allowing the user to engage with their environment, while maintaining an open path to the user's ears. However, open-ear wearables and near-field speakers typically do not provide adequate bass response in a moving vehicle, as road noise tends to mask the same frequency bands.
[0031] 1A, a schematic diagram illustrating an audio system for providing augmented audio within a vehicle cabin 100 is shown. As shown, the vehicle cabin 100 includes a set of ambient speakers 102. (For purposes of this disclosure, a speaker is any device that receives an electrical signal and converts it into an acoustic signal.) A controller 104 located within the vehicle is configured to receive a first content signal u1 and a second content signal u2. The first content signal u1 and the second content signal u2 are audio signals (and may be received as analog or digital signals according to any suitable protocol) each including bass content (i.e., content below 250 Hz ± 150 Hz) and upper range content (i.e., content above 250 Hz ± 150 Hz). The controller 104 is configured to drive the ambient speakers 102 with drive signals d1-d4 to form at least a first array configuration and a second array configuration. A first array configuration formed by at least a subset of the surrounding speakers 102 constructively combines the acoustic energy generated by the surrounding speakers 102 to generate bass content of a first content signal u1 in a first listening zone 106 arranged at a first seating position P1. A second array configuration similarly formed by at least a subset of the surrounding speakers 102 constructively combines the acoustic energy generated by the surrounding speakers 102 to generate bass content of a second content signal u2 in a second listening zone 108 arranged at a second seating position P2. Additionally, the first array configuration can destructively combine the acoustic energy generated by the ambient speakers 102 to form a substantial null in the second listening zone 108 (and any other seating positions within the vehicle cabin), and the second array configuration can destructively combine the acoustic energy generated by the ambient speakers 102 to form a substantial null in the first listening zone (and any other seating positions within the vehicle cabin).
[0032] It should be understood that in various embodiments, there may be some or complete overlap between the subset of surround speakers 102 arranged to generate the bass content of a first content signal u1 in a first listening zone 106 and the subset of surround speakers 102 arranged to generate the bass content of a second content signal u2 in a second listening zone.
[0033] Assuming that the magnitude of the bass content in the first and second content signals is substantially the same, the arrangement of the surround speakers 102 means that the magnitude of the bass content of the first content signal u1 is greater than the magnitude of the bass content of the second content signal u2 in the first listening zone 106. Similarly, the magnitude of the bass content of the second content signal u2 is greater than the magnitude of the bass content of the first content signal u1. The net effect is that a user sitting at position P1 will primarily perceive the bass content of the first content signal u1 as being greater than the bass content of the second content signal u2, which may not be perceptible in some cases. Similarly, a user sitting at position P2 will primarily perceive the bass content of the second content signal u2 as being greater than the bass content of the first content signal u1. In one embodiment, in the first listening zone, the magnitude of the bass content of the first content signal u1 is at least 3 dB greater than the magnitude of the bass content of the second content signal u2, and similarly, in the second listening zone, the magnitude of the bass content of the second content signal u2 is at least 3 dB greater than the magnitude of the bass content of the first content signal u1.
[0034] Although only four ambient speakers 102 are shown, it should be understood that any number of ambient speakers 102 greater than one may be used. Additionally, for purposes of this disclosure, the ambient speakers 102 may be located in the vehicle doors, pillars, ceiling, floor, dashboard, rear deck, trunk, under the seats, integrated within the seats, or in the center console within the passenger compartment 100, or any other drive point within the cabin structure that generates acoustic bass energy within the cabin.
[0035] In various embodiments, the first content signal u1 and the second content signal u2 (as well as any other received content signals) may be received from one or more of a mobile device (e.g., via a Bluetooth® connection), a wireless signal, a satellite wireless signal, or a cellular signal, although other sources are contemplated. Furthermore, each content signal need not be received simultaneously, but rather may have been previously received and stored in a memory for later playback. Furthermore, as described above, the first content signal u1 and the second content signal u2 may be received as analog or digital signals according to any suitable communication protocol. Furthermore, since the first content signal u1 and the second content signal u2 may be transmitted digitally, consisting of a set of binary values, the bass content and upper range content of these signals refer to the constituent signals of the respective frequency ranges of the bass content and upper range content when the content signals are converted to analog signals before being converted by a speaker or other device.
[0036] As shown in Fig. 1A, the binaural devices 110 and 112 are positioned to generate a stereo first acoustic signal 114 in the first listening zone 106 and a stereo second acoustic signal 116 in the second listening zone, respectively. As shown in Fig. 1A, the binaural devices 110 and 112 are composed of speakers 118, 120 arranged in respective headrests arranged adjacent to the listening zones 106, 108. The binaural device 110 comprises, for example, a left speaker 118L arranged in the headrest for sending a left first acoustic signal 114L to the left ear of a user sitting in a first sitting position P1, and a right speaker 118R for sending a right first acoustic signal 114R to the right ear of the user. Similarly, the binaural device 112 comprises a left speaker 120L disposed in a headrest for sending a left second acoustic signal 116L to the left ear of a user seated in a second seating position P2, and a right speaker 120R for sending a right second acoustic signal 116R to the right ear of the user. Although the acoustic signals 114, 116 are shown as comprising left and right stereo components, it should be understood that in some embodiments, one or both of the acoustic signals 114, 116 may be a mono signal in which both the left and right sides are the same. The binaural devices 110, 112 may each further employ a set of cross-cancellation filters to cancel the audio of each side generated by the opposite side. Thus, for example, the binaural device 110 may employ a set of cross-cancellation filters to cancel the audio generated for the user's right ear at the user's left ear and vice versa. In embodiments in which the binaural device is wearable (e.g., open-ear headphones) and has driving points close to the ears, crosstalk cancellation is typically not required. However, for more distant headrest speakers or wearables (e.g., Bose SoundWear), binaural devices typically employ some measurement crosstalk cancellation to achieve binaural control.
[0037] Although the first binaural device 110 and the second binaural device 112 are shown as speakers located in the headrest, it should be understood that the binaural devices described in this disclosure can be any device suitable for delivering independent left-ear and right-ear acoustic signals (i.e., stereo signals) to a user sitting in the respective position. Thus, in an alternative example, the first binaural device 110 and / or the second binaural device 112 can be comprised of speakers located in other areas of the vehicle cabin 100, such as an upper seatback, a headliner, or any other location positioned near the user's ears, suitable for delivering independent left-ear and right-ear acoustic signals to a user. In yet another alternative example, the first binaural device 110 and / or the second binaural device 112 can be an open-ear wearable worn by a user sitting in the respective seating position. For the purposes of this disclosure, an open-ear wearable is any device designed to be worn by a user and capable of delivering independent left and right ear acoustic signals while maintaining an open path to the user's ears. Figures 2 and 3 show two examples of such open-ear wearables. The first open-ear wearable is a pair of frames 200 featuring left and right speakers 202L and 202R located at the left and right temples 204L and 204R, respectively. The second is a pair of open-ear headphones 300 featuring left and right speakers 302L and 302R. Both the frame 200 and the open-ear headphones 300 can provide separate acoustic signals to the user's left and right ears while maintaining an open path to the user's ears.
[0038] The controller 104 can provide at least the upper range content of the first content signal u1 to the first binaural device 110 via the binaural signal b1, and at least the upper range content of the second content signal u2 to the second binaural device 112 via the binaural signal b2. (In one embodiment, the full range, including bass content, of the first content signal u1 and the second content signal u2 are sent to the first binaural device 110 and the second binaural device 112, respectively.) As a result, the first acoustic signal 114 includes at least the upper range content of the first content signal u1, and the second acoustic signal 116 includes at least the upper range content of the second signal u2. The production of bass content of the first content signal u1 in the first listening zone 106 by the ambient speakers 102 enhances the production of the upper range content of the first signal u1 generated by the first binaural device 110, and the production of bass content of the second content signal u2 in the second listening zone 108 by the ambient speakers 102 enhances the production of the upper range content of the second content signal u2 generated by the second binaural device.
[0039] Thus, a user sitting at seating position P1 perceives a first content signal u1 played in a first listening zone 106 from the combined output of a first arrangement of the ambient speakers 102 and the first binaural device 110. Similarly, a user sitting at seating position P2 perceives a second content signal u2 played in a second listening zone 108 from the combined output of a second arrangement of the ambient speakers 102 and the second binaural device 112.
[0040] 7A and 7B show example plots of frequency crossover between bass content and upper range content of an example content signal (e.g., first content signal u1) at 100 Hz and 200 Hz, respectively. As mentioned above, crossover between bass content and upper range content may occur, for example, at 250 Hz ± 150 Hz, and thus crossover 100 Hz or 200 Hz is an example of this range. As shown, the combined total response in the listening zone is perceived as a flat response. (Of course, a flat response is only one example of a frequency response, and other examples may be, for example, boosting bass, midrange, and / or treble, depending on the desired equalization.
[0041] The binaural signals b1, b2 (and any other binaural signals generated for additional binaural devices) are generally N-channel signals, where N≧2 (since there is at least one channel per ear). N can be correlated to the number of speakers in the rendering system (e.g., if a headrest has four speakers, the associated binaural signal typically has four channels). If the binaural device employs crosstalk cancellation, there may be some overlap between the content in the channels for the purpose of cancellation. However, typically, the signal mixing is performed by a crosstalk cancellation filter located in the binaural device, not the binaural signal received by the binaural device.
[0042] The controller 104 can provide the binaural signals b1, b2 either wired or wirelessly. For example, if the binaural devices 110 or 112 are open-ear wearables, the respective binaural signals b1, b2 can be transmitted via Bluetooth, WiFi, or any other suitable wireless protocol.
[0043] Additionally, the controller 104 may be further configured to time-align the generation of bass content in the first listening zone 106 with the generation of upper range content by the first binaural device 110 to account for radio, acoustic, or other transmission delays inherent in the generation of such signals. Similarly, the controller 104 may be further configured to time-align the generation of bass content in the second listening zone 108 with the generation of upper range content by the second binaural device 112. There is some inherent delay between the output of the drive signals d1-d4 and the time at which the bass content converted by the surrounding speakers 102 reaches the respective listening zones 106, 108. The delay includes the time required for the drive signals d1-d4 to be converted by the respective speakers 102 into acoustic signals and travel from the respective speakers 102 to the first listening zone 106 or the second listening zone 108 (although other factors may also affect the delay). Since each peripheral speaker 102 is likely to be located at a certain unique distance from the first listening zone 106 and the second listening zone 108, the delay can be calculated separately for each peripheral speaker 102. Furthermore, there is some delay between the output of the binaural signals b1, b2 and the generation of the acoustic signals 114, 116 in the first listening zone 106 and the second listening zone 108, respectively. This delay is a function of the time to process the received binaural signals b1, b2 (if the binaural signals are encoded in a communication protocol, such as a wireless protocol, and / or if the binaural device performs any additional signal processing) and convert the binaural signals b1, b2 into the acoustic signals 114, 116, and the time for the acoustic signals 114, 116 to travel to the user sitting at the positions P1, P2 (although this is likely to be negligible since each binaural device is located relatively close to the user). (Again, other factors may affect the delay.)) Thus, to take these delays into account, the controller 104 can time the generation of the drive signals d1-d4 and the binaural signals b1, b2 such that the generation of the bass content of the first content signal u1 by the peripheral speaker 102 is time-aligned with the generation of the upper range content of the first content signal u1 by the first binaural device 110 in the first listening zone 106, and the generation of the bass content of the second content signal u2 by the peripheral speaker 102 is time-aligned with the generation of the upper range content of the second content signal u2 by the second binaural device 112 in the second listening zone 108.
[0044] For purposes of this disclosure, "time-aligned" refers to the alignment in time of the generation of bass content and upper range content of a given content signal at a given point in a space (e.g., a listening zone) such that the content is reproduced accurately at the given point in the space. It should be understood that the bass content and upper range content only need to be time-aligned sufficiently for a user to perceive that the content signal is reproduced accurately. In general, a 90° offset in crossover frequency between the bass content and the upper range content is acceptable in a time-aligned acoustic signal. To provide some examples at several different crossover frequencies, acceptable offsets may be + / -2.5 ms for 100 Hz, + / -1.25 ms for 200 Hz, + / -1 ms for 250 Hz, and + / -0.625 ms for 400 Hz. However, it should be understood that for purposes of this disclosure, anything up to a 180° offset in crossover frequency is considered to be time-aligned.
[0045] As shown in Figures 7A and 7B, beyond the crossover frequency, there is further overlap between the bass content and the upper range content. The phase of these frequencies within the overlap can be individually shifted to time-align the upper range content and the bass content. As will be appreciated, the phase shift applied is frequency-dependent. For example, one or more all-pass filters designed to introduce a phase shift at least at the overlap frequency of the upper range content and the bass content can be included to achieve the desired time alignment across frequencies.
[0046] The time alignment can be established a priori for a given binaural device. In a headrest speaker embodiment, the delay between receiving the binaural signal and generating the acoustic signal is always the same, and therefore the delay can be set as a factory setting. However, when the binaural devices 110, 112 are wearables, the delay typically varies from wearable to wearable based on the different times required to process the respective binaural signals b1, b2 and generate the acoustic signals 114, 116 (this is especially true for wireless protocols with well-known variable latencies). Thus, in one embodiment, the controller 104 can store multiple delay presets for time-aligning the generation of bass content with the generation of the acoustic signals 114, 116 for different wearable devices or types of wearable devices. Thus, upon connecting to a particular wearable device, the controller 104 can identify the wearable device (e.g., a pair of Bose frames) and retrieve from storage a particular pre-stored delay for time-aligning the bass content with the acoustic signals 114, 116 generated by the identified wearable device. In an alternative example, the pre-stored delay can be associated with a particular device type. For example, if the delays associated with wearables operating a particular communication protocol (e.g., Bluetooth) or protocol version (e.g., Bluetooth version) are typically the same, the controller 104 can select the delay according to the detected communication protocol or communication protocol version. These pre-stored delays for a given device or type of device can be determined by employing a microphone in a given listening zone and calibrating the delay by a manual or automatic process until the bass content of a given content signal is time-aligned with the acoustic signal of a given binaural device in the listening zone. In yet another example, the delay can be calibrated according to a user input.For example, a user wearing an open-ear wearable device can sit in seating positions P1 or P2 and adjust the generation of drive signals d1-d4 and / or binaural signals b1, b2 until the bass content is correctly time-aligned with the upper range of the acoustic signals 114, 116. In another example, the device can report to the controller 104 the delay required for time alignment.
[0047] In an alternative example, the time alignment may be determined automatically during runtime rather than by a set of pre-stored delays. In one example, a microphone may be placed on or near the binaural device (e.g., on a headrest or on a wearable) and used to generate a signal to a controller to determine the delay for time alignment. One method for automatically determining time alignment is described in U.S. Patent Application Publication No. 2020 / 0252678, entitled "Latency Negotiation in a Heterogeneous Network of Synchronized Speakers," which is incorporated herein by reference in its entirety, although any other suitable method for determining delays may be used.
[0048] As explained above, time alignment can be achieved over a range of frequencies using all-pass filters. To account for different delays of various binaural devices, the particular filter implemented can be selected from a set of stored filters, or the phase change implemented by the all-pass filter can be adjusted. The selected filter or phase change can be based on different devices or device types, by user input, according to a delay detected by a microphone on the wearable device, according to a delay reported by the wearable device, etc., as described above.
[0049] In the embodiment of FIG. 1A, the controller 104 generates both the driving signals d1-d4 and the binaural signals b1, b2. However, in alternative examples, one or more mobile devices can provide the binaural signals b1, b2. For example, as shown in FIG. 1B, the mobile device 122 provides the binaural signal b1 to the binaural device 110 (e.g., if the binaural device 110 is an open-ear wearable) via a wired or wireless (e.g., Bluetooth) connection. For example, a user can enter the vehicle cabin 100 wearing the open-ear wearable binaural device 110 and listen to music via a Bluetooth connection (binaural signal b1) paired with the mobile device 122. Upon entering the vehicle cabin 100, the controller 104 can begin providing bass content of the first content signal u1, while the mobile device 122 continues to provide the binaural signal b1 to the open-ear wearable binaural device 110. In this embodiment, the controller 104 can receive the first content signal u1 from the mobile device 122 to generate the bass content of the first content signal u1 in the first listening zone 106. Thus, the mobile device 122 can be paired (or otherwise connected) with both the binaural device 110 and the controller 104 to provide the binaural signal b1 and the first content signal u1. In an alternative example, the mobile device 122 can broadcast a single signal that is received by both the controller 104 and the binaural device 110 (in this embodiment, each device can apply a respective high pass / low pass for crossover). For example, the Bluetooth 5.0 standard provides such an isochronous channel for locally broadcasting a signal to nearby devices.In an alternative example, instead of transmitting the first content signal u1, the mobile device 122 can transmit metadata of the content transmitted to the first binaural device 110 via the first binaural signal b1 to the controller 104, which enables the controller 104 to supply the correct first content signal u1 (i.e., the same content) from an external source such as a streaming service.
[0050] Although only one mobile device 122 is shown in FIG. 1B, it should be understood that any number of mobile devices may provide binaural signals to any number of binaural devices (e.g., binaural devices 110, 112) located within the vehicle cabin 100.
[0051] Of course, as described in connection with FIG. 1A, the controller 104 can receive the first content signal u1 from the mobile device. Thus, in one embodiment, the user can wear the open-ear wearable first binaural device 110 when entering the vehicle, at which time the mobile device 122 stops transmitting content to the first binaural device and instead provides the first content signal u1 to the controller 104, which is assumed to transmit the binaural signal b1, for example, via a wireless connection such as Bluetooth. Similarly, in the case of multiple binaural devices (e.g., binaural devices 110, 112) receiving signals from multiple mobile devices, the controller 104 can be assumed to transmit the respective binaural signals (e.g., binaural signals b1, b2) to the binaural device rather than the mobile device.
[0052] The controller 104 may include a processor 124 (e.g., a digital signal processor) and a non-transitory storage medium 126 that stores program code that, when executed by the processor 124, performs the various functions and methods described in this disclosure. However, it should be understood that in some embodiments, the controller 104 may be implemented solely as hardware (e.g., as an application specific integrated circuit or a field programmable gate array) or as some combination of hardware, firmware, and software.
[0053] To arrange the surround speakers 102 to provide bass content to the first listening zone 106 and the second listening zone 108, the controller 104 may implement a number of filters that each adjust the acoustic output of the surround speakers 102 such that the bass content of the first content signal u1 combines constructively in the first listening zone 106 and the bass content of the second signal u2 combines constructively in the second listening zone 108. Although such filters are typically implemented as digital filters, they may alternatively be implemented as analog filters.
[0054] Further, although only two listening zones 106 and 108 are shown in Figures 1A and 1B, it should be understood that the controller 104 can receive any number of content signals and create any number of listening zones (including only one) by filtering the content signals to the array surround speakers, with each listening zone receiving the bass content of a unique content signal. For example, in a five-seat automobile, the surround speakers can be arranged to generate five separate listening zones, with each listening zone generating the bass content of a unique content signal (i.e., the bass content of each content signal is the loudest, assuming that the bass content of each content signal is played substantially equally loud in the other listening zones). Further, a separate binaural device can be disposed in each listening zone to receive a separate binaural signal augmented by and time-aligned with the bass content generated in the respective listening zone.
[0055] In the above embodiment, the binaural devices 110, 112 (or any other binaural device) can send the same content to both users. In this embodiment, the controller 104 can augment the acoustic signal generated by the binaural device with bass content generated by the peripheral speaker 102 without creating separate listening zones for playing separate content. The bass content can be time-aligned with the upper range content played from both the binaural devices 110, 112, so that both users perceive a played content signal that includes the upper range signal sent by the binaural devices 110, 112 and the bass content played by the peripheral speaker 102. It is conceivable that each device receives the same program content signal, but the users select different volume levels of the same content. In this case, rather than creating separate listening zones, the controller 104 can employ the first array configuration and the second array configuration to create separate volume zones in which each user perceives the same program content at different volumes.
[0056] In one embodiment, it is not necessary for each user to have an associated binaural device; rather, some users may only hear the content generated by the peripheral speaker 102. In this embodiment, the peripheral speaker 102 generates not only bass content, but also upper range content of the program content signal (e.g., program content signal u1). To a user with a binaural device, the program content signal is perceived as a stereo signal, as provided by the binaural signal (e.g., binaural signal b1) and by the left and right speakers of the binaural device. In fact, it should be understood that in each of the embodiments described in this disclosure, there may be some or complete overlap of the spectral range between the signals generated by the peripheral speaker 102 and the signals generated by the binaural device (e.g., binaural devices 110, 112). Those with binaural devices that have an overlap of the spectral range with the peripheral speaker 102 receive an enhanced experience with improved stereo, audio staging, and perceived spaciousness.
[0057] It should be understood that navigation prompts and phone calls are included in a program content signal that may be directed to a particular user within a listening zone, such that a driver may hear navigation prompts generated by a binaural device (e.g., binaural device 110) with bass boosted by ambient speakers, while a passenger may hear music in a different listening zone.
[0058] Additionally, the microphones on the wearable binaural device can be used for voice pickup and for traditional uses such as telephone calls, vehicle-based or mobile device-based voice recognition, digital assistants, etc.
[0059] Additionally, multiple filters, rather than one set of filters, can be implemented by the controller 104 depending on the configuration of the vehicle cabin 100. For example, various parameters within the vehicle cabin change the acoustics of the vehicle cabin 100, including the number of passengers in the vehicle, whether the windows are rolled up or down, the position of the seats within the vehicle (e.g., whether the seats are upright, reclined, or moving forward or backward within the vehicle cabin), etc. These parameters can be detected by the controller 104 (e.g., by receiving signals from the vehicle's onboard computer) and the correct set of filters can be implemented to provide the first, second, and any additional array configurations. For example, various sets of filters can be stored in the memory 126 and retrieved according to the detected cabin configuration.
[0060] In an alternative example, the filters may be a set of adaptive filters that are adjusted according to signals received from error microphones (e.g., positioned on the binaural device or within the respective listening zones) to adjust filter coefficients to align the first listening zone across the respective seat position (first seat position P1 or second seat position P2) or to adjust for changes in the cabin configuration, such as whether the windows are rolled up or down.
[0061] 4 illustrates a flow chart of a method 400 for providing enhanced sound to a user in a vehicle cabin. The steps of method 400 may be performed by a controller (such as controller 104) in communication with a set of ambient speakers (such as ambient speaker 102) located within the vehicle, and further in communication with a set of binaural devices (such as binaural devices 110, 112) located at respective seating positions within the vehicle.
[0062] At step 402, a first content signal and a second content signal are received. These content signals may be received from a number of potential sources, such as a mobile device, a radio, a satellite radio, a cellular connection, etc. The content signals each represent audio that may include bass content and upper range content.
[0063] In steps 404 and 406, the plurality of ambient speakers are driven according to a first array configuration (step 404) and a second array configuration (step 406) such that a bass content of a first content signal is produced in a first listening zone and a bass content of a second content signal is produced in a second listening zone within the cabin. The nature of the arrays creates listening zones such that when the bass content of the first content signal is reproduced in the first listening zone as loud as the bass content of the second signal is reproduced in the second listening zone, the loudest bass content of the first content signal is greater (e.g., by at least 3 dB) than the loudest bass content of the second content signal in the first listening zone, and the loudest bass content of the second signal is greater (e.g., by at least 3 dB) than the loudest bass content of the first content signal in the second listening zone. In this way, a user sitting in a first seating position will perceive the loudness of the first bass content as being louder than the second bass content, and similarly, a user sitting in a second seating position will perceive the loudness of the second bass content as being louder than the first bass content.
[0064] In steps 408 and 410, the upper range content of the first content signal is provided to a first binaural device positioned to generate the upper range content in a first listening zone (step 408), and the upper range content of the second content signal is provided to a second binaural device positioned to generate the upper range content in a second listening zone (step 410). The end result is that a user sitting in a first seating position perceives a first content signal from a combination of the output of the first binaural device and the output of the surrounding speakers, and a user sitting in a second seating position perceives a second content signal from a combination of the output of the second binaural device and the output of the surrounding speakers. Stated another way, the ambient speakers enhance the upper range of the first content signal as produced by the first binaural device with the bass of the first content signal in the first listening zone, and enhance the upper range of the second content signal as produced by the second binaural device with the bass of the second content signal in the second listening zone. In various alternatives, the first binaural device is a speaker located in an open-ear wearable or a headrest.
[0065] Further, the generation of the bass content of the first content signal in the first listening zone may be time-aligned with the generation of the upper range of the first content signal by the first binaural device in the first listening zone, and the generation of the second bass content in the second listening zone may be time-aligned with the generation of the upper range of the second content signal by the second binaural device. In alternative embodiments, the first upper range content or the second upper range content may be provided to the first binaural device or the second binaural device by a mobile device, with the generation of the bass content being time-aligned.
[0066] Although method 400 is described for two separate listening zones and two binaural devices, it should be understood that method 400 can be extended to any number of listening zones (including only one) located within a vehicle and with respective binaural devices located therein. In the case of a single binaural device and listening zone, separation to other seats is no longer important and the multiple ambient speaker filters can be different than in the multi-zone case to optimize bass presentation. (In the single user case, this can be determined, for example, by a user interface or via sensors located in the seats.)
[0067] 5, an alternative schematic diagram of a vehicle audio system arranged in a vehicle cabin 100 is shown, in which an ambient speaker 102 is employed to enhance the bass content of at least one binaural device generating spatialized audio. In this embodiment, the controller 504 (an alternative to the controller 104) is configured to generate the binaural signals b1, b2 as spatial audio signals, such that the binaural devices 110 and 112 generate the acoustic signals 114, 116 as spatial audio signals that are perceived by a user as emanating from virtual audio sources SP1 and SP2, respectively. The binaural signal b1 is generated as a spatial audio signal according to the position of the head of a user sitting at a position P1. Similarly, the binaural signal b2 is generated as a spatial audio signal according to the position of the head of a user sitting at a position P2. 1A and 1B, these spatialized sound signals generated by the binaural devices 110, 112 may be augmented by bass content generated by the ambient speakers 102 and driven by the controller 504.
[0068] As shown in FIG. 5, the first head tracking device 506 and the second head tracking device 508 are arranged to detect the position of the head of a user sitting in a seating position P1 and a user sitting in a seating position P2, respectively. In various embodiments, the first head tracking device 506 and the second head tracking device 508 may be composed of a time-of-flight sensor configured to detect the position of the user's head in the vehicle cabin 100. However, a time-of-flight sensor is only one possible example. Alternatively, multiple 2D cameras may be used that triangulate the distance from one of the camera foci using epipolar geometry such as an 8-point algorithm. Alternatively, each head tracking device may include a LIDAR device that generates a black and white image with ranging data for each pixel as one data set. In an alternative example where each user is wearing an open-ear wearable, head tracking may be achieved or augmented by tracking the position of each of the open-ear wearables on the user, which typically correlates to the position of the user's head. In yet other alternatives, capacitive sensing, inductive sensing, inertial measurement unit tracking may be used in combination with imaging. It should be understood that the above-described implementations of head tracking devices are meant to convey that a variety of possible devices and combinations of devices may be used to track the location of a user's head.
[0069] For purposes of this disclosure, detecting the position of the user's head can include detecting any part of the user or a wearable worn by the user from which the location of the center of the user's skull can be derived. For example, the location of the user's ears can be detected, from which the center can be found approximating drawing a line between the tragus to find the center. Detecting the position of the user's head can also include detecting the orientation of the user's head, which can be derived according to any method for finding the pitch, yaw, and roll angles. Of these, yaw is particularly important as it typically has the most impact on the distance of the ears to each binaural speaker.
[0070] The first head tracking device 506 and the second head tracking device 508 may communicate with a head tracking controller 510, which receives the outputs h1, h2 of the first head tracking device 506 and the second head tracking device 508, determines therefrom the position of the user's head sitting at position P1 or position P2, and generates an output signal to the controller 504 accordingly. For example, the head tracking controller 510 may receive raw output data h1 from the first head tracking device 506, interpret the position of the user's head sitting at position P1, and output a position signal e1 representative of the detected position to the controller 504. Similarly, the head tracking controller 510 may receive output data h2 from the second head tracking device 508, interpret the position of the user's head sitting at seating position P2, and output a position signal e2 representative of the detected position to the controller 504. The position signals e1 and e2 may be sent in real time as coordinates representative of the position of the user's head (including, for example, an orientation as determined by pitch, yaw, and roll).
[0071] The controller 510 may comprise a processor 512 and a non-transitory storage medium 514 storing program code, which when executed by the processor 512, performs various functions and methods disclosed herein to generate position signals including receiving the output signals of each head tracking device 506, 508 and to generate position signals e1, e2 to the controller 104. In one embodiment, the controller 510 may determine the position of the user's head through stored software or using a neural network trained to detect the position of the user's head according to the output of the head tracking devices. In an alternative example, each head tracking device 506, 130 may comprise its own controller to perform the functions of the controller 510. In yet another embodiment, the controller 504 may directly receive the output of the head tracking devices 506, 508 and perform the processing of the controller 510.
[0072] The controller 504 receiving the position signals e1 and / or e2 can generate the binaural signals b1 and / or b2, so that at least one of the binaural devices 110, 112 generates an acoustic signal that is perceived by a user as emanating from some virtual point in space within the vehicle cabin 100 other than the actual location of the loudspeakers (e.g., speakers 118, 120) generating the acoustic signal. For example, the controller 504 can generate the binaural signal b1 such that the binaural device 110 generates an acoustic signal 114 that is perceived by a user sitting at the seating position P1 as emanating from a spatial point SP1 (represented by a dotted line in FIG. 5 since this is a virtual sound source). Similarly, the controller 504 can generate the binaural signal b2 such that the binaural device 112 generates an acoustic signal 116 that is perceived by a user sitting at the seating position P2 as emanating from a spatial point SP2. This may be accomplished by filtering and / or attenuating the binaural signals b1, b2 according to multiple head-related transfer functions (HRTFs) that adjust the acoustic signals 114, 116 to simulate sounds from virtual spatial points (e.g., spatial points SP1, SP2). Because the signals are binaural, i.e., related to both of the listener's ears, the system may utilize one or more HRTFs to simulate sounds specific to various locations around the listener. It should be appreciated that the particular left and right HRTFs used by the controller 504 may be selected based on a given combination of azimuth and elevation angles detected between the relative positions of the user's left and right ears and the respective spatial positions SP1, SP2. More specifically, multiple HRTFs may be stored in memory and retrieved and implemented according to the detected positions of the user's left and right ears and the selected spatial positions SP1, SP2. However, it should be understood that if the binaural devices 110, 112 are open-ear wearables, the location of the user's ears may be used in place of or determined from the location of the open-ear wearables.
[0073] It should be understood that although two different spatial points SP1, SP2 are shown in FIG. 5, the same spatial point may be used for both binaural devices 110, 112. Furthermore, for a given binaural device, any point in space may be selected as the spatial point at which to virtualize the generated acoustic signal. (The selected point in space may be, for example, a moving point in space to simulate a moving, audio-generating object.) For example, the left, right, or center channel audio signals may be simulated as if they were generated in close proximity to the surround speakers 102. Furthermore, the realism of the simulated sound may be enhanced by adding additional virtual sound sources at locations within the environment, i.e., the vehicle cabin 100, to simulate the effect of sounds generated at the virtual sound source locations being reflected back to the listener from acoustically reflective surfaces. Specifically, for each virtual sound source generated in the environment, additional virtual sound sources can be generated and placed at various positions to simulate first and second reflections of sound corresponding to the sound propagating from the first virtual sound source, acoustically reflecting off surfaces, and propagating back to the listener's ears (first reflection), and the sound propagating from the first virtual sound source, acoustically reflecting off the first and second surfaces, and propagating back to the listener's ears (second reflection). Methods for implementing HRTFs and virtual reflections to create spatialized audio are discussed in more detail in U.S. Patent Application Publication No. 2020 / 0037097(A1), entitled "Systems and methods for sound source virtualization," which is incorporated herein by reference in its entirety. In one embodiment, the virtual sound source can be located outside the vehicle. Similarly, the primary and secondary reflections do not need to be calculated for actual surfaces within the vehicle, but rather for virtual surfaces outside the vehicle, for example to create the impression that the user is in an area larger than the passenger compartment, or at least to optimize the reverberation and quality of the sound for an environment better than the passenger compartment of a vehicle.
[0074] The controller 504 is otherwise configured as the controller 104 described in connection with FIG. 1A and FIG. 1B, i.e., the spatialized sound signals 114, 116 may be augmented (e.g., in a time-aligned manner) with the bass content generated by the ambient speaker 102. For example, the ambient speaker 102 may be utilized to generate the bass content of a first content signal u1, the upper range content of which is generated by the binaural device 110 as a spatialized sound signal and perceived by a user at the seating position P1 to emanate from a spatial position SP1. Although the bass content generated by the ambient speaker 102 in the first listening zone 106 may not be a stereo signal, a user sitting at the seating position P1 may still perceive the first content signal u1 as emanating from a spatial position SP1. Similarly, the ambient speaker may augment the bass content of a second content signal u2 in a second listening zone, the upper range of which is generated by the binaural device 112 as a spatial sound signal. A user at seating position P2 perceives the second content signal u2 originating in the second listening zone as spatial location SP2, with the bass content being provided from the surround speaker 102 as a mono audio signal.
[0075] Although two binaural devices 110, 112 are shown in FIG. 5, it should be understood that only a single spatialized binaural signal (e.g., binaural signal b1) may be provided to one binaural device. Furthermore, it is not necessary for each binaural device to provide a spatialized audio signal, and in any case, one binaural device (e.g., binaural device 110) may provide a spatialized audio signal, while the other binaural device (e.g., binaural device 112) may provide a non-spatialized audio signal. Furthermore, as described above, each binaural device may receive the same binaural signal, with the bass content being augmented by the ambient speaker 102 (not necessarily generated in a separate listening zone), such that each user hears the same content. Furthermore, the embodiment of FIG. 5 may be extended to any number of listening zones and any number of binaural devices.
[0076] The controller 504 may further implement an upmixer, for example, that receives left and right program content signals and generates left, right, center, etc. channels in the vehicle. The spatialized audio rendered by the binaural devices (e.g., binaural devices 110, 112) may be exploited to enhance the user's perception of the source of these channels. Thus, in effect, multiple virtual sound sources may be selected to accurately generate the impression of left, right, center, etc. audio channels.
[0077] 6 illustrates a flow chart of a method 600 for providing enhanced sound to a user in a vehicle cabin. The steps of method 600 may be performed by a controller (such as controller 504) in communication with a set of ambient speakers (such as ambient speaker 102) located within the vehicle, and further in communication with a set of binaural devices (such as binaural devices 110, 112) located at respective seating positions within the vehicle.
[0078] A content signal is received at step 602. The content signal may be received from a number of potential sources, such as a mobile device, a radio, a satellite radio, a cellular connection, etc. The content signal is an audio signal that includes bass content and upper range content.
[0079] In step 604, the spatial audio signal is output to the binaural device according to a position signal indicative of the position of the user's head within the vehicle, such that the binaural device generates a spatial audio signal that is perceived by the user as emanating from a virtual sound source. The virtual sound source, in one embodiment, can be a selected location within the vehicle cabin, such as near the vehicle's ambient speakers. This can be achieved by filtering and / or attenuating the audio signal output to the binaural device according to multiple head-related transfer functions (HRTFs), which adjust the acoustic signal to simulate sounds from the virtual sound sources (e.g., spatial points SP1, SP2). Because the signal is binaural, i.e., associated with both of the listener's ears, the system can utilize one or more HRTFs to simulate sounds specific to various locations around the listener. It should be appreciated that the particular left and right HRTFs used can be selected based on a given combination of azimuth and elevation angles detected between the relative positions of the user's left and right ears and their respective spatial positions. More specifically, multiple HRTFs may be stored in a memory, retrieved and implemented according to the detected positions of the user's left and right ears and selected spatial positions.
[0080] The user's head position may be determined according to the output of a head tracking device (such as head tracking devices 506, 508), which may consist of, for example, a time-of-flight sensor, a LIDAR device, multiple two-dimensional cameras, a wearable mounted inertial motion unit, a proximity sensor, or a combination of these components. Additionally, other suitable devices are contemplated. The output of the head tracking device may be processed through a dedicated controller (e.g., controller 510), which may implement software or neural networks trained to detect the position of the user's head.
[0081] In step 606, the ambient speakers are driven such that the bass content of the content signal is generated within the vehicle cabin. In this manner, the spatial audio signal generated by the binaural device is augmented by the ambient speakers within the vehicle cabin. Detecting the position of the user's head may include detecting the user or any portion of a wearable worn by the user from which the respective positions of the user's ears or the position of a wearable worn by the user can be derived, including directly detecting the positions of the user's ears or directly detecting the position of the wearable.
[0082] Although method 600 describes a method for enhancing a spatial audio signal provided by a single binaural device, method 600 may be extended to enhance multiple content signals provided by multiple binaural devices by arranging surround speakers to generate bass content of each content signal in different listening zones throughout a room, steps of such a method are described in method 400 and in conjunction with Figures 1A and 1B.
[0083] The functionality or portions thereof, and various modifications thereof (hereinafter "functionality") described herein may be implemented, at least in part, via a computer program product (e.g., a computer program tangibly embodied in an information carrier, such as one or more non-transitory machine-readable media or storage devices, for execution by or to control the operation of one or more data processing apparatus, e.g., a programmable processor, computer, multiple computers, and / or programmable logic components).
[0084] The computer program may be written in any form of programming language, including compiled or interpreted languages, and it may be arranged in any form, including as a stand-alone program or as a module, component, subroutine or other unit suitable for use in a computing environment. The computer program may be arranged to be executed on one computer or on multiple computers at one site, or may be distributed across multiple sites and interconnected by a network.
[0085] The operations associated with implementing all or a portion of the functionality may be performed by one or more programmable processors executing one or more computer programs to perform the functions of the calibration process. All or a portion of the functionality may be implemented as special purpose logic circuitry, such as an FPGA and / or an ASIC (application-specific integrated circuit).
[0086] Processors suitable for the execution of a computer program include, by way of example, both general and special purpose microprocessors, and any one or more processors of any kind of digital computer. Generally, a processor will receive instructions and data from a read-only memory, a random access memory, or both. Elements of a computer include a processor for executing instructions and one or more memory devices for storing instructions and data.
[0087] While several embodiments of the invention have been described and illustrated herein, those skilled in the art will readily envision various other means and / or structures for performing the functions and / or obtaining the results and / or advantages of one or more of the advantages described herein, and each of such variations and / or modifications are deemed to be within the scope of the embodiments of the invention described herein. More generally, those skilled in the art will readily appreciate that all of the parameters, dimensions, materials, and configurations described herein are exemplary, and that the actual parameters, dimensions, materials, and / or configurations will depend on the specific application or applications for which the teachings of the invention are used. Those skilled in the art will recognize, or be able to ascertain using no more than routine experimentation, many equivalents to the specific embodiments of the invention described herein. Thus, it should be understood that the foregoing embodiments have been presented by way of example only, and that, within the scope of the appended claims and their equivalents, embodiments of the invention may be practiced otherwise than as specifically described and claimed. The inventive embodiments of the present disclosure relate to each individual feature, system, article, material, and / or method described herein. Furthermore, any combination of two or more such features, systems, articles, materials and / or methods, if such features, systems, articles, materials and / or methods are not mutually inconsistent, is included within the inventive scope of the present disclosure. [Explanation of symbols]
[0088] 100 Car cabins 102 Speaker 104 Controller 106 First Listening Zone 108 Second Listening Zone 110 The first binaural device 112 Second Binaural Device 114 First sound signal 116 Second Acoustic Signal 118L Left speaker 118R Right speaker 120L Left speaker 120R Right speaker 122 Mobile Devices 124 processors 126 Non-transitory storage medium 130 Head Tracking Device 200 frames 202L Left speaker 202R Right Speaker 204L Left Temple 204R Right Temple 300 Open Ear Headphones 302L Left speaker 302R Right Speaker 504 Controller 506 First Head Tracking Device 508 Second Head Tracking Device 510 Controller 512 processor 514 Non-transitory storage medium
Claims
1. 1. A system for providing enhanced audio in a vehicle, comprising: a plurality of speakers arranged around a passenger compartment of the vehicle; A controller; a first binaural device and a second binaural device; at least a first head tracking device, the controller comprising: receiving a first content signal and a second content signal; driving the plurality of speakers according to a first array configuration such that a first bass content of the first content signal is produced in a first listening zone within the passenger compartment; and configured to drive the plurality of speakers according to a second array configuration such that a second bass content of the second content signal is produced in a second listening zone within the passenger compartment; in the first listening zone, a magnitude of the first bass content is greater than a magnitude of the second bass content, and in the second listening zone, the magnitude of the second bass content is greater than the magnitude of the first bass content; the first head tracking device is configured to detect a position of a user's head in the first listening zone; The controller: providing at least an upper range content of the first content signal to the first binaural device via a first binaural signal; providing at least an upper range content of the second content signal to the second binaural device via a second binaural signal; generating the first binaural signal as a spatial audio signal based on the head position, the spatial audio signal being perceived by the user as emanating from a first virtual sound source; It is configured as follows: system.
2. 2. The system of claim 1, wherein the controller is configured to: time-align the production of the first bass content in the first listening zone with the production of upper range content of the first content signal by the first binaural device; and time-align the production of the second bass content in the second listening zone with the production of upper range content of the second content signal by the second binaural device.
3. 2. The system of claim 1, wherein the controller is further configured to output a first upper range of the first content signal to the first binaural device and a second upper range of the second content signal to the second binaural device.
4. The system of claim 1 , wherein the controller is configured to receive at least one of the first bass content and the second bass content from a first mobile device.
5. 2. The system of claim 1, wherein in the first listening zone, the magnitude of the first bass content exceeds the magnitude of the second bass content by 3 decibels, and in the second listening zone, the magnitude of the second bass content exceeds the magnitude of the first bass content by 3 decibels.
6. 2. The system of claim 1, wherein the controller forms the first array configuration and the second array configuration by implementing a plurality of filters, the controller being configured to adjust at least one of the plurality of filters according to an error signal.
7. 2. The system of claim 1, wherein the controller forms the first array configuration and the second array configuration by implementing a plurality of filters, the plurality of filters being selected from a set of stored filters according to parameters describing a configuration of the cabin.
8. The system of claim 1, wherein the controller is configured to provide the upper range content of the first audio signal to the first binaural device such that the first binaural device generates the upper range content of a first audio signal in the first listening zone, and to provide the upper range content of the second audio signal to the second binaural device such that the second binaural device generates the upper range content of a second audio signal in the second listening zone.
9. 9. The system of claim 8, wherein the controller is configured to: time-align the generation of the first bass content in the first listening zone with the generation of the upper range content of the first content signal by the first binaural device; and time-align the generation of the second bass content in the second listening zone with the generation of the upper range content of the second content signal by the second binaural device.
10. 10. The system of claim 9, wherein the time alignment in at least one of the first listening zone or the second listening zone is determined automatically according to at least one microphone signal.
11. 9. The system of claim 8, wherein the first binaural device and the second binaural device are each selected from one of a set of speakers disposed in a headrest or an open-ear wearable.
12. 1. A method for providing enhanced audio to a user in a vehicle, comprising: receiving a first content signal and a second content signal; driving a plurality of speakers disposed about a passenger compartment of the vehicle in a first array configuration such that a first bass content of a first audio signal is produced in a first listening zone within the passenger compartment; driving the plurality of speakers according to a second array configuration such that a second bass content of a second audio signal is produced in a second listening zone in the passenger compartment, wherein a magnitude of the first bass content is greater than a magnitude of the second bass content in the first listening zone, and wherein the magnitude of the second bass content is greater than the magnitude of the first bass content in the second listening zone; detecting a position of a user's head in the first listening zone; providing at least a first upper range content of the first content signal to a first binaural device via a first binaural signal; providing at least a second upper range content of the second content signal to a second binaural device via a second binaural signal; generating a spatial audio signal based on the head position, the spatial audio signal being perceived by the user as the first binaural signal emanating from a first virtual sound source. method.
13. 13. The method of claim 12, wherein the generation of the first bass content is time-aligned with the generation of a first upper range content of the first content signal by the first binaural device in the first listening zone, and the generation of the second bass content is time-aligned with the generation of a second upper range content of the second content signal by the second binaural device in the second listening zone.
14. The method of claim 13 , wherein the time alignment in at least one of the first listening zone or the second listening zone is determined automatically according to at least one microphone signal.
15. 14. The method of claim 13, further comprising the steps of outputting the first top range content to the first binaural device and outputting the second top range content to the second binaural device.
16. The method of claim 13 , wherein at least one of the first bass content and the second bass content is received from a first mobile device.
17. The method of claim 13 , wherein the first binaural device and the second binaural device are each selected from one of a set of speakers located in a headrest or an open-ear wearable.
18. 13. The method of claim 12, wherein in the first listening zone, the magnitude of the first bass content exceeds the magnitude of the second bass content by 3 decibels, and in the second listening zone, the magnitude of the second bass content exceeds the magnitude of the first bass content by 3 decibels.
19. 13. The method of claim 12, further comprising the step of adjusting at least one filter of a plurality of filters according to an error signal, the plurality of filters forming the first array configuration and the second array configuration.
20. 13. The method of claim 12, further comprising the step of selecting a plurality of filters from a set of stored filters according to parameters representative of a configuration of the cabin, the plurality of filters forming the first array configuration and the second array configuration.
Citation Information
Patent Citations
A system and method for radiating sound with directionality.
JP2010529758A
Sound field reproduction system, sound field reproduction method, and sound field reproduction program
JP2020010106A
Sound output device, sound generation method, and program
WO2017061218A1
