Integrated in-vehicle personal audio system
By utilizing wireless audio unit detection and synchronous transmission technology, the problems of high-fidelity audio reproduction and driving safety within vehicles are solved, providing a simplified and efficient personalized audio solution.
Patent Information
- Application Number
- CN202380096800.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-04-12
- Publication Date
- 2025-11-04
AI Technical Summary
Existing vehicle entertainment systems struggle to provide high-fidelity audio reproduction, and personal audio systems are unsafe to use in driving environments. Furthermore, the audio transmission requirements for multi-user scenarios are complex and resource-intensive.
By detecting personal audio devices within a vehicle using a wireless audio unit, establishing a wireless link, and synchronously transmitting audio signals, a mixed audio signal is generated by combining environmental data to provide high-fidelity audio content while maintaining driving environment information.
It enables high-fidelity audio reproduction within vehicles, simplifies system complexity and cost, ensures driving safety, and supports personalized audio transmission in multi-user scenarios.
Smart Images

Figure CN120898433A_ABST
Abstract
Description
Technical Field
[0001] Various implementation schemes typically involve audio systems, and more specifically, personal audio systems within integrated vehicles. Background Technology
[0002] Vehicles typically include vehicle entertainment systems (such as in-vehicle entertainment (ICE) or in-vehicle infotainment (IVI) systems), which include various hardware and software components to enhance the driver and passenger experience by providing audio or video entertainment, video game capabilities, internet connectivity, and related features to passengers and the driver. A given vehicle may include multiple devices, such as mounted units, rear-seat entertainment (RSE) units mounted on the vehicle seats, and / or portable devices connected to the vehicle. Typically, each device is connected to a central hub (such as a host unit mounted near the driver's seat and / or within the vehicle's dashboard).
[0003] One drawback of conventional vehicle entertainment systems is their difficulty in providing high-fidelity audio reproduction to vehicle occupants. For example, compared to personal audio systems (e.g., headphones, directional speakers), conventional vehicle entertainment systems include speaker configurations that struggle to reproduce audio signals with high fidelity. Conventional audio systems capable of high-fidelity reproduction are very complex and occupy significant space within the vehicle. Furthermore, the complexity of such systems necessitates expensive components and additional maintenance costs. Several solutions have been proposed, including wearable personal audio systems within vehicles. However, such personal audio systems are considered unsafe because they obstruct a large amount of information about the driving environment and are deemed unsafe for vehicle occupants. Another drawback of conventional vehicle entertainment systems is the significant control and network resources required to generate a personalized audio field for each occupant. For instance, when multiple users are participants in a group phone call, the vehicle entertainment system must transmit media feeds to each participant individually. However, providing individual feeds in this manner requires substantial processing and network resources. Furthermore, various technologies that enable group voice chat (such as muting the microphones of other participants) may make conversations in vehicles feel awkward, as the proximity of occupants in a vehicle makes such audio blocking technologies feel unnatural.
[0004] Given the above, more effective technologies for providing personalized audio within vehicles would be useful. Summary of the Invention
[0005] Various implementations disclose a computer-implemented method comprising: detecting one or more personal audio devices within a vehicle via a wireless audio unit of the vehicle; establishing a wireless link with at least a first personal audio device among the one or more personal audio devices; synchronizing communication with the first personal audio device via the wireless link; and transmitting an audio signal from the wireless audio unit to the first personal audio device via the wireless link for playback by the first personal audio device.
[0006] Other embodiments provide, in particular, a non-transitory computer-readable storage medium for storing instructions for implementing the methods described above, and a system configured to implement the methods described above.
[0007] At least one technical advantage of the integrated in-vehicle personal audio system over the prior art is that, utilizing the disclosed technology, the integrated in-vehicle personal audio system can provide high-fidelity audio reproduction of audio signals within the vehicle, while simultaneously providing contextual information about the driving environment to the vehicle occupants. Furthermore, by incorporating compatible personal audio components to generate a personalized sound zone for a given occupant, the integrated in-vehicle personal audio system offers a less complex and more cost-effective solution for providing high-fidelity audio to individuals compared to conventional in-vehicle audio systems. These technical advantages represent one or more technological advancements superior to existing methods. Attached Figure Description
[0008] To gain a detailed understanding of the manner in which the features of the various embodiments are described above, a more specific description of the inventive concept briefly outlined above can be obtained by referring to the various embodiments, some of which are illustrated in the accompanying drawings. However, it should be noted that the drawings illustrate only typical embodiments of the inventive concept and should therefore not be construed as limiting the scope in any way, and that other equivalent embodiments exist.
[0009] Figure 1 A block diagram of a wireless audio system configured to implement one or more aspects of this disclosure is shown;
[0010] Figure 2 The following are shown according to various implementation schemes: Figure 1 An exemplary transportation system of the wireless audio unit 116;
[0011] Figure 3 The following are shown according to various implementation schemes: Figure 1 An exemplary configuration of the wireless audio unit;
[0012] Figure 4 The following are shown according to various implementation schemes: Figure 1 An exemplary vehicle interior containing a wireless audio unit;
[0013] Figure 5 The following are shown for use according to various implementation schemes. Figure 1 A flowchart of the method steps for synchronizing audio streams between a wireless audio unit and a personal audio device; and
[0014] Figure 6 A flowchart illustrating the steps of a method for generating a mixed audio signal based on data from a vehicle environment, according to various implementation schemes, is shown. Detailed Implementation
[0015] In the following description, numerous specific details are set forth to provide a more thorough understanding of the various embodiments. However, it will be apparent to those skilled in the art that the inventive concept can be practiced without one or more of these specific details.
[0016] Overview
[0017] The embodiments disclosed herein include a wireless audio system comprising a wireless audio unit that establishes communication with one or more personal audio devices within a vehicle. The wireless audio unit synchronizes its communication with the personal audio devices to control audio playback of content, either concurrently with or in lieu of audio playback via speakers within the vehicle. During playback, the wireless audio unit adds audio components based on environmentally relevant data, such as adding audio clips of the external environment captured by an external microphone or adding pure audio notifications associated with specific alarms. The wireless audio unit mixes the added audio components with an audio signal from an audio source to generate a mixed audio signal that provides the added audio components while blocking the audio signal from the audio source. Thus, a listener within the vehicle can receive high-fidelity audio content from a personal audio device while simultaneously receiving auditory information about the environment within and around the vehicle.
[0018] System Overview
[0019] Figure 1 A block diagram of a wireless audio system 100 configured to implement one or more aspects of this disclosure is shown. As shown, but not limited to, the wireless audio system 100 includes a computing device 110, an audio source 120, a sensor 130, an input / output (I / O) device 140, and a personal audio device 150. For example 150(1) to 150(N)), network 160, and remote data source 170. The computing device 110 includes, but is not limited to, a processing unit 112 and a memory 114. The memory 114 includes, but is not limited to, a wireless audio unit 116 and a data storage area 118. The data storage area 118 includes, but is not limited to, a profile 122.
[0020] For illustrative purposes, multiple instances of similar objects are shown, where reference labels identify objects and additional labels are appended to identify instances as needed. For example Personal audio device 150 (1)). In addition, even if not shown, the wireless audio system 100 includes multiple instances of the device.
[0021] In operation, the computing device 110 executes the wireless audio unit 116 to control the playback of audio from one or more vehicle components and / or personal audio devices 150 within the vehicle. Specifically, the processing unit 112 receives data from the sensor 130, I / O device 140, and / or personal audio device 150. The wireless audio unit 116 processes the data to detect at least one personal audio device 150. For example The presence of a personal audio device 150(1). Upon detecting a personal audio device 150(1), the wireless audio unit 116 determines whether the personal audio device 150(1) is known, and if so, whether the personal audio device 150(1) is associated with a known user and / or user profile. When the device or user is known, the wireless audio unit 116 loads a profile 122 for the user and / or personal audio device 150(1). The profile 122 includes configuration information associated with audio reproduction using the personal audio device 150(1) and / or vehicle speakers, including one or more of the following: specific equalizer settings, selected speaker preferences, auditory augmented reality (AR) preferences, etc. The wireless audio unit 116 uses the profile to determine which audio output devices ( For example The personal audio device 150(1), one or more vehicle loudspeakers, etc., are used to reproduce audio signals and modify incoming audio signals. A wireless audio unit 116 establishes a wireless communication link with the personal audio device 150(1). In various embodiments, the wireless audio unit 116 determines the location of the personal audio device 150(1), determines a sound zone for the determined location, and manages the loudspeakers within the sound zone. In some embodiments, the wireless audio unit 116 mutes the loudspeakers in the sound zone so that only the personal audio device 150(1) can reproduce audio signals within the sound zone. Alternatively, in some embodiments, the wireless audio unit 116, together with the personal audio device 150(1), controls a set of loudspeakers in the sound zone so that the personal audio device 150(1) and the set of loudspeakers jointly reproduce audio signals.
[0022] While the wireless audio unit 116 is streaming audio signals to the sound area for reproduction, the wireless audio unit 116 continues to process signals from various devices ( For exampleThe system receives incoming data from sensors 130, remote data sources 170, other vehicle components, etc., to determine whether to mix additional audio components with the audio signal. Additional audio components may include audio clips recorded by a microphone, such as sounds from outside the vehicle or speech from a passenger in another vehicle. Alternatively, additional audio components may include pure audio tones associated with the type of event triggered by the incoming data. For example (This includes audio notifications indicating navigation tones, alarm notifications based on controller area network messages, etc.). When the wireless audio unit 116 determines to add an additional audio component, it mixes the audio signal with the additional audio component, thereby doubling the audio signal as needed to produce an attenuated version of the audio signal that the user can hear the additional audio component. The wireless audio unit 116 transmits the mixed audio signal to the speakers in the sound area for reproduction.
[0023] The computing device 110 includes a processing unit 112 and a memory 114. In various embodiments, the computing device 110 is a device including one or more processing units 112 (such as a system-on-a-chip (SoC)). In various embodiments, the computing device 110 is a mobile computing device wirelessly connected to other devices in a vehicle, such as a tablet computer, mobile phone, media player, etc. In some embodiments, the computing device 110 is a host unit included in a vehicle system. Alternatively or additionally, the computing device 110 may be a detachable device installed as part of a separate console within a vehicle. Typically, the computing device 110 is configured to coordinate the overall operation of the wireless audio system 100. The embodiments disclosed herein envision any technically feasible system configured to realize the functionality of the wireless audio system 100 via the computing device 110. The functionality and technology of the wireless audio system 100 are also applicable to other types of vehicles, including consumer vehicles, commercial trucks, airplanes, helicopters, spacecraft, small boats, submarines, etc.
[0024] Processing unit 112 may include one or more central processing units (CPUs), digital signal processing units (DSPs), microprocessors, application-specific integrated circuits (ASICs), neural processing units (NPUs), graphics processing units (GPUs), field-programmable gate arrays (FPGAs), etc. Processing unit 112 typically includes a programmable processor that executes program instructions to manipulate input data and generate output. In some embodiments, processing unit 112 may include any number of processing cores, memory, and other modules for facilitating program execution. For example, processing unit 112 may receive input from a user via I / O device 140 and generate input for use in I / O device 140. For exampleThe pixels displayed on the display device. In some embodiments, the processing unit 112 is configured to perform the wireless audio unit 116 to control audio playback on one or more devices (including one or more personal audio devices 150). In such instances, the wireless audio unit 116 mixes additional audio signals based on data from multiple devices to provide a mixed audio signal incorporating information from the vehicle environment.
[0025] Memory 114 may include memory modules or a collection of memory modules. Memory 114 typically includes storage chips such as random access memory (RAM) chips that store application programs and data for processing by processing unit 112. In various embodiments, memory 114 includes non-volatile memory such as optical drives, magnetic drives, flash drives, or other storage devices. In some embodiments, a separate data storage area (such as a remote data source 170 connected to network 160) For example The “cloud storage device” is connected to the wireless audio unit 116. The wireless audio unit 116 within the memory 114 is executed by the processing unit 112 to realize the overall functionality of the computing device 110 and thus coordinate the operation of the wireless audio system 100 as a whole.
[0026] Wireless audio unit 116 processes incoming data from one or more devices and controls personal audio device 150 and / or other vehicle speakers to reproduce audio signals. In various embodiments, wireless audio unit 116 establishes a communication channel in a configuration to provide high-fidelity audio content in the audio signals reproduced by personal audio device 150. In various embodiments, wireless audio unit 116 extends connectivity with personal audio devices 150(1) to 150(N). For example, wireless audio unit 116 may simultaneously connect to six individual personal audio devices inside the vehicle. In some embodiments, wireless audio unit 116 detects personal audio devices 150 when they enter or approach the vehicle. For example, wireless audio unit 116 may use ultra-wideband (UWB) communication and / or near-field communication (NFC) to detect personal audio devices 150 approaching or inside the vehicle. In various embodiments, wireless audio unit 116 collects various types of data and provides notifications to the user about said data. For example, wireless audio unit 116 may acquire sound from external and / or internal microphones (…). For example (Ambient sounds, voices of other occupants, etc.) and mix the acquired sounds with audio signals to provide super hearing functionality to a given personal audio device 150, so that the user can hear the acquired sounds when using the personal audio device 150.
[0027] Data storage area 118 is the portion of memory 114 that stores various types of data locally, including profile 122 ( For example User profiles, device profiles, etc.) and other data (not shown), such as content items, data tables ( For example (a table that maps pure audio tones to events) and / or application data associated with the wireless audio unit 116 ( For example (Security application data, metadata, etc.). In various embodiments, data storage area 118 may include volatile memory and may correspond to segments of non-volatile memory. In some embodiments, computing device 110 may synchronize data between volatile and non-volatile memory to store copies of data in both volatile and non-volatile memory. In some embodiments, data storage area 118 stores downloaded content items received via network 160 for playback when access to network 160 is unavailable or when network resources of the vehicle are limited.
[0028] Profile 122 includes a device profile associated with a specific personal audio device 150 and / or a user profile associated with a specific user. In some embodiments, the user profile is linked to one or more device profiles, and vice versa. In such instances, wireless audio unit 116 prompts the user to select which personal audio device 150 is in use. In various embodiments, profile 122 includes configuration information associated with audio signal reproduction using personal audio device 150 and / or vehicle speakers. Such configuration may include, for example, specific equalizer settings, selected speaker preferences, augmented reality (AR) preferences, etc. Wireless audio unit 116 uses the profile to determine which audio output devices are used ( For example Personal audio device 150 (1), one or more vehicle speakers, etc.) to reproduce audio signals and how to modify incoming audio signals.
[0029] Audio source 120 includes one or more data sources that provide audio signals for reproduction. In various embodiments, audio source 120 is included in devices within a vehicle, such as an entertainment subsystem included in the vehicle's main unit, a rear-seat entertainment console, or devices installed in the vehicle. In some embodiments, audio source 120 is included in a mobile device, wearable device, and / or other portable device connected to wireless audio unit 116. Alternatively or concurrently, audio source 120 may be located remotely from the vehicle. For example, audio source 120 may be included in a remote data source 170. In such instances, the remote data source streams audio signals to computing device 110, and then wireless audio unit 116 transmits the audio signals to personal audio device 150 for reproduction.
[0030] Sensor 130 includes one or more means for performing measurements and / or acquiring data relating to certain objects in the environment. In various embodiments, sensor 130 generates sensor data relating to a user and / or objects in the environment that are not users. In some embodiments, sensor 130 is coupled to and / or included within computing device 110 and transmits sensor data to processing unit 112.
[0031] In various embodiments, sensor 130 includes audio sensors, such as microphones and / or microphone arrays for recording external sounds and / or internal microphones for recording sounds within the cabin of a vehicle. In some embodiments, the sound data acquired by the microphones is processed by wireless audio unit 116 using various natural language (NL) processing techniques, sentiment analysis, and / or speech analysis to determine the semantics of phrases spoken in the environment.
[0032] In some embodiments, sensor 130 includes optical sensors, such as RGB cameras, infrared cameras, depth cameras, and / or camera arrays, said optical sensors including two or more of such cameras. Other optical sensors may include imagers and laser sensors. In some embodiments, sensor 130 includes physical sensors that register the body position and / or movement of the user and / or personal audio device 150, such as touch sensors, pressure sensors, position sensors (…). For example Accelerometers and / or inertial measurement units (IMUs), motion sensors, etc. In some embodiments, sensor 130 includes physiological sensors such as heart rate monitors, electroencephalography (EEG) systems, radio sensors, thermal sensors, and skin conductance sensors. For example Sensors that measure changes in skin resistance caused by emotional stress, non-contact sensor systems, magnetoencephalography (MEG) systems, etc.
[0033] Input / output (I / O) devices 140 include devices capable of receiving input, such as a keyboard, mouse, touchscreen, microphone, and other input devices for providing input data to computing device 110. In various embodiments, I / O devices 140 are associated with a specific console, such as a personalized screen mounted as part of a seat, a personal audio device 150, a personalized speaker within the vehicle, a console-specific input component, etc. Alternatively or additionally, I / O devices 140 include various devices capable of providing output, such as display screens, speakers, etc. In various embodiments, one or more of the I / O devices 140 are incorporated into computing device 110 or located externally to computing device 110. In some embodiments, computing device 110 and / or one or more I / O devices 140 may be components of an advanced driver assistance system (ADAS) or entertainment subsystem included in a vehicle. In various embodiments, a wireless audio unit 116 responds to various inputs received by one or more I / O devices 140. For example, the vehicle may include a host unit that includes a user interface. In such instances, the wireless audio unit 116 may respond to one or more touch inputs and / or NL voice inputs received via the host unit.
[0034] Personal audio device 150 (e.g., 150(1) to 150(N)) includes one or more headphones, earphones, wearable devices, and / or other types of personalized audio devices that reproduce audio signals to provide audio content to an individual. In some embodiments, personal audio device 150 provides directional sound (e.g., a collar providing directional speakers) in a manner that provides personalized audio to a listener. In some embodiments, personal audio device 150 is configured to provide equalization, noise cancellation, audio augmented reality, high-fidelity audio, and / or other features. In some embodiments, personal audio device 150 uses proprietary protocols and / or is manufactured using proprietary hardware to communicate with wireless audio unit 116 with low latency.
[0035] Network 160 enables communication between computing device 110 and other devices in network 160 via wired and / or wireless communication protocols, satellite networks, V2X networks (including Bluetooth, Bluetooth Low Energy (BLE), Wi-Fi, cellular protocols and / or Near Field Communication (NFC)).
[0036] Remote data source 170 includes a computing device that communicates with computing device 110, such as a laptop computer, tablet computer, smartphone, cellular phone, desktop computer, teleconferencing system, etc. In some embodiments, the remote data source is a device that provides software services or executes media applications (such as audio software, video software, audio calling software, messaging software, media service platforms, etc.). In such instances, remote data source 170 may use such media applications to communicate with wireless audio unit 116 operating within a vehicle.
[0037] Figure 2 The following are shown according to various implementation schemes: Figure 1 An exemplary vehicle system 200 includes a wireless audio unit 116. As shown, the vehicle system 200 includes, but is not limited to, a sensing module 210, a host unit 220, an output module 230, and a set of personal audio devices 150 (e.g., 150(1) to 150(N)). The sensing module 210 includes, but is not limited to, vehicle sensors 214, occupant-facing sensors 216, and cabin sensors 218. The host unit 220 includes, but is not limited to, the wireless audio unit 116, an entertainment subsystem 222, a network module 224, and a navigation subsystem 226. The output module 230 includes, but is not limited to, a speaker 232, a display 234, and a human-machine interface (HMI) 236. The wireless audio unit 116 includes, but is not limited to, an input processing module 262, an output generation module 264, and a synchronization module 266.
[0038] During operation, the wireless audio unit 116 establishes a connection with the personal audio device 150. The wireless audio unit 116 transmits audio signals to the personal audio device 150 and processes incoming data from components of the sensing module 210 and / or the host unit 220 to determine whether to add additional audio components to a given audio signal. The wireless audio unit 116 then adds audio clips and / or audio pure tones to the audio signal to provide the user with information about the vehicle's environment.
[0039] Sensing module 210 includes various types of sensors, including vehicle sensor 214 ( For example (External cameras, external microphones, accelerometers, etc.), and occupant-facing sensors 216. For example (Cameras, microphones, motion sensors, etc.) and / or non-occupant-facing cabin sensors 218 For example (Pressure sensors, temperature sensors, etc.). In various embodiments, sensing module 210 provides a combination of sensor data describing the situation of the vehicle and the occupants present within the vehicle. For example, sensing module 210 can provide a set of values associated with the occupants ( For example(e.g., the location of occupants, the location of personal audio devices 150, noise levels, etc.). In such examples, the wireless audio unit 116 can identify which seats within the vehicle are occupied.
[0040] In various embodiments, the vehicle sensor 214 may also include other external sensors. Such external sensors may include optical sensors, road vibration sensors, temperature sensors, etc. In some embodiments, the sensing module 210 and / or the network module 224 acquire other external data, such as geolocation data. For example GNSS systems, including Global Positioning System (GPS), GLONASS, Galileo, etc., demographic data, psychometric data, etc. In such instances, the wireless audio unit 116 can process incoming data. For example, the wireless audio unit 116 can add a notification tone about the destination to the user based on the geolocation of the vehicle. In another example, the wireless audio unit 116 provides an alert from a driver assistance system when an alarm condition is detected, and provides an audio clip of ambient sound associated with the alarm condition. In some implementations, navigation data and / or geolocation data are combined and associated with a specific media configuration. For example, when the navigation subsystem 226 generates a route between locations, the wireless audio unit 116 provides an audio tone associated with navigating the route ( For example (Added voice-generated clips for navigation instructions).
[0041] The main unit 220 is a component of a vehicle, installed in any location within the passenger compartment of the vehicle in any technically feasible manner. In some embodiments, the main unit 220 includes any number and type of instruments and applications, and provides any number of input and output mechanisms. For example, the main unit 220 enables the user ( For example The driver and / or passengers can control the entertainment subsystem 222 and / or the navigation subsystem 226. The host unit 220 supports any number of input and output data types and formats, as known in the art. For example, the host unit 220 may include built-in Bluetooth for hands-free calling and / or audio streaming, a Universal Serial Bus (USB) connection, speech recognition, rearview camera input via sensing module 210, video output via output module 230 for any number and type of displays 234, and any number of audio outputs. Typically, any number of sensors ( For example Sensors 130, 214, 216, 218, display 234, receiver, transmitter, etc., can be integrated into the host unit 220, or implemented externally to the host unit 220. Alternatively, the wireless audio unit 116 can be integrated into the host unit 220, or implemented externally to the host unit 220. In various embodiments, external devices ( For exampleThe personal audio device 150 communicates with the host unit 220 in any technically feasible manner.
[0042] The entertainment subsystem 222 provides various information to the vehicle's user and / or one or more other occupants via the output module 230. The navigation subsystem 226 provides information about the vehicle's location and route-finding information. For example, the navigation subsystem may provide route information associated with the vehicle via the host unit 220 and / or HMI 236. The entertainment subsystem 222 enables playback from various media sources ( For example Audio and / or video content (via an internal source or an external media provider) of the network module 224. In various embodiments, the entertainment subsystem enables audio and / or video content to be delivered via the wireless audio unit 116 and / or other output devices included in the output module 230. For example The content is played back using output devices 140, speakers 232, displays 234 and / or HMI 236.
[0043] Output module 230 performs one or more actions in response to actions performed by host unit 220 and / or wireless audio unit 116. For example, output module 230 may generate one or more output signals in response to received media signals to drive the output of speaker 232 and / or display 234. In another example, output module 230 may generate one or more output signals to modify human-machine interface (HMI) 236 to display notification messages and / or alarms. In some embodiments, HMI 236 is a separate component from display 234, such as when HMI 236 is included as part of a windshield. In such instances, host unit 220 may specify whether notifications are displayed via display 234 or via HMI 236.
[0044] The wireless audio unit 116 includes various modules for managing data processing and managing the transmission of audio signals for reproduction. In various embodiments, the wireless audio unit 116 simultaneously implements one or more of the input processing module 262, the output generation module 264, and / or the synchronization module 266 to establish a wireless communication link with one or more personal audio devices in the personal audio device 150 and to mix additional audio components into the audio signal provided by the audio source 120.
[0045] Input processing module 262 processes various types of data from one or more components and / or devices. For example, input processing module 262 processes incoming data from one or more devices to detect the location of a given personal audio device 150 within the vehicle. For example, input processing module 262 may process sensor data from sensor 130 (e.g., cabin sensor 218) indicating the location of personal audio device 150 within vehicle 302. In some embodiments, wireless audio unit 116 receives messages directly from personal audio device 150(N). Alternatively or additionally, input processing module 262 processes incoming data associated with the environment from various devices, such as audio data from microphones recording the external environment of the vehicle, speech from other occupants of the vehicle, and events associated with the operation of entertainment subsystem 222, network module 224, navigation subsystem 226, etc.
[0046] Output generation module 264 provides the audio signal to personal audio device 150 and / or speaker 232 for reproduction. In various embodiments, output generation module 264 responds to determining whether to mix additional audio content with the audio signal by generating the additional audio content and generating a mixed audio signal comprising the audio signal provided by audio source 120 and the additional audio content. In some embodiments, output generation module 264 extracts audio content from incoming data. For example, output generation module 264 generates an audio clip by extracting a portion of ambient sound data from a microphone included in vehicle sensor 214. In another example, output generation module 264 adds a notification sound indicating changes to the audio track based on a notification message generated by entertainment subsystem 222. In various embodiments, output generation module 264 applies various equalization, noise reduction, and / or other sound modification techniques based on one or more profiles 122. For example, the output generation module 264 retrieves the device profile 122 associated with the personal audio device 150, uses the device profile as an output profile to modify the audio signal, and then transmits the modified audio signal to the personal audio device 150 for reproduction.
[0047] Synchronization module 266 establishes communication with personal audio device 150 and performs various techniques to establish a wireless communication link with personal audio device 150 and reduce latency when transmitting audio signals to personal audio device 150. For example, synchronization module 266 exchanges messages with personal audio device 150 to determine the location of personal audio device 150 within a vehicle and exchanges message sets to determine the characteristics of the wireless communication link to be established (e.g., negotiating the capability set for wireless communication link 312(N), determining whether to establish a reverse channel, determining content protection, payload composition, etc.). While determining the characteristics, wireless audio unit 116 establishes a communication link with personal audio device 150. Alternatively or additionally, synchronization module 266 performs various techniques to reduce latency between the audio source providing the audio signal and personal audio device 150. For example, wireless audio unit may allocate more processing resources to increase throughput on the wireless communication link.
[0048] In various implementations, upon determining that a personal audio device 150 is an certified component confirmed to interoperate with the wireless audio unit 116, the synchronization module 266 establishes communication with the given personal audio device 150. In such instances, upon determining that the personal audio device 150 is not certified to operate with the wireless audio unit 116, the synchronization module 266 establishes connectivity with the speaker 232 in place of the personal audio device 150. Alternatively, the synchronization module 266 establishes connectivity with the speaker 232 when the personal audio device 150 is absent or not powered.
[0049] Wireless audio synchronization and management
[0050] Figure 3 The following are shown according to various implementation schemes: Figure 1 An exemplary system 300 includes a wireless audio unit 116. As shown, system 300 includes, but is not limited to, a vehicle 302, a mobile device 320, a personal audio device 150, a wireless communication link 312, and an audio link 332.
[0051] In operation, the mobile device 320 connects to the wireless audio unit 116 to provide audio signals. The wireless audio unit 116 simultaneously establishes a streaming session with each of the personal audio devices 150(1), 150(2), and controls speakers 232(1), 232 located near the personal audio devices 150(1), 150 respectively, and provides audio signals via audio link 332. The wireless audio unit 116 receives data from vehicle sensor 214 and / or cabin sensor 218, and generates a mixed audio signal incorporating information provided by sensors 214, 218. The wireless audio unit 116 transmits the audio signal and / or the mixed audio signal to the personal audio device 150 via wireless communication link 312 and / or to the speaker 232 via audio link 332.
[0052] In various implementations, the personal audio device 150 uses a communication protocol such as Bluetooth to establish a wireless communication link 312. In various implementations, the wireless audio unit specifies the characteristics of the wireless communication link 312 and / or audio link 332 for the respective personal audio device 150. For example, the wireless audio unit 116 may mute the speaker 232(1). In such instances, the wireless audio unit avoids providing audio signals to the speaker 232(1). Alternatively, in some implementations, the wireless audio unit 116 may transmit inaudible audio signals (…). For example (Noise cancellation signal) is reproduced by speaker 232(1). In another example, wireless audio unit 116 may generate a set of component audio signals based on the audio signal, and may transmit the component audio signals separately to personal audio device 150(N) and speaker 232(N). In such an example, personal audio device 150(N) and speaker 232(N) reproduce the respective component signals to jointly reproduce the audio signal provided by audio source 120.
[0053] Figure 4 The following are shown according to various implementation schemes: Figure 1 The wireless audio unit 116 is located inside the interior 400 of an exemplary vehicle 302. As shown, the interior 400 includes, but is not limited to, a personal audio device 150 and a sound zone 402. For example , 402(1), 402(2), etc.).
[0054] In various embodiments, the vehicle 302 includes various sets of loudspeakers 232 that generate multiple sound zones located at different positions within the vehicle 302. For example , 402(1), 402(2)) and provide personalized audio to occupants. In some embodiments, the vehicle 302 includes a plurality of speaker sets 232, said plurality of speaker sets being located in the vehicle and in relation to individual seats or larger areas ( For exampleSound zones 402(1) to 402(6) are generated in the corresponding areas of the front and rear seats. In such instances, each sound zone 402 is located in the area close to the seat, such that when the sound zone is in a specific position, the occupant's ear is located within the sound zone 402. For example, as shown, when the occupant is sitting in the front passenger seat, the occupant's ear is located within the sound zone 402(2).
[0055] In various implementations, one or more output devices 140 associated with a corresponding console and / or other speakers 232 positioned close to the seat generate a sound zone 402. In such instances, a wireless audio unit 116 can control the speakers 232 for a given sound zone 402, such that a personal audio device 150 operates in conjunction with or in place of the speakers 232 in the sound zone 402. In such instances, the occupant of the sound zone hears the reproduced audio signal, while other occupants hear little or no reproduced audio signal.
[0056] In some implementations, the wireless audio unit 116 determines the sound zone based on the location of each personal audio device 150. For example, the wireless audio unit 116 determines that the personal audio device 150 (4) is worn by an occupant in the rear seat. In such an instance, the wireless audio unit 116 modifies the sound zone 402 (5) to include the entire rear seat. The wireless audio unit 116 then determines the sound zone based on the configuration associated with the personal audio device 150 (4). For example Select only the subwoofer) and / or the user's preferences ( For example The stored user profile has a preference to mute all speakers 232 in sound zone 402(5) to control the set of speakers 232 for the rear row.
[0057] Figure 5 The following are shown for use according to various implementation schemes. Figure 1 A flowchart of the method steps for synchronizing audio streams between a wireless audio unit 116 and a personal audio device 150. Although referenced... Figures 1 to 4 The system describes the method steps, but those skilled in the art will understand that any system configured to perform the method steps in any order falls within the scope of various implementations.
[0058] As shown in the figure, method 500 begins at step 502, where wireless audio unit 116 detects a personal audio device 150 within vehicle 302. In various embodiments, wireless audio unit 116 processes incoming data from one or more devices to detect the location of a given personal audio device 150(N) within vehicle 302. In some embodiments, input processing module 262 included in wireless audio unit 116 processes data from sensor 130 (… For exampleThe sensor data (218) indicates the location of the personal audio device 150(N) within the vehicle 302. In some embodiments, the wireless audio unit 116 receives messages directly from the personal audio device 150(N). In such instances, the synchronization module 266 of the wireless audio unit 116 exchanges messages with the personal audio device 150(N) to determine its location within the vehicle 302.
[0059] At step 504, the wireless audio unit 116 identifies the user associated with the personal audio device 150(N). In various embodiments, the wireless audio unit 116 identifies a device identifier associated with the personal audio device 150(N). In such instances, the wireless audio unit 116 scans profile 122 in the data storage area 118 to determine whether the personal audio device 150(N) is associated with a specific user and / or user profile. Alternatively, in some embodiments, the user accesses the device via an input device (…). example like (e.g., mobile device 320, vehicle control console, etc.) provides input for check-in. In such instances, wireless audio unit 116 uses information provided by the user during check-in to locate the user-associated profile 122.
[0060] At step 506, the wireless audio unit 116 determines whether any profile 122 stored in the data storage area 118 is associated with a user. When the wireless audio unit 116 identifies a user-specific profile 122, the wireless audio unit 116 proceeds to step 508, whereby the wireless audio unit 116 loads the profile 122 from the data storage area 118. Otherwise, if the wireless audio unit 116 does not identify a user-specific profile 122, it proceeds to step 510. In some embodiments, the wireless audio unit 116 generates a user-specific profile for streaming to the personal audio device 150(N).
[0061] At step 510, the wireless audio unit 116 establishes a communication link 312 with the personal audio device 150(N). In various embodiments, the wireless audio unit 116 establishes a direct connection with the personal audio device 150(N) by establishing a wireless communication link 312(N). In various embodiments, a synchronization module 266 included in the wireless audio unit 116 exchanges message sets with the personal audio device 150(N) to determine the characteristics of the wireless communication link 312(N). example likeThe process includes negotiating the capability set of the wireless communication link 312(N), determining whether to establish a reverse channel, determining content protection, payload composition, etc. When determining the characteristics, the wireless audio unit 116 establishes a communication link 312(N) with the personal audio device 150(N).
[0062] At step 512, the wireless audio unit 116 determines a sound zone including the personal audio device 150(N). In various embodiments, the input processing module 262 of the wireless audio device processes the input dataset to determine the location of the personal audio device 150(N) and identify the sound zone to provide personalized audio to a user positioned near the personal audio device 150(N). In various embodiments, a subset of the speakers 232 within the vehicle may be associated with a predetermined sound zone ( For example The sound zone 402(1) is associated with this. In such an instance, the wireless audio unit 116 identifies a subset of the speakers 232 when identifying the sound zone 402(1). Alternatively, the wireless audio unit 116 uses a selection algorithm to identify the set of speakers 232 in the vehicle 302 that are to provide sound to the sound zone 402(1).
[0063] At step 514, the wireless audio unit 116 manages the vehicle loudspeakers 232 for sound zone 402. In various embodiments, the wireless audio unit 116 manages the set of loudspeakers 232(N) associated with the sound zone 402(1) identified in step 512. In some embodiments, the wireless audio unit 116 mutes the loudspeakers 232(N) for sound zone 402(1), causing the personal audio device 150(N) to reproduce the audio signal in place of the loudspeakers 232(N). Alternatively, the wireless audio unit 116 may manage the loudspeakers 232(N) to reproduce the audio signal together with the personal audio device 150(N). In such instances, the wireless audio unit 116 provides portions separately to the personal audio device 150(N) and the loudspeakers 232(N) for reproduction within sound zone 402(1).
[0064] At step 516, the wireless audio unit 116 synchronizes the audio stream to the sound zone 402. In various embodiments, the synchronization module 266 of the wireless audio unit 116 synchronizes the audio streams provided to the personal audio device 150(N) via wireless communication link 312(N) and / or to the speakers 232(N) in the sound zone 402(1) via audio link 332(N), so that the device can reproduce the audio signal. In various embodiments, the synchronization module 266 performs various techniques to reduce the latency between the audio source providing the audio signal and the personal audio device 150(N) reproducing the audio signal. For example, the wireless audio unit may allocate significant processing resources to increase the throughput through communication links 312(N), 332(N).
[0065] Figure 6 A flowchart illustrating the steps of a method for generating a mixed audio signal based on data from a vehicle environment, according to various embodiments, is shown. (Although references are provided...) Figures 1 to 5 The system describes the method steps, but those skilled in the art will understand that any system configured to perform the method steps in any order falls within the scope of various implementations.
[0066] As shown, method 600 begins at step 602, where the wireless audio unit processes incoming data. In various embodiments, the input processing module 262 of the wireless audio unit 116 processes data from various devices (e.g., sensor 130, remote data source 170, entertainment subsystem 222, network module 224, navigation subsystem 226, etc.). The incoming data (such as audio data from a microphone recording the external environment of the vehicle, speech from other occupants of the vehicle, events associated with the operation of the entertainment subsystem 222, network module 224, navigation subsystem 226, etc.) is associated with the environment. In various embodiments, the input processing module 262 processes the incoming data while the output generation module 264 streams audio signals to the personal audio device 150 and the speaker 232(N) for the sound zone 402(1). In such instances, the input processing module 262 can continuously process the incoming data while establishing a wireless communication link 312(N) with the personal audio device 150(N).
[0067] At step 604, the wireless audio unit 116 determines whether to add an audio component to the audio signal based on the incoming data. In various embodiments, the input processing module 262 determines whether the incoming data indicates that an additional audio component should be mixed with the audio signal. For example, the input processing module 262 receives a CAN message indicating an alarm condition from a driver assistance system. In such an instance, the input processing module 262 determines to provide an additional audio component based on the alarm condition. When the wireless audio unit 116 determines to add an audio component, the wireless audio unit 116 proceeds to step 606; otherwise, the wireless audio unit 116 determines not to add an audio component and returns to step 602 to further process the incoming data.
[0068] At step 606, the wireless audio unit 116 determines whether to add audio content to the incoming data. In various embodiments, the input processing module 262 determines the audio content to be added to the incoming data. For example, the input processing module 262 responds to a CAN message from a driver assistance system by adding ambient sounds recorded by vehicle sensors 214 of the external environment. In another example, the input processing module 262 detects a conversation between two or more vehicle occupants, including a user. In such an instance, the input processing module 262 determines that the conversation includes the speech of the vehicle occupants recorded by occupant-facing sensors 216 and / or cabin microphones 218. When the wireless audio unit 116 determines to add audio content from the incoming data, the wireless audio unit 116 proceeds to step 608. Otherwise, the wireless audio unit 116 proceeds to step 608.
[0069] At step 608, the wireless audio unit 116 extracts an audio clip from the incoming data. In various embodiments, the input processing module 262 identifies the audio clip to be included as additional audio content. In such instances, the input processing module 262 extracts the audio clip from the incoming dataset. In some embodiments, the input processing module 262 further processes the audio clip. For example, when the audio clip contains ambient sounds, the input processing module 262 filters out the ambient sound portion, such as by isolating specific sounds in the environment (…). For example (Emergency sirens, traffic notification sounds, etc.) are filtered out. In some implementations, the input processing module 262 generates an audio loop from the audio clip so that a longer version of the audio clip can be added to the audio signal.
[0070] At step 610, the wireless audio unit 116 determines whether to generate an audio pure tone. In various embodiments, the input processing module 262 determines whether to generate an audio pure tone to mix with the audio signal. For example, the input processing module 262 may detect an event associated with the audio pure tone at step 604. For example Alarm conditions, navigation events, notifications provided by the entertainment subsystem 222, etc.). In addition to audio content, or to indicate non-audio events, pure audio tones can also be generated ( For example (Alarm pure tone other than ambient sound). When the wireless audio unit 116 determines that an audio pure tone is to be generated, the wireless audio unit 116 proceeds to step 612; otherwise, the wireless audio unit 116 determines that no audio pure tone is to be added and proceeds to step 614.
[0071] At step 612, the wireless audio unit 116 generates an audio pure tone corresponding to the determined event type. In various embodiments, when determining the event type to be indicated by the audio pure tone, the wireless audio unit 116 identifies the audio pure tone corresponding to the event type. In some embodiments, the data storage area 118 stores a set of pure tones corresponding to a specific event type. For example, the data storage area 118 may store an air horn pure tone mapped to an alarm event type, a ringing alarm pure tone mapped to an incoming call event type, a harp string pure tone mapped to a navigation event type, etc. In such instances, the output generation module 264 of the wireless audio unit 116 generates the audio pure tone mapped to the determined event type.
[0072] At step 614, the wireless audio unit 116 generates a mixed audio stream with additional audio components. In various embodiments, the output generation module 264 of the wireless audio unit 116 mixes the additional audio components (e.g., audio clips and / or audio tones) with the audio signal to generate a mixed audio signal. In various embodiments, the mixed audio signal includes an attenuated version of the audio signal provided by the audio source plus the additional components. Thus, the speakers in sound zone 402 reproduce audio providing contextual information about the vehicle environment during audio signal playback. In some embodiments, the wireless audio unit 116 mixes the signal by significantly attenuating or muting a specific range of audio signals. In such instances, the additional audio components are more prominent in the mixed audio signal and are easier for the user to hear during playback.
[0073] At step 616, the wireless audio unit 116 transmits the mixed audio signal to the sound zone for reproduction. In various embodiments, the output generation module 264 of the wireless audio unit 116 transmits the mixed audio signal to the personal audio device 150(N) and speaker 232(N) in the sound zone 402(1) for reproduction. In some embodiments, the output generation module 264 generates individual component signals from the mixed audio signal. In such instances, the wireless audio unit 116 transmits the corresponding component signals to the devices in the sound zone 402(1) to reproduce the components of the mixed audio signal. While transmitting the mixed audio signal for reproduction, the wireless audio unit 116 returns to step 602 to process other incoming data.
[0074] In general, the wireless audio unit manages audio signals delivered to one or more personal audio devices (PAVs) for occupants of a vehicle. The wireless audio unit detects a given PAV and its location within the vehicle. The wireless audio unit loads a stored profile for the PAV and / or the user associated with it. The wireless audio unit establishes a communication link with the PAV to provide an audio stream for playback by the PAV. In various embodiments, the wireless audio unit determines the audio zone for the PAV based on its location within the vehicle and manages one or more speakers within the sound zone, such as by muting speakers or by providing a portion of the audio stream to the speakers to reproduce the audio stream along with the PAV.
[0075] When streaming audio signals to a personal audio device, the wireless audio unit processes incoming data received from one or more vehicle components, such as audio data, sensor data, and / or other types of data. The wireless audio unit processes the data to determine whether to add an audio portion to the audio stream. When the wireless audio unit determines to add an audio portion, it extracts an audio clip from the incoming data or adds an audio pure tone notification. The wireless audio unit mixes the added audio portion with the audio stream to generate a mixed audio stream for transmission to the personal audio device and speakers in the sound zone.
[0076] At least one technical advantage of the integrated in-vehicle personal audio system over the prior art is that, utilizing the disclosed technology, the integrated in-vehicle personal audio system can provide high-fidelity audio reproduction of audio signals within the vehicle, while simultaneously providing contextual information about the driving environment to the vehicle occupants. Furthermore, by incorporating compatible personal audio components to generate a personalized sound zone for a given occupant, the integrated in-vehicle personal audio system offers a less complex and more cost-effective solution for providing high-fidelity audio to individuals compared to conventional in-vehicle audio systems. These technical advantages represent one or more technological advancements superior to existing methods.
[0077] 1. In various embodiments, a computer-implemented method comprising: detecting one or more personal audio devices within a vehicle via a wireless audio unit; establishing a wireless link with at least a first personal audio device among the one or more personal audio devices; synchronizing communication with the first personal audio device via the wireless link; and transmitting an audio signal from the wireless audio unit to the first personal audio device via the wireless link for playback by the first personal audio device.
[0078] 2. The computer-implemented method according to Clause 1, the method further comprising: establishing at least a second wireless link with a second personal audio device among the one or more personal audio devices; and transmitting a second audio signal from the wireless audio unit to the second personal audio device via the second wireless link for playback, wherein the wireless audio unit transmits the second audio signal while establishing the wireless link with the first personal audio device.
[0079] 3. The computer-implemented method according to Clause 1 or 2, the method further comprising: receiving an incoming data set from a vehicle component; determining, based on the incoming data set, an additional component signal to be added to the audio signal; mixing the additional component signal with the audio signal to generate a mixed audio signal; and transmitting the mixed audio signal from the wireless audio unit to the first personal audio device.
[0080] 4. The computer-implemented method according to any one of claims 1 to 3, the method further comprising: extracting an audio clip from an additional audio signal included in the incoming data; and generating the additional component signal from the audio clip.
[0081] 5. The computer-implemented method according to any one of claims 1 to 4, the method further comprising: determining that the incoming dataset corresponds to an alarm; generating an alarm pure tone corresponding to the alarm, wherein the additional component signal includes the alarm pure tone.
[0082] 6. The computer-implemented method according to any one of claims 1 to 5, the method further comprising shunting the audio signal to generate an attenuated audio signal, wherein mixing the additional component signal with the audio signal comprises mixing the additional component signal with the attenuated audio signal.
[0083] 7. The computer-implemented method according to any one of claims 1 to 6, the method further comprising: generating a second wireless link with the mobile device; and receiving the audio signal from the mobile device before transmitting the audio signal.
[0084] 8. The computer-implemented method according to claims 1 to 7, the method further comprising: determining the location of the first personal audio device within the vehicle; and using a plurality of speakers installed in the vehicle and the first personal audio device to generate a sound zone configured to reproduce sound to a single occupant of the vehicle.
[0085] 9. The computer-implemented method according to claims 1 to 8, the method further comprising muting the plurality of speakers.
[0086] 10. The computer-implemented method according to claims 1 to 9, the method further comprising: identifying a speaker characteristic set for the plurality of speakers and the first personal audio device; generating an output profile based on the speaker characteristic set; and modifying the audio signal based on the output profile.
[0087] 11. In various embodiments, one or more non-transitory computer-readable media store instructions that, when executed by one or more processors, cause the one or more processors to perform the following steps: detecting one or more personal audio devices within the vehicle via a wireless audio unit of the vehicle; establishing a wireless link with at least a first personal audio device among the one or more personal audio devices; synchronizing communication with the first personal audio device via the wireless link; and transmitting an audio signal from the wireless audio unit to the first personal audio device via the wireless link for playback by the first personal audio device.
[0088] 12. One or more non-transitory computer-readable media of claim 11, wherein the steps further include: receiving an incoming data set from a vehicle component; determining, based on the incoming data set, an additional component signal to be added to the audio signal, wherein the additional component signal includes at least one of an audio clip from an additional audio signal included in the incoming data or an alarm pure tone corresponding to an alarm triggered by the incoming data set; mixing the additional component signal with the audio signal to generate a mixed audio signal; and transmitting the mixed audio signal from the wireless audio unit to the first personal audio device via the wireless link for playback.
[0089] 13. One or more non-transitory computer-readable media as described in Clause 11 or 12, wherein the steps further include: identifying a first user identifier associated with the first personal audio device; identifying a first user profile associated with the first user identifier in a data storage area storing one or more user profiles; and modifying the audio signal based on the user profile.
[0090] 14. One or more non-transitory computer-readable media according to any one of claims 11 to 13, wherein the steps further include: generating a second wireless link with the mobile device; and receiving the audio signal from the mobile device before transmitting the audio signal.
[0091] 15. One or more non-transitory computer-readable media according to any one of claims 11 to 14, wherein the step further comprises: determining the location of the first personal audio device within the vehicle; identifying a sound zone comprising a speaker set from a plurality of speakers installed in the vehicle, the sound zone being configured to reproduce sound to a single occupant of the vehicle.
[0092] 16. One or more non-transitory computer-readable media according to any one of claims 11 to 15, wherein the wireless audio unit is a device integrated into a seat or other part of the vehicle, or a device detachable from an installation included in the vehicle.
[0093] 17. One or more non-transitory computer-readable media according to any one of claims 11 to 16, wherein the wireless audio unit is included in the host unit of the vehicle.
[0094] 18. In various embodiments, a system includes: a memory storing a wireless audio management application; and a processor coupled to the memory, the processor executing the wireless audio management application by performing the following steps: detecting one or more personal audio devices within the vehicle via a wireless audio unit of the vehicle; establishing a wireless link with at least a first personal audio device among the one or more personal audio devices; synchronizing communication with the first personal audio device via the wireless link; and transmitting an audio signal from the wireless audio unit to the first personal audio device via the wireless link for playback by the first personal audio device.
[0095] 19. The system according to Clause 18, wherein the first human audio device includes one of a headset, an earphone, a wearable device, or one or more directional wireless speakers.
[0096] 20. The system according to Clause 18 or 19, wherein the steps further include: receiving an incoming data set from a vehicle component; determining, based on the incoming data set, an additional component signal to be added to the audio signal, wherein the additional component signal includes at least one of an audio clip from an additional audio signal included in the incoming data or an alarm pure tone corresponding to an alarm triggered by the incoming data set; mixing the additional component signal with the audio signal to generate a mixed audio signal; and transmitting the mixed audio signal from the wireless audio unit to the first personal audio device via the wireless link for playback.
[0097] Any and all combinations of any element of any claim and / or any element described in this application, in any form, fall within the contemplated scope and protection of this invention.
[0098] Various embodiments have been described for illustrative purposes; however, these descriptions are not intended to be exhaustive or limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments.
[0099] Various aspects of embodiments of this invention may be embodied as systems, methods, or computer program products. Therefore, aspects of this disclosure may take the form of a completely hardware implementation, a completely software implementation (including firmware, resident software, microcode, etc.), or an implementation combining software and hardware aspects, which are generally referred to herein as “modules,” “systems,” or “computers.” Furthermore, any hardware and / or software technology, process, function, component, engine, module, or system described in this disclosure may be implemented as a circuit or group of circuits. Additionally, aspects of this disclosure may take the form of a computer program product embodied in one or more computer-readable media having computer-readable program code embodied thereon.
[0100] Any combination of computer-readable media may be used. A computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. A computer-readable storage medium can be, for example, but not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or apparatuses, or any suitable combination of the foregoing media. More specific examples (not an exhaustive list) of computer-readable storage media will include: electrical connections having one or more wires, portable computer floppy disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable optical disc read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing media. In the context of this document, a computer-readable storage medium can be any tangible medium that can contain or store programs for use by or in connection with an instruction execution system, device, or apparatus.
[0101] The foregoing description, with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this disclosure, has described various aspects of this disclosure. It should be understood that each block in the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine. When executed via a processor of a computer or other programmable data processing apparatus, the instructions enable the implementation of the functions / actions specified in one or more blocks of the flowchart illustrations and / or block diagrams. Such a processor can be, but is not limited to, a general-purpose processor, a special-purpose processor, an application-specific processor, or a field-programmable gate array (FPGA).
[0102] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this respect, each block in a flowchart or block diagram may represent a module, segment, or portion of code comprising one or more executable instructions for implementing one or more specified logical functions. It should also be noted that in some alternative embodiments, the functions mentioned in the blocks may not appear in the order shown in the drawings. For example, two blocks shown consecutively may actually be executed substantially simultaneously, or these blocks may sometimes be executed in reverse order, depending on the functionality involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented by a system based on dedicated hardware or a combination of dedicated hardware and computer instructions that performs the specified functions or operations.
[0103] While the foregoing describes embodiments of this disclosure, other and more embodiments of this disclosure may be devised without departing from its essential scope, and the scope of this disclosure is determined by the claims.
Claims
1. A computer-implemented method, the method comprising: Detect one or more personal audio devices within the vehicle via the vehicle's wireless audio unit; Establish a wireless link with at least the first personal audio device among the one or more personal audio devices; The communication with the first personal audio device will be synchronized via the wireless link; as well as Audio signals are transmitted from the wireless audio unit to the first personal audio device via the wireless link for playback by the first personal audio device.
2. The computer-implemented method according to claim 1, further comprising: Establish at least a second wireless link with a second personal audio device among the one or more personal audio devices; as well as And transmit a second audio signal from the wireless audio unit to the second personal audio device via the second wireless link for playback, wherein the wireless audio unit transmits the second audio signal while establishing the wireless link with the first personal audio device.
3. The computer-implemented method according to claim 1, further comprising: Receive the incoming dataset from the vehicle component; The additional component signals to be added to the audio signal are determined based on the incoming dataset; The additional component signal is mixed with the audio signal to generate a mixed audio signal; as well as The mixed audio signal is transmitted from the wireless audio unit to the first personal audio device.
4. The computer-implemented method according to claim 3, further comprising: Extract audio clips from the additional audio signals included in the incoming data; as well as The additional component signal is generated from the audio clip.
5. The computer-implemented method according to claim 3, further comprising: Determine that the incoming dataset corresponds to the alarm; Generate an alarm pure tone corresponding to the alarm, wherein the additional component signal includes the alarm pure tone.
6. The computer-implemented method according to claim 3, further comprising: Dodge the audio signal to generate an attenuated audio signal. The mixing of the additional component signal with the audio signal includes mixing the additional component signal with the attenuated audio signal.
7. The computer-implemented method according to claim 1, further comprising: Generate a second wireless link with the mobile device; as well as The audio signal is received from the mobile device before it is transmitted.
8. The computer-implemented method according to claim 1, further comprising: Determine the location of the first personal audio device within the vehicle; Multiple speakers installed in the vehicle and the first personal audio device are used to generate a sound zone configured to reproduce sound to a single occupant of the vehicle.
9. The computer-implemented method of claim 8, further comprising muting the plurality of speakers.
10. The computer-implemented method according to claim 8, further comprising: Identify speaker characteristic sets for the plurality of speakers and the first personal audio device; An output profile is generated based on the speaker feature set. as well as The audio signal is modified based on the output profile.
11. One or more non-transitory computer-readable media storing instructions that, when executed by one or more processors, cause the one or more processors to perform the following steps: Detect one or more personal audio devices within the vehicle via the vehicle's wireless audio unit; Establish a wireless link with at least the first personal audio device among the one or more personal audio devices; The communication with the first personal audio device will be synchronized via the wireless link; as well as Audio signals are transmitted from the wireless audio unit to the first personal audio device via the wireless link for playback by the first personal audio device.
12. The one or more non-transitory computer-readable media according to claim 11, wherein the step further comprises: Receive the incoming dataset from the vehicle component; Based on the incoming dataset, additional component signals to be added to the audio signal are determined, wherein the additional component signals include at least one of the following: Audio clips from additional audio signals included in the incoming data; or An alarm pure tone corresponding to an alarm triggered by the incoming dataset; The additional component signal is mixed with the audio signal to generate a mixed audio signal; as well as The mixed audio signal is transmitted from the wireless audio unit to the first personal audio device via the wireless link for playback.
13. The one or more non-transitory computer-readable media of claim 11, wherein the step further comprises: Identify a first user identifier associated with the first personal audio device; Identify the first user profile associated with the first user identifier in a data storage area that stores one or more user profiles; The audio signal is modified based on the user profile.
14. The one or more non-transitory computer-readable media of claim 11, wherein the step further comprises: Generate a second wireless link with the mobile device; as well as The audio signal is received from the mobile device before it is transmitted.
15. One or more non-transitory computer-readable media according to claim 11, wherein the step further comprises: Determine the location of the first personal audio device within the vehicle; Identify a sound zone comprising a speaker set from multiple speakers installed in the vehicle, the sound zone being configured to reproduce sound to a single occupant of the vehicle.
16. One or more non-transitory computer-readable media according to claim 11, wherein the wireless audio unit is a device integrated into a seat or other part of the vehicle, or a device detachable from an installation included in the vehicle.
17. One or more non-transitory computer-readable media according to claim 11, wherein the wireless audio unit is included in the host unit of the vehicle.
18. A system comprising: Memory that stores wireless audio management applications; as well as A processor, coupled to the memory, executes the wireless audio management application by performing the following steps: Detect one or more personal audio devices within the vehicle via the vehicle's wireless audio unit; Establish a wireless link with at least the first personal audio device among the one or more personal audio devices; The communication with the first personal audio device will be synchronized via the wireless link; as well as Audio signals are transmitted from the wireless audio unit to the first personal audio device via the wireless link for playback by the first personal audio device.
19. The system of claim 18, wherein the first human audio device comprises one of a headset, an earphone, a wearable device, or one or more directional wireless speakers.
20. The system of claim 18, wherein the step further comprises: Receive the incoming dataset from the vehicle component; Based on the incoming dataset, additional component signals to be added to the audio signal are determined, wherein the additional component signals include at least one of the following: Audio clips from additional audio signals included in the incoming data; or An alarm pure tone corresponding to an alarm triggered by the incoming dataset; The additional component signal is mixed with the audio signal to generate a mixed audio signal; as well as The mixed audio signal is transmitted from the wireless audio unit to the first personal audio device via the wireless link for playback.