Dynamic sound from automotive input

Abstract

A computer system for manipulating, mixing, or synthesizing dynamic sounds accesses a package of one or more music tracks. The computer system then receives input variables from the one or more vehicle sensors. One or more vehicle sensors measure a condition of a driving parameter of a vehicle. In response to the input variable, the computer system generates a particular audio effect using the one or more music tracks.

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims the benefit of and priority to U.S. Patent Application Serial No. 18 / 337,017, filed on June 18, 2023, entitled “DYNAMIC SOUNDS FROM AUTOMOTIVE INPUTS,” and U.S. Provisional Patent Application Serial No. 63 / 447,265, filed on February 21, 2023, entitled “DYNAMIC SOUNDS FROM AUTOMOTIVE INPUTS,” and U.S. Provisional Patent Application Serial No. 63 / 440,879, filed on January 24, 2023, entitled “AI GENERATED SOUNDS FROM AUTOMOTIVE INPUTS,” and U.S. Provisional Patent Application Serial No. 63 / 440,879, filed on January 24, 2023, entitled “AI GENERATED SOUNDS FROM AUTOMOTIVE INPUTS,” and U.S. Provisional Patent Application Serial No. 63 / 440,879, filed on January 24, 2023, entitled “AI GENERATED SOUNDS FROM AUTOMOTIVE The entire contents of each of the above applications and / or patents are incorporated herein by reference in their entirety. Background Art

[0003] The popularity of music streaming services has increased significantly in recent years. Users now have access to vast libraries of music, allowing them to play their favorite songs anytime, anywhere. Most music services now offer users customized music selections. Users can request a completely customized music playlist or request music of a specific genre or type. Music services can generate a music playlist that is selected in whole or in part based on previously identified user preferences.

[0004] As a result, modern music services are able to provide users with customized music experiences. These experiences are driven by a collection of software, including artificial intelligence, that carefully collects information about the user's musical tastes and curates the music experience based on that information. The ability to use technology to map music and sounds to the user provides significant benefits to the user's music experience.

[0005] The subject matter claimed herein is not limited to embodiments that solve any disadvantages or that operate only in environments such as those described above. Rather, this background section is merely provided to illustrate one exemplary technology area where some embodiments described herein may be practiced. Summary of the invention

[0006] The disclosed embodiments include a computer system for manipulating, mixing or synthesizing dynamic sounds. The computer system accesses a package of one or more music stems. The computer system then receives input variables from one or more vehicle sensors. The one or more vehicle sensors measure conditions of driving parameters of the vehicle. In response to the input variables, the computer system generates a specific audio effect using the one or more music stems.

[0007] This Summary is provided to introduce a selection of concepts in a simplified form that are further described in the Detailed Description below. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.

[0008] Additional features and advantages will be set forth in the following description, and in part will be apparent from the description, or may be learned through practice of the teachings herein. The features and advantages of the present invention may be realized and obtained by means of the tools and combinations particularly pointed out in the appended claims. The features of the present invention will become more apparent from the following description and the appended claims, or may be learned through practice of the present invention as described below. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] In order to describe the manner in which the above and other advantages and features can be obtained, a more particular description of the subject matter briefly described above will be implemented with reference to specific embodiments shown in the accompanying drawings. It will be understood that these drawings depict only typical embodiments and are therefore not to be considered limiting of scope, and through the use of the drawings described below, the embodiments will be described and explained with additional specificity and detail.

[0010] Figure 1 A schematic diagram of a computer system for artificial intelligence generated sounds based on automotive input is shown.

[0011] Figure 2 A schematic diagram of roads and vehicles is shown.

[0012] Figure 3 A flow chart of a method for generating artificial intelligence generated sounds based on automobile inputs is shown.

[0013] Figure 4 A user interface for generating artificial intelligence generated sounds based on automobile inputs is shown.

[0014] Figure 5 Another user interface for generating artificial intelligence generated sounds based on automobile input is shown. DETAILED DESCRIPTION

[0015] The disclosed embodiments include a computer system for mixing, manipulating or synthesizing dynamic sounds. The computer system receives input variables from vehicle sensors. In response to the input variables, the system generates, mixes and / or manipulates specific sounds mapped to the input variables. For example, as a driver travels along a road or highway, the user's speed, braking, turning, backing up, and other vehicle actions can be used to create a unique soundtrack that matches the driving experience.

[0016] The disclosed embodiments allow a driver to create a custom soundscape that connects the driver, the vehicle, and the driving environment. As used herein, a "soundscape" includes any audio synthesis or recording of a soundtrack that is dynamically adjusted to accommodate the driving of the vehicle. The driver is able to create a custom soundscape in whole or in part that is based at least in part on sensor readings (i.e., input variables) from vehicle sensors. As used herein, vehicle sensors may include sensors such as, but not limited to, steering sensors, suspension sensors, IMU sensors, gyroscopes, accelerometers, speed sensors, acceleration sensors, gear sensors, brake sensors, GPS sensors, temperature sensors, clocks, rain sensors, odometers, weather data, and any other common vehicle sensors. In at least one embodiment, the vehicle sensors may include sensors that are not integrated into the vehicle itself, such as a GPS sensor in a mobile phone that transmits the GPS coordinates of the mobile phone (and therefore the GPS coordinates of the vehicle) to a computer system. A combination of one or more sensors may be used to create a custom soundscape in response to the driver and the vehicle traveling through an area. I. Computer system for dynamically generating sounds based on automobile inputs

[0017] The disclosed embodiments include an artificial intelligence system that utilizes input variables from vehicle sensors (e.g., navigation route, speed, time, location, etc.) to generate or manipulate audio compositions in real time. Thus, in some embodiments, the driver acts as a DJ or even a creator of unique music or soundscapes based on how, where, and when they drive the vehicle. Similarly, the vehicle becomes an ecosystem for new creative experiences. In at least one embodiment, drivers are able to publish the soundscapes they create on other platforms for others to consume and / or purchase.

[0018] The driver can select a specific base song, one or more tracks that the user manipulates during driving. For example, when the user accelerates, the base song or track can speed up or increase the volume. Conversely, when the user steps on the brakes, the base song or track can reduce speed or volume. Similarly, in at least one embodiment, when the user accelerates or decelerates, the computer can apply one or more filters to the base song or track or remove one or more filters from the base song or track. Thus, the user can select a popular song, such as OMG by Will.i.am. Then, based on the user's driving of the vehicle, the user can "customize" or otherwise manipulate the song in real time. Specifically, the song or track can be manipulated to reflect the user's feelings based on the way the user drives the vehicle or other relevant information.

[0019] Figure 1 A schematic diagram of a computer system 100 for artificial intelligence generated sounds based on automotive input is shown. The computer system 100 includes one or more processors 110 and computer storage media 120. The computer storage media 120 stores computer executable instructions that, when executed, cause the computer system 100 to perform various actions. For example, the computer executable instructions may include instructions for a dynamic sound generation software 130 application.

[0020] The dynamic sound generation software 130 application includes a sound generation engine 140, a sensor API 150, and a music library storage 160. In at least one embodiment, the disclosed system can intelligently generate any aspect of the soundscape, including melody, rhythm, beats, and various audio effects. The audio during the journey can be generated in real time and played in real time on the vehicle speakers, making it an integral part of the driving experience. The audio can also be saved as a file for later playback. The audio can also be uploaded to social media platforms and / or marketplaces for other users to consume and experience.

[0021] As used herein, an "engine" includes computer executable code and / or computer hardware that performs a particular function. Those skilled in the art will appreciate that the distinctions between different engines are at least partially arbitrary, and that engines may be combined and divided in other ways and still be within the scope of the present disclosure. Therefore, describing a component as an "engine" is provided for purposes of clarity and explanation only, and should not be interpreted as indicating that any particular structure of computer executable code and / or computer hardware is required, unless otherwise expressly stated. In this specification, the terms "component", "agent", "manager", "service", "module", "virtual machine", etc. may also be used similarly.

[0022] In at least one embodiment, the sound generation engine 140 includes an artificial intelligence algorithm, a machine learning algorithm, a neural network, or some other suitable algorithm that can be used to synthesize a soundtrack based on various sensor inputs received from the driver's vehicle 170. The sound generation engine 140 can receive sensor inputs from a sensor API 150. The sensor API 150 can be configured to receive sensor data from vehicle sensors.

[0023] When the sound generation engine 140 generates the soundscape, the sound generation engine 140 can utilize information from the sensor API 150 and the music library storage 160. For example, the music library storage 160 can include acoustic profiles for different types of instruments, different genres, different songs, different song samples, different individual tracks, and / or different groups of tracks. In addition, when the driver synthesizes the soundscape, the dynamic sound generation software 130 application can store the custom created soundtrack in the music library storage 160.

[0024] In at least one embodiment, one or more portions of the dynamic sound generation software 130 can be distributed among multiple different processors in multiple different locations. For example, in at least one embodiment, a portion of the dynamic sound generation software 130 is hosted in the cloud, so that multiple different vehicles communicate with the cloud-hosted portion. Similarly, portions of the dynamic sound generation software 130 can be hosted by each of the multiple different vehicles.

[0025] In at least one embodiment, the dynamic sound generation software 130 may include a music store that allows users to download and / or upload songs, tracks, and other soundscape components. For example, a user may be allowed to purchase multiple different tracks, and the driver may select between these different tracks and / or mix them together to create a desired soundscape. Once purchased, the tracks, songs, or other soundscape components may be stored locally on the vehicle. Conversely, in some embodiments, the tracks, songs, or other soundscape components are stored in the cloud and downloaded by the vehicle 170 as needed.

[0026] In at least one embodiment, some tracks, songs or other soundscape components are available only at a specific destination, time, after the user performs a specific action and / or in some other specific situations. For example, only when the driver passes a specific dining place at noon, a specific track is available for the driver. Similarly, once the driver drives the vehicle 170 more than 100,000 miles, a specific soundscape is available for the driver. As another example, only when the driver drives in the snow, a specific song is available. Once available, tracks, songs or other soundscape components can be automatically downloaded to the vehicle 170, automatically downloaded to the driver's cloud storage and / or presented to the user as an optional download.

[0027] In some embodiments, a user can purchase a track, song, or other soundscape component from the user's mobile phone or computer. Additionally or alternatively, a user can purchase a track, song, or other soundscape component from a user interface integrated into the vehicle entertainment system. In either case, once purchased, the user can manipulate and use the purchased track, song, or other soundscape component. II. Sensors and Data for Input to the Sound Generation Engine

[0028] Any action or parameter received from the vehicle sensors may affect the synthesis of the soundscape. The sensor API 150 may receive data from the vehicle sensors, which may include but is not limited to turns, speed, acceleration and deceleration, routes taken, braking actions, gear shifting and speed changes, forward and reverse actions, sonar, radar, recovery, and any other mechanical actions of the car. The sensor API 150 may also receive any data from the vehicle sensors related to the vehicle 170 or the driving experience, which may include but is not limited to travel time and duration, weather conditions, environmental conditions, traffic conditions, location, the origin and destination of the trip, characteristics of the driver and passengers, the brand and model of the vehicle itself, and other vehicle-specific characteristics. In at least one embodiment, the sensor API 150 may receive input variables from a gyroscope and accelerometer integrated within the vehicle 170. For example, input variables from a gyroscope may provide a better soundscape experience than input variables from a steering wheel, because the driver turning the steering wheel to stop may not reflect the actual physical feeling of turning in the vehicle 170. In this case, the gyroscope may provide better input variables.

[0029] In at least one embodiment, the synthesis of the soundscape can be customized for a specific driver based on the information about the driver. The driver can create a user profile and / or can create a user profile for the driver over time. For example, the driver may appreciate the music of a particular genre, the intensity of the music, the type of instrument, the specific performer, the loudness of the music, the era of the music, and various other classifications and features of the music. In some embodiments, the sound and music preferences of the user can be collected from the pre-existing data about the user (for example, the playlist or music listening history of the user). In addition, the server can track the music taste of an individual over time and location. For example, the server can indicate that the user likes different music / sounds when driving in the forest and when driving in the desert, or when driving in the rain and when driving on a sunny day. The resulting music / sound synthesis can be adjusted to reflect these differences.

[0030] In at least one embodiment, the sensor API 150 can receive data from vehicle sensors, including one or more of the following example sources: acceleration, GPS, AI voice, front sonar / radar, rear sonar / radar, and / or seat vibration. In additional or alternative embodiments, the sound generation engine 140 can map specific sensors to specific audio parameters. For example, the acceleration of the vehicle 170 can be mapped to audio / timbre / preset sound effects. The brake pedal can be mapped to audio release / attenuation / timbre / preset sound effects. The steering wheel can be mapped to envelope / filter / timbre / preset sound effects. The suspension can be mapped to LFO / timbre / preset sound effects. The speedometer can be mapped to an arpeggio / timbre / preset sound effect that is activated after reaching a certain speed.

[0031] In at least one embodiment, each track, track group or audio effect can be mapped to a specific input variable through metadata stored with the track, track group or audio effect. A user can use a software interface to map a specific track, track group or audio effect to a desired input variable. For example, a user can map a track group of a percussion instrument to an input variable from an accelerator. In addition, a user can define a mapping by indicating the relationship between an accelerator input variable and a track group of a percussion instrument. For example, a user can define that pressing an accelerator causes the track group of a percussion instrument to play at a faster speed and a louder volume. In addition, a user can also define that a specific filter is applied to the track group of a percussion instrument when the vehicle is below a specified speed, and another filter is applied when the vehicle 170 is above another specified speed. Each of these parameters can be stored with the track group of a percussion instrument so that the vehicle can correctly map the track group to the correct input variable. A further description of a system for associating a track, track group or audio effect with an input variable will be provided below.

[0032] Similar to the above mappings, the sound generation engine 140 may also include a default mapping if no other mappings are provided. For example, the input variables of the suspension of the vehicle 170 may be mapped to percussion instruments, while the input variables of the accelerometer may be mapped to guitars. It will be appreciated that the listed mappings are provided for exemplary purposes only. Various additional or alternative mappings may also be used without departing from the present disclosure. Additionally or alternatively, the sound generation engine 140 may also utilize non-speaker functions of the vehicle to create a more complete audio experience. For example, the sound generation engine 140 may vibrate the driver's seat or steering wheel based on sensor data. Such functionality may allow for a more immersive audio experience. In at least one embodiment, parameter configurations may be set on all channels to give the vehicle ultra-flexible, ultra-dynamic audio / sensing intelligence.

[0033] In addition, in at least one embodiment, the sensor API 150 can dynamically adjust one or more input variables. For example, input variables related to speed or acceleration can be dynamically adjusted based on the speed limit of the road on which the vehicle 170 is traveling. For example, input variables from vehicle sensors can include a visual system that reads speed limit signs, or a location / map system (e.g., GPS) that provides speed limits from a map or database based on the detected vehicle location. The sensor API 150 can adjust the input variables so that a full range of audio effects can be applied within the speed limit. For example, metadata associated with a particular audio track can indicate lower speeds and higher speeds at which different audio effects are applied. In at least one embodiment, the sensor API 150 adjusts the lower speeds and higher speeds so that they are both suitable for the speed limit of the road on which the vehicle is traveling. Therefore, the sensor API 150 is configured to encourage safe driving by ensuring that audio effects are adjusted to be applied within the speed limit. III. Dynamic Generation and Customization of Music

[0034] In at least one embodiment, a user's vehicle 170 is able to act as a soundscape composition system as the user drives from point A to point B. Such a system turns the vehicle 170 into an ecosystem for new creative experiences. The disclosed embodiments open the door for the creative community to create soundscapes for drivers, adding new color compositions to the world of music and audio travel. Users can then sell, license, or otherwise share their soundscape compositions through streaming services or other downloadable services.

[0035] For example, in at least one embodiment, the sensor API 150 feeds data to the sound generation engine 140, which in turn generates a customized dynamic soundscape for the driver and passengers of the vehicle. In some embodiments, the sound generation engine 140 includes an artificial intelligence algorithm that processes the data received from the sensor API 150 and the driver-specific data. The artificial intelligence algorithm creates a soundscape that is created in real time and is personalized for the driver.

[0036] Furthermore, in at least one embodiment, one or more modes may be associated with the playback of the soundscape. For example, the audio system of a vehicle may include various modes, such as aggressive, relaxed, optimistic, etc. The sound generation engine 150 may adjust the soundscape based on the audio system mode. Additionally or alternatively, the sound generation engine 150 may adjust the soundscape based on the driving mode of the vehicle 170. For example, many vehicles have an eco-driving mode, a sport driving mode, a normal driving mode, and various other driving modes. Each driving mode may include unique adjustments, restrictions, and / or AI responses. For example, putting a car in sport mode may cause the sound engine 150 to play faster audio effects and at a higher volume, while eco mode may cause the audio effects to be slower and at a lower volume.

[0037] The following discussion relates to non-limiting examples of the dynamic sound generation software 130. These examples are provided for purposes of explanation and clarity only and should not be construed as limiting or otherwise defining key or essential features of the present invention.

[0038] The sound of the vehicle 170 traveling on the highway may generate a natural rhythm based on road noise from road seams or based on the driver driving over a speed bump at the edge of the road. In at least one embodiment, sensors within the suspension of the vehicle 170 can identify the rhythm and transmit it to the computer system 100 via the sensor API 150. The sound generation engine 140 can generate an acoustic fingerprint based on the recorded rhythm. The acoustic fingerprint can be created using a spectrogram or using any other acoustic fingerprinting method used in the art.

[0039] The sound generation engine 140 may then map the acoustic fingerprint to a pre-stored acoustic fingerprint within the music library storage 160. The music library storage 160 may include a database of beats, rhythms, choruses, melodies, etc. associated with the pre-stored acoustic fingerprints. After identifying a match or closest match to the acoustic fingerprint of the generated road noise, the sound generation engine 140 may insert the identified matching or closest matching music from the music library storage 160 into the soundscape.

[0040] Additionally or alternatively, the sound generation engine 140 can access packages of track groups from the music library storage 160, each track group being mapped to a corresponding input variable. The input variables associated with the suspension sensor can be used to manipulate the track group associated with the suspension. For example, the sound generation engine 140 can apply a filter, adjust the filter, adjust the speed, adjust the volume, or perform any number of other audio adjustments to the track group. For example, the sound generation engine 140 can speed up the audio of the track group until its rhythm matches the rhythm (or a factor of the rhythm) of the suspension vibration.

[0041] In addition, in at least one embodiment, when searching for a matching acoustic fingerprint in the music library storage 160, the sound generation engine 140 can limit the search scope based on the driver's profile. For example, the driver profile may indicate a preference for country music. Therefore, the sound generation engine 140 can limit the search in the music library storage 160 to only tracks, groups of tracks, beats, rhythms, choruses, melodies, etc. that belong to the country music genre.

[0042] In additional or alternative embodiments, the sound generation engine 140 may utilize GPS and map data when generating the soundscape. For example, Figure 2 A schematic diagram of a road 200 and a vehicle 170 is shown. The sound generation engine 140 can use GPS data to identify the type of area through which the vehicle 170 is traveling. For example, if the vehicle is traveling along the Pacific Coast Highway, the sound generation engine 140 can generate a song with a beach vibe. In addition, the sound generation engine 140 can rely on tracks, track groups, beats, rhythms, choruses, melodies, etc. from the music library storage 160, which are based on songs from bands such as the Beach Boys, Jack Johnson, Colbie Caillat, and other musicians with a significant "beach vibe."

[0043] As another example of the sound generation engine 140 utilizing an input variable in the form of location data (e.g., GPS data), if the sound generation engine 140 detects that the vehicle is entering New York City, the sound generation engine 140 may generate a soundscape with a stronger urban musical influence. For example, the sound generation engine 140 may generate a soundscape based on recent music samples created by New York City music groups. Similarly, the sound generation engine 140 may utilize GPS data to identify popular songs in the local market or songs that reference or are related to where the vehicle is traveling. Thus, the sound generation engine 140 may generate a soundscape based at least in part on a current list of popular songs within New York City or famous songs that reference or are related to New York City. For example, in Figure 2, the digital data package 240 may represent a location-specific audio track or audio file that the vehicle 170 may access when it enters the general geographic area associated with the digital data package 240. It will be appreciated that the visual representations of the digital data package 240 and the digital data package 230 are provided for exemplary purposes only. In practice, the digital data package 240 may not necessarily be physically located at the geographic location. Instead, the digital data package 240 may be hosted on a server and provided to the vehicle 170 when the vehicle arrives within a threshold distance of the location of the digital data package 240. Additionally or alternatively, in at least one embodiment, the digital data package 240 may be hosted by a server located at the geographic location such that the audio track or audio file is provided to the vehicle via a local area network when the vehicle 170 enters the network range.

[0044] In at least one embodiment, the sound generation engine 140 generates only soundscapes that match the user profile. For example, the user may indicate a preference for hip-hop and rock music, but may also indicate a dislike for jazz music. In response, the sound generation engine 140 may generate only soundscapes that match hip-hop and rock music, while avoiding soundscapes that use elements of jazz music.

[0045] In additional or alternative embodiments, the sound generation engine 140 may also utilize the location data to identify the current weather conditions of the area of ​​the vehicle 170. For example, the sound generation engine 140 may use an online weather service to determine that it is currently snowing in the area where the vehicle is traveling. In response to identifying that it is snowing, the sound generation engine 140 may create a soundscape informed by the weather. In this case, the soundscape may include warmer and softer tones and / or may include sound elements based on music related to winter (e.g., Christmas music). Conversely, if the sound generation engine 140 determines that the weather outside is sunny, the sound generation engine 140 may generate a cheerful and faster-paced soundscape. It will be appreciated that many different attributes may be associated with different weather patterns. Therefore, the examples provided above are merely for clarity and discussion. Any number of different soundscape features may be generated based on data received from weather reports.

[0046] The sound generation engine 140 may also receive map data related to the driver's travel plans. For example, the sound generation engine 140 may receive the departure and destination of the vehicle. In response, the sound generation engine 140 may generate a soundscape that takes into account the entire journey that the vehicle is planning. For example, the sound generation engine 140 may take into account the time of day, expected weather, expected traffic patterns, and other data related to the journey when creating the soundscape. At the beginning of the journey, the sound generation engine 140 may generate a cheerful and energetic soundscape to motivate the driver during the journey. As the driver approaches the expected traffic during driving, the sound generation engine 140 may generate a calming soundscape to help the driver better navigate the traffic. If the journey ends at a late hour, the sound generation engine 140 may generate a loud and exciting soundscape to help the driver stay awake and focused.

[0047] In addition, in at least one embodiment, a voice assistant can also be incorporated into the soundscape. For example, if the driver is receiving driving instructions from a voice assistant, the sound generation engine 140 can manipulate the voice assistant so that the voice assistant speaks at a volume, rhythm, beat, effect, etc. that matches the soundscape. For example, the sound generation engine 140 can cause the voice assistant to speak in an echo that matches the rhythm of the soundscape. As another example, the sound generation engine 140 can cause the voice assistant to sing in a style that matches the soundscape.

[0048] In at least one embodiment, at least a portion of the soundscape created by the driver is stored in a music library storage. The music library storage can be local to the vehicle, in the cloud, local to a particular location, or in a combination of local storage and cloud storage. The driver can access and listen to the soundscape at a later time, share the soundscape with others, sell or license the soundscape, or process the soundscape in a manner the driver likes. For example, a well-known music artist can create a specific soundscape based on driving from Los Angeles, California to Santa Barbara, California. Other drivers can purchase or otherwise listen to the same soundscape.

[0049] For example, another driver may be planning to take the same trip from Los Angeles, California to Santa Barbara, California. The driver may be interested in experiencing the same soundscape created by the musician. Therefore, the user can purchase or obtain permission for the soundscape created by the musician for the same journey. In at least one embodiment, the sound generation engine 140 can adjust and modify the original soundscape in real time based on the driver's location along the way. For example, the time the driver left may be different than the time the creator of the original soundscape left. Due to different traffic conditions, the driver's location may be out of sync with the location of the soundtrack creator. Therefore, the sound generation engine 140 can extend or shorten specific portions of the original soundscape to ensure that the driver's location is synchronized with the location in the original soundscape. Therefore, when the driver travels at a specific location between Los Angeles, California and Santa Barbara, California, the driver is experiencing the soundscape created by the original creator.

[0050] In additional or alternative embodiments, a music artist may also create a custom audio layer or track that the artist geo-locates to a specific location on a map. The music library storage 160 may store multiple custom audio layers from different artists, and at least a portion of the audio layer may be geo-located to a specific location. For example, an artist may create an audio layer and associate it with a specific location on Park Avenue in New York City. When the vehicle passes the specific location, the sound generation engine 140 is able to access the audio layer and add it to the current soundscape. In at least one embodiment, the driver is provided with the option of whether or not they would like the audio layer from the artist to be automatically incorporated into their drive.

[0051] In some embodiments, the acquisition of audio layers from music artists can be gamified. For example, when the driver passes by a location specified by the artist, the sound generation engine 140 can unlock or download the audio layer. For example, if the vehicle 170 passes by the building 220, the vehicle 170 can access the digital data package 230. The digital data package 230 can include tracks and / or audio files that the user can now use to create a soundscape. In at least one embodiment, once the driver acquires the audio layer, the driver is able to use the audio layer at will in any location. Therefore, as the driver acquires more and more audio layers, the driver can create increasingly complex and interesting soundscapes by utilizing these layers.

[0052] In additional or alternative embodiments, advertising material may also be incorporated into the soundscape. For example, in some configurations, as the driver drives the vehicle along a road, the sound generation engine 140 may identify nearby locations for which advertising material has been prepared for the system. For example, before the vehicle passes a fast food restaurant (e.g., building 220), an advertising audio layer (e.g., digital data package 230) prepared by the fast food restaurant company may be added to the soundscape. The fast food restaurant company may prepare a series of audio layers that differ for different user type preferences, such that different drivers may load different audio layers at the same location based on the driver's respective profiles. Thus, as the driver passes a particular point, the driver may be provided with customized advertising material layered into his or her customized soundscape.

[0053] In at least one embodiment, drivers can pay a subscription fee to avoid ads. In addition, users can select ads that they are personally interested in. In addition, the sound generation engine 140 can also "intelligently" identify ads of interest. For example, the sound generation engine 140 can play a fast food ad around lunch time, but not play it at 3 pm. Similarly, the sound generation engine 140 can play a gas station ad when the fuel sensor indicates a low fuel level, but not play a gas station ad when the fuel sensor indicates a high fuel level.

[0054] Thus, the sound generation engine 140 can create a customized soundscape in various ways that is responsive to the driver, responsive to the location of the vehicle, responsive to loaded content (e.g., audio layers from a musical artist), responsive to weather, and / or responsive to various other inputs.

[0055] IV. Example Method for AI-Generated Sound Based on Automotive Input

[0056] The following discussion now relates to a number of methods and method actions that may be performed. Although method actions may be discussed in a particular order or shown in a flowchart as occurring in a particular order, these method actions do not require a particular order unless otherwise specified or because one action depends on another action being completed before the action is performed.

[0057] Figure 3 A flow chart of a method 300 for generating sounds generated by artificial intelligence based on automobile input is shown. The method 300 includes an action 310 of accessing a music track. The action 310 includes accessing a package of one or more music tracks. For example, the computer system 100 can access the music tracks stored in the music library storage 160.

[0058] In addition, method 300 includes an act 320 of receiving input variables. Act 320 includes receiving input variables from vehicle sensors. Vehicle sensors measure conditions of driving parameters of the vehicle. For example, sensor API 150 may receive data from a sensor connected to an accelerator pedal.

[0059] Method 300 may also include an act 330 of generating a sound. Act 330 includes, in response to the input variable, generating a specific sound mapped to the input variable. For example, the sound generation engine 140 may create a custom soundscape within the vehicle based on the driver depressing and releasing the accelerator pedal.

[0060] In at least one embodiment, the sound generation engine 140 can also be configured to create an external soundscape for the vehicle 170. The external soundscape can match the internal soundscape or include different sounds. For example, the sound generation engine 140 can generate an external soundscape as a safety feature for an electric vehicle. In many cases, electric vehicles are so quiet during normal operation that pedestrians may not hear the sound of the vehicle backing up or approaching from behind. Therefore, in at least one embodiment, the sound generation engine 140 can create an external soundscape using input variables to warn others about the approach of the vehicle. For example, in at least one embodiment, reversing the vehicle 170 causes the external speakers on the car to play the internal soundscape. Additionally or alternatively, a different soundscape can be played on the external speakers. The external soundscape can use a track or set of tracks to create a customized soundscape based on the input variables from the vehicle 170.

[0061] V. System for creating soundscape packages

[0062] In at least one embodiment, a computer system may provide a user with an interface for creating a soundscape package. Figure 4A user interface 400 for generating sounds generated by AI based on car inputs is shown. As used herein, a soundscape package includes audio components, such as tracks associated with input variables received from vehicle sensors. For example, the interface can display visual representations of audio tracks 412, 414, 416, 418 in a selection of track groups 410. The track groups 410 can be provided to the computer system by a music artist who has uploaded the track groups to the computer system. The user can then associate one or more of the tracks 412, 414, 416, 418 with a visual representation of a specific input variable 420 (e.g., accelerator 422, brake 424, suspension 426, GPS 426, etc.) and / or a visual representation of a specific filter and / or audio effect 430, 432, 434, 436, 438. For example, a user can associate a bass track 412 with the acceleration 422 of the vehicle 170. This association may be achieved by dragging the bass track 412 onto the visual indication of the accelerator 422 .

[0063] Figure 5 Another user interface 500 is shown for generating sounds generated by the AI ​​based on car inputs. Once the user has associated the bass soundtrack 412 with the acceleration 422, the user interface 500 can allow the user to further customize the interaction between a particular input variable 420 and the soundtrack group 410. For example, in the user interface 500, an adjustment line 510 is depicted for the accelerator. As further described herein, the adjustment line 510 can be used to allow the computer system 100 to adjust the soundscape for a speed limit on a given road and / or allow the computer system 100 to adjust the soundscape for a particular car model.

[0064] In the user interface 500, the user has associated filter A 432 with the accelerator input variable ranging from 2 to 4. Once the accelerator 422 reaches a level of 4 on the adjustment line 510, the bass track 412 is associated with the accelerator 422. Furthermore, once the accelerator 422 reaches a level of 4 on the adjustment line 510, the bass track 412 is associated with the input variable from the accelerator. Furthermore, once the accelerator 422 reaches a level of 7 on the adjustment line 510, effect B 428 is associated with the bass track 412 and the accelerator 422. Furthermore, once the accelerator 422 reaches a level of 4 on the adjustment line 510. Thus, when initially accelerating, the user may first hear filter A 432 applied to the soundscape. Filter A 432 will transition to the bass track 412 at some point in the acceleration. Eventually, effect B 438 will be applied to the bass track 412. It will be appreciated that the user may add other audio effects, such as specific filters that should be applied at different times based on one or more input variables. For example, a user may indicate that a distortion filter should be applied to a percussion track during an initial period of vehicle acceleration.

[0065] Once the user has completed the association of their desired track groups with input variables and audio effects, the computer system can create a soundscape package that is formatted to be read by the computer system in the vehicle. In at least one embodiment, the soundscape package includes metadata associated with the package and / or the track groups within the soundscape package. For example, each individual track group can be saved with metadata that associates the track group with one or more input variables from one or more vehicle sensors and one or more audio effects.

[0066] In at least one embodiment, the computer system can set limits on various input variables. For example, the computer system can set an upper limit of 100MPH for any speed input variable. Additionally or alternatively, the computer system can set a dynamic upper limit on the speed input variable based on the real-time speed limit of the vehicle. In at least one embodiment, when the track group is associated with the input variable (e.g., speed), the user specifies the relationship in a range rather than in an actual numerical value. For example, the user can indicate that a specific filter should be added at level 8 (within the example range of 1-10). The adjustment information can be encoded in the metadata associated with the track group. When used, the vehicle can identify the current speed limit and standardize the adjustment for the speed limit so as to add a specific filter at 80% of the speed limit. It will be appreciated that this example of a 1-10 range, a speed input variable, and a filter is merely exemplary, and the process can be applied to any number of different input variables.

[0067] In at least one embodiment, the computer system can place limits on various audio effects. For example, the computer system can set limits on the volume levels allowed for a particular track group and / or soundscape package. For example, a user can indicate that a volume of level 8 (out of an example range of 1-10) should be used. The adjustment information can be encoded into metadata associated with the track group. When used, the vehicle can identify the current volume level of the audio system and adjust the audio of the track group accordingly. It will be appreciated that this example of a 1-10 range and volume level is merely exemplary, and the process can be applied to any number of different audio effects.

[0068] In additional or alternative embodiments, the computer system can also link various input variables together. For example, in response to a first input variable (e.g., acceleration of a vehicle), the sound generation engine 140 can apply a specific audio effect (e.g., increased volume) to one or more music tracks. The sensor API 150 can then determine that the first input variable exceeds a threshold. For example, the sensor API 150 can determine that the driver has released the accelerator by more than a threshold amount. Based on the first input variable exceeding the threshold, the sound generation engine 140 can apply a specific audio effect (e.g., volume) to one or more music tracks in response to a second input variable.

[0069] For example, if a particular audio effect is immediately cut off from the soundscape based on the driver pressing the accelerator pedal, an undesirable soundscape may be produced. In order to create a more seamless soundscape experience, when the sensor API 150 detects that the accelerator has been released to a threshold amount, the sensor API 150 can switch to associating the vehicle speed with a particular music track and / or audio effect. Therefore, when the user releases the accelerator pedal, the soundtrack and audio effects associated with the vehicle acceleration can be seamlessly switched to be associated with the vehicle speed. This switching should provide a more continuous and subtle decline in audio effects and music tracks. It will be appreciated that the examples provided are not limiting. Any number of different audio effects, input variables, and tracks can be associated with thresholds that cause the sensor API 150 and / or the sound generation engine 140 to switch the association between input variables, audio effects, and tracks to create a better soundscape experience.

[0070] Furthermore, in at least one embodiment, it may be desirable to adjust the soundscape based on the characteristics of the vehicle in which the soundscape is being played and created. For example, different vehicles include different audio systems, different haptic systems, and different performance characteristics. A sports car equipped with a high-end stereo system will provide a very different soundscape experience than a large SUV equipped with a low-end stereo system.

[0071] In at least one embodiment, the soundscape package can be customized to match a specific type and configuration of car. For example, each type and configuration of vehicle can download slightly different soundscape packages, which have metadata that have been optimized to match a specific vehicle type and configuration. Additionally or alternatively, the sound generation engine 140 can be configured to apply a transfer function and / or a predetermined adjustment to the soundscape package to optimize the soundscape experience of the vehicle. For example, each type and configuration of vehicle can have acoustic characteristics so that each audio effect is associated with an adjustment or transfer function that optimizes a specific audio effect for a given vehicle. In addition, the characteristics of the performance of each type and configuration of vehicle are such that each input variable from the vehicle sensor is associated with an adjustment or transfer function that optimizes the input variable for a given vehicle. As used herein, "adjustment" can include linear adjustment or nonlinear adjustment. In at least one embodiment, "adjustment" can include an equation or a step function.

[0072] For example, the adjustment or transfer function may be such that an input variable related to acceleration exerts a greater influence on a sports car than an input variable related to acceleration from an SUV. Similarly, the adjustment or transfer function may exert a lesser influence on bass effects in a better sound system of a sports car than on bass effects in a poorer sound system in an SUV. By performing the above optimization, the acceleration of the two different types of vehicles may be better mapped to the soundscape, and the bass effects of the two vehicles may be better distinguished through different categories of stereo.

[0073] In at least one embodiment, the music creator is also able to associate specific tracks from a song with specific geographic locations. For example, a musician may wish to host a secret concert. The route to the concert may be hidden in a soundscape created by the musician. For example, the musician may associate one or more track groups to the location of the concert so that as the driver approaches the concert, the one or more track groups play louder and / or faster. Thus, as the concert location is approached, the musician's fans can find the secret concert by following the soundscape created within the fan's vehicle.

[0074] In additional or alternative embodiments, music creators can use geographic location information for a variety of different purposes. For example, music creators can create a "treasure hunt" activity for listeners. Metadata associated with a track can guide users to a specific physical location by volume, beats, or some other audio indicators. Once the user arrives at a specific location, a specific physical object can be provided to the user, such as a coupon, meal, product, or any other physical object. Similarly, music creators can create metadata associated with a specific physical location, unlocking a new album or soundtrack for the user to listen to at that specific physical location. Similar geographic location features can also be used for guided tours. For example, metadata can guide users to multiple different locations along a guided tour route. At a specific location, the soundscape may change to include verbal communication that describes the location or otherwise accompanies the guide. In addition, in at least one embodiment, the metadata associated with the track can be time-limited, so that a specific geographic location is only valid during a specified time.

[0075] In at least one embodiment, the computer system used to create the soundscape package can also provide the following functions: add digital rights management functions to the resulting soundscape package. For example, each soundscape package can be signed and / or encrypted within a unique token. The token used to decrypt the encryption can only be provided to approved users, so that only approved users can decrypt the soundscape package within their vehicle. In addition, the digital rights management function can prevent the soundscape package from being played by unapproved systems. For example, only systems that are specifically approved to play the soundscape package can be provided with the necessary tools to meet the digital rights management function.

[0076] Additionally, in at least one embodiment, when a driver creates their own work using a soundscape package, the same digital rights management functionality can also be applied to any recordings of the driver's work. Such functionality can limit the driver's ability to share licensed soundscape package content with unapproved individuals or systems. Thus, soundscapes and associated licensing rights can be managed within the system to prevent unauthorized sharing and / or unauthorized playback of artist content.

[0077] VI. Aspects of the sound generated by the AI ​​based on the car’s input

[0078] In a first aspect of a computer system for manipulating and synthesizing dynamic sounds in a vehicle, one or more processors and one or more computer-readable media are included, wherein the one or more computer-readable media have executable instructions stored thereon, and when the executable instructions are executed by the one or more processors, the computer system is configured to manipulate and synthesize dynamic sounds in the vehicle. The computer system can access a package of one or more music tracks. In addition, the computer system can receive input variables from one or more vehicle sensors, and the one or more vehicle sensors measure conditions of driving parameters of the vehicle. In response to the input variables, the computer system can generate a specific audio effect using the one or more music tracks.

[0079] Aspect 2 relates to the computer system of aspect 1, wherein the executable instructions for generating the specific audio effect using the one or more music tracks include: instructions executable to configure the computer system to apply a filter to at least a portion of the one or more music tracks.

[0080] Aspect three relates to a computer system according to any one of the above aspects, wherein the executable instructions include: instructions executable to configure the computer system to apply the filter in response to the input variable indicating that the vehicle is decelerating.

[0081] Aspect 4 relates to a computer system of any one of the above aspects, wherein the one or more vehicle sensors include one or more of the following: a steering sensor, a suspension sensor, an IMU sensor, a gyroscope, an accelerometer, a speed sensor, an acceleration sensor, a gear sensor, a brake sensor, a GPS sensor, a temperature sensor, a clock, a rain sensor, weather data or an odometer.

[0082] Aspect five relates to a computer system of any one of the above aspects, wherein the executable instructions for generating the specific audio effect using the one or more music tracks include instructions executable to configure the computer system to perform the following steps: applying the specific audio effect to the one or more music tracks in response to a first input variable; determining that the first input variable exceeds a threshold; and applying the specific audio effect to the one or more music tracks in response to a second input variable based on the first input variable exceeding the threshold.

[0083] Aspect six relates to the computer system of any one of the above aspects, wherein the specific audio effect includes a tactile effect.

[0084] Aspect seven relates to the computer system of any one of the above aspects, wherein the one or more music tracks include a group of tracks from a song.

[0085] Aspect eight relates to the computer system of any one of the above aspects, wherein a specific music track selected from the one or more music tracks is associated with metadata mapping the specific music track to a specific input variable.

[0086] Aspect nine relates to a computer system of any one of the above aspects, wherein the executable instructions for generating the specific audio effect using the one or more music tracks include instructions executable to configure the computer system to perform the following steps: identifying that the vehicle is located at a specific location; and in response to identifying that the vehicle is located at the specific location, accessing an advertising audio layer associated with the specific location.

[0087] Aspect ten relates to a computer system according to any one of the above aspects, wherein the executable instructions for generating the specific audio effect using the one or more music tracks include: instructions executable to configure the computer system to merge the advertising audio layer into the one or more music tracks.

[0088] Aspect 11 relates to a computer-implemented method of any of the above aspects. The computer-implemented method for manipulating and synthesizing dynamic sounds in a vehicle comprises: accessing a package of one or more music tracks; receiving input variables from one or more vehicle sensors, the one or more vehicle sensors measuring conditions of driving parameters of the vehicle; and generating a specific audio effect using the one or more music tracks in response to the input variables.

[0089] Aspect twelve relates to the computer-implemented method of any of the above aspects, further comprising: applying a filter to at least a portion of the one or more music tracks.

[0090] Aspect thirteen relates to a computer-implemented method according to any one of the above aspects, further comprising: applying the filter in response to the input variable indicating that the vehicle is decelerating.

[0091] Aspect fourteen relates to a computer-implemented method of any of the above aspects, wherein the one or more vehicle sensors include one or more of the following: a steering sensor, a suspension sensor, an IMU sensor, a gyroscope, an accelerometer, a speed sensor, an acceleration sensor, a gear sensor, a brake sensor, a GPS sensor, a temperature sensor, a clock, a rain sensor, weather data or an odometer.

[0092] Aspect fifteen relates to a computer-implemented method of any one of the above aspects, further comprising: applying the specific audio effect to the one or more music tracks in response to a first input variable; determining that the first input variable exceeds a threshold; and based on the first input variable exceeding the threshold, applying the specific audio effect to the one or more music tracks in response to a second input variable.

[0093] Aspect sixteen relates to a computer-implemented method of any one of the above aspects, wherein the specific audio effect includes a haptic effect.

[0094] Aspect seventeen relates to the computer-implemented method of any of the above aspects, wherein the one or more music tracks comprise a group of tracks from a song.

[0095] Aspect eighteen relates to the computer-implemented method of any one of the above aspects, wherein a specific group of tracks selected from the one or more music tracks is associated with metadata mapping the specific group of tracks to a specific input variable.

[0096] Aspect nineteen relates to a computer-implemented method according to any one of the above aspects, further comprising: identifying that the vehicle is located at a specific location; and in response to identifying that the vehicle is located at the specific location, accessing an advertising audio layer associated with the specific location.

[0097] Aspect 20 relates to a computer-implemented method according to any one of the above aspects, further comprising: merging the advertising audio layer into the one or more music tracks.

[0098] VII. Example Architecture and Computer Hardware

[0099] In at least one embodiment, the computer hardware for the above system can be integrated into the original equipment manufacturer (OEM) multimedia center that comes with the vehicle. Additionally or alternatively, the system can be added to the vehicle after purchase through a new aftermarket multimedia center and / or through a plug-in device. For example, in at least one embodiment, a user can plug a stand-alone device into their vehicle to obtain the above functionality. For example, the stand-alone device can be plugged into a USB port in the vehicle. Additionally or alternatively, the stand-alone device can be plugged into an on-board diagnostic system (e.g., OBDII) to collect data about the vehicle sensors to feed into the sensor API 150 in the stand-alone device.

[0100] In addition, in at least one embodiment, the onboard device may include an internal inertial measurement unit (IMU) that is capable of inferring at least a portion of the sensor readings from the vehicle. For example, the IMU can detect the car's turns and accelerations. Similarly, the IMU can detect vibrations through the suspension. The IMU can feed its readings into the sensor API 150 as if its readings were received from the vehicle sensors. The onboard device can then provide the soundscape to the multimedia system in the car through the USB port or through some other means (e.g., Bluetooth). Thus, the disclosed embodiments include both built-in systems and standalone devices that can retrofit a vehicle to include the described functionality.

[0101] In addition, the method can be practiced by a computer system including one or more processors and a computer readable medium such as a computer memory. In particular, the computer memory can store computer executable instructions that, when executed by one or more processors, cause the execution of various functions, such as the actions listed in the embodiments.

[0102] Computing system functionality can be enhanced by the ability of the computing system to interconnect to other computing systems via network connections. Network connections may include, but are not limited to, connections via wired or wireless Ethernet, cellular connections, or even computer-to-computer connections via serial, parallel, USB, or other connections. These connections allow computing systems to access services on other computing systems and to receive application data from other computing systems quickly and efficiently.

[0103] The interconnection of computing systems enables distributed computing systems, such as so-called "cloud" computing systems. In this description, "cloud computing" can be a system or resource for enabling ubiquitous, convenient, on-demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications, services, etc.), which can be provided and published in a manner that reduces management effort or service provider interaction. Cloud models can consist of various features (e.g., on-demand self-service, broad network access, resource pools, rapid elasticity, measured services, etc.), service models (e.g., software as a service ("SaaS"), platform as a service ("PaaS"), infrastructure as a service ("IaaS"), and deployment models (e.g., private cloud, community cloud, public cloud, hybrid cloud, etc.).

[0104] Cloud-based and remote service applications are common. Such applications are hosted on public and private remote systems (e.g., the cloud) and typically provide a set of network-based services for communicating back and forth with clients.

[0105] Many computers are intended to be used through direct user interaction with the computer. Therefore, computers have input hardware and software user interfaces to facilitate user interaction. For example, a modern general-purpose computer may include a keyboard, mouse, touch pad, camera, etc. to allow a user to input data into the computer. In addition, various software user interfaces may be used.

[0106] Examples of software user interfaces include graphical user interfaces, text command line based user interfaces, function key or hot key user interfaces, and the like.

[0107] The disclosed embodiments may include or utilize a special or general-purpose computer including computer hardware, as discussed in more detail below. The disclosed embodiments also include physical and other computer-readable media for carrying or storing computer-executable instructions and / or data structures. Such computer-readable media may be any available media that can be accessed by a general or special-purpose computer system. The computer-readable media that stores computer-executable instructions are physical storage media. The computer-readable media that carries computer-executable instructions are transmission media. Thus, by way of example and not limitation, embodiments of the present invention may include at least two distinctly different types of computer-readable media: physical computer-readable storage media and transmission computer-readable media.

[0108] Physical computer-readable storage media include RAM, ROM, EEPROM, CD-ROM or other optical disk storage (e.g., CD, DVD, etc.), magnetic disk storage or other magnetic storage devices, or any other media that can be used to store desired program code tools in the form of computer-executable instructions or data structures and that can be accessed by a general or special purpose computer.

[0109] A "network" is defined as one or more data links capable of transmitting electronic data between computer systems and / or modules and / or other electronic devices. When information is transmitted or provided to a computer via a network or another communication connection (hardwired, wireless, or a combination of hardwired or wireless), the computer properly views the connection as a transmission medium. Transmission media may include networks and / or data links, which may be used to carry program code in the form of computer executable instructions or data structures and may be accessed by general or special-purpose computers. Combinations of the above are also included within the scope of computer-readable media.

[0110] In addition, upon reaching various computer system components, program code tools in the form of computer executable instructions or data structures can be automatically transferred from a transmission computer readable medium to a physical computer readable storage medium (or vice versa). For example, a computer executable instruction or data structure received via a network or data link can be cached in RAM within a network interface module (e.g., a "NIC"), and then ultimately transferred to the computer system RAM and / or a less volatile computer readable physical storage medium on the computer system. Thus, a computer readable physical storage medium can be included in a computer system component that also (or even primarily) utilizes a transmission medium.

[0111] Computer executable instructions include, for example, instructions and data that enable a general-purpose computer, a special-purpose computer, or a special-purpose processing device to perform a specific function or group of functions. Computer executable instructions can be, for example, binary, intermediate format instructions (e.g., assembly language), or even source code. Although the subject matter is described in a language specific to structural features and / or method actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the above-mentioned features or actions. On the contrary, the described features and actions are disclosed as example forms of implementing the claims.

[0112] It will be appreciated by those skilled in the art that the present invention can be practiced in a network computing environment with various types of computer system configurations, including personal computers, desktop computers, portable computers, message processors, handheld devices, multiprocessor systems, microprocessor-based or programmable consumer electronics, network PCs, minicomputers, mainframe computers, mobile phones, PDAs, pagers, routers, switches, etc. The present invention can also be practiced in a distributed system environment, in which local and remote computer systems via a network link (by a hardwired data link, a wireless data link, or by a combination of a hardwired and wireless data link) all perform tasks. In a distributed system environment, program modules can be located in both local and remote storage devices.

[0113] Alternatively or additionally, the functionality described herein may be performed at least in part by one or more hardware logic components. For example, but not limited to, illustrative types of hardware logic components that may be used include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), etc.

[0114] The present invention may be implemented in other specific forms without departing from the spirit or features of the present invention. The described embodiments are considered to be exemplary and non-restrictive in all respects. Therefore, the scope of the present invention is shown by the appended claims rather than the foregoing description. All changes within the meaning and scope of the equivalent schemes of the claims are included within their scope.

Claims

1. A computer system for manipulating and synthesizing dynamic sounds in a vehicle, comprising: one or more processors; as well as One or more computer-readable media having executable instructions stored thereon, which, when executed by the one or more processors, configure the computer system to perform the following steps: A package that accesses one or more music tracks; receiving input variables from one or more vehicle sensors that measure conditions of a driving parameter of the vehicle; as well as In response to the input variables, a specific audio effect is generated using the one or more music tracks.

2. The computer system according to claim 1, wherein: The executable instructions for generating the specific audio effect using the one or more music tracks include instructions executable to configure the computer system to perform the following steps: A filter is applied to at least a portion of the one or more music tracks.

3. The computer system according to claim 2, wherein: The executable instructions include instructions executable to configure the computer system to perform the following steps: The filter is applied in response to the input variable indicating that the vehicle is decelerating.

4. The computer system according to claim 1, wherein: The one or more vehicle sensors include one or more of the following: Steering sensor, suspension sensor, IMU sensor, gyroscope, accelerometer, speed sensor, acceleration sensor, gear sensor, brake sensor, GPS sensor, temperature sensor, clock, rain sensor, weather data or odometer.

5. The computer system according to claim 1, wherein: The executable instructions for generating the specific audio effect using the one or more music tracks include instructions executable to configure the computer system to perform the following steps: applying the particular audio effect to the one or more music tracks in response to a first input variable; determining that the first input variable exceeds a threshold; and Based on the first input variable exceeding the threshold, the particular audio effect is applied to the one or more music tracks in response to a second input variable.

6. The computer system according to claim 1, wherein: The specific audio effect includes a haptic effect.

7. The computer system according to claim 1, wherein: The one or more music tracks include groups of tracks from a song.

8. The computer system according to claim 7, wherein: A particular music track selected from the one or more music tracks is associated with metadata that maps the particular music track to a particular input variable.

9. The computer system according to claim 1, wherein: The executable instructions for generating the specific audio effect using the one or more music tracks include instructions executable to configure the computer system to perform the following steps: Identifying that the vehicle is located at a specific location; and In response to identifying that the vehicle is located at the specific location, an advertising audio layer associated with the specific location is accessed.

10. The computer system according to claim 9, wherein: The executable instructions for generating the specific audio effect using the one or more music tracks include instructions executable to configure the computer system to perform the following steps: The advertising audio layer is merged into the one or more music tracks.

11. A computer-implemented method for manipulating and synthesizing dynamic sounds within a vehicle, comprising: A package that accesses one or more music tracks; receiving input variables from one or more vehicle sensors that measure conditions of a driving parameter of the vehicle; as well as In response to the input variables, a specific audio effect is generated using the one or more music tracks.

12. The computer-implemented method of claim 11 , further comprising: A filter is applied to at least a portion of the one or more music tracks.

13. The computer-implemented method of claim 12, further comprising: The filter is applied in response to the input variable indicating that the vehicle is decelerating.

14. The computer-implemented method of claim 11, wherein: The one or more vehicle sensors include one or more of the following: Steering sensor, suspension sensor, IMU sensor, gyroscope, accelerometer, speed sensor, acceleration sensor, gear sensor, brake sensor, GPS sensor, temperature sensor, clock, rain sensor, weather data or odometer.

15. The computer-implemented method of claim 11, further comprising: applying the particular audio effect to the one or more music tracks in response to a first input variable; determining that the first input variable exceeds a threshold; as well as Based on the first input variable exceeding the threshold, the particular audio effect is applied to the one or more music tracks in response to a second input variable.

16. The computer-implemented method of claim 11, wherein: The specific audio effect includes a haptic effect.

17. The computer-implemented method of claim 11, wherein: The one or more music tracks include groups of tracks from a song.

18. The computer-implemented method of claim 17, wherein: A particular group of tracks selected from the one or more music tracks is associated with metadata that maps the particular group of tracks to a particular input variable.

19. The computer-implemented method of claim 11, further comprising: Identifying that the vehicle is located at a specific location; as well as In response to identifying that the vehicle is located at the specific location, an advertising audio layer associated with the specific location is accessed.

20. The computer-implemented method of claim 19, further comprising: The advertising audio layer is merged into the one or more music tracks.

Images