System and method for adjusting activity control parameters

Abstract

Systems and methods for generating sound in a vehicle or other location are presented. In one example, a single user input can be the basis for adjusting the sound level and frequency of occurrence of sound stored in a controller memory and output via one or more speakers.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to sounds that can be output in a vehicle. BACKGROUND

[0002] Some infotainment systems include pre-recorded sounds or artificially generated sounds from actual natural environments that can be played back to a human user in the form of audio sounds. For example, an infotainment system user can only hear one sound from a set of sounds. The set of sounds can include, for example, the sound of rain falling, the sound of a waterfall, the sound of ocean waves, or the sound of thunder. The user can select which sound to play back, and the sound can be played back via speakers in the vehicle so that the human user can experience a feeling such as relaxation or calmness. Listening to the sound can also reduce stress and anxiety of the human user. The infotainment system can also display a scene corresponding to the sound being played in order to further enhance the user experience. While the sound and scene can successfully set the mood or environment for the user, the sound and scene can be static and inflexible. Specifically, the volume or sound power level can be the only adjustable aspect of the pre-recorded or artificially generated sound. Thus, once the user becomes accustomed to hearing the pre-recorded sound, the user can become less interested in the sound. Additionally, each pre-recorded or artificially generated sound can only be used to bring about one user mood or mindset under set conditions. SUMMARY

[0003] The inventors have recognized the previously mentioned problems and have developed systems and methods for at least partially solving the above problems. Specifically, the inventors have developed a method for generating sounds in a vehicle, the method comprising: generating a sound according to a state of a user control, the user control comprising an operating range that is subdivided into a plurality of group regions, each of the plurality of group regions being associated with one or more elements unique to the group region within the plurality of group regions.

[0004] By generating a sound according to a position of a user control comprising an operating range that is subdivided into a plurality of group regions, it is possible to combine two or more sounds to increase the variety of sounds generated via the infotainment center. Additionally, an additional sound can be used to augment a base sound, the repetition frequency of a base sound can be modified, and the sound output power level of a base sound can be adjusted in order to provide a range of mood changing or enhancing sounds. Thus, the functionality of an infotainment system or audio system can be improved while the ease of system control that can be provided via the position of a unique user control.

[0005] This description offers several advantages. Specifically, the method increases the diversity of mood-changing sounds available to system users. Additionally, the method provides increased functionality via a simple, single user input. Furthermore, the method allows users to change the intensity level of the experience via the same single input.

[0006] The advantages and other advantages and features described herein will readily become apparent from the following detailed description, taken alone or in conjunction with the accompanying drawings.

[0007] It should be understood that the above summary is provided to introduce, in a simplified form, a series of concepts further described in the detailed description. This is not intended to identify key or essential features of the claimed subject matter, the scope of which is uniquely defined by the claims following the detailed description. Furthermore, the claimed subject matter is not limited to implementations that address any of the shortcomings described above or in any part of this disclosure. Attached Figure Description

[0008] Figure 1 An exemplary partial view of a vehicle cabin according to one or more embodiments of the present disclosure is shown;

[0009] Figure 2 An exemplary computing system in a vehicle according to one or more embodiments of the present disclosure is shown;

[0010] Figure 3 An exemplary sound processing system in a vehicle according to one or more embodiments of the present disclosure is shown;

[0011] Figure 4A A schematic depiction of an exemplary activity control is shown;

[0012] Figure 4B A schematic depiction of active controls within an exemplary control area is shown;

[0013] Figure 4C A schematic depiction of two active controls is shown in an exemplary control area;

[0014] Figure 5 It shows that it can be based on Figures 4A-4C The graph shows the audio properties modified according to the state of the user interface.

[0015] Figure 6 A flowchart illustrating an exemplary method for generating sound via an audio or infotainment system; and

[0016] Figure 7 An exemplary scene and the sounds associated with the scene are shown. Detailed Implementation

[0017] The present disclosure relates to generating sound in accordance with user input. The generation of sound includes generating a sound in a first set of sounds in accordance with a position or state of user input; and adding an additional sound to the first set of sounds when the position or state of user input changes. Further, the user input can control a volume or sound output power level (e.g., decibels (dB)) and a frequency of repeating the activated sound when generating the sound.

[0018] As shown in Figures 1-3 The system according to the present disclosure can be part of a vehicle, and the method according to the present disclosure can be performed via a computing system in the vehicle.

[0019] Figure 1 An exemplary partial view of an environment of an audio customization system is shown, an interior of a cabin 100 of a vehicle 102 in which a driver and / or one or more passengers can sit. Figure 1 The vehicle 102 can be a motor vehicle that includes drive wheels (not shown) and an internal combustion engine 104. The internal combustion engine 104 can include one or more combustion chambers that can receive intake air via an intake passage and expel combustion gases via an exhaust passage. The vehicle 102 can be a road automobile, as well as other types of vehicles. In some examples, the vehicle 102 can include a hybrid propulsion system that includes an energy conversion device that is operable to absorb energy from vehicle motion and / or an engine, and convert the absorbed energy to a form of energy suitable for storage by an energy storage device. The vehicle 102 can include an all-electric vehicle that incorporates a fuel cell, a solar energy capture element, and / or other energy storage systems for powering the vehicle.

[0020] As shown, the instrument panel 106 can include various displays and controls that are accessible to a human driver (also referred to as a user) of the vehicle 102. For example, the instrument panel 106 can include a touchscreen 108 of an in-vehicle computing system 109 (e.g., infotainment system), an audio system control panel, and an instrument cluster 110. The touchscreen 108 can receive user input to the in-vehicle computing system 109 in order to control audio output, visual display output, user preferences, control parameter selections, and the like. While in Figure 1The example system shown in FIG. 1 includes audio system controls that can be executed via a user interface of the in-vehicle computing system 109, such as the touchscreen 108, without a separate audio system control panel, although in other embodiments the vehicle can include an audio system control panel that can include controls for a conventional vehicle audio system such as a radio, compact disc player, MP3 player, etc. The audio system controls can include features for controlling one or more aspects of audio output via the speakers 112 of the vehicle speaker system. For example, the in-vehicle computing system or the audio system controls can control the volume of audio output, the sound distribution between individual speakers of the vehicle speaker system, the equalization of audio signals, and / or any other aspect of audio output. In other examples, the in-vehicle computing system 109 can adjust radio station selection, playlist selection, audio input source (e.g., from a radio or CD or MP3), etc. based on user input received directly via the touchscreen 108 or based on data received via the external device 150 and / or mobile device 128 regarding the user, such as the user's physical state and / or environment. The audio system of the vehicle can include an amplifier (not shown) coupled to a plurality of loudspeakers (not shown). In some embodiments, one or more hardware elements of the in-vehicle computing system 109, such as the touchscreen 108, display screen 111, various control dials, knobs, and buttons, memory, processor, and any interface elements (e.g., connectors or ports) can form an integrated head unit that is mounted in the dashboard 106 of the vehicle. The head unit can be fixedly or removably attached in the dashboard 106. In additional or alternative embodiments, one or more hardware elements of the in-vehicle computing system 109 can be modular and mountable in multiple locations of the vehicle.

[0021] The cabin 100 can include one or more sensors for monitoring the vehicle, user, and / or environment. For example, the cabin 100 can include one or more seat-mounted pressure sensors configured to measure pressure applied to a seat to determine the presence of a user, a door sensor configured to monitor door activity, a humidity sensor to measure the humidity of the cabin, a microphone to receive user input in the form of voice commands to enable the user to make a phone call and / or measure ambient noise in the cabin 100, etc. It will be understood that the above-described sensors and / or one or more additional or alternative sensors can be located at any suitable location of the vehicle. For example, the sensors can be located in the engine compartment, on the exterior surface of the vehicle, and / or other suitable locations so as to provide information regarding the operation of the vehicle, the environmental conditions of the vehicle, the user of the vehicle, etc. Information regarding the environmental conditions of the vehicle, the state of the vehicle, or the driver of the vehicle can also be received from sensors external to the vehicle / separate from the vehicle (i.e., not part of the vehicle system), such as sensors coupled to the external device 150 and / or the mobile device 128.

[0022] The cabin 100 can also include one or more user objects stored in the vehicle prior to, during, and / or after travel, such as a mobile device 128. The mobile device 128 can include a smartphone, a tablet computer, a laptop computer, a portable media player, and / or any suitable mobile computing device. The mobile device 128 can be connected to the computing system in the vehicle via a communication link 130. The communication link 130 can be wired (e.g., via a Universal Serial Bus [USB], Mobile High-Definition Link [MHL], High-Definition Multimedia Interface [HDMI], Ethernet, etc.) or wireless (e.g., via Bluetooth, WIFI, WIFI Direct, Near-Field Communication [NFC], cellular connection, etc.) and configured to provide bidirectional communication between the mobile device and the computing system in the vehicle. The mobile device 128 can include one or more wireless communication interfaces for connecting to one or more communication links (e.g., one or more of the example communication links described above). The wireless communication interfaces can include one or more physical devices, such as antennas or ports, coupled to data lines to carry transmitted or received data, and one or more modules / drivers for operating the physical devices in accordance with other devices in the mobile device. For example, the communication link 130 can provide sensors and / or control signals from various vehicle systems, such as a vehicle audio system, a climate control system, etc., and the touchscreen 108 to the mobile device 128, and can provide control and / or display signals from the mobile device 128 to the systems in the vehicle and the touchscreen 108. The communication link 130 can also provide power from a power source in the vehicle to the mobile device 128 to charge an internal battery of the mobile device.

[0023] The in-vehicle computing system 109 can also be communicatively coupled to additional devices that are operated and / or accessed by the user but located outside of the vehicle 102, such as one or more external devices 150. In the depicted embodiment, the external devices are located outside of the vehicle 102, but it will be appreciated that in alternative embodiments, the external devices can be located inside the cabin 100. The external devices can include server computing systems, personal computing systems, portable electronic devices, electronic wristbands, electronic headbands, portable music players, electronic activity tracking devices, pedometers, smartwatches, GPS systems, and the like. The external devices 150 can be connected to the in-vehicle computing system via a communication link 136, which can be wired or wireless, as discussed with reference to the communication link 130, and configured to provide bidirectional communication between the external devices and the in-vehicle computing system. For example, the external devices 150 can include one or more sensors, and the communication link 136 can transmit sensor output from the external devices 150 to the in-vehicle computing system 109 and the touchscreen 108. The external devices 150 can also store and / or receive information regarding contextual data, user behavior / preferences, operating rules, and the like, and can transmit such information from the external devices 150 to the in-vehicle computing system 109 and the touchscreen 108.

[0024] The in-vehicle computing system 109 can analyze inputs received from the external devices 150, the mobile device 128, and / or other input sources, and select settings for various in-vehicle systems, such as climate control systems or audio systems, provide outputs via the touchscreen 108 and / or the speakers 112, communicate with the mobile device 128 and / or the external devices 150, and / or perform other actions based on the evaluation. In some embodiments, all or a portion of the evaluation can be performed by the mobile device 128 and / or the external devices 150.

[0025] In some embodiments, one or more of the external devices 150 can be indirectly communicatively coupled to the in-vehicle computing system 109 via another one of the mobile device 128 and / or the external devices 150. For example, the communication link 136 can communicatively couple the external devices 150 to the mobile device 128, such that output from the external devices 150 is relayed to the mobile device 128. Data received from the external devices 150 can then be aggregated at the mobile device 128 with data collected by the mobile device 128, which is then transmitted to the in-vehicle computing system 109 and the touchscreen 108 via the communication link 130. Similar data aggregation can occur at a server system and then transmitted to the in-vehicle computing system 109 and the touchscreen 108 via the communication link 136 / 130.

[0026] Figure 2A block diagram of an in-vehicle computing system 109 configured and / or integrated within the interior of the vehicle 102 is shown. The in-vehicle computing system 109 can perform one or more of the methods described herein in some embodiments. In some examples, the in-vehicle computing system 109 can be a vehicle infotainment system configured to provide information-based media content (audio and / or visual media content, including entertainment content, navigation services, etc.) to vehicle users to enhance the in-vehicle experience for the operator. The vehicle infotainment system can include or be coupled to various vehicle systems, subsystems, hardware components, and software applications and systems integrated in or capable of integration in the vehicle 102 in order to enhance the in-vehicle experience for the driver and / or passengers.

[0027] The in-vehicle computing system 109 can include one or more processors, including an operating system processor 214 and an interface processor 220. The operating system processor 214 can execute an operating system on the in-vehicle computing system and control the input / output, display, playback, and other operations of the in-vehicle computing system. The interface processor 220 can interface with the vehicle control system 230 via an inter-vehicle system communication module 222.

[0028] The inter-vehicle system communication module 222 can output data to other vehicle systems 231 and vehicle control elements 261, while also receiving data input from other vehicle components and systems 231, 261, for example, through the vehicle control system 230. When outputting data, the inter-vehicle system communication module 222 can provide signals corresponding to outputs of any status of the vehicle, the environment surrounding the vehicle, or any other source of information connected to the vehicle via a bus. The vehicle data outputs can include, for example, analog signals such as current speed, digital signals provided by separate sources of information such as a clock, a thermometer, a position sensor such as a global positioning system [GPS] sensor, etc., digital signals propagated through vehicle data networks such as an engine CAN bus through which engine-related information can be communicated, a climate control CAN bus through which climate control-related information can be communicated, and a multimedia data network through which multimedia data can be communicated between multimedia components in the vehicle. For example, the in-vehicle computing system 109 can retrieve from the engine CAN bus a current speed of the vehicle estimated by wheel sensors, a power status of the vehicle via a battery and / or power distribution system of the vehicle, an ignition status of the vehicle, etc. Additionally, other interfacing means such as Ethernet can also be used without departing from the scope of the present disclosure.

[0029] A non-volatile storage device 208 can be included in the in-vehicle computing system 109 to store data, such as instructions executable by the processors 214 and 220, in a non-volatile form. The storage device 208 can store application data, including pre-recorded sounds, to enable the in-vehicle computing system 109 to run applications to connect to cloud-based servers and / or collect information for transmission to cloud-based servers. The applications can retrieve data stored in the in-vehicle computing system, such as information gathered by vehicle systems / sensors, input devices (e.g., user interface 218), data stored in volatile storage 219A or non-volatile storage (e.g., memory) 219B, devices in communication with the in-vehicle computing system (e.g., a mobile device connected via a Bluetooth link), etc. The in-vehicle computing system 109 can also include volatile memory 219A. The volatile memory 219A can be random access memory (RAM). The non-transitory storage device, such as the non-volatile storage device 208 and / or non-volatile memory 219B, can store instructions and / or code that, when executed by a processor (e.g., operating system processor 214 and / or interface processor 220), control the in-vehicle computing system 109 to perform one or more of the actions described in this disclosure.

[0030] A microphone 202 can be included in the in-vehicle computing system 109 to: receive voice commands from a user; measure ambient noise in the vehicle; determine whether audio from a speaker of the vehicle is tuned according to the acoustic environment of the vehicle, etc. The speech processing unit 204 can process voice commands, such as voice commands received from the microphone 202. In some embodiments, the in-vehicle computing system 109 can also be able to receive voice commands and sample ambient vehicle noise using microphones included in the audio system 232 of the vehicle.

[0031] One or more additional sensors can be included in the sensor subsystem 210 of the in-vehicle computing system 109. For example, the sensor subsystem 210 can include a camera, such as a rearview camera to assist a user in parking the vehicle and / or a cabin camera to identify a user (e.g., using facial recognition and / or user gestures). The sensor subsystem 210 of the in-vehicle computing system 109 can communicate with and receive input from various vehicle sensors and can further receive user input. For example, input received by the sensor subsystem 210 can include transmission gear position, transmission clutch position, throttle pedal input, brake input, transmission selector position, vehicle speed, engine speed, mass air flow through the engine, ambient temperature, intake air temperature, etc., as well as input from climate control system sensors (such as heat transfer fluid temperature, antifreeze temperature, fan speed, passenger cabin temperature, desired passenger cabin temperature, ambient humidity, etc.), input from audio sensors that detect voice commands issued by a user, input from a key fob sensor that receives commands from and optionally tracks the geographic location / proximity of a key fob of the vehicle, etc. While certain vehicle system sensors can communicate with the sensor subsystem 210 individually, other sensors can communicate with both the sensor subsystem 210 and the vehicle control system 230, or can communicate indirectly with the sensor subsystem 210 via the vehicle control system 230. The navigation subsystem 211 of the in-vehicle computing system 109 can generate and / or receive navigation information such as location information (e.g., via a GPS sensor and / or other sensors from the sensor subsystem 210), route guidance, traffic information, point of interest (POI) identification, and / or other navigation services for a driver.

[0032] The external device interface 212 of the in-vehicle computing system 109 can be capable of coupling to, and / or communicating with, one or more external devices 150 located outside of the vehicle 102. While the external devices are illustrated as being located outside of the vehicle 102, it will be understood that they can be temporarily housed in the vehicle 102, such as when a user is operating the external devices while operating the vehicle 102. In other words, the external devices 150 are not integral with the vehicle 102. The external devices 150 can include a mobile device 128 (e.g., connected via Bluetooth, NFC, WIFI direct, or other wireless connection) or an alternative Bluetooth-enabled device 252. The mobile device 128 can be a mobile phone, smart phone, wearable device / sensor, or other portable electronic device that can communicate with the in-vehicle computing system via wired and / or wireless communication. Other external devices include an external service 246. For example, the external devices can include a vehicle-external device that is separate from the vehicle and located outside of the vehicle. Other external devices include an external storage device 254, such as a solid state drive, pen drive, USB drive, etc. The external devices 150 can communicate with the in-vehicle computing system 109 wirelessly or via a connector without departing from the scope of the present disclosure. For example, the external devices 150 can communicate with the in-vehicle computing system 109 via the external device interface 212 over a network 260, a universal serial bus (USB) connection, a direct wired connection, a direct wireless connection, and / or other communication link.

[0033] The external device interface 212 can provide a communication interface to enable the in-vehicle computing system to communicate with a mobile device associated with a contact of the driver. For example, the external device interface 212 can enable a telephone call to be established with a mobile device associated with a contact of the driver and / or a text message (e.g., SMS, MMS, etc.) to be sent to the mobile device (e.g., via a cellular communication network). The external device interface 212 can additionally or alternatively provide a wireless communication interface to enable the in-vehicle computing system to synchronize data with one or more devices in the vehicle (e.g., a mobile device of the driver) via WIFI direct, as described in greater detail below.

[0034] One or more applications 244 can be operable on the mobile device 128. For example, a mobile device application 244 can be operable to aggregate user data regarding a user's interactions with the mobile device. For example, the mobile device application 244 can aggregate data regarding a user's music playlists that are listened to on the mobile device, phone call records (including the frequency and duration of phone calls that the user answers), location information (including locations that the user frequents and the amount of time spent at each location), etc. The application 244 can transmit the collected data to the external device interface 212 via the network 260. In addition, specific user data requests can be received at the mobile device 128 from the vehicle-in computing system 109 via the external device interface 212. The specific data requests can include requests to determine where the user is geographically located, the ambient noise level and / or music genre at the user's location, the ambient weather conditions (temperature, humidity, etc.) at the user's location, etc. The mobile device application 244 can send control instructions to components (e.g., microphones, amplifiers, etc.) or other applications (e.g., a navigation application) of the mobile device 128 to enable the requested data to be collected on the mobile device or requested adjustments to be made to the components. The mobile device application 244 can then relay the collected information back to the vehicle-in computing system 109.

[0035] Likewise, one or more applications 248 can be operable on the external service 246. For example, an external service application 248 can be operable to aggregate and / or analyze data from multiple data sources. For example, the external service application 248 can aggregate data from one or more social media accounts of a user, data from the vehicle-in computing system (e.g., sensor data, log files, user inputs, etc.), data from internet queries (e.g., weather data, POI data), etc. The collected data can be transmitted to another device and / or analyzed by the application to determine a context of the driver, the vehicle, and the environment and perform actions based on the context (e.g., request / send data to other devices).

[0036] The vehicle control system 230 can include controls for controlling aspects of various vehicle systems 231 involved in different vehicle functions. These can include, for example, controlling aspects of a vehicle audio system 232 for providing audio entertainment to vehicle occupants, controlling aspects of a climate control system 234 for satisfying cabin cooling or heating needs of vehicle occupants, and controlling aspects of a telecommunication system 236 for enabling vehicle occupants to establish telecommunication links with other people.

[0037] The audio system 232 can include one or more acoustic reproducing devices, including electromagnetic transducers such as speakers 235. The vehicle audio system 232 can be passive, or active such as by including power amplifiers. In some examples, the in-vehicle computing system 109 can be the only audio source for the acoustic reproducing devices, or there can be other audio sources (e.g., external devices such as mobile phones) connected to the audio reproduction system. Any such external device connections to the audio reproduction devices can be analog technology, digital technology, or any combination of analog and digital technology.

[0038] The climate control system 234 can be configured to provide a comfortable environment within the cabin or passenger compartment of the vehicle 102. The climate control system 234 includes components that enable controlled ventilation, such as vents, heaters, air conditioners, integrated heater and air conditioner systems, etc. Other components connected to the heating and air conditioning equipment can include a windshield defroster and defogger system capable of clearing the windshield, and a ventilation air filter for cleaning outside air entering the passenger compartment through fresh air inlets.

[0039] The vehicle control system 230 can also include controls for adjusting settings of various vehicle controls 261 (or vehicle system control elements) related to the engine and / or auxiliary elements within the vehicle cabin, such as steering wheel controls 262 (e.g., steering wheel mounted audio system controls, cruise control, windshield wiper controls, headlight controls, turn signal controls, etc.); instrument panel controls; microphones; accelerator / brake / clutch pedals; shift lever; door / window controls in the driver or passenger doors; seat controls; cabin light controls; audio system controls; cabin temperature controls, etc. The vehicle controls 261 can also include internal engine and vehicle operation controls (e.g., engine controller modules, actuators, valves, etc.) configured to receive instructions via the vehicle’s CAN bus to change the operation of one or more of the engine, exhaust system, transmission, and / or other vehicle systems. The control signals can also control audio output at one or more speakers 235 of the vehicle’s audio system 232. For example, the control signals can adjust audio output characteristics such as volume, equalization, audio image (e.g., audio signal configuration that produces audio output that appears to a user to originate from one or more defined locations), audio distribution between multiple speakers, etc. Likewise, the control signals can control the vents, air conditioners, and / or heaters of the climate control system 234. For example, a control signal can increase the delivery of cool air to a particular section of the cabin.

[0040] Control elements located outside the vehicle (e.g., controls for safety systems) may also be connected to the computing system 109, for example, via communication module 222. The control elements of the vehicle control system may be physically and permanently located on and / or within the vehicle for receiving user input. In addition to receiving control commands from the computing system 109 within the vehicle, the vehicle control system 230 may also receive input from one or more external devices 150 operated by the user (such as from the mobile device 128). This allows for control of various aspects of the vehicle system 231 and vehicle controls 261 based on user input received from the external devices 150.

[0041] The in-vehicle computing system 109 may also include an antenna 206. Antenna 206 is shown as a single antenna, but in some embodiments it may include one or more antennas. The in-vehicle computing system may obtain broadband wireless internet access via antenna 206 and may also receive broadcast signals such as radio, television, weather, traffic, etc. The in-vehicle computing system may receive location signals, such as GPS signals, via one or more antennas 206. The in-vehicle computing system may also receive wireless commands via FR, such as via antenna 206 or via infrared or other means through a suitable receiving device. In some embodiments, antenna 206 may be included as part of audio system 232 or telecommunications system 236. Additionally, antenna 206 may provide AM / FM radio signals to external device 150 (e.g., to mobile device 128) via external device interface 212.

[0042] Users can control one or more components of the computing system 109 in the vehicle via user interface 218. User interface 218 may be included on a touchscreen, such as... Figure 1 The touchscreen 108 displays a graphical user interface and / or user-actuated buttons, switches, knobs, dials, sliders, etc. For example, user-actuated elements may include steering wheel controls, door and / or window controls, dashboard controls, audio system settings, climate control system settings, etc. Users can also interact with one or more applications of the vehicle's computing system 109 and mobile device 128 via the user interface 218. In addition to receiving the user's vehicle setting preferences on the user interface 218, vehicle settings selected by the vehicle's control system can be displayed to the user on the user interface 218. Notifications and other messages (e.g., received messages) and navigation assistance can be displayed to the user on the user interface's display. User preferences / information and / or responses to presented messages can be executed via user input to the user interface.

[0043] Figure 3is a block diagram of a vehicle 102 including an example audio or sound processing system (AS) 302, which can include any one or combination of the sound processing systems and methods described below. The vehicle 102 includes doors 304, a driver's seat 309, a passenger seat 310, and a rear seat 312. While a four-door vehicle is shown as including doors 304-1, 304-2, 304-3, and 304-4, the audio system (AS) 102 can be used in vehicles having more or fewer doors. The vehicle 102 can be a car, truck, boat, etc. While only one rear seat is shown, larger vehicles can have multiple rows of rear seats. Smaller vehicles can have only one or more seats. While a particular example configuration is shown, other configurations can be used, including configurations having fewer or additional components.

[0044] The audio system 302, which can include amplifiers and / or other audio processing devices for receiving, processing audio, and / or outputting audio to one or more speakers of the vehicle, can improve the spatial characteristics of a surround sound system. The audio system 302 supports the use of a variety of audio components, such as a radio, a CD, a DVD, derivatives thereof, etc. The audio system 302 can use 2-channel source material, such as direct left and right channels, 5.1 channels, 6.2 channels, 7 channels, 12 channels, and / or discrete source material from a matrix decoder encoded / decoded digitally, etc. The audio system 302 utilizes channels for TI / HWL sound only and separate from channels for the rest of the sound, including one or more of the rest of the warning sound, media sound, navigation sound, and telephony / telematics sound.

[0045] The amplitude and phase characteristics of the source material and the reproduction of specific sound field characteristics in the listening environment play a key role in successfully reproducing a surround sound field.

[0046] In at least one example, the audio system 302 can improve the reproduction of a surround sound field by controlling sound delay times, surround upmixer parameters (e.g., wrap, reverberation space size, etc.), amplitudes, phases, and mixing ratios between discrete and passive decoder surround signals and / or direct two-channel output signals. The amplitudes, phases, and mixing ratios can be controlled between the discrete and passive decoder output signals. All seated position spatial sound field reproduction can be improved by redirecting direct, passive, and active mixing and steering parameters, especially in a vehicle environment.

[0047] Mixing and steering ratios and spectral characteristics can be adaptively modified in accordance with noise and other environmental factors. In a vehicle, information from a data bus, microphones, and other transducers can be used to control mixing and steering parameters.

[0048] The vehicle 102 has a front center speaker (CTR speaker) 324, a front left speaker (FL speaker) 313, a front right speaker (FR speaker) 315, and at least one pair of surround speakers.

[0049] The surround speakers can be a left side speaker (LS speaker) 317 and a right side speaker (RS speaker) 319, a left rear speaker (LR speaker) 329 and a right rear speaker (RR speaker) 330, or a combination of speaker sets. Other speaker sets can be used. Although not shown, there can be one or more dedicated subwoofers or other drivers. Possible subwoofer mounting locations include the cargo area 305, under the seats, or the rear window shelf 308. The vehicle 102 can also have one or more microphones 350 mounted inside.

[0050] Each CTR speaker, FL speaker, FR speaker, LS speaker, RS speaker, LR speaker, and RR speaker can include one or more transducers of a predetermined range of frequency response, such as a tweeter, a midrange, or a woofer. The tweeter, midrange, or woofer speakers can be mounted adjacent to each other in substantially the same location or different locations. For example, the FL speaker 313 can be a tweeter located in the door 304-1 or elsewhere at approximately the same height as the side view mirror or higher. On the right side of the vehicle (e.g., in the door 304-2), the FR speaker 315 can have a similar arrangement as the FL speaker 313.

[0051] The LR speaker 329 and the RR speaker 330 can each be a woofer mounted in the rear window shelf 308. The CTR speaker 324 can be mounted in the front dashboard 307, in the headliner, on or near the rearview mirror, or elsewhere in the vehicle 102. In other examples, other configurations of amplifiers with other frequency response ranges are possible. In some embodiments, additional speakers can be added to the upper pillars in the vehicle to enhance the height of the sound image. For example, the upper pillars can include vertical or near-vertical supports to the area of the car windows. In some examples, additional speakers can be added toward the upper area of the “A” pillar in the front direction of the vehicle.

[0052] Turning now to Figure 4A , one example of an activity control 400 is shown. The activity control 400 can be displayed on a touchscreen (e.g., 108 of FIG. 1) or a mobile device 128. Alternatively, the activity control 400 can be implemented as a web page that is accessed by a user via a web browser. Figure 1 Figure 2 ​three-dimensional device that controls a portion of the audio system 232 of the vehicle 100. In this example, the active control 400 takes the form of a slider control that includes a slider bar 402 and a slider bar guide 422. However, in other examples, the active control 400 can be implemented in the form of a rotary knob or other known user input device without departing from the scope or intent of this specification. The position or state of the active control 400 can refer to the position or state of the slider bar 402.

[0053] The human user 403 can move the slider bar 402 longitudinally along the length of the slider bar guide 422 as indicated by the arrow 404. The slider bar 402 can be moved to the left limit 420 or the right limit 424 to adjust the sound activity that can be associated with a particular scene that can be shown on the display 111 of the vehicle 100. For example, the user can wish to relax by listening to pre-recorded sounds of rain falling, waves crashing on a shore, or water flowing along a stream. The user can select which sound to play back on the vehicle speakers and a visual representation of the sound can be shown on the display panel. The properties of the selected sound to be played back on the vehicle speakers can be adjusted according to the position of the slider bar 402 or the operational state of the active control as described in more detail in the description of Figure 1 Figures 4B-6

[0054] The slider bar 402 can be at a base position when moved to the left limit 420. The slider bar 402 can be fully advanced when moved to the right limit 424. In one example, when the slider bar 402 is at the left limit 420, the lowest level of output of the controlled sound or feature can be output. When the slider bar 402 is at the right limit 424, the maximum or highest level of output of the controlled sound or feature can be output.

[0055] Referring now to Figure 4B , the active control 400 is shown to include a plurality of control regions. In this example, the active control 400 includes three control regions; however, in other examples, the actual total number of control regions can be greater than three or less than three. Furthermore, in this example, the control regions each include approximately one-third of the length of the slider bar guide 422, but the control regions can be adjusted according to other dimensions if desired. The control range or authority range of the active control 400 is indicated by the arrow 425 and it spans the three control regions.

[0056] A first control region 490 of the slider bar 402 begins at the left limit 420 of the slider bar guide 422 and it ends at the vertical line 430. The guide line 410 shows the range of the first control region 490. The slider bar 402 is shown in the first control region 490, thus in Figure 1 the computing system 109 shown in Figure 2 ​​The audio system 232 shown can play back sounds digitally stored in non-volatile memory, including a first set of sounds associated with a specific theme, scene, or landscape selected by a user. The theme can be a mood or state of mind conveyed (e.g., relaxation, high emotional energy, happiness, etc.). The sounds can be played back or broadcast via loudspeakers in a vehicle. The first set of sounds can be characterized as steady-state sounds. Steady-state sounds can include (but are not limited to) the sound of falling raindrops, waves lapping against the shore, the chirping of crickets, the sound of wind, and other sounds characteristic of a predetermined capture pattern or the nature of a selected theme, scene, or landscape. Steady-state sounds can be perceived as continuous by the user.

[0057] The position of the slider 402 within the first control region 490 defines the volume or sound power output level of the speaker and the playback frequency or density of steady-state sounds included in a selected scene or landscape. For example, if the slider is located at the left limit of the slider guide 422, steady-state sounds in a selected subject, scene, or landscape can be played back at a low repetition frequency (e.g., a sequence of rain sounds retrieved from memory can be repeated at a rate of 0.03 Hz) and a very low volume or sound power output level. If the slider 402 is moved to the right and stopped before entering the second control region 491, the same steady-state sounds can be played back at a higher frequency (e.g., 0.1 Hz) and a low volume or sound power level. Therefore, when the slider 402 is moved from left to right while it is in the first control region, the amount of sound power and the playback frequency of steady-state sounds increase.

[0058] The second control area 491 of the slider 402 begins at vertical line 430 and ends at vertical line 432. Guide line 412 indicates the extent of the second control area 491. In one example, when the slider 402 enters the second control area 491, the steady-state sound volume or sound power output remains at its most recent level, and the steady-state sound playback frequency remains at its most recent level. Figure 1 The computing system 109 shown in the figure or Figure 2 The audio system 232 shown can begin playing back sounds stored in non-volatile memory, including sounds from a second set of sounds associated with a selected specific subject, scene, or landscape. The sounds can be played back or broadcast via loudspeakers in a vehicle. The second set of sounds can be characterized as dynamic sounds. Dynamic sounds may include (but are not limited to) bird calls, distant thunder, owl calls, and similar sounds mimicking wildlife and fauna included in the selected subject, scene, or landscape. Dynamic sounds may have discontinuous perceived characteristics.

[0059] The position of the slider 402 within the second control area 491 can define the volume or sound power output level of the speaker and the playback frequency or density of dynamic sounds included in a selected theme, scene, or landscape. For example, if the slider 402 is exactly to the right of line 430, steady-state sounds in the selected theme, scene, or landscape can be played back according to their repetition frequency and volume or sound power output as when the slider 402 reaches the position of line 430. When the slider 402 is exactly to the right of line 430, dynamic sounds in the selected theme, scene, or landscape can be played back at a low repetition frequency and low volume or sound power output.

[0060] If the slider 402 moves to the right and stops just before reaching the position of the vertical line 432, the steady-state sounds in the selected theme, scene, or landscape can continue to be played back at their repetition frequency and volume or sound power output as when the slider 402 reached the position of line 430. The dynamic sounds in the selected theme, scene, or landscape can be played back at a higher repetition frequency and a higher volume or sound power output than when the slider 402 was just to the left of line 430.

[0061] The third control region 492 of the slider 402 begins at the vertical line 432 and ends at the right limit 424 of the slider guide 422. Guide line 414 indicates the extent of the third control region 492. In one example, when the slider 402 enters the third control region 492, the volume or sound power output of the steady-state and dynamic sounds can be maintained at their most recent levels, and the playback frequency of the steady-state and dynamic sounds can be maintained at their most recent levels. Figure 1 The computing system 109 shown in the figure or Figure 2 The audio system 232 shown can begin playing back sounds stored in non-volatile memory, including a third set of sounds associated with a selected specific theme, scene, or landscape. The sounds can be played back or broadcast via loudspeakers in a vehicle. The third set of sounds can be characterized as surreal sound elements. Surreal sound elements may include (but are not limited to) wolf howls, deer calls, thunderclaps, and other unnatural sounds intended to enhance the user's emotional response to the selected theme, scene, or landscape.

[0062] The position of the slider bar 402 within the third control region 492 can define the volume or sound power output level of the speakers and the playback frequency or density of the surrealistic sound included in the selected theme, scene, or landscape. For example, if the slider bar 402 happens to be positioned to the right of the line 432, the steady-state sound and dynamic sound in the selected theme, scene, or landscape can be played back at their repetition frequency and volume or sound power output at the position of the slider bar 402 when it reached the line 432. When the slider bar 402 happens to be positioned to the right of the line 432, the surrealistic sound in the selected theme, scene, or landscape can be played back at a low repetition frequency and a low volume or sound power output.

[0063] If the slider bar 402 is moved to the right and happens to stop before the slider bar reaches the limit 424 of the slider bar guide 422, the steady-state sound elements and dynamic sound in the selected theme, scene, or landscape can continue to be played back at their repetition frequency and volume or sound power output at the position of the slider bar 402 when it reached the line 432. The surrealistic sound in the selected theme, scene, or landscape can be played back at a higher repetition frequency and a higher volume or sound power output than when the slider bar 402 happens to be positioned to the right of the line 432.

[0064] Thus, the only active control can be the basis for increasing the complexity of the sound generated via the computing system 109 shown in Figure 1 or the audio system 232 shown in Figure 2 Moreover, the volume and intensity of the sound generated and broadcast by the speakers can be adjusted via the same active control by defining the control region of the active control.

[0065] Referring now to Figure 4C , an example is shown in which two active controls are included in the system of Figures 1-3 The active control 400 is the same active control shown in Figure 4A and Figure 4B Moreover, the active control 400 includes the same previously mentioned control regions 490-492. The active control 400 also includes the same slider bar 402 and slider bar guide 422. The active control 400 is operable and provides the previously described functionality.

[0066] The second active control 450 includes a slider bar 452 and a slider bar guide 460. The slider bar 452 can be moved left and right longitudinally along the slider bar guide 460 by the user 403, as indicated by arrow 454, and between a left limit 462 and a right limit 464. In this example, the second active control 450 has a control range or authority range 475 that is subdivided into two control regions 470 and 472, although the authority range 475 can be subdivided into additional control regions if desired. In one example, a surround sound control parameter can be adjusted depending on the position of the slider bar 452 and the control region in which the slider bar 452 is located. For example, when the slider bar 452 is located in the first control region 470, a center spread can be increased as the slider bar 452 is moved from the limit 462 toward a vertical line 499. Increasing the center spread can change the sound distribution from the center speaker to the left and right front speakers. When the slider bar 452 reaches the position of the vertical line 499, the center spread can reach a maximum level. If the slider bar is moved into the second control region 472, the levels of the upmix channels can be adjusted. For example, the levels of the upmix channels can be increased as the slider bar 452 is moved from the vertical line 499 toward the limit 464. The second active control 450 can also adjust other surround sound control parameters, such as space size simulation, delay time, and dynamic compression. In addition, the second active control 450 can adjust the sound control parameters for vehicle-specific sound control parameters. For example, the second active control 450 can adjust the delivery of sound to the speakers to improve sound reception for specific passengers (e.g., front driver, front passenger, etc.).

[0067] In one example, the second active control 450 can adjust the positioning of specific sounds to different areas of the vehicle. For example, the second active control can adjust the sound distribution and / or location within each vehicle zone (e.g., left front passenger, right front passenger, etc.) differently for different sound group regions, such as steady-state sound elements, dynamic sound elements, and / or surreal sound elements. The user input control can thus provide adjustments to the vehicle zones to provide different control of each of the different group regions in each of the vehicle zones. In another example, the user input control can provide movement of only one of the group regions, such as the steady-state sound elements, from one zone to another.

[0068] Thus, an active control can be assigned to adjust more than one sound control parameter. In addition, two or more active controls can be provided to further improve system flexibility and user experience. In this way, one or more functions can be assigned to a single active control to reduce the number of user inputs, thereby reducing the perceived system complexity by the user.

[0069] Figures 1-4CA system of the present disclosure provides a vehicle sound system, the sound system comprising: one or more speakers; and a controller electrically coupled to the one or more speakers, the controller comprising executable instructions stored in a non-transitory memory that cause the controller to increase a frequency of occurrence and an audible level of sound generated via the one or more speakers as a function of a state of a user control. The system comprises, wherein the user control comprises an operating range subdivided into a plurality of sound group regions, each of the plurality of sound group regions comprising one or more sounds unique to one sound group region within the plurality of sound group regions, and wherein the one or more speakers are comprised within a vehicle passenger cabin. The system further comprises additional executable instructions that: when the user control is located in a first sound group region of the plurality of sound group regions, generate sound from only a first set of sounds comprised in the first sound group region. The system further comprises additional executable instructions that: when the user control is located in a second sound group region of the plurality of sound group regions, generate sound from only a first set of sounds and a second set of sounds comprised in the first sound group region and the second sound group region. The system further comprises additional executable instructions that: when the user control is located in a third sound group region, generate sound from the first set of sounds, the second set of sounds, and a third set of sounds. The system further comprises additional executable instructions that: increase a sound level of the generated sound as a function of a location of the user control.

[0070] Referring now to Figure 5 , a graph is shown that illustrates how audio properties of sound can be modified as a function of a state of an activity control or a user interface change. The graph illustrates how a computing system 109 shown in Figure 1 or an audio system 232 shown in Figure 2 can adjust sound according to the method of Figure 6 and the system of Figures 1-4A .

[0071] The first graph from the top of Figure 5 is a graph of sound output power amplitude or volume versus activity control region (e.g., 490-492). The vertical axis represents the sound output power amplitude of sounds included in a first set (e.g., steady state sound) of sounds associated with a first control region of an activity control. The sound output power amplitude increases in the direction of the vertical axis arrow. The horizontal axis represents the activity control region and is broken down into three regions as shown in Figure 4B . The trace 502 represents the output power amplitude or volume of sounds included in the first set of sounds.

[0072] From Figure 5The second graph at the top is a graph of the sound playback frequencies (e.g., the frequencies at which sounds are repeated when broadcast via a speaker) of the sounds included in the first set of sounds relative to the active control area. The vertical axis represents the playback frequencies of the sounds included in the first set of sounds associated with the first control area of ​​the active control. The horizontal axis represents the active control area, and the active control area is decomposed as follows: Figure 4B The three regions are shown. Trace 504 represents the sound playback frequency of the sound included in the first group of sounds.

[0073] from Figure 5 The third curve at the top is a graph of the sound output power amplitude or volume relative to the active control area. The vertical axis represents the sound output power amplitude of the sounds included in the second set of sounds (e.g., dynamic sounds) associated with the second control area of ​​the active control. The sound output power amplitude increases in the direction of the arrow on the vertical axis. The horizontal axis represents the active control area, and the active control area is decomposed as follows: Figure 4B The three regions are shown. Trace 506 represents the output power amplitude or volume of the sound included in the second set of sounds.

[0074] from Figure 5 The fourth curve at the top is a graph showing the playback frequency of the sounds included in the second set of sounds relative to the active control area. The vertical axis represents the playback frequency of the sounds included in the second set of sounds associated with the second control area of ​​the active control. The horizontal axis represents the active control area, which is decomposed as follows: Figure 4B The three regions are shown. Trace 508 represents the sound playback frequency of the sound included in the second set of sounds.

[0075] from Figure 5 The fifth curve at the top is a graph of the sound output power amplitude, or volume, relative to the active control area. The vertical axis represents the sound output power amplitude of the sounds included in the third group of sounds (e.g., surreal sounds) associated with the third control area of ​​the active control. The sound output power amplitude increases in the direction of the arrow on the vertical axis. The horizontal axis represents the active control area, and the active control area is decomposed as follows: Figure 4B The three regions are shown. Trace 510 represents the output power amplitude or volume of the sound included in the third group of sounds.

[0076] from Figure 5 The sixth curve at the top is a graph showing the playback frequency of the sounds included in the third group of sounds relative to the active control area. The vertical axis represents the playback frequency of the sounds included in the third group of sounds associated with the third control area of ​​the active control. The horizontal axis represents the active control area, which is decomposed as follows: Figure 4BThe three regions are shown. Trace 512 represents the sound playback frequency of the sound included in the third group of sounds.

[0077] from Figure 5 The seventh curve at the top is a graph of the active control's state or position relative to the active control area. The vertical axis represents the state or position of the active control (e.g., slider 402), and the active control moves from left to right in the direction of the arrow on the vertical axis. The horizontal axis represents the active control area, and the active control area is decomposed as follows: Figure 4B The three areas shown. Trace 514 indicates the state or position of the active control.

[0078] On the far left of the graph, the active control is located at the first limit of the active control (e.g., Figure 4A (420). The active control is located in the first control area, therefore the sound output power amplitude or volume and sound playback frequency of the sounds included in the second and third sound groups are zero. When the position of the active control moves from the left to the right of the curve, the sound output power amplitude of the sounds included in the first sound group increases. Similarly, when the active control moves from the left to the right of the curve, the playback or repetition frequency of the sounds included in the first sound group increases. When the active control reaches the position of the vertical line L1, the sound output power amplitude of the sounds included in the first sound group stops increasing. Similarly, when the active control reaches the position of the vertical line L1, the playback or repetition frequency of the sounds included in the first sound group stops increasing.

[0079] Continuing to move the control from left to right on the graph, the sound output power amplitude and playback frequency of the sounds included in the first group remain constant. As the active control moves from position L1 to position L2 on the vertical line, the sound output power amplitude of the sounds included in the second group increases. Similarly, the playback or repetition frequency of the sounds included in the second group increases as the active control moves from position L1 to position L2. The sound output power amplitude and playback frequency of the sounds included in the third group remain zero. When the active control reaches position L2 on the vertical line, the sound output power amplitude of the sounds included in the second group stops increasing. Similarly, when the active control reaches position L2 on the vertical line, the playback or repetition frequency of the sounds included in the second group stops increasing.

[0080] After the sound activity control reaches the position of line L2, the sound output power amplitude and playback frequency of the sounds included in the first and second groups remain constant. As the position of the activity control moves from the position of the vertical line L2 toward the activity control limit (e.g., ...), ... Figure 4Athe third set of sounds. Likewise, when the activity control is moved from the position of the vertical line L2 to the activity control limit (e.g., the end of the sound bar 402), the playback or repetition frequency of the sounds included in the third set of sounds is increased. In this way, sounds from different sound sets can be mixed together as the activity control changes position or state. Further, the frequency of repeating sounds can be increased or decreased as the position of the activity control is changed. Thus, a wide variety of sounds can be generated via a single activity control to improve the user experience. Figure 4A the third set of sounds. Likewise, when the activity control is moved from the position of the vertical line L2 to the activity control limit (e.g., the end of the sound bar 402), the playback or repetition frequency of the sounds included in the third set of sounds is increased. In this way, sounds from different sound sets can be mixed together as the activity control changes position or state. Further, the frequency of repeating sounds can be increased or decreased as the position of the activity control is changed. Thus, a wide variety of sounds can be generated via a single activity control to improve the user experience.

[0081] In this way, sounds from different sound sets can be mixed together as the activity control changes position or state. Further, the frequency of repeating sounds can be increased or decreased as the position of the activity control is changed. Thus, a wide variety of sounds can be generated via a single activity control to improve the user experience.

[0082] Figure 6 A flowchart illustrating an example method 600 for adjusting audio output (e.g., in a vehicle) is shown. The method 600 can be performed by a computing system 109 and / or a combination of a computing system and an audio system, which can include one or more computing systems integrated in a vehicle. For example, the method 600 can be performed by executing instructions stored in a memory of a computing system 109 in the vehicle alone or in combination with one or more other vehicle systems (e.g., an audio controller, a CAN bus, an engine controller, etc.). The computing system 109 can perform the method 600, including adjusting actuators in the real world (e.g., speakers) and performing operations internally that ultimately are the basis for adjusting actuators in the real world. One or more steps included in the method 600 can optionally be performed.

[0083] At 602, the method 600 displays one or more activity controls (e.g., a sound bar 402 shown in Figure 4A At 602, the method 600 displays one or more activity controls (e.g., a sound bar 402 shown in

[0084] At 604, the method 600 receives data from the touchscreen display to determine whether a user is touching the display to indicate a desired state or position of the one or more sound activity controls. The method 600 determines whether a user is attempting to adjust the position of the sound activity controls (e.g., the sound bar 402 shown in Figure 4A At 604, the method 600 receives data from the touchscreen display to determine whether a user is touching the display to indicate a desired state or position of the one or more sound activity controls. The method 600 determines whether a user is attempting to adjust the position of the sound activity controls (e.g., the sound bar 402 shown in

[0085] At 606, the method 600 determines the state or position of the sound activity control from data received from a touchscreen display or other user input device. The method 600 can also subdivide the control range of the sound activity control into multiple control regions, as shown in Figure 4B For example, the control range of the sound activity control can be subdivided based on the actual total number of groups of sound elements (e.g., a first group of sound elements can be steady-state sound elements; a second group of sound elements can be dynamic sound elements; a third group of sound elements can be surreal sound elements) and the physical size of the sound activity control. Thus, if there are three groups of sound elements, the range of the sound activity control can be subdivided into three control regions of equal length, as shown in Figure 4B In other examples, the control regions can vary with or be based on the surround sound control parameter or other sound control parameter. The method 600 can determine the state or position of the sound activity control and which control region the sound activity control is in from data output via the touch panel display or other device. The method 600 proceeds to 608.

[0086] At 608, the method 600 determines a theme, scene, or landscape via receiving a selection from a user input device (e.g., a touchscreen display). The theme, scene, or landscape selection can include, but is not limited to, a desert, a tropical rainforest, a coast, etc. Additionally, in some examples, two or more themes, scenes, or landscapes can be selected, if desired, such that sounds from different themes, scenes, or landscapes can be combined. The method 600 proceeds to 610.

[0087] At 610, the method 600 determines sounds associated with the selected theme, scene, or landscape. The sounds for the selected theme, scene, or landscape can also be grouped. For example, a desert theme can include the sound of a cricket in a first group (e.g., steady-state) of sounds that also includes the sound of a light desert wind and / or the sound of a campfire. The desert theme can also include a bird call in a second group (e.g., dynamic) of sounds that also includes the sound of a distant thunder. Additionally, the desert theme can include a wolf howl in a third group (e.g., surreal) of sounds that also includes the sound of a distant train whistle. Thus, each theme, scene, or landscape can be associated with one or more groups of sounds, and the one or more groups of sounds can be further distinguished by sound element category (e.g., steady-state, dynamic, and surreal). When a theme, scene, or landscape is selected, the sounds can be retrieved from non-volatile memory. Additionally, a visual representation of the selected theme, scene, or landscape can be displayed via the computing system in the vehicle. The method 600 proceeds to 612.

[0088] At 612, the method 600 determines whether the sound activity control is within the first control region based on the output of the user input device. If the method 600 determines that the sound activity control is within the first control region, the answer is yes and the method 600 proceeds to 630. Otherwise, the answer is no and the method 600 proceeds to 614.

[0089] At 614, the method 600 determines whether the sound activity control is within the second control region based on the output of the user input device. If the method 600 determines that the sound activity control is within the second control region, the answer is yes and the method 600 proceeds to 620. Otherwise, the answer is no and the method 600 proceeds to 616.

[0090] It should be noted that while the method 600 includes providing three control regions, the actual total number of control regions can be increased or decreased in a similar manner. Additional categories of sound elements can be added by increasing the number of control regions.

[0091] At 630, the method 600 stops playback or broadcasting of sound from the second set of sound elements and the third set of sound elements. In addition, the method 600 adjusts the sound output power of the sound included in the second set of sound elements and the third set of sound elements to zero. The method 600 also adjusts the playback or repetition frequency of the sound included in the second set of sound elements and the third set of sound elements to a base rate (e.g., the slowest frequency at which the sound can be played back or broadcast via a speaker). Thus, if the sound activity control is moved from the second control region to the first control region by moving the slider bar 402 of FIG. 4 from right to left, the sound included in the second set of sound elements and the third set of sound elements is not played back or broadcast via a speaker. The method 600 proceeds to 632. Figure 4B

[0092] At 632, the method 600 plays (e.g., broadcasts via a speaker) the sound included in the first set of sound elements (e.g., the steady state sound) associated with the selected theme, scene, or landscape and adjusts the volume or sound output power amplitude and the playback or repetition frequency of the sound. The sound output power amplitude can be adjusted in proportion to the position of the activity control when the activity control is within the first control region. For example, if the activity control is moved from left to right, the sound power amplitude or volume can be increased in proportion to the adjustment of the activity control. Likewise, the playback or repetition frequency of the sound included in the first set of sound can be adjusted in proportion to the position of the activity control when the activity control is within the first control region. For example, if the activity control is moved from left to right, the recorded repetition of the sound can be increased in proportion to the adjustment of the activity control. From the top of the first graph and the second graph of FIG. 4, an example of controlling the sound of the first set of sound in this manner is shown between the vertical axis and the vertical line LI. Figure 5 ​​

[0093] It should also be mentioned that the activity control can be configured to make other sound and / or sound system adjustments other than volume and repetition frequency adjustments based on the control region of the activity control. For example, instead of adjusting the sound output power amplitude and repetition frequency of the sounds of a first set of sounds associated with a selected theme, scene, or landscape, the sounds of the first set of sounds can be adjusted in other ways, including but not limited to adjusting the sounds based on surround upmixer tuning parameters, delay times, reverberation, recreated or simulated sound venues (e.g., hall, stadium, movie theater, etc.), simulated distance from the sound source, and zoned sound control locations within a vehicle passenger cabin. As one example, adjusting the activity control location can change a vehicle occupant's sound perception of listening to the chirping sounds of a cricket in the distance to listening to the chirping sounds of a cricket right next to the cricket making the chirping sounds. Also, in the case of two or more activity controls being implemented or realized at the same time in the vehicle or by the computing system 109 in the vehicle, one activity control can adjust the sounds being played back, the volume of the sounds being played back, and the frequency or repetition of the sounds being played back. Another activity control can adjust the surround upmixer tuning parameters and zoned sound control within the vehicle. The method 600 proceeds to exit.

[0094] At 612, the method 600 maintains playing the sounds in the first and second sets of sounds at their current sound output power levels. The method 600 also maintains the repetition rates of the sounds in the first and second sets of sounds at their current frequencies or rates. Thus, if the sound activity control is moved from the second control region to the third control region by moving the slider bar 402 of FIG. 4 from right to left, the sounds included in the first and second sets continue to be played back or broadcast via the speakers as if the sounds were just before entering the third control region. The method 600 proceeds to 614. Figure 4B

[0095] At 614, the method 600 adjusts the volume or output power amplitude and playback or repetition frequency of the sounds included in a third set of sound elements (e.g., surreal sounds) associated with the selected theme, scene, or landscape. The sound output power amplitude can be adjusted in proportion to the location of the activity control when the activity control is located within the third control region. Likewise, the playback or repetition frequency of the sounds included in the third set of sounds can be adjusted in proportion to the location of the activity control when the activity control is located within the third control region.

[0096] At 616, the method 600 adjusts the volume or output power amplitude and playback or repetition frequency of the sounds included in a fourth set of sound elements (e.g., ambient sounds) associated with the selected theme, scene, or landscape. The sound output power amplitude can be adjusted in proportion to the location of the activity control when the activity control is located within the fourth control region. Likewise, the playback or repetition frequency of the sounds included in the fourth set of sounds can be adjusted in proportion to the location of the activity control when the activity control is located within the fourth control region. Figure 5 ​one example of the way in which sounds of the third group of sounds are controlled in the fifth and sixth graphs shown between the vertical line L2 of the graph and the right boundary limit. As mentioned previously, the active control can be configured to make other sound and / or sound system adjustments in addition to volume and repetition frequency adjustments according to the control region of the active control. As one example, adjusting the active control can change the vehicle occupant's perception of listening to a sound of a wolf howling in the distance to listening just next to the wolf that is howling. Additionally, in the case of two or more active controls being implemented or realized at the same time in the vehicle or by the computing system 109 in the vehicle, one active control can adjust the sound being played back, the volume of the sound being played back, and the frequency or repetition of the sound being played back. Another active control can adjust the surround sound upmixer tuning parameters and zone sound control within the vehicle. The method 600 proceeds to exit.

[0097] At 620, the method 600 stops playback of sounds belonging to the third group of sounds and maintains playing the sounds of the first and second groups of sounds at their current sound output power levels. The method 600 also maintains the repetition rate of the sounds in the first group at their current frequency or rate. Thus, if the sound active control is moved from the first control region to the second control region, or from the third control region to the second control region, the sounds included in the first group of sounds continue to be played back or broadcast via the speakers as if the sounds were just before entering the second control region. The method 600 proceeds to 622.

[0098] At 622, the method 600 adjusts the volume or output power amplitude and playback or repetition frequency of sounds included in the second group of sound elements (e.g., dynamic sounds) associated with the selected theme, scene, or landscape. The sound output power amplitude can be adjusted in proportion to the position of the active control when the active control is within the second control region. Likewise, the playback or repetition frequency of sounds included in the second group of sounds can be adjusted in proportion to the position of the active control when the active control is within the second control region. In the case of the active control being moved from the second control region to the third control region, the method 600 proceeds to 624. Figure 5 one example of the way in which sounds of the second group of sounds are controlled in the third and fourth graphs shown between the vertical line LI and the vertical line L2 at the top of the graphs.

[0099] As previously mentioned, the activity control can be configured to make other sound and / or sound system adjustments other than volume and repetition frequency adjustments according to the control region of the activity control. As one example, adjusting the activity control can change a vehicle occupant's perception of listening to a sound of a bird calling from a distance to listening right next to the bird calling. Additionally, in the case of two or more activity controls being implemented or realized at the same time in the vehicle or by the computing system 109 in the vehicle, one activity control can adjust the sound being played back, the volume of the sound being played back, and the frequency or repetition of the sound being played back. Another activity control can adjust surround sound upmixer tuning parameters and zoned sound control. The method 600 proceeds to exit.

[0100] In this way, an activity control can be used to adjust sound and sound control of sound that can be associated with a theme, scene, or landscape. The activity control provides a simplified way of creating a personalized environment within a vehicle or other listening venue.

[0101] Thus, Figure 6 The method of claim 1, wherein generating sound comprises converting electrical signals to sound via one or more speakers, wherein the plurality of regions are sound group regions, wherein the elements are sound. The method of claim 1, wherein a first group of the plurality of sound group regions is a group steady sound element. The method of claim 1, wherein a second group of the plurality of sound group regions is a group dynamic sound element. The method of claim 1, wherein a third group of the plurality of sound group regions is a group surreal sound element. The method of claim 1, further comprising increasing an actual total number of sounds generated according to a position of the user control in the plurality of group regions. The method of claim 1, further comprising increasing an actual total number of sounds generated according to a position of the user control in one of the plurality of group regions. The method of claim 1, wherein the one or more elements comprise surround sound control parameters, and further comprising increasing a sound level according to a position of the user control in the plurality of group regions.

[0102] Figure 6The method further includes a method for generating sound in a vehicle, the method including increasing a frequency of the generated sound and an audible sound level of the generated sound in response to a state of a single user control input device, the sound being generated from a set of sounds stored in a controller memory. The method includes wherein the generated sound is included in a first set of sounds corresponding to a first region of an operating range of the user control. The method further includes adjusting a frequency of a second generated sound and an audible sound level of the second generated sound in response to a position of the single user control input device when the single user control input device is in a second region of the operating range of the user control, the second sound being generated from the set of sounds stored in the controller memory. The method further includes increasing a frequency of a third generated sound and an audible sound level of the third generated sound in response to a position of the single user control input device when the single user control input device is in a third region of the operating range of the user control, the third sound being generated from the set of sounds stored in the controller memory. The method further includes not adjusting the frequency of the second generated sound in response to the single user control input not being in the second region of the operating range. The method further includes not adjusting the frequency of the third generated sound in response to the single user control input not being in the third region of the operating range.

[0103] Referring now to Figure 7 , example scenarios and their associated sound files are shown. Figure 7 Two example scenarios and associated sound files are shown, which can make the sound files available to a user to enhance the user's experience while traveling in a vehicle.

[0104] An example desert scenario 700 is shown. A user can wish to experience the sounds of a desert landscape. The user can select the desert scenario and can be shown a picture or perspective of the desert in a vehicle display screen shown at 111 in Figure 1 . The desert scenario can include a plurality of associated sound files 702-706 stored in a controller non-volatile memory. The associated sound files can be grouped together according to the type of sound or the way the sound is applied via a computing system 109 or audio system 232 in the vehicle. In this example, a first set of sounds 702 can be referred to as steady state elements or sounds. The steady state sounds are, in this example, the sounds of a cricket and the sounds of a campfire. A second set of sounds 704 can be referred to as dynamic elements or sounds. The dynamic sounds are, in this example, the sounds of an owl hooting and the sounds of a bird chirping. A third set of sounds can be referred to as surreal elements or sounds. The surreal sounds are, in this example, the sounds of a distant thunder and the sounds of a wolf howling. Of course, the sets of sounds can be referred to in ways other than steady state, dynamic and surreal if desired. The sound files can be played back or broadcast via speakers, as shown at 703, 705 and 707.Figure 6 as described in the method of

[0105] An example ocean scene 750 is also shown. A user can wish to experience the sound of an oceanfront beach. The user can select the ocean scene and a picture or perspective of the ocean can be shown on the display screen in the vehicle. The ocean scene can include a plurality of associated sound files 752-756 stored in the controller's non-volatile memory. As previously described, the associated sound files can be grouped together. In this example, the first group of sounds 752 can be referred to as the steady state elements or sounds. The steady state sounds in this example are the sound of the waves and the sound of the wind. The second group of sounds 754 can be referred to as the dynamic elements or sounds. The dynamic sounds in this example are the sound of a fish breaking the surface and the sound of a bird calling. The third group of sounds can be referred to as the surreal elements or sounds. The surreal sounds in this example are the sound of a fog horn and the sound of a train whistle. The sound files can be played back or broadcast via the speakers as Figure 6 as described in the method of

[0106] The methods herein can utilize the in-vehicle tuning, mixing, and reproduction processes described above to achieve user control over a variety of nature sounds. In one example, the processes include utilizing reference recordings, sound design reproduction, and in-vehicle upmixing and dynamic routing using the three components such as described herein. As described, in one example, at least some of the reference recording data is obtained from actual scenes where a sound engineer travels to a location and captures a spatially accurate audio / video field recording, and captures the intended "emotional impact" of the scene. In addition, for later stages of the process, local fauna, flora, and wildlife species must be taken into account.

[0107] For sound design reproduction, due to technical constraints of typical field recording equipment, the initial field recording can be reproduced from clean representative audio samples. In some examples, a field recording can contain the sound of an owl calling in the background, but these can also contain wind noise, environmental noise, and generally contain high background noise, making them less suitable for critical listening environments such as premium brand audio vehicles. These sounds can then be reproduced from a library of samples, gathered from clean microphone recordings with the cleaner turned off, or synthesized by some other means.

[0108] Next, regarding in-car upmixing and dynamic routing, the in-car mixing process can be implemented using the sliders described herein. Reproduced samples can be injected into the vehicle signal path downstream of the surround panner (QLI) and upstream of the vehicle channel tuning parameters. This allows for flexible spatial control of the placement of these sounds. Typically three types of sound elements can be generated as described herein: steady-state base elements, dynamic elements, and surreal elements. These three types of elements can then be mixed in the vehicle to reproduce a spatially accurate natural soundscape that captures the spectral content of the space as well as the spatial characteristics and overall emotional impact.

[0109] In this way, it is possible to address the technical challenge of creating a spatially accurate soundscape in a variety of vehicles with reduced storage and selection requirements. Likewise, this addresses the technical challenge of providing a certain tuning capability and flexibility, including a high level of flexibility in the spatial mixing process, which results in a more accurate natural soundscape experience in a car.

[0110] The description of implementations has been presented for purposes of illustration and description. Suitable modifications and alterations are commensurate in light of the above description to those skilled in the art with the above description being incorporated herein by reference. The methods described can be implemented using a combination of one or more logic devices (e.g., processors) executing stored instructions in combination with one or more additional hardware elements such as storage devices, memory, image sensor / lens systems, light sensors, hardware network interfaces / antennas, switches, actuators, clock circuitry, etc. The described methods and associated acts can also be performed in various sequences other than the one described, concurrently, and / or at the same time. Moreover, the described methods can be performed repeatedly. The described systems are exemplary in nature and can include additional elements and / or omit elements. The subject matter of the present disclosure includes all novel and non-obvious combinations and sub-combinations of the various systems and configurations disclosed with other features, functions, and / or properties.

[0111] As used in this application, the recitation of elements or steps in the singular is not exclusionary of the plural unless context clearly dictates otherwise. Moreover, the recitation of "one implementation" or "one example" of a term in this application is not exclusionary of additional implementations of the same term unless context clearly dictates otherwise. The terms "first," "second," and "third," etc. are used merely as labels, and are not intended to impose numerical requirements or a particular spatial or chronological order on their objects. The appended claims particularly point out the subject matter regarded as novel and non-obvious.

Claims

1. A method for generating sound in a vehicle, the method comprising: generating sound according to a position of a single user control, the single user control comprising an operating range subdivided into a plurality of group regions, each of the plurality of group regions being associated with two or more sounds unique to the group region within the plurality of group regions, the single user control being movable between the plurality of group regions; in response to the single user control moving through one of the plurality of group regions, linearly increasing a frequency of a second group of sounds included in a second group region of the plurality of group regions and maintaining a frequency of a first group of sounds included in a first group region of the plurality of group regions.

2. The method of claim 1, wherein generating sound comprises converting electrical signals to sound via one or more speakers, wherein the plurality of group regions are a plurality of sound group regions.

3. The method of claim 2, wherein the first group of sounds are group steady state sounds.

4. The method of claim 3, wherein the second group of sounds are group dynamic sounds.

5. The method of claim 4, wherein a third group of sounds included in a third group region of the plurality of group regions are group surreal sounds.

6. The method of claim 1, further comprising increasing an actual total number of sounds generated according to the position of the single user control in the plurality of group regions.

7. The method of claim 1, further comprising increasing an actual total number of sounds generated according to the position of the single user control in one of the plurality of group regions.

8. A sound system for a vehicle, the sound system comprising: one or more speakers; and a controller electrically coupled to the one or more speakers, the controller comprising executable instructions stored in non-transitory memory that cause the controller to increase a frequency of occurrence and an audible level of sound generated via the one or more speakers according to a position of a single user control, wherein the single user control comprises an operating range subdivided into a plurality of sound group regions, each of the plurality of sound group regions comprising two or more sounds unique to the sound group region within the plurality of sound group regions, the single user control being movable between the plurality of sound group regions; the executable instructions causing the controller to, in response to the single user control moving through one of the plurality of sound group regions, linearly increase a frequency of a second group of sounds included in a second sound group region of the plurality of sound group regions and maintain a frequency of a first group of sounds included in a first sound group region of the plurality of sound group regions.

9. The system of claim 8, wherein the one or more speakers are included within a passenger cabin of a vehicle.

10. The system of claim 9, further comprising additional executable instructions that generate sound from only a first group of sounds included in a first sound group region of the plurality of sound group regions when the single user control is positioned in the first sound group region.

11. The system of claim 10, further comprising additional executable instructions to generate sound from only the first and second sets of sounds included in the first and second sound group regions when the single user control is located in a second sound group region of the plurality of sound group regions.

12. The system of claim 11, further comprising additional executable instructions to generate sound from the first, second, and third sets of sounds when the single user control is located in a third sound group region.

13. The system of claim 12, further comprising additional executable instructions to increase a sound level of the generated sound in accordance with the location of the single user control.

14. A method for generating sound in a vehicle, the method comprising: increasing a frequency of a generated sound and an audible sound level of the generated sound in response to a location of a single user control input device, the sound being generated from a set of sounds stored in a controller memory, the single user control input device movable between a first region, a second region, and a third region of an operating range thereof, each of the first, second, and third regions associated with its own two or more sounds; wherein the method further comprises, in response to the single user control input device moving through one of the first, second, and third regions, linearly increasing a frequency of a second set of sounds included in the second region and maintaining a frequency of a first set of sounds included in the first region.

15. The method of claim 14, wherein the generated sound is included in a first set of sounds corresponding to the first region of an operating range of a single user control input device.

16. The method of claim 15, further comprising adjusting a frequency of a generated second sound and an audible sound level of the generated second sound in response to a location of the single user control input device when the single user control input device is in the second region of the operating range of the single user control input device, the second sound being generated from the set of sounds stored in a controller memory.

17. The method of claim 16, further comprising increasing a frequency of a generated third sound and an audible sound level of the generated third sound in response to a location of the single user control input device when the single user control input device is in the third region of the operating range of the single user control input device, the third sound being generated from the set of sounds stored in a controller memory.

18. The method of claim 17, further comprising not adjusting the frequency of the generated second sound in response to the single user control input not being in the second region of the operating range.

19. The method of claim 18, further comprising not adjusting the frequency of the third sound generated in response to the single user control input not being in the third region of the operating range.

Images