Method of operating a vehicle system and product thereof

Abstract

The present disclosure relates to a method for operating a vehicle system associated with a vehicle, comprising: receiving, by the vehicle system, audio data, the audio data at least partially representing at least one audio content; determining, by the vehicle system and based on one or more characteristics of the audio content represented by the received audio data, at least one output to be provided to at least one individual present in the vehicle using at least one output function of the vehicle system; the at least one output function is controlled by the vehicle system as a function of the determined output.

Description

Technical Field

[0001] The present disclosure relates to a method for operating a vehicle system of a vehicle. Further embodiments relate to a computer program product, a control unit for a vehicle system, and a vehicle. Background Art

[0002] In-car entertainment systems are a popular way to alleviate boredom and enhance the travel experience for those in the vehicle. Audio-based entertainment, such as audiobooks, news, and music, is a popular choice. However, ensuring driver attention and safety remains crucial.

[0003] Therefore, there is a need for improved approaches for vehicle systems. Summary of the Invention

[0004] According to one aspect of the present disclosure, a method for operating a vehicle system associated with a vehicle is provided. The method includes receiving, via the vehicle system, audio data that at least partially represents at least one audio content. The method also includes determining, via the vehicle system and based on one or more characteristics of the audio content represented by the received audio data, at least one output function of the vehicle system to be provided to at least one individual present in (or within) the vehicle. The method also includes controlling, via the vehicle system, the at least one output function in accordance with the determined output.

[0005] For example, a family on a car ride can follow audio content in the form of a story. This can lead to a more relaxed mood due to the stimulation provided. Furthermore, this provides an opportunity to bond as a family, spark conversation, and build memories during the ride.

[0006] For example, the audio content represented by the received audio data may be provided to at least one other output function of the vehicle system, such as a sound system.

[0007] In the context of the present disclosure, "audio content" may apply to the perceptible acoustic output when audio data is appropriately output to an acoustic output function (e.g., a speaker). Thus, in some examples, "audio content" may apply to anything acoustically represented by the audio data, such as text, speech, or music. Audio content may also include anything that can be derived from the acoustic output of the acoustic output function output to the audio content (e.g., the speaker's volume, emotions, and feelings, etc.). However, in addition to audio content, audio data may also represent information that is not intended to, and / or may even be output in a meaningful way via the corresponding acoustic output function (e.g., metadata, such as file information).

[0008] The method may further include: analyzing, by the vehicle system, audio content represented by the received audio data and extracting one or more characteristics of the audio content. Furthermore, the one or more characteristics may include at least one of the following: (A) a genre of the at least one sequence of audio content represented by the audio data, such as an audiobook, music, or news; (B) a grammatical and / or semantic description of the at least one sequence of audio content represented by the audio data; and (C) one or more pieces of contextual information about the at least one sequence of audio content represented by the audio data. The contextual information may relate to characters, objects, and / or places that appear in the at least one sequence of audio content represented by the audio data.

[0009] For example, the grammatical description of at least one sequence of audio content represented by the audio data may refer to characteristics associated with one or more phrases, one or more sentences and / or one or more paragraphs of the audio content.

[0010] For example, the semantic description of at least one sequence of audio content represented by the audio data may refer to characteristics related to one or more pauses, story and / or context of the audio content.

[0011] In an example, the at least one audio sequence comprises an audio sequence of suitable length for the purpose of performing the corresponding analysis. In some examples, the sequence has a length between 1 second and 100 seconds (e.g., between 1 second and 60 seconds or between 1 second and 30 seconds). The sequence can have a length of at least 1 second and / or at most 100 seconds. For example, the sequence can include a suitable number of phrases, sentences, and / or paragraphs for the purpose of performing the corresponding analysis.

[0012] In some examples, the method may include periodically receiving and / or analyzing audio data at least partially representing at least one audio content, and periodically extracting characteristics of the audio content, so that a corresponding output that can change over time can be determined based on the set of time-dependent characteristics.

[0013] The context information may relate to or represent one or more keywords, which describe the audio content or at least one sequence of audio content in a concise manner.

[0014] The method may further include determining, by the vehicle system and based at least in part on a first set of characteristics of audio content represented by the received audio data, at least one digital visual content using at least one first output function of the vehicle system, the at least one digital visual content as a first output to be provided to the at least one individual present in the vehicle. The method may then further include controlling, by the vehicle system, the at least one first output function in accordance with the determined first output.

[0015] For example, the digital visual content may include at least one still image and / or at least one video sequence.

[0016] For example, the first set of characteristics of the audio content represented by the received audio data may include one or more pieces of contextual information about at least one sequence of the audio content represented by the audio data.

[0017] The first set of characteristics may also include other information.

[0018] In addition, determining the at least one digital visual content may include: creating, by the vehicle system and at least one prompt based at least in part on a first set of features of the audio content represented by the received audio data; querying, by the vehicle system, an AI model, such as a generative AI model, using the created prompt; and receiving, by the vehicle system, the at least one digital visual content from the generative AI model for use as a first output.

[0019] Thus, the generative AI model can provide, in response to a query, corresponding digital visual content to be provided to one or more individuals via corresponding output functions.

[0020] The generative AI model may be stored by a storage device of the vehicle system. In other examples, the generative AI model may be at least partially stored at a network node external to the vehicle system, such that queries may be performed via some connection link suitable for bidirectional data transmission between the vehicle system and the network node.

[0021] The method may further include determining, by the vehicle system and based at least in part on a second set of characteristics of the audio content represented by the received audio data, at least one ambient light scenario using at least one second output function of the vehicle system, the at least one ambient light scenario being provided as a second output to the at least one individual present in the vehicle. The method may then further include controlling, by the vehicle system, the at least one second output function in accordance with the determined second output.

[0022] For example, an ambient light scheme may include a sequence of light effects over time (with time-dependent light parameters such as color, brightness, hue, saturation, etc.). An ambient light scheme may also include a fixed selection of light parameters without time-dependent adaptation of any of these parameters.

[0023] The ambient light scheme may include at least one ambient light color spectrum (e.g., in which case the second output function may output light having a constant and / or time-dependent color described by the corresponding spectrum) and / or at least one ambient light effect, such as sunrise, dawn, or dusk.

[0024] For example, the second set of characteristics of the audio content represented by the received audio data may include: one or more pieces of context information about at least one sequence of the audio content represented by the audio data,

[0025] The second set of characteristics may also include other information.In some examples, the second set of characteristics may be the same as the first set of characteristics.

[0026] Furthermore, determining the at least one ambient light scenario may include accessing an ambient light database via the vehicle system. The ambient light database may be stored in a storage device of the vehicle system.

[0027] Alternatively or in addition, determining the at least one ambient light scenario may include: creating, via the vehicle system, at least one prompt based at least in part on a second set of characteristics of the audio content represented by the received audio data; querying, via the vehicle system, an AI model, such as a generative AI model, using the created prompt; and receiving, via the vehicle system, the at least one ambient light scenario from the generative AI model as a second output. Thus, the generative AI model may provide, in response to the query, a corresponding ambient light scenario to be provided to the one or more individuals via a corresponding output function.

[0028] The generative AI model may be stored by a storage device of the vehicle system. In other examples, the generative AI model may be at least partially stored at a network node external to the vehicle system, such that queries may be performed via some connection link suitable for bidirectional data transmission between the vehicle system and the network node.

[0029] The method may further include determining, by the vehicle system and based at least in part on a third set of characteristics of the audio content represented by the received audio data, at least one sound scheme using at least one third output function of the vehicle system, the at least one sound scheme being provided as a third output to the at least one individual present in the vehicle. The method may then further include controlling, by the vehicle system, the at least one third output function in accordance with the determined third output.

[0030] For example, a sound scheme may include at least one spatial sound design. In some examples, a corresponding sound scheme may include different sound content for different channels of a corresponding output function. This allows for a multi-dimensional (e.g., 3D) sound experience for each individual in the vehicle.

[0031] For example, the third set of characteristics of the audio content represented by the received audio data may include: one or more pieces of contextual information about at least one sequence of the audio content represented by the audio data.

[0032] The third set of characteristics may also include other information.In some examples, the third set of characteristics may be the same as the first set of characteristics and / or the second set of characteristics.

[0033] Furthermore, determining the at least one sound scheme may include accessing a sound database via the vehicle system. The sound database may be stored in a storage device of the vehicle system.

[0034] Alternatively or in addition, determining the at least one sound scheme may include: creating, via the vehicle system, at least one prompt based at least in part on a third set of characteristics of the audio content represented by the received audio data; querying, via the vehicle system, an AI model, such as a generative AI model, using the created prompt; and receiving, via the vehicle system, the at least one sound scheme from the generative AI model as a third output. Thus, the generative AI model may provide, in response to the query, a corresponding sound scheme to be provided to the one or more individuals via a corresponding output function.

[0035] The generative AI model may be stored by a storage device of the vehicle system. In other examples, the generative AI model may be at least partially stored at a network node external to the vehicle system, such that queries may be performed via some connection link suitable for bidirectional data transmission between the vehicle system and the network node.

[0036] Therefore, in some examples, the method may include: determining, by the vehicle system and based on one or more characteristics of the audio content represented by the received audio data, two or more outputs to be provided to the at least one individual present in the vehicle using at least two output functions of the vehicle system; and controlling, by the vehicle system, the two or more output functions according to the determined outputs. Preferably, if there are N outputs, the vehicle system has means for outputting N outputs on one or more output functions. For example, a different output function may be used for each output. However, at least one output function may also be used for two or even more outputs. In some examples, a single output function may include a monitor and a speaker. In this case, the single output function can serve as both the first and third output functions. This is because the first output can be output to the individual via the monitor, and the third output can be output to the individual via the speaker. Of course, in other examples, the first and second outputs may be output on one single output function, while the third output is output on another third output function. Alternatively, the second and third outputs may be output on one single output function, while the first output is output on another first output function.

[0037] The method may further include obtaining, via a vehicle system, information about at least one of the at least one individual present in the vehicle. For example, the information may be obtained via at least one sensor system of the vehicle system (e.g., at least one camera device or at least one proximity sensor located in one or more seats of the vehicle). For example, the information may be used when adapting at least one corresponding output to meet the preferences of the at least one individual. In some examples, the information may relate to the number of individuals present in the vehicle and / or information related to the type, age, and / or gender of the at least one individual present in the vehicle.

[0038] The obtained information may be obtained based on at least one of real-time sensor data obtainable through a sensor system of the vehicle system, communication data receivable through a communication unit of the vehicle system, and / or historical data storable in a storage device of the vehicle system.

[0039] In addition, the method may include: evaluating the first output, the second output and / or the third output from the perspective of relevance and / or appropriateness for the at least one individual based on the information obtained; and controlling the corresponding at least one output function through the vehicle system according to the result of the evaluation, in particular preventing the corresponding at least one output from being provided to the corresponding at least one output function.

[0040] For example, if the information obtained indicates that a child is present in the vehicle, outputs not suitable for children may be prevented from being provided to the individual via the corresponding output function. Instead, the output may be adapted so as to be suitable for children (e.g., by reducing the maximum volume).

[0041] The method may further include obtaining, via a vehicle system, additional information regarding audio content represented by the audio data, such as at least one audio transcription and / or at least one audio information of the audio content represented by the audio data. The additional information may be used when determining, using the at least one output function (e.g., the first output function, the second output function, and / or the third output function), the at least one output function to be provided to the at least one individual in the vehicle.

[0042] The additional information may be stored by a storage device of the vehicle system. In other examples, the additional information may be at least partially stored at a network node external to the vehicle system, such that the additional information may be obtained via some connection link suitable for bidirectional data transmission between the vehicle system and the network node.

[0043] In some examples, at least one audio transcription may include a script of the audio content (particularly if the audio content relates to a story). In other examples, at least one audio transcription may include lyrics of the audio content (particularly if the audio content relates to a song).

[0044] In some examples, the at least one audio information may include meta-information related to the audio content represented by the audio data. In some examples, the audio information may also include information that cannot be directly derived from the audio content, such as metadata, for example, the author of the audio content, the publisher of the audio content, the publication time of the audio content, and / or the expiration date of the audio content.

[0045] In some examples, the audio information may be a portion of the audio data that is not intended and / or suitable for direct output to the acoustic output function.

[0046] The audio data may be received from at least one audio source. Exemplary audio sources are at least one human-machine interface device, at least one media player device, and / or at least one navigation device.

[0047] The audio data may be received via a suitable data link.

[0048] The first output function may include at least one in-vehicle device having a monitor, the second output function may include at least one light device, and the third output function may include at least one speaker device, preferably a plurality of speaker devices.

[0049] The first output function may be a navigation device or a media player device. The light device may be disposed within the interior of the vehicle. Preferably, multiple light devices are provided as the second output function. Multiple speaker devices may be used to provide spatial sound to the at least one individual.

[0050] The first output function, the second output function and / or the third output function may be respectively the same as an output function for outputting audio content represented by the audio data.

[0051] For example, the method may include outputting audio content represented by the audio data on at least one output function. The output function may include at least one speaker device. In some examples, the output function is the same as the first output function, the second output function, and / or the third output function. Thus, for example, a media player and / or a navigation device (whether in-vehicle or mobile) may be used to provide output related to audio compatibility. The device may also be configured to provide the first output, the second output, and / or the third output.

[0052] According to another aspect of the present disclosure, a computer program product is provided, which includes program code portions that, when executed by a processor of a control unit of a vehicle system associated with a vehicle, cause the control unit to perform the method as provided herein.

[0053] According to another aspect of the present disclosure, a control unit for a vehicle system associated with a vehicle is provided. The control unit includes a processor and a storage device operably coupled to the processor. The storage device stores portions of program code that, when executed by the processor, cause the control unit to perform a method as provided herein.

[0054] According to another aspect of the present disclosure, a vehicle is provided. The vehicle includes a vehicle system, the vehicle system including a control unit as provided herein and one or more output functions operatively coupled to the control unit. BRIEF DESCRIPTION OF THE DRAWINGS

[0055] Further details and advantages of the embodiments will become apparent from the detailed description taken in conjunction with the accompanying drawings, in which:

[0056] Figure 1 is a method for operating a vehicle system of a vehicle according to an embodiment;

[0057] Figure 2 A vehicle having a vehicle system including a control unit according to an embodiment;

[0058] Figure 3 is a control unit for a vehicle system according to an embodiment. DETAILED DESCRIPTION

[0059] Figure 1 A flow chart of a method 100 for operating a vehicle system of a vehicle is shown. In some examples, the method 100 is performed by a control unit of the vehicle system.

[0060] The method 100 includes step 110 of receiving, by a vehicle system, audio data at least partially representing at least one audio content.

[0061] Method 100 further includes step 120 of determining, by the vehicle system and based on one or more characteristics of the audio content represented by the received audio data, at least one output to be provided to at least one individual present in the vehicle using at least one output function of the vehicle system.

[0062] The method 100 further includes step 130 of controlling, by the vehicle system, the at least one output function according to the determined output.

[0063] Figure 2A vehicle 200 is shown schematically and exemplarily. The vehicle 200 includes a vehicle system 210. The vehicle system 210 includes a control unit 220 including a processor 222 and a data storage device 224 operatively connected to the processor 222. The vehicle system 210 further includes Figure 2 2 , sensor system 240 is exemplarily shown. Sensor system 240 includes a camera 240 for monitoring the interior of vehicle 200. The interior of vehicle 200 includes individuals present in vehicle 200, such as driver D and passenger P of vehicle 200. Vehicle system 210 also includes at least one first output function 230, configured to provide a perceptible output (e.g., a visual output) to an individual (e.g., driver D and passenger P). Vehicle system 210 also includes at least one second output function 232, configured to provide a perceptible output (e.g., a light output) to an individual (e.g., driver D and passenger P). Vehicle system 210 also includes at least one third output function 234, configured to provide a perceptible output (e.g., an acoustic output) to an individual (e.g., driver D and passenger P).

[0064] In the example shown, the vehicle system 210 further includes a communication unit 250 adapted to receive and transmit communication signals, such as radio signals, via a communication network to which the vehicle system 210 is wirelessly connected. Each of the output functions 230, 232, 234, the sensor 240, and the communication unit 250 is operable to be operatively connected to the control unit 220.

[0065] The control unit 220 may be configured to receive audio data at least partially representing at least one audio content.

[0066] Control unit 220 can use any type of data available to vehicle system 210 and representing audio content as the corresponding audio data. For example, a media player device provided as an in-vehicle device of vehicle 200 and / or a media player device with one of the at least one individual can serve as a source of the corresponding audio data, with control unit 220 receiving the audio data from this source. Alternatively or in addition, audio data can also be received from a source external to vehicle 200 via communication unit 250.

[0067] The control unit 220 may be configured to determine, based on one or more characteristics of the audio content represented by the received audio data, at least one output to be provided to at least one individual D, P present in the vehicle 200 using at least one output function 230, 232, 234 of the vehicle system 210. The control unit 220 may be configured to control the at least one output function 230, 232, 234 according to the determined output.

[0068] In some examples, control unit 220 can be configured to determine at least one output using a trained machine learning model. Data available to vehicle system 210 (e.g., acquired audio data or any data derived from the audio data) can be provided as input to the trained machine learning model. In some examples, the trained machine learning model is stored via storage device 224. In other examples, the trained machine learning model is at least partially stored at a network node external to vehicle 200, to which control unit 220 is communicatively connected via communication unit 250.

[0069] In some examples, the control unit 220 may also be configured to analyze the audio content represented by the received audio data and extract one or more characteristics of the audio content. Furthermore, the one or more characteristics may include at least one of the following: (A) a type of at least one sequence of audio content represented by the audio data, such as an audiobook, music, or news; (B) a grammatical and / or semantic description of the at least one sequence of audio content represented by the audio data; and (C) one or more pieces of contextual information about the at least one sequence of audio content represented by the audio data.

[0070] For example, the context information may relate to people acting in the story of the audio content or locations where actions mentioned in the story of the audio content occurred.

[0071] In some examples, control unit 220 can be configured to analyze audio content and extract one or more characteristics of the audio content at least in part by using a trained machine learning model. Data available to vehicle system 210 (e.g., acquired audio data) can be provided as input to the trained machine learning model. In some examples, the trained machine learning model is stored via storage device 224. In other examples, the trained machine learning model is at least partially stored at a network node external to vehicle 200, to which control unit 220 is communicatively connected via communication unit 250.

[0072] In some examples, control unit 220 is further configured to determine, based at least in part on a first set of characteristics of the audio content represented by the received audio data, at least one digital visual content as a first output to be provided to the at least one individual present in the vehicle using at least one first output function 230 of vehicle system 210. For example, the first set of characteristics of the audio content represented by the received audio data may include one or more pieces of contextual information about at least one sequence of the audio content represented by the audio data. Control unit 220 may then be further configured to control at least one first output function 230 based on the determined first output.

[0073] In some examples, for determining at least one digital visual content, the control unit 220 can be configured to create at least one prompt based at least in part on a first set of characteristics of the audio content represented by the received audio data. The control unit 220 can then be further configured to query the generative AI model using the created prompt. The control unit 220 can then be further configured to receive the at least one digital visual content from the generative AI model for use as a first output. In some examples, the generative AI model is stored via a storage device 224. In other examples, the generative AI model is at least partially stored at a network node outside the vehicle 200, and the control unit 220 is communicatively connected to the network node via a communication unit 250.

[0074] In some examples, control unit 220 may also be configured to determine, based at least in part on a second set of characteristics of the audio content represented by the received audio data, at least one ambient light scenario (including, in particular, at least one ambient light color spectrum and / or at least one ambient light effect, such as sunrise, dawn, or dusk) using at least one second output function 232 of vehicle system 210. The at least one ambient light scenario may be provided as a second output to the at least one individual present in the vehicle. For example, the second set of characteristics of the audio content represented by the received audio data may include one or more pieces of contextual information regarding at least one sequence of the audio content represented by the audio data. Control unit 220 may then be further configured to control at least one second output function 232 based on the determined second output.

[0075] In some examples, for determining at least one ambient light scenario, the control unit 220 can be configured to access an ambient light database. Alternatively or in addition, for determining at least one ambient light scenario, the control unit 220 can be configured to create at least one prompt based at least in part on a second set of characteristics of the audio content represented by the received audio data. The control unit 220 can then be further configured to query the generative AI model using the created prompt. The control unit 220 can then be further configured to receive the at least one ambient light scenario from the generative AI model for use as a second output. In some examples, the generative AI model is stored via a storage device 224. In other examples, the generative AI model is at least partially stored at a network node outside the vehicle 200, and the control unit 220 is communicatively connected to the network node via a communication unit 250.

[0076] In some examples, control unit 220 may also be configured to determine, based at least in part on a third set of characteristics of the audio content represented by the received audio data, at least one sound scheme using at least one third output function 234 of vehicle system 210, as a third output to be provided to the at least one individual present in the vehicle. For example, the third set of characteristics of the audio content represented by the received audio data may include one or more pieces of contextual information regarding at least one sequence of the audio content represented by the audio data. Control unit 220 may then be further configured to control at least one third output function 234 based on the determined third output.

[0077] In some examples, for determining at least one sound scheme, the control unit 220 can be configured to access a sound database. Alternatively or in addition, for determining at least one sound scheme, the control unit 220 can be configured to create at least one prompt based at least in part on a third set of characteristics of the audio content represented by the received audio data. The control unit 220 can then be further configured to query the generative AI model using the created prompt. The control unit 220 can then be further configured to receive the at least one sound scheme from the generative AI model for use as a third output. In some examples, the generative AI model is stored via a storage device 224. In other examples, the generative AI model is at least partially stored at a network node outside the vehicle 200, and the control unit 220 is communicatively connected to the network node via a communication unit 250.

[0078] Therefore, in an exemplary embodiment, control unit 220 may be configured to determine, based on one or more characteristics of the audio content represented by the received audio data, two or more outputs to be provided to at least one individual D, P in the vehicle using at least two output functions 230, 232, 234 of vehicle system 210. Control unit 220 may then be further configured to control the two or more output functions based on the determined outputs. Preferably, if there are N outputs, vehicle system 210 includes means for outputting N outputs on one or more output functions 230, 232, 234. For example, a different output function may be used for each output (e.g., a first output on a first output function, a second output on a second output function, a third output on a third output function, etc.). However, at least one output function may also be used for two or even more outputs. In some examples, a single output function may include both a monitor device and a speaker device. An example of such an output function is an in-vehicle navigation system. In this case, the single output function may function as both the first and third output functions. This is because the first output can be output to the individual via the monitor of the output function, and the second output can be output to the individual via the speaker of the output function. Of course, in other examples, and generally speaking, the first and second outputs can be output on a single output function, while the third output is output on another third output function. Alternatively, the second and third outputs can be output on a single output function, while the first output is output on another first output function.

[0079] The determined at least one output (particularly the first output, the second output, and / or the third output) is operable to be provided to the individuals D, P present in the vehicle via one or more output functions 230, 232, 234. For example, this can be achieved by the control unit 220 generating a corresponding control signal and outputting the control signal to the corresponding one or more output functions 230, 232, 234.

[0080] In some examples, control unit 220 may also be configured to obtain information regarding at least one of the at least one individuals D and P present in vehicle 200. To this end, control unit 220 may utilize any type of data available to vehicle system 210 and suitable for obtaining corresponding information regarding at least one of the at least one individuals D and P present in vehicle 200. For example, control unit 220 may utilize at least one of the following: real-time sensor data obtainable via sensor system 240 of vehicle system 210, communication data receivable via communication unit 250 of vehicle system 210, and / or historical data stored in storage device 224 of vehicle system 210. Examples of such information may include the number of individuals D and P present in vehicle 200 and / or information related to the type, age, and / or gender of the at least one individual D and P present in the vehicle. For example, sensor 240 may be operable to detect one or more of the aforementioned information in real time. In some examples, image data acquired by camera 240 may be operable to determine the presence of individuals in the vehicle. In other examples, proximity sensors provided in seats of the vehicle 200 may be used as the sensor system, making it possible to detect the presence of individuals present in the vehicle 200 , thereby detecting the number of individuals in the vehicle 200 .

[0081] According to some of the aforementioned examples, the information may be obtained by the vehicle system 210 based on real-time sensor data already obtained by a sensor system (e.g., sensor 240) of the vehicle system 210. Additionally or alternatively, in some examples, the information may be obtained by the vehicle system 210 based on communication data already received via the communication unit 250. Additionally or alternatively, in some examples, the control unit 220 uses historical data, such as stored sensor data and / or stored previous driving trajectories of the vehicle 200 defined by the driver D, where such data may have been stored, for example, via the storage device 224.

[0082] In some examples, the control unit 220 may be further configured to evaluate the first output, the second output, and / or the third output from the perspective of relevance and / or appropriateness for the at least one individual based on the obtained information. The control unit 220 may then be further configured to control the corresponding at least one output function 230, 232, 234 based on the evaluation result, in particular, to prevent the corresponding at least one output from being provided to the corresponding at least one output function 230, 232, 234.

[0083] In some examples, control unit 220 can also be configured to obtain additional information about the audio content represented by the audio data. To this end, control unit 220 can use any type of data available to vehicle system 210 and suitable for obtaining the corresponding additional information. For example, control unit 220 can use data receivable via communication unit 250 of vehicle system 210. Examples of such information can include at least one audio transcription of the audio content represented by the audio data and / or at least one piece of audio information. The additional information can then be used when determining, using at least one output function 230, 232, 234, the corresponding at least one output to be provided to at least one individual D, P present in vehicle 200.

[0084] According to some of the foregoing examples, audio data is received from at least one audio source, such as at least one human interface device, at least one media player device, and / or at least one navigation device.

[0085] According to some of the aforementioned examples, the first output function 230 includes at least one in-vehicle device having a monitor, the second output function 232 includes at least one light device, and / or the third output function 234 includes at least one speaker device, preferably a plurality of speaker devices (which in particular allows providing multi-dimensional sound effects to individuals D, P in the vehicle 200).

[0086] It should be noted that a single device (such as an in-vehicle navigation device and / or an in-vehicle media player device) can simultaneously implement one or more output functions. For example, the in-vehicle navigation device may include a monitor and a speaker, so that the first output function and the third output function can be provided by such a single device.

[0087] According to some of the aforementioned examples, the first, second and / or third output functions 230 , 232 , 234 , respectively, are identical to output functions for outputting audio content represented by the audio data.

[0088] Figure 3 Schematically and exemplarily, a control unit 300 of a vehicle system for a vehicle is shown. The control unit 300 comprises a processor 310 operatively connected to a memory device 320. The control unit 300 may be configured to receive and / or output data signals via one or more interfaces 312, 314, such as Figure 3 Schematically shown in FIG.

[0089] The storage device 320 stores program codes that can be executed by the processor 310. The control unit 300 can be controlled by an onboard control unit (such as Figure 2In other examples, the control unit 300 may be implemented at least partially at one or more network nodes that are in network communication with the onboard vehicle system to receive data from the vehicle system and / or output and transmit generated data to the vehicle system via the communication network.

[0090] The storage device 320 stores a portion of the program code that, when executed by the processor 310, configures the control unit 300 to execute the above-described combined Figure 1 and 2 Describe the operation of any example.

[0091] The storage device 320 stores program code that, through interaction with the processor 310 , constitutes an audio data receiving module 322 for receiving audio data at least partially representing at least one audio content.

[0092] The storage device 320 also stores program code that constitutes an output determination module 324 for determining at least one output to be provided to at least one individual present in the vehicle using at least one output function of the vehicle system based on one or more characteristics of the audio content represented by the received audio data.

[0093] The storage device 320 also stores program codes constituting an output function control module 326 , which is configured to control the at least one output function according to the determined output.

Claims

1. A method for operating a vehicle system associated with a vehicle, characterized in that The method comprises: - receiving, by the vehicle system, audio data, the audio data at least partially representing at least one audio content; - determining, by the vehicle system and based on one or more characteristics of audio content represented by the received audio data, at least one output to be provided to at least one individual present in the vehicle using at least one output function of the vehicle system; - controlling, by the vehicle system, the at least one output function in dependence on the determined output.

2. The method according to claim 1, characterized in that The method comprises: - analyzing, by the vehicle system, audio content represented by the received audio data and extracting one or more characteristics of the audio content; The one or more characteristics include at least one of the following: - the type of at least one sequence of audio content represented by the audio data; - a syntactic and / or semantic description of at least one sequence of audio content represented by said audio data; and / or - one or more pieces of context information regarding at least one sequence of audio content represented by said audio data.

3. The method according to claim 1 or 2, characterized in that The method comprises: - determining, by the vehicle system and based at least in part on a first set of characteristics of audio content represented by the received audio data, using at least one first output function of the vehicle system, at least one digital visual content as a first output to be provided to the at least one individual present in the vehicle, Wherein, the first set of characteristics of the audio content represented by the received audio data includes: one or more pieces of contextual information about at least one sequence of the audio content represented by the audio data; - controlling, by the vehicle system, the at least one first output function in dependence on the determined first output; Wherein, determining the at least one digital visual content comprises: - creating, by the vehicle system and based at least in part on a first set of characteristics of audio content represented by the received audio data, at least one prompt; - querying, via the vehicle system, an AI model using the created prompt, wherein the AI ​​model comprises a generative AI model; - Receiving, by the vehicle system, the at least one digital visual content from the generative AI model for use as the first output.

4. The method according to any one of claims 1 to 3, characterized in that The method comprises: - determining, by the vehicle system and based at least in part on a second set of characteristics of audio content represented by the received audio data, at least one ambient light scenario using at least one second output function of the vehicle system, the at least one ambient light scenario as a second output to be provided to the at least one individual present in the vehicle, Wherein, the second set of characteristics of the audio content represented by the received audio data includes: one or more pieces of contextual information about at least one sequence of the audio content represented by the audio data; - controlling, by the vehicle system, the at least one second output function in dependence on the determined second output; Wherein, determining the at least one ambient light scheme includes: - accessing an ambient light database via the vehicle system; and / or - creating, by the vehicle system and based at least in part on a second set of characteristics of audio content represented by the received audio data, at least one prompt; - querying, via the vehicle system, an AI model using the created prompt, wherein the AI ​​model comprises a generative AI model; - Receiving, by the vehicle system, the at least one ambient light scenario from the generative AI model for use as the second output.

5. The method according to any one of claims 1 to 4, characterized in that The method comprises: - determining, by the vehicle system and based at least in part on a third set of characteristics of audio content represented by the received audio data, at least one sound scheme using at least one third output function of the vehicle system, the at least one sound scheme as a third output to be provided to the at least one individual present in the vehicle, Wherein, the third set of characteristics of the audio content represented by the received audio data includes: one or more pieces of contextual information about at least one sequence of the audio content represented by the audio data; - controlling, by the vehicle system, the at least one third output function in accordance with the determined third output; The determining of the at least one sound scheme includes: - accessing a sound database via said vehicle system; and / or - creating, by the vehicle system and based at least in part on a third set of characteristics of audio content represented by the received audio data, at least one prompt; - querying, via the vehicle system, an AI model using the created prompt, wherein the AI ​​model comprises a generative AI model; - Receiving, by the vehicle system, the at least one sound scheme from the generative AI model for use as the third output.

6. The method according to any one of claims 1 to 5, characterized in that The method comprises: - obtaining, by the vehicle system, information about at least one of the at least one individual present in the vehicle, the information including the number of individuals present in the vehicle.

7. The method according to claim 6, wherein the method comprises: - based on the obtained information, evaluating the first output, the second output and / or the third output from the perspective of relevance and / or appropriateness for the at least one individual; - controlling, by the vehicle system, at least one corresponding output function as a function of the result of the evaluation.

8. The method according to any one of claims 1 to 7, characterized in that The method comprises: - obtaining, by the vehicle system, additional information about the audio content represented by the audio data, the additional information comprising at least one audio transcription and / or at least one audio information of the audio content represented by the audio data, and using the additional information when determining, using at least one output function, a respective output to be provided to the at least one individual present in the vehicle.

9. The method according to any one of claims 1 to 8, characterized in that The audio data is received from at least one audio source, wherein the at least one audio source comprises at least one human-machine interface device, at least one media player device, and / or at least one navigation device.

10. The method according to any one of claims 1 to 9, characterized in that The first output function includes at least one in-vehicle device having a monitor, the second output function includes at least one light device, and / or the third output function includes at least one speaker device.

11. The method according to any one of claims 1 to 10, characterized in that The first output function, the second output function and / or the third output function are respectively the same as output functions for outputting audio content represented by audio data.

12. A computer program product, characterized in that The computer program product comprises portions of program code which, when executed by a processor of a control unit of a vehicle system associated with a vehicle, cause the control unit to perform a method according to any one of claims 1 to 11.

13. A control unit for a vehicle system, characterized in that: The control unit comprises a processor and a storage device operatively coupled to the processor, wherein the storage device stores portions of program code which, when executed by the processor, cause the control unit to perform the method according to any one of claims 1 to 11.

14. A vehicle, characterized in that: The vehicle includes a vehicle system, the vehicle system including: - a control unit according to claim 13, - one or more output functions operatively coupled to the control unit.

Images