Method, device and computer program for varying audio content to be output in a vehicle
Patent Information
- Application Number
- DE102017213252
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2017-08-01
- Publication Date
- 2025-10-16
- Estimated Expiration
- 2037-08-01
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[0001] The invention relates to a method, a device and a corresponding computer program for varying an audio content to be or can be output in a vehicle.
[0002] Modern vehicles can access a variety of different audio sources, which can be played via a multimedia system in the vehicle interior. The audio sources include a radio station, music or audio books from a permanently installed storage device in the vehicle (e.g. a hard drive) or from a device carried in the vehicle. This includes accessing or playing streaming content, e.g. an entertainment program from the Internet. Likewise, a video, a television program, a video game or a video simulation can be output, e.g. via a so-called rear-seat entertainment system. With a vehicle multimedia system, it is known that the volume of the output audio content becomes louder as the background noise increases while driving. An artificially generated engine noise is also increasingly emitted via the speakers of such a multimedia system.Such an engine noise can be part of a specific sound design. In electric vehicles, the artificially generated engine noise serves to create the familiar feeling of combustion engines for the driver through the generated background noise, while also signaling the vehicle's movement or speed.
[0003] DE 10 2015 118 553 A1 describes methods and devices for filtering noise in a vehicle. The methods include generating a microphone signal corresponding to noise in the passenger compartment. The methods also include receiving an audio-based service used by at least one occupant. A noise separation mode is selected from the plurality of noise separation modes. Each noise separation mode corresponds to a different audio filtering method. The method also includes filtering the input received from the microphone according to the selected noise separation mode to generate at least one filtered signal.
[0004] DE 10 2015 206 021 A1 describes a computer system for a vehicle, comprising a computing unit and an output unit. The computing unit comprises a virtualization layer, a central virtual management unit, and at least one virtual signal generator unit. The virtualization layer is designed to operate an operating system of the central virtual management unit on the computing unit in parallel with a respective operating system of the at least one virtual signal generator unit. The at least one virtual signal generator unit is designed to provide a signal representative of an audio signal to be output. The central virtual management unit is designed to control the output of a respective signal of the at least one virtual signal generator unit via the output unit.
[0005] US 2013 / 0028443 A1 describes an audio enhancement system comprising a computer and an output device. The computer includes a sensor configured to determine the user's location relative to the computer. The sensor is further configured to collect environmental data corresponding to an environment of the computer. The computer further includes a processor communicating with the sensor and configured to process the user location and the environmental data and adjust at least one audio or video output. The output device is in communication with the processor and configured to output at least one audio output or one video output.
[0006] In modern vehicles where the vehicle communicates with the occupants via voice output, it is also known to reduce the volume of currently playing audio content when an on-board computer is providing information to the occupants. Such information could be, for example, navigation information, vehicle-related service information, etc.
[0007] In addition, there is typically a need or necessity for the vehicle's occupants to communicate with each other. Such communication, especially verbal communication, can often be of great relevance to the vehicle's user. The ability of the occupants to communicate with each other as undisturbed as possible can at times be much more important to the vehicle's users than the vehicle's technical parameters, such as engine performance, manufacturing quality, vehicle design, or vehicle brand. However, such communication is very often disrupted by a variety of audio content played in the vehicle. Therefore, there is a contradiction between the occupants' desire to hear certain audio content and the desire to speak undisturbed while driving. Furthermore, the occupants of the vehicle, e.g. members of a family, can have very different, sometimes contradictory needs, e.g.regarding active verbal communication or listening to other inmates or to the audio content.
[0008] It is an object of the invention to provide a method, a device and a corresponding computer program which functionally improve the output of audio content, in particular the operation of audio sources in a vehicle.
[0009] These objects are achieved by a method according to the features of claim 1, a computer program according to the features of claim 19 and a device according to the features of claim 20. Advantageous embodiments are specified in the dependent claims.
[0010] A method is proposed for varying audio content to be output in a vehicle, in particular in the interior of the vehicle. The audio content to be output can be multimedia content played via a multimedia system of the vehicle, e.g., an audio signal that can be output in the interior of the vehicle, or data (audio files, streaming content, etc.) that correspond to the audio content. The audio content to be output can correspond to the audio content currently being output or to an outputtable audio content, e.g., one scheduled for output in the near future.
[0011] The multimedia content can be a radio broadcast, a music track, a video, audio content of a video game output via a display unit of the vehicle, and the like. The multimedia content can be output via a number of loudspeakers and / or display units distributed throughout the vehicle's interior, in particular monitors of a rear-seat entertainment system. The loudspeakers can be arranged at various locations within the vehicle's interior in a manner known to those skilled in the art.
[0012] Alternatively or additionally, audio content can be content generated within the vehicle, e.g., depending on the current driving state of the vehicle or the driving context. For example, the audio content can be audio content generated, e.g., using signal synthesis. Such audio content can, for example, serve to implement part of the vehicle's sound design.
[0013] In particular, the audio content can also be an artificially generated engine noise or driving noise. Such an engine noise or an artificially generated driving noise can also be generated for the interior of the vehicle in addition to or dependent on the actual, physical engine noise. The artificially generated engine noise or driving noise can be generated due to a specific sound design or a user request. This can also be output via the vehicle's multimedia system. The artificially generated engine noise or driving noise can be used in particular in vehicles powered by an electric motor. However, it can also be used to convey a specific engine sound in vehicles powered by a combustion engine. Such an engine noise orDriving noise can be generated in the process depending on the actual power output of the vehicle's drive and / or depending on the power requested by the driver from the vehicle's drive (even before the power is actually available).
[0014] The audio content to be output can be a stereo signal, preferably a multi-channel signal, or a surround sound signal, e.g., an encoded one. The audio content to be output can be, for example, in one of the surround sound formats known from home theater applications. Preferably, a surround sound signal corresponding to the audio content can be determined, amplified, and output in the interior of the vehicle, e.g., from the data or data packets of an audio source, according to the features of the invention described below.
[0015] In the method, at least one directional parameter of a verbal communication of at least one occupant of the vehicle is determined, in particular predicted. In the context of this method, the communication is verbal communication, which is also referred to as auditory communication. Preferably, verbal communication relates to communication between at least two occupants of the vehicle. Such communication is, for example, a conversation conducted in the interior of the vehicle. Such a conversation can be a monologue of an occupant or a dialogue between two or more occupants in the vehicle. Such verbal communication between the occupants of the vehicle can be explicitly differentiated in the method from other audio content in the vehicle that includes speech, such as a radio program or an audio book.Vocal communication also differs from an additional audio context audible in the vehicle interior. Such an audio context may include an additional acoustic signal generated in the vehicle interior and / or acoustic content originating from outside the vehicle but audible in the vehicle interior. For example, an audio context may originate from a portable device operable in the vehicle, e.g., a mobile user device carried in the vehicle.
[0016] Preferably, the method determines the occupancy of one or more seats (e.g., by adults, children, so-called child seats, and / or baby seats). Particularly preferably, the method determines the number and / or distribution of the vehicle's occupants across specific seats or seating positions within the vehicle interior and takes this into account in the method.
[0017] In a simplified case, the number and / or distribution of persons present in the vehicle can be determined by evaluating the actuation of corresponding door contacts and / or a seat belt fastening detection system and / or by a sensory, e.g. capacitive, seat occupancy detection system known to those skilled in the art.
[0018] Furthermore, the number and / or distribution of people present in the vehicle can also be determined via the number of mobile user devices detected, in particular localized, in the vehicle interior, e.g. mobile radio devices and / or wearables (e.g. smart watches). Furthermore, the number and / or distribution of people present in the vehicle can be determined using so-called smart closes or near-field communication using NFC (= Near Field Communication) or RFID chips (= Radio Frequency Identification). Identification of the people is not necessary in the method. Nevertheless, identification of specific people can also be carried out, in particular to assign a specific user profile that is relevant for the method. For example, it can also be determined which of the people present is sitting in which seat of the vehicle.
[0019] In particular, it is also possible to determine the assignment of individuals or groups of individuals (e.g., adult, child, baby without a baby seat, baby seat with or without a baby) to specific seating positions or seats within the vehicle. The method can also be applied differently to different groups of individuals. For example, the method can take into account specific audio parameters, such as threshold parameters, that should and / or should not be exceeded in the seating area of a child or baby.
[0020] The directional parameter of a communication can be representative of the direction in which the communication is conducted, for example, it can be representative of one or more directions between one or more speakers and one or more listeners. The directional parameter can also include a parameter that characterizes a specific spatial area, in particular one corresponding to a specific seat, as a spatial area of the "speaker" or as a spatial area of the "listener". The directional parameter can also include a parameter that characterizes whether communication is one-way, two-way, or multidirectional, or (in the case of prediction) will soon be conducted. For example, a distinction can be made as to whether the ongoing or predicted auditory communication is a monologue or a dialogue.Furthermore, the directional parameter may also be indicative of communication that is conducted (by a “speaker”) using a mobile phone or hands-free device and / or is not intended or directed at any other occupants of the vehicle.
[0021] A directional parameter can, for example, represent values that represent spatial areas within the vehicle, angular values, solid angles, etc., and / or the relationships between them, e.g., through vectors. A directional parameter preferably comprises a spatial orientation and / or distribution of acoustic parameters of the communication. This can, for example, be characteristic of the spatial propagation or propagation direction of acoustic waves in speech communication.
[0022] In addition, the directional parameter of a communication in the method can also comprise one or more different parameters of the communication, in particular characteristic of acoustic parameters of auditory communication, such as an amplitude curve of the auditory communication (e.g. an envelope of the amplitude curve) and / or one or more frequency parameters (e.g. energy density spectrum or envelope of the energy density spectrum) and / or one or more phase parameters (e.g. phase differences or phase shifts).
[0023] Preferably, a directional parameter can refer to at least one spatial parameter, in particular one or more specific directions, and can comprise at least one acoustic parameter of the auditory communication that relates to the at least one direction. The directional parameter can establish a relationship, e.g., an assignment or a mathematical function, between one or more specific directions and one or more specific corresponding acoustic parameters of the auditory communication, and this relationship can be taken into account in the method.
[0024] The directional parameter of a communication can be recorded using two or more microphones in the vehicle's interior, e.g., those belonging to a hands-free system. The position of a speaking passenger can be determined, for example, by comparing the phases of the acoustic waves recorded by two or more microphones. Auditory communication (speech) can also be recorded from another conceivable audio context in the vehicle's interior using signal processing. Furthermore, a directional parameter can also be determined based on other vehicle sensors, in particular an interior camera.
[0025] As a further step, at least one parameter of the vehicle's audio content to be output is adjusted. This means that acoustic and / or content parameters of the audio content are controlled, in particular regulated, depending on the at least one directional parameter of the communication between the occupants.
[0026] In particular, a parameter of the audio content to be output is continuously adjusted, e.g., by controlling the parameter at frequently successive time intervals.
[0027] This allows for a spatial redistribution of audio content within the vehicle interior, so that voice communication can be improved, at least in one direction, at least for the recipient of the voice communication. On the other hand, passengers further inside the vehicle may be less affected by the voice communication, provided the communication is not also directed at them.
[0028] In other words, it is detected, for example, which of the vehicle's occupants is speaking or intends to speak, and to whom the speaking occupant's communication is directed. Depending on this, the volume of audio content output via the vehicle's multimedia system is reduced in the spatial area where the recipient of the voice communication is located. Adjusting the audio content parameter can affect a parameter of one or more audio signals to be output.
[0029] The adaptation of the audio content parameter can be performed as an optimization according to one or more predetermined criteria, e.g., user settings. The adaptation can be carried out in such a way that control signals for controlling the vehicle's audio output device, e.g., the multimedia system, are determined in the method. The control signals can be transmitted to the audio output device to carry out the adaptation of the audio content. The method can be applied, in particular simultaneously, to multiple voice communications in the vehicle. For example, it can be applied to different communications that occur simultaneously or at an overlapping time. For example, communications that are conducted between different people and / or addressed to different people can be regarded as different communications.Although this description refers to one communication, it can refer to one, in particular a specific, communication of several communications taking place or possible in the vehicle.
[0030] When the method is applied to at least two communications occurring simultaneously or at an overlapping time, the resulting adaptation of the at least one parameter of the audio content to be output in the vehicle can be carried out taking into account the at least two communications. In this case, the at least two different communications can be taken into account in the method, for example, with different predetermined criteria and / or with different influences on one or more parameters of the audio content to be controlled. Furthermore, the adaptation of the at least one parameter of the at least two different audio contents (e.g., audio contents of different types) can be carried out in a specific, in particular different, way.
[0031] A suitable embodiment provides that at least one directional parameter of linguistic communication - a position of a speaking person in the vehicle, in particular the seat of the speaking person, and / or - the position or positions, in particular the seat or seats, of the person or persons to whom the communication (a specific communication) of the person speaking is addressed, and / or - a spatial direction, in particular as one or more vectors, in which the communication (a specific communication) is conducted, represents.
[0032] The at least one parameter of the audio content can be adapted depending on the at least one directional parameter of the spoken communication in the vehicle. For this purpose, the number of people speaking to each other is determined. In particular, it is determined which of the people is a speaking passenger (speaker) and which of the people is the recipient (listener or target person expected to listen) of the spoken communication of the speaking passenger. Depending on this, one or more audio contents of the vehicle are adapted accordingly.
[0033] The at least one audio content parameter adjusted in the method takes into account, in particular, which occupant is speaking during a specific time interval and which occupant(s) are listening. The at least one audio content parameter adjusted in the method can be selected such that appropriate audibility is ensured at a specific position in the vehicle interior where the listener(s) are located.
[0034] Furthermore, the determined seat occupancy and / or number and / or distribution of the occupants present in the vehicle on certain seats or seating positions within the vehicle interior can be taken into account when determining the at least one directional parameter of the communication and / or when adapting the at least one parameter of the audio content to be output in the vehicle.
[0035] For example, if it is determined that no one is sitting in a particular seat in the vehicle, it can be ruled out that any spoken communication is expected from that spatial direction. Instead, the audio content parameters can be better adapted for at least one other spatial direction.
[0036] For example, if it is determined that no one is sitting in a particular seat in the vehicle, no audio content parameters need to be adjusted for that seat. Instead, a more accurate adjustment is performed for occupied seats.
[0037] As a result, depending on the at least one determined directional parameter of the linguistic communication, for example, an adjustment of one or more parameters which are characteristic of the spatial distribution of one or more audio contents to be output within the vehicle interior takes place.
[0038] The sound reinforcement with specific audio content, of which there may be not just one but several, is adjusted in the vehicle interior by selecting the speakers or optimizing the balance between the speakers arranged "left," "right," "center," "front," and "rear." Furthermore, alternatively or additionally, the phase parameters of at least one signal component of an audio content can be adjusted such that, in order to create a subjective impression for an occupant, the audio content or a specific part of the audio content comes from a specific direction.
[0039] A further advantageous embodiment provides for the distribution of at least two different audio content items across at least two spatial areas within the vehicle interior. The parameters of the at least two audio content items can be adjusted to result in an (optimized) distribution of the two different audio content items within the vehicle interior. In particular, a distribution of the audio content components (possibly provided for in a surround sound signal of the audio source) can be deviated from.
[0040] In other words, this means that the output audio content is redistributed between at least two spatial areas of the vehicle, for example by the front left area being exposed to more sound than the rear right area. This can therefore be distributed between the front and rear seats, between the driver's seat and the other seats, or between the right and left halves of the interior. This can, for example, improve the communication of an occupant occupying the front passenger seat who is addressing occupants in the back seat by, for example, significantly attenuating and / or outputting with modified parameters an engine noise or driving noise output via the rear loudspeakers in the rear seat area. In contrast, the engine noise or driving noise output via the loudspeakers facing the driver's seat can remain.
[0041] For example, the effective locations for at least two audio signals corresponding to different audio content and / or signal sources can be controlled, in particular regulated, depending on the at least one determined directional parameter. In particular, a temporal variation of the spatial distribution of the audio content (an adaptive spatial distribution that changes over time) can be implemented. The variation of the spatial distribution of the audio content can be controlled depending on a detected change in the at least one directional parameter. In this case, detection of the change in the at least one directional parameter is sufficient.
[0042] According to a further expedient embodiment, the adaptation of the at least one parameter of the audio content comprises the adaptation of one or more surround sound parameters, wherein the surround sound parameter(s) control a direction objectively or subjectively perceived by the occupant(s) from which the audio content is reproduced, depending on the at least one directional parameter of the communication of the occupants of the vehicle.
[0043] The adaptation of at least one parameter of the audio content can be carried out by assigning certain audio contents and / or signal components of the at least one audio content to at least one loudspeaker and / or by adjusting the balance between at least two, preferably between at least four, loudspeakers arranged in the vehicle interior.
[0044] Alternatively or additionally, the adaptation of at least one parameter of the audio content is preferably carried out in such a way that a subjective impression is created in at least one spatial area or for an occupant potentially located in a spatial area or at a seating position that the audio content or a specific part of the audio content is coming from a specific direction. In particular, the method adapts a subjectively perceived direction and / or distance and / or a subjectively perceived location at which a specific part of an audio content is perceived (heard) by human (binoural) acoustic perception. In this case, one or more phase parameters, in particular a phase offset of at least one signal component of an audio content that is output from at least two different loudspeakers, can be adapted.In particular, a control, preferably a regulation, of a parameter of the audio content, in particular an envelope of a parameter curve, can be carried out depending on the at least one directional parameter of a current or predicted auditory communication.
[0045] For example, depending on the direction from which a passenger is speaking and / or the relative position of the listener, the direction from which one or more audio content items are generated or adjusted in the vehicle can be adjusted. This can involve shifting the acoustic power generated in certain parts of the vehicle interior and / or changing the phase of one or more audio signals or signal components of an acoustic content from one or more loudspeakers of the vehicle's multimedia system.
[0046] The source of the audio signal perceived by a specific occupant, particularly from a specific seating position, in the vehicle (the spatial position of the sound source perceived by human perception), which corresponds to at least part of the audio content, can be shifted depending on the at least one directional parameter of the speech communication with respect to the power generated by a loudspeaker. This can, in particular, take into account a communication intention and / or a parameter of the voice of at least one other occupant of the vehicle.
[0047] Alternatively or additionally, a subjectively perceived direction and / or distance from which the audio signal originates, generated using a surround sound process implemented and / or implemented in the method, can be adjusted, e.g., shifted, depending on the at least one directional parameter (e.g., a recognized communication intention and / or a voice of at least one vehicle occupant). Furthermore, the method can also implement a movement (perceptible to a human auditory ...
[0048] The parts of the audio content can, for example, correspond to the content encoded in different channels of a surround sound signal (a voice of the speaker of a broadcast or entertainment program, background music, so-called atmospheric sounds, etc.).
[0049] For example, weighting and / or spatial shifting and / or movement of the parts of the audio content corresponding to different channels of a surround sound signal may also be performed depending on the auditory communication between at least two occupants of the vehicle.
[0050] Furthermore, a content distribution of multiple audio content can be created for the occupants, reducing mutual masking and / or improving acoustic perceptibility for the occupants. This allows the occupants to better process the audio content and / or verbal communication.
[0051] It is also possible to distinguish how many occupants, in particular which of the occupants, communicate aurally with which other occupants, and depending on this, at least one parameter of the audio content can be adjusted with regard to a surround sound or the spatial distribution of the audio content.
[0052] A further expedient embodiment provides that the communication is analyzed for the presence of a predetermined sentence fragment of the auditory communication, in particular representing a question and / or a (subsequently) expected answer in the future. If the result is positive, a predictive adjustment of the previously processed directional parameters of the communication is carried out. In particular, the directional parameters of the communication are reversed. When the directional parameter is reversed, for example, a spatial area previously represented as a "listener" can be (subsequently) labeled as a "speaker" and / or a spatial area previously represented as a "speaker" can be (subsequently) labeled as a "listener."
[0053] This design allows the expected direction of further verbal communication to be predicted. If, for example, it is determined that a question is directed from one inmate to another inmate, then a corresponding change, i.e., reversal of the direction of communication, is assumed after the question has ended. Questions can be recognized based on the order of words typical for questions and / or a typical intonation, e.g., in connection with the mention of a person's name. In addition, the recipient of the question can be determined by determining a sitting position and / or physical attention. When reversing the direction parameter, for example,a room area previously occupied by a “listener” may (hereinafter) be marked as a room area occupied by a “speaker” and / or a room area previously occupied by a “speaker” may (hereinafter) be considered as a room area occupied by a “listener”.
[0054] A further expedient embodiment provides that, in order to determine the at least one directional parameter, recognition of one or more keywords in the communication of one of the occupants and / or recognition of the gestures of at least one occupant is carried out.
[0055] For example, a reference to the target person's name and / or predefined keywords, e.g., "to everyone," "listen up," "children," "you in the back," can be used as a guide for adapting at least one parameter of the audio content or audio signal. In this context, it is useful if keywords such as those mentioned above are defined and / or learned in advance. It is also useful to define and / or learn predefined gestures of the occupants that indicate a direction of communication.
[0056] A further expedient embodiment provides for the audio content to be varied with respect to its frequency range by modifying signal components of the audio content that relate to the frequency range of human speech, in particular within the speaker's voice of an occupant speaking during auditory communication, such that the signal energy is distributed across one or more frequency ranges that do not relate to the frequency range of human speech or relate to it to a lesser extent. For example, the signal energy of at least a portion of the audio content is distributed across one or more frequency ranges that exhibit a lower, in particular the lowest possible, overlap or correlation with the frequency ranges of the voice of a specific occupant (the "speaker").
[0057] In other words, this means that a transformation of the frequencies of the audio signal of the audio content can be carried out in such a way that the frequencies of the signal components of the vehicle's audio signal, which have a significant portion of their signal energy within the frequency range of human speech, are transformed into one or more frequency ranges that do not relate, or relate to a lesser extent, the frequency ranges of human speech. The modification or transformation of several signal components of the audio signal can be carried out in such a way that a mathematical relationship between the signal components, which relate to one or more proportions, is essentially maintained. In this way, a so-called masking (cf. psychoacoustics), which occurs for a listener between the speaker's voice and at least part of the audio content, can be reduced.
[0058] In particular, a frequency band transformation can also be applied, whereby the frequency components of the audio signal which lie within the frequency band of human speech are transformed to the frequency ranges which lie substantially outside the aforementioned frequency bands.
[0059] For example, in the method, depending on the at least one directional parameter or a further parameter of the communication in the interior of the vehicle, a change, in particular adaptation, of the audio content to be output can comprise a modification of the frequency components of the audio signal corresponding to the audio content, which have an overlap with the frequency range of the human voice, in particular the voice of the speaker, into frequency components which have a lower overlap with the frequency range of the human voice, in particular the voice of the speaker.
[0060] A change, in particular an adaptation of the audio signal corresponding to the audio content can also be carried out by applying an audio signal encoded in the frequency domain or transformed in the frequency domain, wherein the spectral properties, in particular a frequency density spectrum, of at least a part of the audio signal which is intended for the output of acoustic waves in a specific spatial region of the interior are adapted.
[0061] A further expedient embodiment provides that the adaptation of the parameter of the audio content comprises an at least partial shift of the frequencies of the audio content, which at least statistically correspond to the frequencies of the speaker's speech, from a first part of the room in which the speaker and / or the listener is located, to a second part of the room, which is substantially different from the first part of the room.
[0062] The term "at least partial displacement" is to be understood in this description in such a way that audio signals from the speaker's spatial part are reduced at least in one frequency range, e.g. between 120 Hz to 6 kHz, in particular 350 Hz to 3 kHz, and frequencies of the audio signal from the vehicle's multimedia system that essentially come from a direction other than the direction of the speaker and are in a frequency range between 200 Hz and 6 kHz, in particular 350 Hz to 3 kHz, are amplified.
[0063] In particular, the audio signal representing the audio content is spatially shifted at specific frequencies in such a way that the overall frequency weighting of the audio signal reaching the listener remains essentially unchanged. It can also be significantly less than the reduction in frequencies from the direction of the speaking occupant.
[0064] According to a further expedient embodiment, a content-related, in particular thematic, feature of a verbal communication between the vehicle's occupants is determined. Furthermore, the at least one directional parameter is determined depending on the content-related feature.
[0065] In other words, this means that a simple, content-based analysis of the verbal communication taking place between the occupants in the vehicle is performed. A fundamental difference from speaking to the on-board computer is that the on-board computer also considers verbal communication that is not addressed to it and adapts its own auditory messages (also referred to as messages or voice notifications) accordingly. Preferably, the method explicitly recognizes that a verbal message is not addressed to an on-board computer. This can then be used not for interpretation as a control command or information exchange with the on-board computer, but rather to adapt the parameters of the audio content to be output.If, however, a verbal message is recognized as a message directed to the on-board computer, the parameters of the audio content to be output are adjusted accordingly (or not at all).
[0066] Alternatively or additionally, an acoustic and / or content parameter of one or more audio content items can be adjusted in the vehicle. This allows the on-board computer to act as a "speaker." Likewise, the on-board computer can be assigned its own specific voice priority or a predetermined right of participation in the vehicle, particularly with regard to occupants in specific positions or with regard to specific occupants.
[0067] A further useful embodiment provides for the content-related characteristic of the linguistic communication to be determined by means of a linguistic analysis. This may involve processing the semantics of the linguistic communication and / or a topic-related characteristic of the linguistic communication and / or information as to whether or not the linguistic communication contains a content-related, self-contained message. A content-related, self-contained message within the meaning of this description may be a sentence or a phrase.
[0068] The topic characteristics can be determined in the process by means of a stored association rule, association logic, a database that represents different strengths of (association) assignments between the topics, words, typical sentence structures, etc.
[0069] For example, if the on-board computer detects that the speaker has finished a sentence and / or a phrase and / or a message, an auditory message from the on-board computer can be adjusted. The on-board computer's auditory message is output in a particularly predictive manner.
[0070] Preferably, the content feature can be used to determine at what point a spoken message from the vehicle's speaker will be completed. This can then be used, for example, to schedule the start of at least part of the on-board computer's audio message. For sentences that are not yet completed, the on-board computer waits a little longer before continuing to play the adapted or unadapted audio content, assuming that further speech from the speaker will follow.
[0071] A further expedient embodiment provides that the audio content is adapted with regard to intonation and / or word choice depending on the determined content feature of the verbal communication between the occupants of the vehicle. According to this embodiment, a predictive content adaptation of the audio content(s) is carried out depending on the determined content feature of the verbal communication between the occupants of the vehicle. For example, with predicted content features of the verbal communication, the content of the auditory message can be reduced and / or further content can be added to the auditory message and / or a more detailed description of the content of the auditory message can be provided. In this case, a signal generated by an on-board computer, e.g.Audio content generated as a synthesized auditory message can be adapted depending on a content feature of the auditory communication between the occupants of the vehicle, whereby the content of the auditory message of the on-board computer does not have to be causally, thematically or logically related to the content of the communication of the occupants.
[0072] For the purposes of this description, an on-board computer is understood to mean a device, particularly one installed in the vehicle or carried with the vehicle, which is designed to capture and interpret a spoken language for voice input, execute a command or generate a response.
[0073] A further expedient embodiment provides that a prediction of at least one directional parameter of the linguistic communication is carried out by means of a content-related, in particular linguistic, evaluation of the linguistic communication between the occupants of the vehicle.
[0074] For example, predefined parameters can be identified and used to predict how the directional parameter of communication will change, e.g., which specific change in at least one directional parameter will occur in the near future (with a high probability). Such predefined parameters can, for example, indicate a beginning and / or an end and / or a temporal progression of the amplitude and / or frequency parameters of linguistic communication.
[0075] For example, depending on given parameters and / or depending on given relationships between certain parameters, a change in a directional parameter of an auditory communication or a prediction of a (new or changed) directional parameter for the near future can occur.
[0076] In the method, a linguistic analysis can be performed and considered with respect to sentences or phrases of auditory communication between the vehicle occupants. The output of audio content, in particular the generation of the auditory message, can be carried out depending on the linguistic analysis, particularly with regard to its content, its division, or the time of the task. A predictive adaptation of the content to be output as auditory message is expediently carried out. Alternatively or additionally, the prediction of the temporal progression of the speaking occupant's voice can also be carried out by analyzing physical movements, facial expressions, lip movement patterns, and / or body language.
[0077] A further expedient embodiment provides that the time for outputting at least part of the audio context is determined depending on the at least one directional parameter of the linguistic communication between at least two occupants of the vehicle.
[0078] A further expedient embodiment provides that the type and / or content of another audio content present in the interior of the vehicle is determined and processed depending on an analysis result in order to adapt at least one parameter of the audio content of the vehicle.
[0079] This embodiment provides for the adaptation of the audible message depending on the type of one or more additional audio signals audible in the vehicle. The type of audio signal can be divided into the following or comparable types: music track; voice program; vehicle voice message; vehicle information message (information sound, warning sound); telecommunications content (phone call, read-aloud SMS, messenger, etc.). The adaptation of the audible message can be dependent on the content of this additional audio signal from the vehicle. The content of the audio content output by the vehicle can be divided into the following or comparable classes: beginning / end of a sentence and / or phrases of a voice broadcast (radio broadcast); audible messages related to a driving context, such asTraffic information; navigation instructions; news, breaking news, entertainment programs; voice messages, in particular recommendations for action, instructions for action, status messages in connection with driving automation or a maneuver that can be performed by the vehicle.
[0080] The content or content feature can be the importance and / or urgency of the additional audio content and / or a specific choice of words and / or a specific gesture accompanying or preceding the verbal message. According to this embodiment, an audio signal of a music track or an entertainment program can therefore be significantly altered if it is simultaneously determined that other occupants have an important and / or urgent message to convey, e.g., based on facial expressions, volume, choice of words, and the like. Depending on the recognized type and / or content of the additional audio context audible in the interior of the vehicle, a verbal communication of a vehicle occupant can be differentiated from this additional audio content, in particular comprising speech or text communication.
[0081] Furthermore, the adjustment of at least one parameter of the audio content can be made depending on the type of audio context. For this purpose, a distinction is made between audio content that is created or played inside the vehicle and an acoustic signal that originates from outside the vehicle interior and penetrates it.
[0082] It is also possible to distinguish between an audio context (e.g. a radio broadcast, a talk show, etc.) output by a playback device carried in the vehicle and another audio context, e.g. a background noise.
[0083] A further expedient embodiment provides that, depending on an evaluation of at least one physical posture and / or gesture of at least one vehicle occupant, it is recognized that a verbal message is explicitly addressed to the on-board computer carried in the vehicle or explicitly not addressed to the vehicle's on-board computer. Alternatively or additionally, it can be recognized that a verbal message is addressed to a specific vehicle occupant.
[0084] This configuration enables the detection that the spoken communication is not explicitly directed at the on-board computer, e.g., when a speaker utters a sentence while physically addressing another occupant of the vehicle. The on-board computer then does not need to analyze the spoken message emitted by the speaker to respond to it or execute a voice command. The evaluation is then performed solely to adjust the parameters of the spoken messages generated by the on-board computer. For example, the sound source corresponding to the voice generated by the on-board computer can virtually shift, move, or move depending on the directional parameter of the spoken communication between at least two occupants of the vehicle.
[0085] For this purpose, the physical posture and / or gesture of at least one vehicle occupant can be detected using a camera. A turning of the head of an occupant, a body rotation, and / or eye contact with another occupant can be detected.
[0086] A further expedient embodiment provides that a probability measure for a recognized linguistic message is determined, wherein if the probability measure exceeds a threshold value that the message is not directed to the on-board computer, the linguistic message in the audio content, which is determined for at least one of the occupants of the vehicle, is adapted.
[0087] Preferably, the method can determine and take into account a probability measure that a portion of the auditory communication, in particular a specific verbal message, is not directed at the on-board computer, and / or is directed at another listener, and / or is directed at a listener connected via mobile phone. The adjustment of at least one parameter of the audio content can then be performed taking into account one or more determined probability measures.
[0088] Messages from vehicle occupants are analyzed to determine whether or not they are addressed to the on-board computer, and if so, with what probability. If the determination of a determined probability measure does not exceed a predefined threshold, the on-board computer should not analyze the verbal message, or should not respond, or should not react (in a way that is perceptible to the occupant), and in particular, should not execute any voice command. This can be achieved, for example, by taking into account a content-related, particularly linguistic, speech analysis.
[0089] A further expedient embodiment provides that at least one feature of the verbal communication between at least two occupants of the vehicle is determined depending on the recognized body language and / or a voice pitch, in particular a change in the voice, of at least one occupant and is processed to adapt the at least one parameter of the audio signal of the vehicle.
[0090] For example, a recognition, in particular a classification of an emotion and / or intention of an occupant can be carried out using image processing or image interpretation with an interior camera of the vehicle and taken into account in the method.
[0091] A further expedient embodiment provides for a directional parameter of a spoken communication between at least two vehicle occupants to be determined and / or the type and / or priority of at least two audio content items to be output. Furthermore, an order of the at least two audio content items and / or individual content items of the spoken communication is determined, depending on the determined directional parameter of the spoken communication and / or the determined type and / or priority of the at least two audio content items to be output.
[0092] Preferably, the method can carry out an analysis of the type and / or priority of at least two audio content items or parts of an audio content to be output. The output of at least two audio content items or sections of an audio content to be output can then be planned, in particular depending on the differences between their types and / or priorities, in particular assigned to specific time intervals and / or to one or more expected criteria or events (e.g. reaching a specific section of roadway, e.g. before an intersection, exit, etc.). In this case, two or more audio content items can be planned on a time axis depending on the parameters determined in the method, in particular their order can be changed or swapped and / or assigned to specific expected criteria.
[0093] Furthermore, the method can also take into account the acoustic parameters, preferably an acoustic model of the vehicle's interior. For example, parameters representing resonance or reflection properties of the interior can be considered directly or indirectly.
[0094] Preferably, at least one optimization criterion for adapting at least one parameter of the audio content represents sufficient audibility and / or perceptibility and / or (acoustic) intelligibility of at least one (specific) auditory communication and / or of the at least one piece of audio content. Such perceptibility, audibility, or intelligibility can be determined, for example, using a psychoacoustic model of human acoustic perception and taken into account in the method.
[0095] A further optimization criterion can be at least one vehicle setting or a user setting, which can be assigned, for example, to a seat or a passenger's user profile. This can, for example, represent the extent to which auditory communication, particularly from a specific direction and / or the extent to which a specific audio content should be audible. Certain perceptual characteristics of at least one specific person, e.g., parameters representing an audiogram of a specific passenger, can also be taken into account.
[0096] Particularly preferably, a control of one or more parameters of an audio content to be output (continuously output or outputtable) in the interior can be carried out, wherein a setpoint value of the control is selected, in particular continuously adjusted, depending on a predetermined audibility and / or acoustic perceptibility of an auditory communication and / or an audio content.
[0097] Consequently, the method can be carried out in such a way that both at least one auditory communication and at least one audio content is sufficiently audible and / or to a desired extent, in particular from a specific position in the interior of the vehicle or from a specific occupant.
[0098] Preferably, a control, in particular regulation of one or more of said temporal parameters is carried out, wherein a setpoint value of the regulation is selected, in particular continuously adjusted, depending on a predetermined audibility and / or acoustic perceptibility of an audio content to be output and / or at least one said linguistic communication or the communication with a specific directional parameter.
[0099] The invention further provides a computer program product for varying audio content to be output, which can be loaded directly into the internal memory of a digital computer and comprises software code sections with which the steps according to one of the preceding claims are carried out when the product is running on a computer. The computer program product can be implemented on a data carrier, such as a DVD, a CD-ROM, a USB stick, and the like. Likewise, the computer program product can be implemented as a program to be loaded, which can be loaded via a network or wirelessly. The computer program product can also be designed as an update of a previous computer program, which, for example, as part of a functional extension, for example as part of a so-called "remote software update", comprises the corresponding program code or software code sections relating to the parts for carrying out the method.
[0100] The invention further proposes a device for varying audio content to be output in a vehicle. The device comprises a first means for determining, in particular for predicting, at least one directional parameter of a spoken communication of at least one occupant of the vehicle and a second means for adapting at least one parameter of the audio content of the vehicle.
[0101] The device according to the invention has the same advantages as those described above in connection with the method according to the invention.
[0102] In an expedient embodiment, the device according to the invention has further means for carrying out the method according to the description given above and below.
[0103] In summary, the invention proposes that a vehicle detects which of the vehicle's occupants is speaking and to whom or which other occupants or persons connected by telephone the address or communication is directed. Depending on this, the audio content present in the vehicle is spatially redistributed within the vehicle interior, so that spoken communication is improved at least in a specific direction from the speaker to the hearing occupants, and the hearing occupants are impaired as little as possible by the vehicle's audio content when perceiving the communication.
[0104] This approach allows the vehicle to detect or predict when a passenger is speaking or wants to speak, and to create the best possible conditions for communication in a specific direction. The vehicle actively assists the speaking and hearing passengers in communicating. This allows, for example, an unspoken passenger to continue listening to a radio program and / or a simulated engine noise played via a multimedia system, while another passenger can communicate with other passengers in a much more relaxed manner.
[0105] The invention is explained in more detail below, without limiting its generality, using exemplary embodiments in the drawings. They show: Fig. 1 a schematic representation of a vehicle with a device for varying an audio content output in the vehicle.
[0106] Fig. Figure 1 shows a schematic top view of a vehicle. The vehicle is a motor vehicle. The motor vehicle can be powered by an internal combustion engine and / or an electric motor. The vehicle can also be designed to be driven purely electrically. Optionally, the vehicle can have semi-autonomous or fully autonomous driving functions. In principle, the type of vehicle and its available driving functions are of secondary importance for the present invention.
[0107] In the Fig. In the illustration shown in Figure 1, the direction of travel of vehicle 1 corresponds to the direction of the arrow marked "front." Thus, the vehicle moves from bottom to top in the drawing at the page level.
[0108] Vehicle 1 has four seats merely for illustrative purposes. A left front seat is labeled 2L, a right front seat 2R, a left rear seat 3L, and a right rear seat 3R. For illustrative purposes only, occupants 11, 12, and 13 are each seated on the left front seat 2L, the right front seat 2R, and the right rear seat 3R. For illustrative purposes only, the left rear seat 3L is unoccupied. Occupant 11 represents the driver of vehicle 1. Therefore, for illustrative purposes only, a steering wheel 14 or other control element for influencing the lateral guidance of the vehicle is arranged in front of occupant 11 in the direction of travel.
[0109] The schematically illustrated vehicle 1 includes an audio output device. In this example, the audio output device is a multimedia system 4 that is installed in the vehicle or can be connected to the vehicle at least via the power supply and / or data exchange for executing the method.
[0110] To output auditory information, the multimedia system 4 is connected to a number of loudspeakers 8-1, ..., 8-7. The loudspeakers 8-1, ..., 8-7 are distributed throughout the vehicle interior, with the loudspeaker 8-1 being arranged centrally in the area of the dashboard in front of the occupants merely as an example. The loudspeakers 8-2, 8-4, 8-6 are arranged in the left area of the vehicle body, and the loudspeakers 8-4, 8-5, 8-7 are arranged in the right area of the body of the vehicle 1. The method can also be applied analogously to virtual loudspeakers, i.e., to loudspeakers that virtually generate a subjectively perceptible signal by modifying the signal from at least two loudspeakers.
[0111] The multimedia system 4 has a control unit (not shown in detail) capable of generating surround sound in the interior of the vehicle 1. This means that auditory information output via the loudspeakers 8-1, ..., 8-7 can be controlled, in particular regulated, by targeted control of surround sound parameters, frequency parameters, amplitude response, and / or phase parameters such that the volume and / or sound characteristics can be developed differently at different seats in the vehicle, in particular according to the optimization criteria.
[0112] The vehicle 1 also has an on-board computer 5, which serves as a processing unit. A camera 6 for recording the vehicle's interior and a microphone 7 for recording messages spoken by the occupants 11, 12, 13 are arranged with the on-board computer 5.
[0113] The reference numeral 9 generally designates a sensor system. The sensor system 9 can, for example, include sensors for detecting seat occupancy and / or sensors for detecting a fastened seatbelt and / or door sensors that detect the opening and closing of a door. Using the sensor system 9, it is possible to determine the occupancy of the individual seats 2L, 2R, 3L, 3R with computer support. To determine whether a seat is occupied, the image of the interior captured by the camera 6 can also be evaluated.
[0114] The described device is used to adapt the sound of the interior of the vehicle with specific audio content by specifically controlling the loudspeakers 8-1, ..., 8-7, the balance between the left loudspeakers 8-2, 8-4, 8-6 and right loudspeakers 8-1, 8-3, 8-5, set phase parameters and / or the amplitude curve to a directional parameter.
[0115] Audio content reproduced by the multimedia system 4 via the loudspeakers 8-1, ..., 8-7 can be music, spoken content from radio broadcasts or audio books, audio content from videos played via a playback system not shown (e.g., so-called rear-seat entertainment), video games, or simulations. The multimedia system 4 can also be used to output an artificially generated engine noise via its loudspeaker system, consisting of the loudspeakers 8-1, ..., 8-7. Such an artificially generated engine noise is output, for example, to reproduce a specific sound design to improve the vehicle's sound characteristics in the interior or to make the vehicle's dynamics more perceptible.
[0116] The directional parameter, depending on which the sound in the interior is adapted with the audio content, comprises a parameter that represents communication between a speaking occupant and one or more hearing occupants and / or a speaking occupant and the on-board computer. The directional parameter of such vocal communication is determined in the vehicle or by the vehicle. This is done using the sensors installed in or carried on board the vehicle 1, such as the microphone 7 and / or the camera 6. The directional parameter can also be predicted by evaluating, for example, image information of the interior of the vehicle recorded with the aid of the camera 6 and observing the facial expressions and / or gestures and / or posture of the occupants.
[0117] The communication is, in particular, verbal (auditory) communication. Such communication is a conversation between two or more occupants in the interior of the vehicle 1. Such communication between the vehicle occupants can be explicitly distinguished from other audio signals in the vehicle that include speech. Such audio signals include audio content from a radio program, an audio book, and the like. The device enables a distinction to be made between verbal communication and an acoustic signal generated in the interior of the vehicle. Likewise, an acoustic signal or acoustic content coming from outside the vehicle 1 and audible in the interior can be distinguished from the verbal communication.
[0118] If, for example, occupant 11 in the left front seat of the vehicle wishes to send a message to occupant 13 in the right rear seat, this can be determined by determining the directional parameter. Assuming that the vehicle interior is being filled with music, for example, via the multimedia system 4, upon detection of the message from occupant 11, the volume and / or frequency parameters and / or amplitude curve and / or phase parameters are adjusted by appropriate control, e.g. of the loudspeakers 8-5 and 8-7, so that the message addressed by occupant 11 to occupant 13 is better understood by the occupant 13. In contrast, the audio content output by the multimedia system 4 via the loudspeaker system in the vehicle does not need to be modified in the area of occupant 12, since the message is not addressed to occupant 12.
[0119] In the method, the directional parameter can refer to spatial areas that correspond, for example, to a seat, e.g., identify the spatial area in which the head of a person sitting in a specific seat is located. The directions that connect certain spatial areas (and one or other direction) can also be represented as simplified angular ranges in a directional parameter. In this case, precise coordinates and / or angular values can be dispensed with. Different directional parameters can be assigned different priorities. Different priorities influence the audio content(s) in the interior of the vehicle 1. For example, communication between certain occupants in different seats in the vehicle can be assigned a different influence on other audio content.Such audio content can then be made stronger or weaker or differently configured, paused or faded out for certain directions of linguistic communication.
[0120] The parameters of the audio content are adapted, on the one hand, after the direction parameter has been recognized, which can be used to identify the occupant(s) addressed in the message. In addition, the speaking occupant can use certain keywords, such as "to everyone," "children," "you in the back seats," etc., to identify who the speaking occupant's message is intended to be addressed to. Once this has been recognized, the corresponding parameters of the audio content can then be adapted for the vehicle's seat(s). The spatial parameter is determined, for example, by the computing unit of the on-board computer 5. The on-board computer 5 is also able to distinguish whether a message output by the speaking occupant is addressed to the on-board computer or to the occupants in the vehicle.Depending on this, the on-board computer 5 can then cause the multimedia system 4 to vary the parameters of the audio content in a suitable manner.
[0121] Determining the directional parameter of the vehicle's occupants' verbal communication can also be used to output verbal messages from the on-board computer 5 in a suitable manner, e.g., during pauses in communication. Likewise, the complexity of the message to be output by the on-board computer 5 can be varied depending on a detected emotion and / or intonation of the occupants' communication. If, for example, the intonation and / or facial expressions and / or gestures indicate that the occupants inside the vehicle are arguing, the on-board computer's messages will be less receptive than if they were having a quiet conversation. In this case, the message to be output by the on-board computer 5 can be modified so that it is limited to simple sentences and / or a few words. Otherwise, the message can be output in more detail via the multimedia system 4.Such a message can be, for example, navigation announcements, information about a vehicle status, information about a destination and the like.
[0122] When implementing the method according to the invention, a distinction can also be made between the type of one or more other audio content items. Examples of other audio content include music, audio programs, voice communication, and the like, which may be output, for example, from a terminal device carried in the vehicle. Other audio content can also include further voice communication between vehicle occupants who are not participating in the communication between the speaking occupant and the occupant to whom the message is addressed. The priority of each voice message can be automatically assessed.
[0123] Audio content can be controlled based on its type, content, or an assigned or determined priority. This allows audio content to be relocated, at least partially, to other parts of the vehicle. Alternatively, audio content can be paused immediately if it is necessary for the message spoken by a speaking occupant to be received by the intended listeners. Audio content, e.g., a message from the onboard computer, can be split and played during one or more pauses in the occupants' communication. Furthermore, audio content can be paused after the speaking occupant's sentence has finished.
[0124] Optionally, one or more sound sources (including virtual ones, at least audible by human perception in the interior of the vehicle) can be generated in the process, whereby the output of one or more audio contents is assigned to the sound sources.
[0125] Parameters of a sound source that correspond to the output of an audio content, which determine, for example, the directions, distances, positions, acoustic parameters of a sound source, can also be controlled, in particular tracked or regulated, depending on at least one directional parameter.
[0126] The generation of sound sources for one or more audio content items can each relate to a specific interior area of the vehicle from which this sound source or sources are to be made perceptible, i.e., audible. For example, the method can control one or more parameters of such a sound source that determine a direction, distance, position, and acoustic parameters for the sound source, which are intended for a specific perception position, in particular a seating position and / or head orientation of the occupant. In this case, multiple sound sources can be generated or adapted for multiple occupants.
[0127] For example, based on an audio signal corresponding to audio content, audibly perceptible sound sources are generated (each different) for at least two different spatial areas of the vehicle's interior or for two specific occupants or occupants in specific seats, depending on one or more parameters of auditory communication. These sound sources or the audio content corresponding to the sound sources can have different, appropriately adapted, objectively measurable, or subjectively perceptible parameters by the actually present or assumed occupants.
[0128] Furthermore, the method can provide for a repetition of a portion of the audio content which is or was significantly influenced, for example, by the communication of the occupants. Such a procedure is suitable, for example, for navigation announcements or traffic announcements, but also for radio broadcasts interrupted by auditory communication. This can be done in particular in such a way that the repeated portion of the audio content results in a valid and sufficiently complete sentence. In this case, a repetition of a section of audio content, for example an auditory message, can take place which is or was significantly influenced by the determined auditory (verbal) communication in the interior. In this case, for example, a section of the audio content which has already been started, e.g.A portion of an auditory message that was significantly (significantly and / or over a relatively long period of time) drowned out by the auditory communication during its output is repeated. Repetition also means that a new auditory message or a section of the auditory message is generated again, thereby compensating for, supplementing, or replacing at least one insufficiently transmitted component.
[0129] At least one directional parameter of the spoken communication can be determined in the method based on sensor data or a history, e.g., in connection with one or more communications in the vehicle interior or communications involving specific people, and / or taking into account a probability calculation. For example, at least one directional parameter of a current or upcoming spoken communication can be predicted by comparing or calculating a large number of content features and / or other parameters from the history. Such a comparison can be carried out in the method, e.g., within a backend.
[0130] Preferably, the method involves adapting one or more audio content items, in particular continuously or cyclically. Different parameters or parameter combinations can be adapted for (in principle) different audio content items. The adaptation can occur before and / or during the output of at least one section of the audio content, depending on at least one content parameter determined in the past or currently and / or at least one predicted content parameter of the communication. In the method, "adapting" means, in particular, an expedient change, which serves, for example, to achieve one or more predetermined goals, one or more predetermined logical or mathematical relationships, in particular according to one or more predetermined optimization criteria. List of reference symbols 1 vehicle 2L left front seat 2R right front seat 3L left rear seat 3R right rear seat 4 Multimedia system 5 on-board computer (processing unit) 6 Camera 7 Microphone 8-1, ... , 8-7 speakers 9 Sensors (seat occupancy, seat belt detection) 11, 12, 13 inmates 14 Steering wheel
Claims
[1] Method for varying audio content to be output in a vehicle (1) wherein - at least one directional parameter of a linguistic communication between at least two occupants of the vehicle (1) is determined, in particular predicted; and - an adjustment of at least one parameter of the audio content to be output in the vehicle (1) depending on which at least one directional parameter is executed. [2] Method according to claim 1, wherein the at least one directional parameter of the linguistic communication - a position of a speaking person (11) in the vehicle (1), in particular the seat (2L) of the speaking person, and / or - the position or positions, in particular the seat(s) (2R, 3R), of the person or persons (12, 13) to whom the communication of the speaking person (11) is directed, and / or - a spatial direction, in particular as one or more vectors, in which the communication is directed, represented. [3] Method according to claim 1 or 2, wherein a playback of at least two different audio contents is distributed to at least two spatial areas within an interior of the vehicle (1). [4] Method according to one of the preceding claims, wherein the adjustment of the at least one parameter of the audio content comprises the adjustment of one or more spatial sound parameters, wherein the spatial sound parameter(s) controls a direction, objectively or subjectively perceived by the occupant(s), from which the audio content is reproduced, depending on the at least one directional parameter of the communication of the occupants in the vehicle (1). [5] Method according to any one of the preceding claims, wherein - the communication is analyzed for the presence of a given sentence fragment, in particular a question and / or an expected future answer; and - in the positive case, a proactive adjustment of the previously processed directional parameters of the communication is carried out, in particular a reversal of the directional parameter. [6] Method according to one of the preceding claims, wherein the determination of at least one direction parameter is carried out by detecting one or more keywords in the communication of one of the occupants (11, 12, 13) and / or by detecting the gestures of at least one occupant (11, 12, 13). [7] Method according to one of the preceding claims, wherein the audio content is varied with respect to its frequency range by modifying signal components of the audio content relating to the frequency range of the human speech of a speaking inmate (11) in such a way that the signal energy is distributed over one or more frequency ranges that do not relate to the frequency range of human speech or relate to it to a lesser extent. [8] Method according to claim 7, wherein the adjustment of the parameter of the audio content comprises at least a partial shift of the frequencies of the audio content, which correspond at least statistically to the frequencies of the speaker's speech, from a first part of space in which the speaker and / or the listener is located, to a second part of space which is substantially different from the first part of space. [9] Method according to any one of the preceding claims, wherein - a content-related, in particular thematic, characteristic of linguistic communication between the occupants (11, 12, 13) of the vehicle is determined, and - which determines at least one directional parameter depending on the content characteristic. [10] Method according to claim 9, wherein the content feature of linguistic communication is determined by means of a linguistic analysis, processing: - a semantics of linguistic communication; and / or - a thematic feature of linguistic communication; and / or - information on whether or not the linguistic communication comprises a complete message, in particular sentences and / or phrases. [11] Method according to claim 9 or 10, wherein the audio content is adapted with respect to intonation and / or word choice depending on the determined content feature of the linguistic communication between the occupants (11, 12, 13) of the vehicle (1). [12] Method according to one of claims 9 to 11, in which a prediction of at least one directional parameter of the linguistic communication is carried out by means of a content-related, in particular linguistic, evaluation of the linguistic communication between the occupants (11, 12, 13) of the vehicle (1). [13] Method according to one of the preceding claims, wherein the time for outputting at least part of the audio content is determined depending on the at least one directional parameter of the speech communication between at least two occupants (11, 12, 13) of the vehicle (1). [14] Method according to one of the preceding claims, wherein the type and / or content of another audio context present in the interior of the vehicle (1) is determined and processed depending on an analysis result to adapt the at least one parameter of the audio content to be output in the vehicle (1). [15] A method according to any of the preceding claims, wherein, depending on an evaluation of at least one physical posture and / or gesture of at least one occupant (11, 12, 13) of the vehicle (1), it is recognized that a linguistic message: - explicitly to the on-board computer carried in the vehicle (1) or explicitly not to the on-board computer (5) of the vehicle (1), and / or - to a specific occupant of the vehicle (1) is directed. [16] Method according to claim 15, wherein a probability value for a recognized speech message is determined, wherein, if the probability value exceeds a threshold that the message is not directed to the on-board computer (5), a speech message in the audio content, which is intended for at least one of the occupants (11, 12, 13) of the vehicle (1), is adapted. [17] Method according to one of the preceding claims, wherein at least one feature of the linguistic communication between at least two occupants (11, 12, 13) of the vehicle (1) is determined depending on the recognized body language and / or a tone of voice, in particular a change in voice, of at least one occupant (11, 12, 13) and processed to adapt the at least one parameter of the audio content to be output in the vehicle (1). [18] Method according to any one of the preceding claims, wherein - a directional parameter of a verbal communication between at least two occupants (11, 12, 13) of the vehicle (1) is determined, and / or - the type and / or priority of at least two audio contents to be output is determined; - a sequence of at least two audio contents and / or individual contents of the spoken communication is determined, depending on the determined directional parameter of the spoken communication and / or the determined type and / or priority of the at least two audio contents to be output. [19] Computer program product that can be loaded directly into the internal memory of a digital computer and comprises software code sections that perform the steps according to any of the preceding claims when the product is running on a computer. [20] Device for varying audio content to be output in a vehicle (1) comprising: - a first means of determining, in particular of predicting, at least one directional parameter of a linguistic communication between at least two occupants (11, 12, 13) of the vehicle (1); and - a second means of adjusting at least one parameter of the audio content to be output in the vehicle (1) depending on at least one direction parameter. [21] Device according to claim 20, characterized by that this further means comprises the means for carrying out the method according to any one of claims 2 to 18.
Citation Information
Patent Citations
systems and procedures for selecting audio filtering methods
DE102015118553A1
Computer system for a vehicle
DE102015206021A1
Devices with enhanced audio
US20130028443A1