VIDEO CONFERENCE SYSTEM FOR A MOTOR VEHICLE, MOTOR VEHICLE AND METHOD FOR CONDUCTING A VIDEO CONFERENCE

Abstract

It is a video conferencing system (12) for conducting a video conference with persons (14) provided in an interior (16) of a motor vehicle (10), comprising at least one microphone (20) for recording speech contributions (22) of the at least one person (14), an evaluation unit (24) for detecting noise sources (26) from the motor vehicle (12) and / or the interior (16) of the motor vehicle (12), wherein the noise sources (26) detected by the evaluation unit (24) are different from the speech contributions (22) recorded via the at least one microphone (20), and a volume control device (32) connected to the evaluation unit (24) for automatically deactivating and / or reducing the volume of the microphone (20) in the event that no speech contribution (22) is recorded by this microphone (20) but the noise source (26) detected by the evaluation unit (24) is recorded.By taking into account sensor data relating to disturbing noise sources (26) in the evaluation unit (24) of the video conferencing system (12), disturbance noise can be avoided by muting a microphone (20) that is not currently used for the speech contribution (22), so that a motor vehicle (12) with an acoustically good video conferencing function is made possible.

Description

The invention relates to a video conferencing system with which a video conference can be conducted with persons located in the interior of a motor vehicle, as well as a motor vehicle with such a video conferencing system and a method for conducting a video conference with such a video conferencing system. From DE 10 2024 115 276 A1 a motor vehicle with an integrated video conferencing system is known, in which a speaking person is identified with the help of an interior camera provided for the video function of the video conferencing system, so that a microphone assigned to the speaking person can be automatically activated and microphones assigned to non-speaking persons can be muted. There is a constant need to improve the acoustic quality of a video conferencing function in a motor vehicle. The purpose of the invention is to demonstrate measures that enable a motor vehicle to have an acoustically good video conferencing function. The problem is solved according to the invention by a videoconferencing system with the features of claim 1, a motor vehicle with the features of claim 9, and a method with the features of claim 10. Preferred embodiments of the invention are specified in the dependent claims and the following description, each of which can individually or in combination represent an aspect of the invention, the scope of protection being determined by the claims. One aspect of the invention relates to a videoconferencing system for conducting a videoconference with persons located in the interior of a motor vehicle, comprising at least one microphone for recording speech contributions from the at least one person, an evaluation unit for detecting noise sources from sensor data relating to the motor vehicle and / or the interior of the motor vehicle, wherein the noise sources detected by the evaluation unit are different from the speech contributions recorded via the at least one microphone, and a volume control device connected to the evaluation unit for automatically deactivating and / or reducing the volume of the microphone in the event that no speech contribution but the noise source detected by the evaluation unit is being recorded by this microphone. The system leveraged the fact that the videoconferencing system intended for the vehicle is already integrated into the vehicle's data infrastructure to ensure proper operation and / or to access the vehicle's resources required for its operation. This makes it particularly easy to utilize other sensors already installed in the vehicle and their data for the videoconferencing system. It can also be taken into account that certain actions initiated by a vehicle occupant create a noise source, such as switching on noisy electrical devices, and / or reduce the shielding against external noise sources, such as opening windows while driving.Especially when vehicle components are used for these noise-generating actions, these noise sources can be detected very easily and effectively, possibly even before the noise source becomes audible and / or is yet to be generated. After evaluating the relevant sensor data in the evaluation unit, this makes it possible to avoid unnecessary background noise from these sources during a video conference, possibly even before the noise becomes audible, by deactivating the microphone that would pick up the background noise or at least reducing its recording volume (a "mute function").The evaluation unit, particularly through the analysis of sensor data not originating from the at least one microphone, can differentiate between a person's speech and a different noise source, thus ensuring that the individual's contributions during the (video) conference are not impaired. The microphone in question is only muted if no speech is currently being recorded through it. By considering sensor data relating to interfering noise sources in the video conferencing system's evaluation unit, background noise can be avoided by muting a microphone not currently in use for speech, enabling a vehicle to offer good acoustic video conferencing capabilities. The video conferencing system can be designed in a particularly simple configuration, comparable to a system for providing a telephone call or conference call with more than two participants. Preferably, the video conferencing system is designed to provide a visual image of the participants using a camera that films the respective person and / or group of people. For this purpose, at least one interior camera of the vehicle can be connected, and preferably, this interior camera can also be used for other functions, such as monitoring driver fatigue. This eliminates the need to install an additional camera for the video function of the video conferencing system, allowing the use of cameras and their existing data infrastructure already installed in the vehicle. The at least one microphone is designed to record sounds inside the vehicle. Preferably, the microphone is designed for speech recording, so that frequency ranges irrelevant to speech can be filtered out and not transmitted to the rest of the video conferencing system. This allows at least some background noise from other sources to be easily and cost-effectively removed from the microphone's recording. The microphone can be permanently installed in the vehicle's interior. However, it is also possible to design the microphone as a separate, relatively movable component, either wired or wireless, for example, to attach the microphone to the assigned person.Preferably, the microphone is part of a smartphone and / or part of the personal belongings of the assigned person, and this microphone can connect to the video conferencing system as a receiver for voice contributions, particularly wirelessly, for example via WiFi or Bluetooth. The evaluation unit can be an integral part of the videoconferencing system, preferably intended for the operation of the videoconferencing system. Preferably, the evaluation unit comprises a computer program with which the invention can be implemented. The evaluation unit can be configured to distinguish speech contributions from other noise sources. This can exploit the fact that speech contributions occur within a typical frequency range and are only modified and / or modulated within certain limits and only occur within a specific volume range. The differentiation between speech contributions and other noise sources can represent a signal-noise problem, in which the speech contributions correspond to the signal and the other noise sources to the noise.The differentiation between speech contributions and other noise sources can be achieved in particular by analyzing the image area of ​​an FFT ("Fast Fourier Transformation") of the noises recorded by a microphone. The volume control can be activated by the evaluation unit to mute a microphone. This allows the affected microphone to be completely deactivated, i.e., the volume of the recorded sounds to be set to zero. It is also possible to reduce the volume to a non-zero value, for example, to essentially maintain a specific volume level. Due to the reduced volume, interference from background noise can be significantly reduced, while avoiding the impression that the muted microphone might be malfunctioning, as its general functionality can still be detected. In particular, several microphones are provided, each assigned to a specific person inside the vehicle, and the volume control is individually connected to each microphone. This means that multiple people inside the vehicle do not have to share a single microphone, which significantly improves the voice quality for video conferencing. Preferably, the multiple microphones are connected to the evaluation unit for using the sounds recorded by each microphone as sensor data for the acoustic identification of a person contributing to speech and / or for the acoustic identification of a person not contributing to speech. This makes it possible, when several people are present in the vehicle's interior and all participating in the video conference, to assign the respective speech contributions of each person to exactly one assigned microphone, thus preventing crosstalk.If one microphone picks up a speech contribution at a higher volume and the same speech contribution is picked up at a lower volume by another microphone, the lower-volume contribution can be identified as crosstalk and treated as a separate, disruptive noise source. This can, in particular, lead to a reduction in the recording sensitivity and / or volume of the microphone carrying the lower-volume contribution, in order to prevent further recording of the speech contribution already captured by the first microphone and to further improve the audio quality of the video conferencing function. Particularly preferred is at least one indoor camera for recording a video sequence of at least one person, wherein the indoor camera is connected to the evaluation unit for using the video sequence as sensor data for the optical identification of a person contributing to speech and / or for the optical identification of a person not contributing to speech and / or for the optical identification of relatively moving parts within the interior that cause noise. With the aid of the indoor camera, for example, the lip movements of a person can be observed in order to recognize speech leading to a contribution to speech. Furthermore, it is possible to identify collisions between relatively moving parts that can generate noise upon impact.By briefly muting the affected microphone, for example, sudden, disruptive clapping or banging noises in the transmission can be avoided. In particular, at least one indoor camera is provided for recording a video sequence of at least one person, and the indoor camera is connected to the evaluation unit for using the video sequence as sensor data to identify a noise-producing bodily action, especially sneezing. The indoor camera need not be used solely for observing the person's lip movements, but can also visually observe other scenarios that result in a disturbing noise produced by the person, which is not a speech contribution. For example, a person's sneeze may be associated with a specific sequence of body and facial movements that can be optically captured by the indoor camera and recognized by the evaluation unit, for example, with the aid of a suitably trained evaluation AI. Preferably, at least one opening sensor is provided for detecting an at least partially opened side window and / or sunroof and / or convertible top, wherein the opening sensor is connected to the evaluation unit for using a sensor signal from the opening sensor as sensor data for localizing a noise source based on audible wind noise relative to the microphones. For example, in the case of electrically operated window regulators, a person can operate a switch to open and / or close a vehicle window, whereby the operation of this switch can be detected by the opening sensor and taken into account in the evaluation unit. If a closed window is to be opened while driving using the switch, disturbing noise from wind noise is to be expected.The evaluation unit can read which vehicle opening should be opened during the journey, so that it is possible to mute microphones located near this vehicle opening as a precaution to avoid interference from wind noise. Particularly preferred is at least one switching device for switching an electrical device, in particular an entertainment system, and / or an electric motor of an auxiliary unit of the motor vehicle, in particular an actuator for a seat adjustment and / or an air conditioning compressor, wherein the switching device is connected to the evaluation unit for using a switch-on signal from the switching device as sensor data for creating a noise source. When a person operates the switching device, this operation of the operating switch and the activation of a previously silent noise source can be taken into account in the evaluation unit. The evaluation unit can read out the location where the activated noise source will originate, so that it is possible to preemptively mute microphones located near this noise source to avoid interference from it. In particular, a speed sensor is provided for detecting the vehicle's speed. This speed sensor is connected to the evaluation unit, which uses the detected speed to adjust a volume threshold for detecting the presence of a noise source. This takes into account that at high speeds, unavoidable background noise caused by the speed is to be expected, so that in this case, a microphone can only be muted at a higher volume of the disturbing noise source. At low speeds, on the other hand, even quieter noise sources can be perceived as disturbing, so that in this case, a microphone can be muted at a lower volume of the disturbing noise source. Another aspect concerns a motor vehicle with an interior and a video conferencing system, which, as described above, can be configured and further developed for conducting video conferences with people in the interior. By taking sensor data relating to disruptive noise sources into account in the evaluation unit of the video conferencing system, background noise can be avoided by muting a microphone that is not currently being used for speaking, thus enabling a motor vehicle with good acoustic video conferencing capabilities. Another aspect of the invention relates to a method for conducting a video conference with persons located in the interior of a motor vehicle using a video conferencing system, which can be designed and further developed as described above, in particular in a motor vehicle, which can be designed and further developed as described above, in which the speech contribution of the person is detected with the aid of the at least one microphone, the noise source different from the speech contribution is detected with the aid of the evaluation unit fed from sensor data of the motor vehicle, and in the case that no speech contribution but the noise source detected by the evaluation unit is recorded at the respective microphone, this microphone is deactivated and / or the volume of this microphone is reduced.By taking into account sensor data relating to disruptive noise sources in the evaluation unit of the video conferencing system, background noise can be avoided by muting a microphone that is not currently being used for the speech contribution, thus enabling a motor vehicle with an acoustically good video conferencing function. Another aspect concerns a computer program product with a program comprising command codes, wherein, when the program is executed by a data processing device, in particular a computer, the command codes cause the data processing device to execute the procedure, which can be developed and further refined as described above. By taking sensor data relating to interfering noise sources into account in the evaluation unit of the video conferencing system, background noise can be avoided by muting a microphone not currently being used for the speech contribution, thus enabling a motor vehicle with good acoustic video conferencing functionality. The invention is explained below by way of example with reference to the accompanying drawings and preferred embodiments, wherein the features shown below can represent an aspect of the invention, either individually or in combination, and the scope of protection is defined by the claims. Figure 1 shows a schematic representation of a motor vehicle with a videoconferencing system, and Figure 2 shows a schematic flowchart for the method that can be carried out with the videoconferencing system from Figure 1. The motor vehicle 10 shown in Fig. 1 has a video conferencing system 12, by means of which at least one person 14, preferably several persons 14, can participate in a video conference in an interior 16 of the motor vehicle 10 while the vehicle is in motion. For this purpose, the video conferencing system 12, which is integrated into the data infrastructure of the motor vehicle 10, can have at least one interior camera 18, with which a sequence of images of the persons 14 located in the interior 16 can be filmed for the video conference. Preferably, a separate interior camera 18 is provided for each person 14 and assigned to the respective person 14. In addition, the video conferencing system 12 has at least one microphone 20 to record speech contributions 22 from the persons 14 for the video conference, wherein preferably several separate microphones 20 and assigned to the respective person 14 are provided. The video conferencing system 12 has an evaluation unit 24 which uses sensor data, which may originate, for example, from the interior camera 18 and / or the microphone 20, to detect whether a speech contribution 22 or background noise from a different sound source 26 is being recorded by the respective microphone 20. For example, the background noise source 26 could be wind noise, which would be audible when a window 28 is opened in the interior 16 of the vehicle 10 and would be recorded by the microphones 20. Since the opening of the window 28, especially with the aid of an electric window regulator, can be easily detected by means of an opening sensor 30, the sensor signal generated by the opening sensor 30 can be evaluated in the evaluation unit 24 in such a way that a disturbing noise source 26 audible in the interior 16 is to be expected in the vicinity of the window 28 to be opened.This can cause the evaluation unit 24 to mute, or "mute", the microphones 20 positioned near the open window 28 and / or near the interfering noise source 26 using a volume control device 32 connected to the evaluation unit 24, provided that this microphone 20 is not currently being used to record a detected speech contribution. The acoustic speech quality of the video conferencing system 12 can be improved by avoiding the recording of interfering noise sources 26 by utilizing sensor signals already present in the vehicle 10 for the anticipatory detection of potential interfering noise sources 26. As shown in Fig. 2, during the operation of the videoconferencing system 12, a first step 34 can be performed to check for each microphone 20 whether a speech contribution 22 is present. In a second step 36, which may be performed before, after, or simultaneously with this step, it can be checked whether a noise source 26, different from the speech contribution 22, is audible in the interior 16 of the vehicle 10 or is likely to become audible in the near future. If this is not the case, the procedure can be repeated with the first step 34. If a disturbing noise source 26 is to be expected, at least those microphones 20 for which no speech contribution 22 is currently present can be automatically muted in a third step 38, after which the procedure can be repeated with the first step 34.The muting can last for a predefined period of time and / or be lifted as soon as the disturbing noise source 26 can no longer be heard in the interior 16 and / or a speech contribution 22 is detected at the previously muted microphone 20.

Claims

Video conferencing system (12) for conducting a video conference with persons (14) provided in an interior (16) of a motor vehicle (10), comprising at least one microphone (20) for recording speech contributions (22) of the at least one person (14), an evaluation unit (24) for detecting noise sources (26) from the motor vehicle (12) and / or the interior (16) of the motor vehicle (12), wherein the noise sources (26) detected by the evaluation unit (24) are different from the speech contributions (22) recorded via the at least one microphone (20), and a volume control device (32) connected to the evaluation unit (24) for automatically deactivating and / or reducing the volume of the microphone (20) in the event that no speech contribution (22) is recorded by this microphone (20) but the noise source (26) detected by the evaluation unit (24) is recorded. Video conferencing system (12) according to claim 1, wherein several microphones (20) are provided for each person (14) in the interior (16) of the motor vehicle (12) and the volume control device (32) is connected to each microphone (20) individually. Video conferencing system (12) according to claim 2, wherein the multiple microphones (20) are connected to the evaluation unit (24) for the use of sounds recorded by means of the respective microphone (20) as sensor data for acoustic identification of a person (14) making a speech contribution (22) and / or for acoustic identification of a person (14) not making a speech contribution (22). Video conferencing system (12) according to one of claims 1 to 3, wherein at least one indoor camera (18) is provided for recording a video image sequence of the at least one person (14), wherein the indoor camera (18) is connected to the evaluation unit (24) for using the video image sequence as sensor data for optical identification of a person (14) making a speech contribution (22) and / or for optical identification of a person (14) not making a speech contribution (22) and / or for optical identification of relatively moving parts within the interior space (16) that cause noise. Video conferencing system (12) according to one of claims 1 to 4, wherein at least one / the indoor camera (18) is provided for recording a video image sequence of the at least one person (14), wherein the indoor camera (18) is connected to the evaluation unit (24) for using the video image sequence as sensor data for the identification of a noise-producing body action. Video conferencing system (12) according to one of claims 1 to 5, wherein at least one opening sensor (30) is provided for the detection of an at least partially opened side window (28) and / or roof window and / or convertible roof, wherein the opening sensor (30) is connected to the evaluation unit (24) for the use of a sensor signal from the opening sensor (30) as sensor data for the localization of a noise source (26) based on audible wind noise relative to the microphones (20). Video conferencing system (12) according to one of claims 1 to 6, wherein at least one switching device is provided for switching an electrical device and / or an electric motor of an auxiliary unit of the motor vehicle (10), wherein the switching device is connected to the evaluation unit (24) for using a switch-on signal of the switching device as sensor data for creating a noise source (26). Video conferencing system (12) according to one of claims 1 to 7, wherein a speed sensor is provided for detecting a driving speed of the motor vehicle (12), wherein the speed sensor is connected to the evaluation unit (24) for using the detected driving speed for adjusting a volume threshold for detecting the presence of a noise source (26). Motor vehicle (10) with an interior (16) and a video conferencing system (12) according to one of claims 1 to 8 for conducting a video conference with persons (14) provided in the interior (16). Method for conducting a video conference with persons (14) located in an interior (16) of a motor vehicle (10) using a video conferencing system (12) according to one of claims 1 to 8, wherein the speech contribution (22) of the person (14) is detected with the aid of the at least one microphone (20), the noise source (26) different from the speech contribution (22) is detected with the aid of the evaluation unit (24) fed from sensor data of the motor vehicle (10), and in the event that no speech contribution (22) but the noise source (26) detected by the evaluation unit (24) is recorded at the respective microphone (20), this microphone (20) is deactivated and / or the volume of this microphone (20) is reduced.

Images