Driver assistance system and procedures

Abstract

The invention relates to a driver assistance system (10) for a vehicle (12), comprising an audio output device (14) and a voice input device (16) for communicating with at least one occupant (18) of the vehicle (12), a first detection device (20) for detecting the position (18a) of at least one commanding occupant (18) on a vehicle seat (20) of the vehicle (12) and a second detection device (22) for identifying the commanding occupant (18), and an electronic computing device (24) for at least partially controlling the audio output device (14) and / or the voice input device (16) depending on the position (18a) and / or the identified commanding occupant (18). The invention further relates to a method, a computer program product, and a non-volatile computer-readable storage medium.

Description

FIELD OF THE INVENTION

[0001] The present invention relates to the field of motor vehicles. In particular, the present invention relates to a driver assistance system (DAS) for a vehicle according to claim 1. Furthermore, the present invention relates to a method for operating such a driver assistance system, a corresponding computer program product, and a corresponding non-volatile computer-readable storage medium. BACKGROUND INFORMATION

[0002] Possibilities for intercommunication with a driver assistance system have already been disclosed in the prior art. However, this typically involves a general output for the vehicle interior, where no specific occupants are taken into account; rather, the communication is intended for all occupants in the interior. In this context, the driver assistance system is designed to interact with every occupant.

[0003] Document WO2022245770 A1 discloses a method and system for identifying and locating a vehicle occupant within a vehicle cabin. The method and system use at least one sensor device installed in the vehicle cabin to automatically collect information about an occupant. This information includes video and audio recordings captured by at least one camera and at least one microphone located in the vehicle cabin. SUMMARY OF THE INVENTION

[0004] The object of the present invention is to improve the communication of a driver assistance system so that it is able to capture more precise comments and make corresponding outputs.

[0005] This object is achieved by a system having the features of claim 1 and by a method according to the invention, using a corresponding computer program product, a corresponding non-volatile computer-readable storage medium, and a corresponding assistance system. Advantageous embodiments of the invention are set forth in the dependent claims.

[0006] One aspect of the invention relates to a driver assistance system used in vehicles, which is equipped with an audio output device and / or a voice input device to enable communication with at least one vehicle occupant. The first detection device is provided to determine the precise position of the at least one commanding occupant on one of the vehicle seats. This detection device can, for example, use sensors on the vehicle seats to determine whether or where the occupants are sitting. The second detection device serves to identify the commanding occupant. An optical detection device, such as a vehicle camera, can be used to recognize the faces of the occupants and identify them.

[0007] To achieve the object of the invention, an electronic computing device is used to partially control the audio output device and / or the voice input device. This at least partial control depends on the position and / or the occupant currently issuing a command. For example, the computing device can direct the audio output precisely to the occupant who is currently uttering a command or request.

[0008] With this driver assistance system, the adjustment of the vehicle's acoustic chambers can be controlled electronically. While conventional vehicles have static acoustic chambers that assume all seats are occupied, this driver assistance system enables dynamic adjustment of the acoustic chambers based on seat occupancy. This has a significant impact on the quality of communication within the vehicle, as audio output and voice input can be optimized depending on seat occupancy. This results in more efficient and personalized communication within the vehicle between the driver assistance system and the occupant, while maintaining occupant privacy and comfort. For example, the volume can be reduced in unoccupied seats to improve occupant privacy and comfort.This can also prevent outside noise from penetrating the interior and disrupting communication. Another example is that the driver assistance system also prevents, for example, a phone call from outside from being heard.

[0009] In an advantageous embodiment of the invention, it is provided that the fine-tuning and / or alignment of the respective loudspeaker and / or other components of the audio output device is at least partially controllable, for example, by the electronic computing device and / or other devices. This means that the system can adjust the volume, sound quality, and alignment of the loudspeakers to achieve optimal sound for the occupants. For example, it can control the vehicle loudspeakers so that the sound is clear and pleasant for the driver and / or the occupants, while it may be different for other occupants or only for the driver or the occupant.

[0010] In a further advantageous embodiment of the invention, the fine-tuning and / or alignment of the respective microphones and / or other components of the voice input device is at least partially controllable. This means that the microphones can be aligned so that they capture the resident's voice clearly and distinctly. This can help minimize background noise and improve the quality of speech recognition for recognizing the given commands.

[0011] In a further advantageous embodiment of the invention, it is provided that the audio output device and / or the voice input device can be controlled at least partially based on multiple detected and / or identified occupants. This allows the system to adapt communication accordingly when multiple occupants are present in the vehicle. For example, it can control the volume or direction of the audio output to ensure that all occupants can be heard.

[0012] In an advantageous embodiment of the invention, the first detection device is designed as an occupant restraint control (ORC). The ORC detects seat occupancy and reports this to the assistance system. This is an example of a sensor device that can be used to detect the occupant position.

[0013] In a further advantageous embodiment of the invention, the second detection device is designed as an optical detection device, for example, a camera. A camera in the vehicle interior records the occupant, and the video footage can be used for identification. This is particularly helpful for clear occupant recognition or identification. If an occupant is identified, the control elements of the devices can, for example, be adjusted according to the installed preferences of the identified occupant.

[0014] In a further advantageous embodiment of the invention, the electronic computing device provides artificial intelligence (AI) for communication with the occupants. The AI ​​can use natural language processing to interact with the occupants and learn about their behavior, using the learned information to optimize the control of all systems. This means that the occupants can communicate naturally with the vehicle by issuing commands or asking questions.

[0015] The driver assistance system for a partially automated motor vehicle comprises at least one module, a detection device and an electronic computing device.

[0016] A second aspect of the invention relates to a method for operating a driver assistance system for a vehicle, in which communication with at least one occupant takes place via an audio output device and / or a voice input device, wherein a position of at least one commanding occupant on one of the vehicle seats is detected by a first detection device. Furthermore, the commanding occupant is identified by a second detection device. The method is characterized in that an at least partial control of the audio output device and / or the voice input device takes place by an electronic computing device as a function of the position and / or the detected or identified occupant.

[0017] Further advantages, features, and details of the invention will become apparent from the following description of preferred embodiments and from the drawings. The features and combinations of features mentioned above in the description, as well as the features and combinations of features mentioned in the following description of the figures and / or illustrated alone in the figures, can be used not only in the respective combinations specified, but also in any other combination or alone, without departing from the scope of the invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The novel features and characteristics of the disclosure are set forth in the appended claims. The accompanying drawings, which are incorporated in and constitute a part of this disclosure, illustrate exemplary embodiments and, together with the description, serve to explain the disclosed principles. In the figures, the leftmost digits of a reference number indicate the figure in which the reference number first appears. Throughout the figures, the same numerals are used to refer to like features and components. Some embodiments of systems and / or methods consistent with embodiments of the present subject matter are described below, by way of example only, and with reference to the accompanying figures.

[0019] The drawings show in: Fig. 1 is a plan view of a vehicle interior showing a possible configuration of a driver assistance system; Fig. 2 a diagram illustrating the possible functionality of data acquisition leading to the execution of commands by the driver assistance system.

[0020] In the figures, identical elements or elements with the same function are identified by the same reference numerals. DETAILED DESCRIPTION

[0021] Throughout this document, the word "exemplary" is used to mean "serving as an example, instance, or illustration." Any embodiment or implementation of the present subject matter described herein as "exemplary" should not necessarily be construed as preferred or advantageous over other embodiments.

[0022] While the disclosure is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will be described in detail below. It should be understood, however, that the disclosure is not intended to be limited to the particular forms, but on the contrary, it is intended to cover all modifications, equivalents, and alternatives falling within the scope of the disclosure.

[0023] The terms "comprises," "including," or other variations thereof are intended to cover non-exclusive inclusion, such that a facility, device, or method comprising a list of components or steps not only includes those components or steps, but may also include other components or steps not expressly listed or included in such facility, device, or method. In other words, one or more elements in a system or device preceded by the word "comprises" or "comprise" do not exclude, without further limitation, the presence of other elements or additional elements in the system or method.

[0024] In the following detailed description of the embodiment of the disclosure, reference is made to the accompanying drawings, which form a part of the disclosure, and in which is shown by way of illustration a specific embodiment in which the disclosure may be practiced. This embodiment has been described in sufficient detail to enable those skilled in the art to apply the disclosure, and it is to be understood that other embodiments may be utilized and changes may be made without departing from the scope of the present disclosure. The following description is therefore not to be taken in a limiting sense.

[0025] Fig. 1 shows a plan view of a vehicle interior of the vehicle 12, illustrating a possible configuration of a driver assistance system 10 for the vehicle 12. The driver assistance system 10 includes an audio output device 14 and a voice input device 16 for communicating with at least one occupant 18 of the vehicle 12.

[0026] In Fig. Figure 1 shows two examples that illustrate the difference between boarding passengers and how the driver assistance system 10 adapts to this difference. The areas where communication is improved are indicated by dashed lines. With a higher number of passengers and thus a larger space requirement, a correspondingly larger space is provided. With only one occupant, the space around the seat is sufficient.

[0027] The driver assistance system 10 further includes a first detection device 20 for detecting a position 18a of at least one commanding occupant 18 on a vehicle seat 12 and a second detection device 22 for identifying the commanding occupant 18. An electronic computing device 24 is provided for at least partially controlling the audio output device 14 and / or the voice input device 16 depending on the position 18a and / or the identified commanding occupant 18. Fine tuning and / or alignment of the respective loudspeakers 14a and other components of the audio output device 14 are at least partially controllable. Furthermore, fine tuning and / or alignment of the respective microphones 16a and other components of the voice input device 16 are at least partially controllable.The audio output device 14 and / or the voice input device 16 are controllable at least partially on the basis of a plurality of recognized and / or identified occupants 18, 19.

[0028] It is provided that the first detection device 20 is designed as an occupant restraint control (ORC) and the second detection device 22 is designed as an optical detection device or camera.

[0029] The electronic computing device 24 may be configured to provide artificial intelligence (AI) for communication with the occupants 18, 19.

[0030] Fig. 1 therefore shows the vehicle interior in which four vehicle seats 20 are installed. The intention is to create a dynamic acoustic chamber to optimize communication between the occupants 18, 19 and the driver assistance system 10. While each vehicle seat 20 has at least one voice input device 16 and one audio output device 14, it is intended that only these audio output devices 14 and only these voice input devices 16 are used when the vehicle seat 20 or the referenced vehicle seat 20 is used by an occupant. Vehicle seats 20 without an occupant 18 are therefore not part of the acoustic chamber, which is why the audio output device 14 and the voice input device 16 of these vehicle seats 20 are deactivated.When the first detection device 20 detects an occupant 18, the detected position 18a is sent to the electronic computing device 24, and the electronic computing device 24 starts identifying the occupant 18 with the second detection device 22. After identifying the occupant 18 at position 18a on the vehicle seat 20, preferences of this occupant 18 can be uploaded to the electronic computing device 24. After identifying the occupant 18, the electronic computing device 24 controls the audio output device 14 and the voice input device 16 to achieve the best possible communication with the occupant 18. For this purpose, the fine tuning and / or alignment with the respective loudspeakers 14a and microphones 16a is controlled and, for example, triggered by the electronic computing device 24.If multiple occupants 18, 19 are present, the audio output device 14 and / or the voice input device 16 are controlled based on the plurality of detected and identified occupants 18, 19.

[0031] In other words, to conduct an accurate and personalized conversation in vehicle 12, the electronic computing device 24 is equipped with artificial intelligence (AI). This AI system needs to know who the occupant is giving a command or requesting information at a given time. This can be solved by providing the AI ​​system with information about which vehicle seat 20 in vehicle 12 is occupied. The information required by the AI ​​system is transmitted via the occupant restraint control (ORC). The ORC transmits to the AI ​​system the number and position of the occupants 18, 19 and their seating positions 18a, 19a, e.g., in the front row or in the rear seats, since the ORC is trained to monitor each vehicle seat 20.

[0032] Using the information provided by the ORC, the AI ​​system calculates and adjusts its acoustic chamber parameters for the audio output device 14 and the voice input device 16, as well as for the microphones 16a and / or the speakers 14a, to obtain prompt responses. This results in the alignment and fine-tuning of the in-vehicle microphones 16a and speakers 14a for better speech recognition and dialogue. Once the acoustic chamber is tuned based on the number of occupants 18, 19, the AI ​​system can prioritize the commands given by the vehicle occupants 18, 19.

[0033] Fig. 2 shows a diagram to explain the implementation of the driver assistance system 10, wherein a series of steps are carried out within the driver assistance system to enable improved communication in the vehicle.

[0034] In a step S1, the ignition is switched on.

[0035] In step S2 the occupants get into the vehicle.

[0036] In a step S3, the occupant restraint control ORC is activated, typically when the seat belts are fastened.

[0037] In step S4, the ORC collects information about the seat occupancy (N 1-4).

[0038] In a step S5, the ORC collects information about the position of the occupant seats, both front and rear.

[0039] In a step S6, the AI ​​system receives information from the ORC, including data such as weight and seat settings from seat and airbag sensors.

[0040] In step S7, the AI ​​system dynamically adjusts the acoustic chambers based on the collected information.

[0041] In step S8, the microphone range and speaker output are adjusted accordingly to optimize audio quality.

[0042] In step 9, the artificial intelligence manages prompt comments from any direction within the vehicle, with priority given to the driver or primary occupant. The AI ​​response audio source is directed to the location of an occupant to ensure effective communication. In summary, the invention describes artificial intelligence for personalized speech recognition and dialogue.

[0043] The chronological sequence of the steps shown can also vary, and the entry of additional steps is possible.

[0044] In summary, the invention describes a method in which an artificial intelligence (AI) system in a vehicle performs various steps to optimize the occupants' audio experience. These steps include switching on the ignition, collecting information about the seat occupancy and position of the occupants, receiving data from sensors in the vehicle, adjusting the acoustic properties of the vehicle interior, and controlling microphones and speakers to optimize audio quality. The AI ​​system also prioritizes communication with the driver or the vehicle's primary occupants to ensure effective interaction. Overall, it is a personalized speech recognition and dialogue solution that enhances the driving experience. Reference symbol 10 Driver assistance system 12 vehicles 14 Audio output device 14a loudspeaker 16 Voice input device 16a Microphones 18 inmates 19 inmates 20 first recording device 22 second detection device 24 electronic computing devices ORC occupant restraint control All artificial intelligence S1-S9 steps 18a Position 19a Position QUOTES CONTAINED IN THE DESCRIPTION

[0000] This list of documents submitted by the applicant was generated automatically and is included solely for the convenience of the reader. This list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions. Cited patent literature

[0000] WO 2022245770 A1

[0003]

Claims

[1] Driver assistance system (10) for a vehicle (12), comprising an audio output device (14) and a voice input device (16) for communicating with at least one occupant (18) of the vehicle (12), comprising a first detection device (20) for detecting the position (18a) of at least one commanding occupant (18) on a vehicle seat (20) of the vehicle (12) and comprising a second detection device (22) for identifying the commanding occupant (18), characterized by : - an electronic computing device (24) for at least partially controlling the sound output device (14) and / or the voice input device (16) as a function of the position (18a) and / or the identified commanding occupant (18). [2] Driver assistance system (10) according to claim 1, characterized by , that the fine tuning and / or alignment of the respective loudspeakers (14a) and / or other components of the audio output device (14) can be at least partially controlled is. [3] Driver assistance system (10) according to claim 1 or 2, characterized by , that the fine tuning and / or alignment of the respective microphones (16a) and / or other components of the speech input device (16) can be at least partially controlled is. [4] Driver assistance system (10) according to one of the preceding claims, characterized by , that the audio output device (14) and / or the voice input device (16) can be controlled at least partially depending on several detected and / or identified occupants (18, 19) are. [5] Driver assistance system (10) according to one of the preceding claims, characterized bythat the first detection device (20) is designed as an occupant restraint control (ORC). [6] Driver assistance system (10) according to one of the preceding claims, characterized by that the second detection device (22) is designed as an optical detection device. [7] Driver assistance system (10) according to one of the preceding claims, characterized by that the electronic computing device (24) is configured to provide artificial intelligence (AI) for communication with the occupants (18, 19). [8] Method for operating a driver assistance system (10) for a vehicle (12), in which communication with at least one occupant (18) takes place via an audio output device (14) and / or a voice input device (16), wherein a position (18a) of at least one commanding occupant (18) on one of the vehicle seats (20) is detected by a first detection device (20); wherein an identification of the commanding occupant (18) takes place by a second detection device (22); characterized by that: an at least partial control of the sound output device (14) and / or the voice input device (16) is carried out by an electronic computing device (24) as a function of the position (18a) and / or the identified occupant (18). [9] Computer program product with program code means for carrying out a method according to claim 8. [10] A non-transitory computer-readable storage medium containing at least the computer program product according to claim 9.

Images