Driver Assistance System and Method

Abstract

A driver assistance system (10) for a vehicle (12), with an audio output device (14) and a voice input device (16) for communication with at least one occupant (18) of the vehicle (12), has a first de

Description

FIELD OF THE INVENTION

[001] The present invention relates to the field of automobiles. More specifically, the present invention relates to a driver assistance system (DAS) for a vehicle according to claim 1. Furthermore, the present invention relates to a method for operating such a driver assistance system, a corresponding computer program product, a corresponding non-transitory computer-readable storage medium. BACKGROUND INFORMATION

[002] In the prior art, intercommunication capabilities with a driver assistance system are already disclosed. However, these capabilities typically involve a general output for the interior of the vehicle, where no specific occupants are considered, but rather, communication is intended for all occupants within the interior. In this context, the driver assistance system is designed to interact with any occupant.

[003] The document WO2022245770 A1 discloses a method and a system for identifying and locating a vehicle occupant within a vehicle cabin. This method and system utilize at least one sensor device installed within the vehicle cabin to automatically collect information about an occupant. This information includes video and audio recording captured by at least one camera and at least one microphone located in the vehicle cabin. SUMMARY OF THE INVENTION

[004] The task of the present invention is to enhance the communication of a driver assistance system, enabling it to capture more precise comments and provide corresponding outputs.

[005] This task is accomplished through a system with the features of claim 1, as well as by a method according to the invention and by utilizing a corresponding computer program product, a corresponding non-transitory computer-readable storage medium, as well as a corresponding assistance system. Advantages embodiments of the invention can be found in the dependent claims.

[006] One aspect of the invention relates to a driver assistance system used in vehicles, equipped with an audio output device and / or a voice input device to facilitate communication with at least one occupant of the vehicle. The first detection device is provided to determine the precise position of at least one commanding occupant on one of the vehicle's seats. This detection device may for example utilize sensors on the vehicle's seats to ascertain whether or where occupants are seated. The second detection device is designed to identify the commanding occupant. An optical detection device, such as an in-car camera, may be used to recognize faces of the occupants and identify them.

[007] In order to address the task of the invention, an electronic computing device is employed to perform partial control over the audio output device and / or the voice input device. The at least partial control depends on the position and / or the rectified commanding occupant. For example, the computing device may precisely route audio output to the occupant currently using a command or making a request.

[008] With this driver assistance system and adaption of the vehicle's acoustic chambers may be controlled by the electronic device. While conventional vehicles have static acoustic chambers that assume all seats are occupied, this driver assistance system allows for dynamic adjustment of the acoustic chamber based on seat occupancy. This has a significant impact on the quality of communication within the vehicle, as audio output and voice input may be optimized depending on seat occupancy. This leads to more efficient and personalized communication within the vehicle between the driver assistance system and the occupant, while preserving the privacy and comfort of the occupants. For example the volume may be reduced in unoccupied seats to enhance the privacy and comfort of the occupant. Additionally, this helps to prevent external noises from entering the interior and disrupting communication. As another example, the driver assistance system also prevents the sound of for example a call from being heard from outside.

[009] In an advantageous embodiment of the invention, it is envisaged that the fine-tuning and / or alignment of the respective speaker and / or other components of the audio output device is at least partially controllable, for example by the electronic computing device and / or other devices. This means that the system may adjust the volume, sound quality, and direction of the speakers to provide an optimal sound for the occupants. For example, it may control the vehicle speakers in such a way that the sound is clear and pleasant for the driver and / or the occupants, whilst it may be intended to be different for other passengers or just for the driver or the occupant.

[0010] In another advantageous embodiment of the invention, it is envisaged that the fine-tuning and / or alignment of the respective microphones and / or other components of the voice input device is at least partially controllable. This means that the microphones may be oriented to capture the occupant's voice clearly and distinctly. This may help minimize background noises and improve the quality of voice recognition to recognize the commands given.

[0011] In another advantageous embodiment of the invention, it is envisaged that the audio output device and / or the voice input device is at least partially controllable based on a plurality of detected and / or identified occupants. This allows the system to adjust communication accordingly when multiple occupants are in the vehicle. For example, it may control the volume or direction of audio output to ensure that all occupants may be heard.

[0012] In an advantageous embodiment of the invention, it is foreseen that the first detection device is implemented as an occupant restraint controller ORC. The ORC detects seat occupancy and reports it to the assistance system. This is an example of a sensor device that may be used for occupant position detection.

[0013] In another advantageous embodiment of the invention, it is foreseen that the second detection device is implemented as an optical detection device for example a camera. A camera in the vehicle interior captures the occupant whereby the video material may be used for identification. This is particularly helpful for clear occupant recognition or identification. For example, when an occupant is identified, controls of the devices may be adjusted according to installed preferences of the identified occupant.

[0014] In another advantageous embodiment of the invention, it is envisaged that the electronic computing device is designed to provide artificial intelligence, Al, for communication with the occupants. The Al may use natural language processing to interact with occupants and learn about the behavior of the occupants and use the learned information to optimize the controlling of all devices. This means that the occupants may communicate with the vehicle naturally by using commands or asking questions.

[0015] The driver assistance system for a partially automated motor vehicle comprises at least one module, one capturing device, and one electronic computing device.

[0016] A second aspect of the invention relates to a method for operating a driver assistance system for a vehicle, in which communication with at least one occupant is conducted through an audio output device and / or voice input device, whereby a position of at least one commanding occupant on one of the vehicle's seat is detected by a first detection device. Furthermore an identification of the commanding occupant is performed by a second detection device. The method is characterized in that an at least partial control of the audio output device and / or the voice input device depending on the position and / or the recognized or identified occupant is performed by an electronic computing device.

[0017] Further advantages, features, and details of the invention derive from the following description of preferred embodiments as well as from the drawings. The features and feature combinations previously mentioned in the description as well as the features and feature combinations mentioned in the following description of the figures and / or shown in the figures alone may be employed not only in the respectively indicated combination but also in any other combination or taken alone without leaving the scope of the invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The novel features and characteristic of the disclosure are set forth in the appended claims. The accompanying drawings, which are incorporated in and constitute a part of this disclosure, illustrate exemplary embodiments and together with the description, serve to explain the disclosed principles. In the figures, the left-most digits of a reference number identifies the figure in which the reference number first appears. The same numbers are used throughout the figures to reference like features and components. Some embodiments of system and / or methods in accordance with embodiments of the present subject matter are now described below, by way of example only, and with reference to the accompanying figures.

[0019] The drawings show in:

[0020] Fig. 1 an overhead view of a vehicle interior illustrating a possible configuration of a driver assistance system;

[0021] Fig. 2 a diagram illustrating the potential functionality of data collecting leading to the execution of commands by the driver assistance system.

[0022] In the figures the same elements or elements having the same function are indicated by the same reference signs. DETAILED DESCRIPTION

[0023] In the present document, the word "exemplary" is used herein to mean "serving as an example, instance, or illustration". Any embodiment or implementation of the present subject matter described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments.

[0024] While the disclosure is susceptible to various modifications and alternative forms, specific embodiments thereof have been shown by way of example in the drawing and will be described in detail below. It should be understood, however, that it is not intended to limit the disclosure to the particular forms disclosed, but on the contrary, the disclosure is to cover all modifications, equivalents, and alternatives falling within the scope of the disclosure.

[0025] The terms “comprises”, “comprising”, or any other variations thereof, are intended to cover a non-exclusive inclusion so that a setup, device or method that comprises a list of components or steps does not include only those components or steps but may include other components or steps not expressly listed or inherent to such setup or device or method. In other words, one or more elements in a system or apparatus preceded by “comprises” or “comprise” does not or do not, without more constraints, preclude the existence of other elements or additional elements in the system or method.

[0026] In the following detailed description of the embodiment of the disclosure, reference is made to the accompanying drawing that forms part hereof, and in which is shown by way of illustration a specific embodiment in which the disclosure may be practiced. This embodiment is described in sufficient detail to enable those skilled in the art to practice the disclosure, and it is to be understood that other embodiments may be utilized and that changes may be made without departing from the scope of the present disclosure. The following description is, therefore, not to be taken in a limiting sense.

[0027] Fig. 1 illustrates an overhead view of a vehicle interior of vehicle 12 illustrating a possible configuration of a driver assistance system 10 for the vehicle 12. The driver assistance system 10 contains an audio output device 14 and a voice input device 16 for communication with at least one occupant 18 of the vehicle 12.

[0028] In Fig. 1, two examples are depicted, highlighting the distinction between entering occupants and the adjustment of the driver assistance system 10 to this difference. The areas where communication is improved are represented by dashed areas. With a higher number of occupants and thus a larger required space, a larger space is provided, accordingly. With only one occupant, the space around the seat is sufficient.

[0029] The driver assistance system 10 also contains a first detection device 20 to detect a position 18a of at least one commanding occupant 18 on a vehicle seat 12 and contains a second detection device 22 to identify the commanding occupant 18. An electronic computing device 24 is foreseen for at least partial control of the audio output device 14 and / or the voice input device 16 depending on the position 18a and / or the identified commanding occupant 18. A fine-tuning and / or alignment of respective speakers 14a and other components of the audio output device 14 are at least partially controllable. Furthermore a fine-tuning and / or alignment of respective microphones 16a and other components of the voice input device 16 are also at least partially controllable. The audio output device 14 and / or the voice input device 16 are at least partially controllable based on a plurality of detected and / or identified occupants 18, 19.

[0030] It is envisaged that the first detection device 20 is implemented as an occupant restrained controller, ORC, and the second detection device 22 is implemented as an optical detection device or a camera.

[0031] The electronic computing device 24 may be configured to provide an artificial intelligence, Al. for communication with the occupants 18, 19.

[0032] Therefore, Fig. 1 illustrates the vehicle interior in which four vehicle seats 20 are installed. It is envisaged to create a dynamic acoustic chamber, to optimize the communication of the occupants 18,19 with the driver assistance system 10. While each vehicle seat 20 has at least one voice input device 16 and one audio output device 14 for itself it is envisaged that only those audio output devices 14 and only those voice input devices 16 are used, if the vehicle seat 20 or the referenced vehicle seat 20 is used by an occupant. Vehicle seats 20 without an occupant 18 are therefore no part of the acoustic chamber, therefore the audio output device 14 and the voice input device 16 of those vehicle seats 20 are turned off. When the first detection device 20 detects an occupant 18, the detected position 18a is sent to the electronic computing device 24 and the electronic computing device 24 starts an identification of the occupant 18 with the second detection device 22. After identifying the occupant 18 on the position 18a on the vehicle seat 20 preferences of this occupant 18 may be uploaded to the electronic computing device 24. After identifying the occupant 18 the electronic computing device 24 controls the audio output device 14 and the voice input device 16 to obtain the best communication possible with the occupant 18. Therefore the fine-tuning and / or alignment with the respective speakers 14a and microphones 16a is controlled by the electronic computing device 24 and for example actuates. If there are more occupants 18, 19, the audio output device 14 and / or the voice input device 16 are controlled based on the plurality based on those detected and identified occupants 18, 19.

[0033] In other words, in order to have an accurate and personalized conversation in the vehicle 12, the electronic computing device 24 is equipped with the artificial intelligence, Al. This Al system will need to know who the occupant giving a command or requesting information at any given time is. This may be resolved by providing information to the Al system as to which vehicle seat 20 in the vehicle 12 is occupied. The information needed by the Al system will come through the occupant restrained controller ORC. The ORC will transmit to the Al system a number and a position of occupants 18, 19 and their seating positions 18a, 19a, for example, in the front row or in the back seats, as the ORC is trained to perform monitoring of each vehicle seat 20.

[0034] With the information coming from the ORC, the Al system will compute and adjust its acoustic chamber's parameters for the audio output device 14 and the voice input device 16, as well for microphones 16a and / or speakers 14a for prompt responses. Resulting in aiming and fine-tuning of the internal vehicle microphones 16a and speakers 14a for better speech recognition and speech dialogue. Once the acoustic chamber is tuned based on the number of occupants 18, 19, the Al system may then prioritize commands giving by the vehicle occupants 18,19.

[0035] Fig. 2 illustrates a diagram to explain a way to implement the driver assistance system 10, whereby to provide an enhanced in-vehicle communication experience, a series of steps are executed within the driver assistance system.

[0036] In a step S1, it is envisaged that the ignition is turned on.

[0037] In a step S2, occupants enter the vehicle.

[0038] In a step S3, the occupant restraint controller ORC system engages, typically when seat belts are fastened.

[0039] In a step S4, the ORC will gather information about seat occupancy (N 1-4).

[0040] In a step S5, the ORC will gather information about the position of the occupant seats, both front and rear.

[0041] In a step S6, the Al system will receive information from ORC, including data such as weight and seat settings from seat sensors and airbag sensors.

[0042] In a step S7, the Al system will dynamically adjust acoustic chambers based on the gathered information.

[0043] In a step S8, the microphone's range and speaker output will be adjusted accordingly to optimize audio quality.

[0044] In a step 9, the Al manages prompt comments from any direction within the vehicle, giving priority to the driver or main occupant of the vehicle. The Al response audio source will be directed to the location where an occupant is located, ensuring effective communication. In summary, the invention describes an artificial intelligence personalized speech recognition and dialogue.

[0045] The chronological arrangement of the steps depicted may also vary, and the input of additional steps is possible.

[0046] In summary, the invention describes a process in which an artificial intelligence (Al) system in a vehicle goes through various steps to optimize the audio experience of the occupants. The steps include turning on the ignition, gathering information about seat occupancy and position of the occupants, receiving data from sensors in the vehicle, adjusting the acoustic properties of the vehicle interior, and controlling microphones and speakers to optimize audio quality. The Al system also prioritizes communication with the driver or main occupants of the vehicle to ensure effective interaction. Overall, it is a personalized speech recognition and dialogue solution that enhances the driving experience. Reference Signs 10 driver assistance system 12 vehicle 14 audio output device 14a speakers 16 voice input device 16a microphones 18 occupant 19 occupant 20 first detection device 22 second detection device 24 electronic computing device ORC occupant restraint controller Al artificial intelligence S1 -S9 steps 18a position 19a position

Claims

1. Driver assistance system (10) for a vehicle (12), with an audio output device (14) and a voice input device (16) for communication with at least one occupant (18) of the vehicle (12), with a first detection device (20) to detect the position (18a) of at least one commanding occupant (18) on a vehicle seat (20) of the vehicle (12) and with a second detection device (22) to identify the commanding occupant (18), characterized by:- an electronic computing device (24) for at least partial control of the audio output device (14) and / or the voice input device (16) depending on the position (18a) and / or the identified commanding occupant (18).

2. Driver assistance system (10) according to claim 1, characterized in thatfine-tuning and / or alignment of respective speakers (14a) and / or other components of the audio output device (14) are at least partially controllable.

3. Driver assistance system (10) according to claim 1 or 2, characterized in thatfine-tuning and / or alignment of respective microphones (16a) and / or other components of the voice input device (16) are at least partially controllable.

4. Driver assistance system (10) according to any one of the preceding claims, characterized in thatthe audio output device (14) and / or the voice input device (16) are at least partially controllable based on a plurality of detected and / or identified occupants (18, 19).

5. Driver assistance system (10) according to any one of the preceding claims, characterized in thatthe first detection device (20) is implemented as an Occupant Restraint Controller (ORC).

6. Driver assistance system (10) according to any one of the preceding claims, characterized in thatthe second detection device (22) is implemented as an optical detection device.

7. Driver assistance system (10) according to any one of the preceding claims, characterized in thatthe electronic computing device (24) is configured to provide an Artificial Intelligence (Al) for communication with the occupants (18, 19).

8. A method for operating a driver assistance system (10) for a vehicle (12), in which communication with at least one occupant (18) is conducted through an audio output device (14) and / or a voice input device (16), whereby a position (18a) of at least one commanding occupant (18) on one of the vehicle seats (20) is detected by a first detection device (20); whereby an identification of the commanding occupant (18) is performed by a second detection device (22); characterized in that:an at least partial control of the audio output device (14) and / or the voice input device (16) depending on the position (18a) and / or the identified occupant (18) is performed by an electronic computing device (24).

9. A computer program product comprising program code means for performing a method according to claim 8.

10. A non-transitory computer-readable storage medium comprising at least the computer program product according to claim 9.

Images