Controlling communication for driver of motor vehicle

Abstract

The invention relates to a method (100) for controlling a communication of a driver (105) of a motor vehicle (110) with a person (115) other than the motor vehicle (110), comprising the following steps: determining (120-130) a driving situation of the motor vehicle (110); determining (140) a level of attention required by the driver for driving the motor vehicle (110) on the basis of the determined driving situation; the implementation of communication endangering required attention is determined; and affecting (145) the communication according to the desired attention.

Description

Technical Field

[0001] The present invention relates to communication between a motor vehicle driver and an outsider, and in particular to ensuring driving safety of the motor vehicle during the communication. Background Art

[0002] The motor vehicle is controlled by the driver. How much attention the driver needs to pay to this activity depends largely on the driving conditions of the vehicle. When a motor vehicle is on a narrow mountain road, for example in the dark and snowy conditions, a higher level of attention is generally required than when driving at moderate speed on a dry, well-built highway with little traffic during the day.

[0003] While driving, the driver can communicate with people outside the vehicle, for example in a phone call or video conference. If the driving situation now changes so that the driver must concentrate more on driving the vehicle, the communication may become disruptive to the driver. In this case, even if the driver himself does not actively participate in the communication, he may continue to be influenced by the information flow of other people.

[0004] It has already been proposed to reduce certain information that affects the driver when the motor vehicle is in a demanding driving situation. For example, the volume of the entertainment system can be automatically reduced in the event of emergency braking. However, such systems usually intervene in the communication only at a later time. In addition, the driver is usually disconnected from the communication, so that the driver may have difficulty following the communication if the required attention to the current driving situation is only moderately or briefly increased. Summary of the invention

[0005] The object of the present invention is to provide an improved technique for assisting a motor vehicle driver in communicating with a person outside the motor vehicle. The present invention achieves this object by means of the technical solution of the independent claim. The dependent claims provide preferred embodiments.

[0006] According to a first aspect of the invention, a method for controlling communication between a driver of a motor vehicle and other persons outside the motor vehicle has the following steps: determining a driving condition of the motor vehicle; determining a level of attention required by the driver to drive the motor vehicle based on the determined driving condition; determining that communication jeopardizes achievement of the required attention; and influencing the communication based on the required attention.

[0007] It has been found that influencing the communication, in particular gradually, not only allows the driver to always pay full attention to the task of driving or monitoring the motor vehicle, but also allows the communication to be better followed up when traffic conditions place changing demands on the driver's attention. Distractions caused by interfering with the communication can preferably be avoided.

[0008] The required attention, which is determined by the driving situation, can be determined based on different influences on the driver. As will be explained in detail herein, for example, a first factor can be located outside the vehicle and relate in particular to visibility conditions, route guidance, traffic intensity or navigation. A second factor may relate to the vehicle itself and its operation or functions, such as required gear changes, control of the drive motor, operation of the air conditioning system (HVAC) or setting or canceling of external signals or lighting devices. A third factor may relate to information or information flows received by the driver independently of the communication, such as outputs from children, passengers or entertainment systems on board.

[0009] In a preferred embodiment, a driver's distraction is determined, which is independent of the driving situation and the communication. It can then be determined that the communication, in combination with the distraction, jeopardizes the achievement of the required concentration. The more the driver's attention is loaded by other events, situations or activities in the vehicle, the less attention he can allocate to driving the vehicle and communicating. If the concentration required for driving the vehicle and for communicating exceeds a predetermined threshold value, the communication can be affected; the threshold value can be lowered depending on the distraction determined.

[0010] Generally speaking, it is preferred that the mode or degree of intervention in the communication can be selected or predetermined by the driver. In addition, the intervention can depend on the required attention level, the current driving situation or the distraction mode. In one embodiment, the driver can associate the driving situation with the intervention communication.

[0011] Intervention communications can be done gently to avoid alarming or distracting the driver by removing the communication burden.

[0012] In one embodiment, a signal is provided to the driver, which in particular indicates a suggested reduction in communication. The signal can be provided if the required attention exceeds a threshold value or is about to exceed a threshold value. Thus, for example, an optical or acoustic signal can be used to remind the driver to reduce or stop communication. The other person can also receive the signal or be excluded.

[0013] In another embodiment, if the driver must achieve increased concentration, the transmitted messages are delayed within the scope of the communication. The delay can involve one or both communication directions. For example, a call or video data stream can be interrupted for a longer period during a call break, or the information stream of the communication can be temporarily stored and transmitted at a slower speed. If the required concentration drops below a predetermined threshold again, the delayed communication can be caught up again, for example by transmitting the information stream from the buffer at an increased speed. If the buffer is empty, the communication can be transmitted at its original speed.

[0014] In another embodiment, an advance notice that requires increased attention can be provided during a telephone call or video conference. For example, an upcoming driving situation can be indicated by a voice message, such as "about to merge".

[0015] The message can be provided at a predetermined time, for example about 5 to about 20 seconds, before the expected driving situation. The communication can be interrupted until the driving situation with increased attention is dealt with. In another embodiment, the expected start or expected end of the driving situation can be indicated, for example, in the form of a broadcast of the remaining time.

[0016] The messages transmitted within the scope of the communication can be output to the driver with reduced urgency. For example, acoustic messages or information can be output more quietly or optical messages or information can be output smaller, with reduced contrast or lower brightness.

[0017] In another embodiment, a signal is provided to the other person, which signal in particular indicates a proposed reduction in communication. Optionally, the signal can also be provided to the driver. In general, it is applicable that when communicating with multiple persons outside the motor vehicle, one or more persons may be affected by the communication interference or the signal.

[0018] The signal is preferably provided for communicating to the other person that the driver needs to pay more attention in order to drive the motor vehicle. The signal is further preferably selected such that it can be intuitively understood by the other person. For example, the signal can communicate a situation which, according to general experience, indicates a temporary interruption of communication or a reduction in communication. In this way, the other person can get the direct impression that the driver is currently not able to follow the communication well. The other person can slow down the communication, reduce the intensity of the communication or stop the communication until the situation communicated to him on the motor vehicle is resolved.

[0019] In a first variant, the signal can be provided acoustically. For example, the signal can include a voice message indicating an active driving situation that requires increased driver attention, such as a warning of a traffic jam or an impending driving maneuver. The signal can also be an acoustic signal or noise that generally indicates a demanding driving situation, such as a series of signals from a parking distance warning system, a warning bell or tire squeals.

[0020] Other noises may be more subtle and include, for example, the noise of a flashing light, a cough or a verbal "hiss," "shhh," "wait," or "please wait." Synthetic signals are also conceivable. Influencing the communication in this way can be particularly effective if the other person is qualified to drive a motor vehicle or is driving another motor vehicle.

[0021] The warning or signal does not necessarily have to indicate a driving situation corresponding to the current driving situation of the motor vehicle, but can also be outputted on behalf of a known driving situation that requires increased attention by the driver. The acoustic output can be correspondingly performed in such a way that the driver cannot hear it or only hears it attenuatedly.

[0022] In a second variant, the communication includes providing or transmitting an image to the other person, and the signal may involve a change in the image. The image may be generated on the vehicle or may provide information for generating the image. The image may be provided in particular within the scope of a video data stream, which may be generated on the motor vehicle or may be generated in a central location. Therefore, for example, when determining a demanding driving situation, the video data stream of the camera aimed at the driver may be replaced by another video data stream, which may be detected, for example, from the environment of the motor vehicle. Alternatively, the image may also be displayed more blurred or with a coarser resolution. In this way, the other person may not see the driver in the video data stream on the one hand and may also recognize, based on the driving situation in the motor vehicle environment, that his communication with the driver is not currently of the highest priority.

[0023] In another embodiment, the image of the driver can be replaced by a symbol indicating the reduced availability of the driver in order to limit communication. For example, a traffic sign suitable for the content can be displayed, such as the sign 101 (warning triangle with exclamation mark) for general warnings of German road traffic or similar signs for more specific warnings, such as from areas 101-10 to 105-20. The displayed signs can be adapted to the traffic system so that they are effective in the motor vehicle area or in the other personnel area.

[0024] Preferably, the manner of influencing is determined according to the communication. Thus, for example, the communication can be influenced according to the other person, the communication channel used or the content of the communication.

[0025] It is also preferred that an upcoming driving situation is predicted and a required level of attention for the upcoming driving situation is determined. It is further preferred that the communication is already influenced at a predetermined time before the required attention is expected to exceed a predetermined threshold value.

[0026] The influence may end only after a certain driving state has ended. It is generally preferred to control the influence in a smooth transition so as not to start or end abruptly. The transition is preferably determined based on a prediction, but can also be carried out in a fixed predetermined manner.

[0027] By adjusting the communication in advance, it is possible to avoid the driver being distracted or confused by the communication intervention at the very moment when he should be paying close attention to driving the motor vehicle.

[0028] It is further preferred to predict how long the required attention exceeds a predetermined threshold. The communication can then be influenced according to the determined duration. In particular, the manner of influencing can be selected according to the expected duration. For example, a short duration can be bridged by pausing the transmitted information flow; whereas for a longer expected duration, a signal can be sent to the external person.

[0029] A similar mode of operation is also possible without prediction. Here, the communication can be influenced according to the duration for which the required attention exceeds a predetermined threshold. Thus, in the above example, the communication can first be suspended, and if the specific driving situation lasts longer than a predetermined time, a signal can be output.

[0030] According to another aspect of the invention, a device for controlling communication between a driver of a motor vehicle and other persons outside the motor vehicle comprises the following elements: a detection device for determining a driving condition of the motor vehicle; a processing device for determining a level of attention required by the driver to drive the motor vehicle based on the driving condition and for determining whether the communication jeopardizes the achievement of the required attention; and a device for influencing communication according to the required attention.

[0031] The processing device can be arranged to carry out the method described herein in whole or in part. For this purpose, the processing device can be implemented electronically and in particular comprise a programmable microcomputer or a microcontroller. The method can be in the form of a computer program product with program code means. The computer program product can also be stored on a computer-readable data carrier. The features or advantages of the method can be transferred to the device or vice versa.

[0032] According to a further aspect of the invention, a motor vehicle comprises the device described herein. The motor vehicle may in particular comprise a passenger car, a truck or a bus. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] The present invention will now be described in more detail with reference to the accompanying drawings, which are as follows:

[0034] Figure 1 A flow chart showing the method;

[0035] Figure 2 illustrates the system; and

[0036] Figure 3 Diagram showing predicted required attention. DETAILED DESCRIPTION

[0037] Figure 1The flow chart of method 100 for controlling communication between a driver 105 of motor vehicle 110 and another person 115 outside motor vehicle 110 is shown. Driver 105 either controls motor vehicle 110 himself or is a responsible supervisor for partially automatic or autonomous driving of motor vehicle 110. Controlling relates in particular to the movement of motor vehicle 110.

[0038] First, the driving situation of motor vehicle 110 is to be determined. For this purpose, the external driving situation can be determined in step 120, the driving situation of vehicle 110 can be determined in step 125, and the internal driving situation can be determined in step 130. Certain factors on the basis of which the driving situation can be determined can be assigned to different steps or to a plurality of steps.

[0039] External driving conditions may include aspects such as the position of motor vehicle 110 and what information must be taken into account to control the movement of motor vehicle 110. In particular, step 120 may involve the determination of other road users, obstacles, the course or state of the road being traveled, maneuvers such as merging, turning or parking, or influences on the physical characteristics of the driving of motor vehicle 110, such as slippery or icy roads, slopes or crosswinds.

[0040] Furthermore, it is possible to determine whether other road users are approaching or moving away, whether vehicles are located in a poorly visible area (blind spot), whether another vehicle is about to change lanes into the lane in which motor vehicle 110 is traveling, which signal is displayed at the traffic light towards which motor vehicle 110 is traveling, possible changes in the signal, or what noises are present in the environment. For example, the operation of a horn, the operation of a police bell, the operation of a train or truck siren, or the squealing of tires can indicate a specific driving situation.

[0041] Situations related to navigation or route guidance of motor vehicle 100 may also be determined. This may include, for example, road guidance, maneuvers to be performed, or passage through areas requiring increased attention, such as residential areas, kindergartens, hospitals, schools, event venues, or pedestrian areas. In addition, dynamic information that may affect navigation or route guidance may be taken into account, such as warnings about traffic jams, accident locations, potholes, objects on the roadway, or deformation of the roadway due to high temperatures.

[0042] The driving situation relating to the motor vehicle 110 may include aspects such as how the motor vehicle 110 can be controlled in its environment. This includes in particular the technical aspects of the boundaries of the predetermined control. Thus, in step 125, in particular the driving speed, the direction signal or turn signal set, the acceleration or deceleration or the lighting conditions can be determined. In addition, the driving maneuvers performed or to be performed with the aid of the motor vehicle 110, such as turning, overtaking, changing lanes, parking, stopping or starting, can be determined. In addition, the traffic density on the road on which the motor vehicle is traveling can be determined, alternatively, with the aid of on-board sensor devices or information services such as RTTI. Other typical processes that lead to an increase in the required attention include the ordering or payment process of requesting a parking ticket or a toll card or through a window (for example at a bank or a snack bar).

[0043] The internal driving situation may include aspects that affect the driver 105 and impair his ability to concentrate. In step 130, it may be determined, for example, whether the driver 105 is also performing additional activities, such as eating or smoking. In addition, it may be determined whether the driver interacts with the motor vehicle 110, for example, whether he operates switches or other operating elements of the motor vehicle 110 or uses gesture control or voice control, for example.

[0044] It can be determined whether other persons, such as passengers or children or young children, are in the motor vehicle 110 and whether they require the attention of the driver 110. It can be determined whether there is an assistance system for the driver 105, whether it is active or to what extent it intervenes in the control of the motor vehicle 110. It can be determined whether the driver 105 is tired, how long the ongoing journey has lasted, how long it is expected to last, or what the mood of the driver 105 is. It can be determined from the entries in the electronic calendar whether the driver 105 is under time pressure.

[0045] The communication aspect with the outsider 115 can also contribute to the internal driving situation. It can thus be determined whether the driver 105 is more passively involved or to what extent he is also actively involved. It can be determined how many outsiders 115 are involved in the communication. The transmission quality of the communication can be determined, for example with respect to noise or interruptions. In addition, it can be determined with which outsider 115 the driver 105 is communicating, how long the call has lasted or how long it is expected to last.

[0046] In step 135, upcoming driving situations can be predicted based on the determinations made. For this purpose, statistical models, self-amplifying filters (such as Kalman filters) or machine learning methods can be used. For example, an artificial neural network (KNN) can be trained to determine specific driving situations that require increased attention from the driver 105. The increased attention level can be predicted. It is preferably predicted how the required attention level will develop over a subsequent period of time. In this case, multiple curves can be determined, each with a corresponding confidence level or probability. This determination can be carried out continuously, wherein curves that have become impossible can be discarded.

[0047] The determinations made can be linked to each other and / or stored. In one embodiment, the experience of other drivers 105 in other motor vehicles 110 can be taken into account. These experiences or specific driving conditions or the determined required attention levels can be processed centrally or distributed. Predictions can be made based on external relevant data.

[0048] In step 140, the required attention of the driver 105 can be determined based on the driving situation or the prediction of the driving situation. The required attention can also be predicted and different curves can also be predicted and confidence or probability can be set. Preferably, it is determined whether the required attention exceeds a predetermined threshold value. In one embodiment, the threshold value can be determined dynamically, for example, based on the determination of the internal driving situation in step 130.

[0049] In step 145, the communication between driver 105 and external person 115 can be influenced. In this case, the transmission of information within the communication can be influenced by, for example, reducing the output rate of information transmitted to driver 105 when the required attention increases. In another specific embodiment, a signal can be provided to driver 105 or external person 115 to indicate that a reduction in communication is recommended.

[0050] Figure 2 A device 200 on a motor vehicle 110 is shown. The device 200 comprises a processing device 205, which can be connected to one or more sensors 210. Exemplary sensors include cameras, radar sensors, lidar sensors and ultrasonic sensors. Other information sources on the motor vehicle 110, such as a navigation system, a driving stability system or a vehicle speed control system, can be activated by means of an interface 215. The processing device 205 can implement a KNN or be connected to a KNN 220. By means of a communication device 225, observations, measurements, experiences or relevant associations of other similar devices 200 can be received or corresponding information can be provided to the outside.

[0051] In addition, the processing device 205 is connected to a device 230, by which the communication between the driver 205 and the person 215 can be influenced. In one embodiment, the device 230 includes an output device for providing an acoustic signal or an optical signal, an image or a video data stream. The provision can be made to an external person 115 and / or the driver 105. In another embodiment, the communication between the person 115 and the driver 105 is transmitted via the device 225, so that the communication can be influenced. The influence can be, for example, filtering or feeding in a signal, changing the speed of the transmitted data stream or increasing or reducing the intensity of the information stream.

[0052] Figure 3 An exemplary diagram 300 is shown of the predicted required attention of driver 105 for driving motor vehicle 110. Time is shown horizontally. In the vertical direction, the upper part of the diagram shows the determined required attention of the driver and the lower part shows the intensity of the communication.

[0053] First curve 305 represents a prediction of the required attention, which is assigned a high probability. The curve shown may exist, for example, when merging into a highway. Here, motor vehicle 105 must accelerate at an entrance or an acceleration strip and drive into an adjacent lane. There are usually only limited paths and therefore only limited time for this maneuver. Depending on the number of vehicles on the lane, the speed at which they travel there, and the acceleration capability of motor vehicle 110, merging may be difficult and require a high degree of concentration of driver 105.

[0054] The second curve 310 represents a prediction for the same process, which has a lower probability. For example, the second curve 310 can be implemented if merging becomes more difficult due to another traffic participant changing lanes into the intended lane. The third curve 315 with the lowest probability of the determined probabilities can relate to the same process under optimal conditions, for example, if no other vehicles are located in the area of ​​the motor vehicle 110.

[0055] The curves 305-315 may be compared to a threshold value 320. If the curves 305-315 exceed the threshold value 320, a specific driving situation may exist where increased attention is required from the driver 105 and communication between the driver 105 and the external person 115 may be affected.

[0056] Fourth curve 325 shows an exemplary influence on communication according to first curve 305. Before curve 305 reaches threshold value 320, communication has already been reduced. The reduction in communication preferably takes place with a gentle transition. When a specific driving situation ends, communication can be increased again, and here too a gentle transition is preferably controlled.

[0057] In this example, the effect may be to slow down the output of received communication information.After the reduction, the speed may be increased above the natural level as shown to enable the driver 115 to keep up with the communication. Reference numerals list

[0058] 100 Methods

[0059] 105 Driver

[0060] 110 Motor Vehicles

[0061] 115 staff

[0062] 120 Determine external driving conditions

[0063] 125 Determine the driving condition of the vehicle

[0064] 130 Determine internal driving conditions

[0065] 135 Predict driving conditions

[0066] 140 Determine the attention required

[0067] 145 Impact on Communications

[0068] 200 devices

[0069] 205 Processing Device

[0070] 210 Sensors

[0071] 215 interface

[0072] 220 Artificial Neural Networks, KNN

[0073] 225 communication device

[0074] 230 devices

[0075] 300 Icons

[0076] 305 First Curve

[0077] 310 Second Curve

[0078] 315 The Third Curve

[0079] 320 threshold

[0080] 325 The Fourth Curve

Claims

1. A method (100) for controlling communication between a driver (105) of a motor vehicle (110) and another person (115) outside the motor vehicle (110), the method comprising the following steps: - determining (120-130) the driving condition of the motor vehicle (110); - determining (140) a required level of attention of the driver (105) in order to drive the motor vehicle (110) based on the driving situation; - Determine that the communication jeopardizes the achievement of the required attention; and - Influence (145) communication based on required attention.

2. The method (100) according to claim 1, wherein: A driver's (105) distraction is determined, the distraction being independent of the driving situation and the communication, and it is determined that the communication in combination with the distraction endangers achievement of required attention.

3. The method (100) according to claim 1 or 2, wherein: A signal (145) is provided to the driver (105).

4. The method (100) according to any one of the preceding claims, wherein: Messages transmitted within the scope of the communication are delayed (145).

5. The method (100) according to any one of the preceding claims, wherein: The message transmitted within the scope of the communication is output ( 145 ) to the driver ( 105 ) with reduced urgency.

6. The method (100) according to any one of the preceding claims, wherein: A signal is provided (145) to the other person (115).

7. The method (100) according to claim 6, wherein: The signal is configured to communicate to the other person (115) that the driver (105) needs to pay more attention to driving the motor vehicle (110).

8. The method (100) according to claim 6 or 7, wherein: The signal is provided acoustically (145).

9. The method (100) according to any one of claims 6 to 8, wherein: The communication includes transmitting the image to the other person (115) and the signal relates to a change (145) of the image.

10. The method (100) according to any one of the preceding claims, wherein: A manner of influencing (145) is determined based on the communication.

11. The method (100) according to any one of the preceding claims, wherein: An upcoming driving situation is predicted ( 140 ) and a required level of attention for the upcoming driving situation is determined.

12. The method (100) according to claim 11, wherein: A duration of required attention exceeding a predetermined threshold is predicted (140); and communication is affected (145) based on the determined duration.

13. The method (100) according to any one of the preceding claims, wherein: The communication is affected (145) based on the duration that the required attention exceeds a predetermined threshold (305-315).

14. A device (200) for controlling communication between a driver (105) of a motor vehicle (110) and another person (115) outside the motor vehicle (110), the device (200) comprising the following elements: - a detection device (210) for determining the driving condition of the motor vehicle (110); - a processing device (205) for determining, based on the driving situation, a level of attention required of the driver (105) in order to drive the motor vehicle (110) and for determining that the communication jeopardizes achievement of the required attention; and - means (230) for influencing the communication according to the required attention.

15. A motor vehicle (110) comprising a device (200) according to claim 14.

Images