METHOD FOR OPERATING A MOTOR VEHICLE WITH AN AUTOPILOT SYSTEM AND MOTOR VEHICLE

DE502019012435D1Active Publication Date: 2024-11-21AUDI AG
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
DE502019012435
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Priority Date
2018-03-07
Filing Date
2019-03-04
Publication Date
2024-11-21
Estimated Expiration
2039-03-04

AI Technical Summary

Technical Problem

Existing autopilot systems in motor vehicles often confuse drivers with frequently changing availability displays and fail to provide clear recommendations for using piloted driving functions, leading to driver distraction and difficulty in predicting when the function is usable, and sometimes display information when the driver is not interested.

Method used

A method that determines both technical activation information and driver-related recommendation information, using a multi-stage display concept with visual and acoustic outputs to provide activation or deactivation recommendations based on the driver's preferences and current situation, ensuring that the piloted driving function is only activated when suitable and providing useful usage recommendations.

Benefits of technology

This approach enhances driver acceptance and understanding of piloted driving functions, reducing driver distraction and improving the usability of autopilot systems by providing clear and contextually relevant activation and deactivation recommendations.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader
Need to check novelty before this filing date? Find Prior Art

Description

[0001] The invention relates to a method for operating a motor vehicle having an autopilot system configured for fully automatic control of the motor vehicle, for which technical activatability information is determined as a function of a current and / or upcoming operating situation described by driving situation data and / or operating state data of the motor vehicle and system boundary information describing the area of ​​application of the autopilot system. The motor vehicle further comprises a display device with a first output element indicating the activatability of the autopilot system according to the technical activatability information. The invention also relates to a motor vehicle.

[0002] Systems for the partial and, in particular, fully automated control of a motor vehicle are an important research topic for further driver assistance. Various piloted driving functions for road-bound vehicles have already been proposed, which can be provided by autopilot systems designed for fully automatic control of the vehicle. One example is the so-called "traffic jam pilot," which can completely take over vehicle control in slow-traffic situations. Other such driving functions include, for example, a highway pilot and a city pilot.

[0003] Such piloted driving functions or autopilot systems cannot be activated in all operating situations a motor vehicle may encounter, since, for example, a traffic jam pilot is intended to be limited to traffic jams, and a highway pilot to highways with corresponding speed limits. The application areas of such autopilot systems are therefore defined by system boundaries, which can be stored by appropriate system boundary information.

[0004] For example, the traffic jam pilot has various technical reasons for preventing activation due to its design, including that no vehicle in front was detected, that no lane markings were detected, that the vehicle in front is traveling faster than 60 km / h, that the wrong road class is present (not a motorway), that pedestrians are detected in the area, that a toll station is ahead, and the like.

[0005] To prevent the driver from attempting to activate an autopilot system despite technical obstacles due to its system limitations, it was proposed to determine technical activation information based on the current and / or upcoming operating situation described by driving situation data and / or operating state data of the motor vehicle and the system limit information. This information can be output on a display device of the motor vehicle using an output element. In particular, the driver is notified that a state has been reached in which there is no technical obstacle to activation. This can be done, for example, by displaying the text "Traffic jam pilot: available," a backlit symbol, or the like.

[0006] WO 2015 / 049231 A1 relates to a method for a driver assistance system of a vehicle, which is intended to control the vehicle at least partially automatically. The start of an autopilot route section is determined in a route planned for the vehicle, along which the driver assistance system can automatically control the vehicle. A distance between the current position of the vehicle and the start of the autopilot route section is determined and output in the vehicle. This distance can be output as a kilometer value, as a graphical representation of the planned route, or as the time until reaching the autopilot route section. An instrument cluster displays whether and for how long the autopilot function is available. This means that technical activation information is also determined for the future in this document.

[0007] DE 10 2014 221 132 A1 relates to a method and a device for indicating the availability of a first driving mode of a vehicle. In the first driving mode, the vehicle is driven at least partially automatically. From environmental data of the vehicle's surroundings, a start of a route section is predicted, from which the first driving mode is available. The predicted start of the route section is displayed on a display element, and the predicted start and / or end of the route section can also be indicated.

[0008] EP 2 531 814 B1 relates to a driver assistance system and a method for driver assistance, in which the complexity of a section of road ahead is used to check whether largely automatic vehicle guidance is possible, so that the driver can pursue a tertiary task or tertiary activity.

[0009] US 2014 / 0156133 A1 concerns switching back and forth between autonomous and manual mode. Following a driver request to switch to autonomous mode, a multitude of checks are performed, and if predetermined conditions are met, the system switches to autonomous mode. Such technical availability displays for autopilot systems have various disadvantages. For example, frequently changing availability displays are displayed, particularly with activation information based on the current operating situation, creating the risk that the driver will no longer pay attention to the display at a certain point. In any case, such availability displays are often only short-lived, making it difficult for the driver to predict whether the piloted driving function will be effective. However, the suggestions cited at the beginning, indicating the duration of availability, can be useful in this case.

[0010] A further disadvantage of the availability display based on activation information is that it is also displayed at times when the driver has no interest in using the autopilot system's piloted driving function. In other operating situations, however, no availability is displayed, even though use of the piloted driving function is currently desired and would be possible with a slight change in driving style.

[0011] The invention is therefore based on the object of providing an improved display concept for piloted driving functions of an autopilot system in motor vehicles.

[0012] To achieve this object, in a method of the type mentioned at the outset, it is provided according to the invention that, in addition to the technical activatability information, driver-related recommendation information is determined as a function of the operating situation and preferences regarding the autopilot system and / or driver data describing the driver's state regarding vehicle control, depending on which driver-related recommendation information a second output element of the display device is controlled, which output element displays an activation recommendation in accordance with the recommendation information, wherein the activatability information and the recommendation information are determined and updated cyclically in parallel.

[0013] It is therefore proposed that, in addition to the technical activatability information, driver-related recommendation information be determined, which describes at least one activation recommendation for the piloted driving function or a deactivation recommendation for the piloted driving function. This can be displayed via at least one corresponding, second output element of the display device in addition to the technical activatability information. This means that a distinction is made between technical availability criteria, described by the system boundary information, and supplementary, driver-related, and situation-specific criteria in order to enable a display of availability depending on the situationally appropriate suitability. In this way, for example, visual and / or acoustic activation recommendations or deactivation recommendations can be made available and outputtable in particularly useful situations.

[0014] The result is a multi-level availability display with additional usage recommendations for the piloted driving function of the autopilot system, whereby ultimately, in addition to the operating status data and driving situation data describing the operating situation, the system limit information for the technical activatability information and situational information on the current driver status or the previous usage behavior of the driver or other drivers in comparable situations are combined for the driver-related recommendation information.

[0015] It is useful if an activation recommendation is only displayed for route sections for which the autopilot system's operational range is defined according to the activation information. This means that an activation recommendation is only issued if the autopilot system's piloted driving function can also be activated, thus avoiding driver confusion. Accordingly, it can be specified that a deactivation recommendation is only issued if the autopilot system's piloted driving function is also active.

[0016] Particularly preferably, predictive data relating to a route section ahead, in particular predictive route data, are used as driving situation data and / or operating status data. In this way, technical activatability information and driver-related recommendation information can also be determined for route sections ahead of the motor vehicle, wherein such predictive route data can be obtained from various sources. For example, it is conceivable to obtain predictive route data at least partially from a navigation system of the motor vehicle, be it by analyzing the road currently being traveled and / or based on an already predetermined route followed by the motor vehicle. Historical data on the driver's preferred routes / routes can also be used to predict the future route of the motor vehicle if no predetermined route exists.The use of digital map material from a navigation system has the particular advantage that additional information or attributes can be assigned to the route sections or route segments recorded therein. These attributes, together with the system boundary information and the driver data, can be used to draw conclusions for determining the technical activation information or driver-related recommendation information. However, such additional information can also be determined if the predictive route data is at least partially derived from sensor data from the vehicle's environmental sensors, for example, including the sensor data from a camera directed at the area in front of the vehicle. Not only can the future route be derived from such sensor data, but it is also conceivable to obtain additional information about this future route.In this context, predictive route data from the navigation system and predictive route data derived from sensor data of the motor vehicle are particularly preferably combined to obtain current additional information on upcoming route sections. Other sources of additional information on currently traveled and / or upcoming route sections also include traffic information, which can be provided, for example, via radio stations and / or the internet. Finally, useful driving situation data describing the operating situation includes weather information, which can also be obtained from sensor data from the motor vehicle's environmental sensors and / or via appropriate communication connections, in particular the internet.Operating status data of the motor vehicle can be obtained, for example, from operating sensors and / or from other information sources within the motor vehicle, in particular from control units, and, in addition to current dynamic information of the motor vehicle, can of course also include currently active vehicle systems and their parameters as well as other control information.

[0017] Options for determining the technical activatability information, particularly for upcoming road sections, are generally known in the prior art, as also shown by way of example at the beginning, and can also be used within the scope of the present invention. To determine the technical activatability information, for example, a comparison with corresponding system boundary information can be carried out, for example, regarding the speed of the motor vehicle and a permitted speed range of the piloted driving function of the autopilot system. Of course, more complex criteria and / or evaluations are also conceivable, for example, regarding the complexity of the driving situation.

[0018] The driver data can preferably be driver-specific or at least vehicle-specific with regard to the driver data describing the driver's preferences. In this case, it can be specifically provided that the driver is identified at the start of the journey, for example, using a driver-specific key, biometric data, and / or user input. A driver profile with corresponding driver data regarding the driver's preferences regarding the piloted driving function of the autopilot system can then be assigned to the driver and stored accordingly. Various corresponding possibilities have been described in the prior art, for example, with regard to the adjustment of safety systems and / or driving dynamics systems to a current driver.

[0019] In an advantageous development of the present invention, it can be provided that the activatability information and / or the recommendation information are determined comprising at least one piece of time information, in particular time information describing a start of activatability and / or an end of the area of ​​use or a time / location of a recommendation. It should be noted that the time information may also be spatial information, for example a distance or location, which can be converted into a time information (and vice versa), as shown in the documents cited at the beginning, so that, for example, if the length of a route section on which the piloted driving function can be used is known, it is possible to estimate how long the piloted driving function can probably be active.In this way, relevant additional knowledge is generated, particularly using predictive route data, and preferably also passed on to the driver.

[0020] Accordingly, it is preferred if the time information and / or output information derived therefrom, in particular an expected extent of the operational area and / or a duration until activation and / or activation recommendation and / or deactivation recommendation, is output by means of the display device. For example, with regard to the technical activation information, in addition to a symbol and / or text representing the basic technical activation, corresponding time information or output information derived therefrom can be displayed, for example, of the type "Autopilot available: in 10 minutes" or "Autopilot available: for 17 km." A similar provision can be made for the recommendation information, so that, for example, a display of the type "Activation of the autopilot recommended. The reasonable usage time is 10 minutes / 20 km" can be displayed there."An autopilot remaining travel time display is particularly useful in this case, whereby, in particular in the case of an estimate, the time information and / or the output information can also be provided as an interval, for example as "2 - 3 minutes".

[0021] In the recommendation information, it is particularly advantageous for an activation recommendation and / or a deactivation recommendation to also be assigned a recommendation level, which makes it possible to assign the corresponding recommendation to a recommendation level, so that the output of activation recommendations and deactivation recommendations can also be expediently graded. In a particularly preferred embodiment, the recommendation information comprises at least one recommendation level describing a recommendation level, depending on which the output of the activation recommendation is adapted; in particular, different second output elements and / or output control parameters are assigned to different recommendation levels.In a practical, concrete embodiment, a route-section-related activation recommendation determined based on the driver-related suitability of a route section can be assigned a lower recommendation level than a topicality-related activation recommendation related to a current activity and / or a current state of the driver. Topicality-related activation recommendations are preferably more clearly perceptible and / or issued for a shorter time, as they relate to current information, in particular a current event. Of course, two activation recommendations and / or deactivation recommendations of different recommendation levels can also be present simultaneously.For example, a recommendation with a lower recommendation level can be displayed permanently on a second output element, while a recommendation with a higher recommendation level can be displayed briefly via a second output element, such as an acoustic output device. This is particularly useful for topical recommendations, as these may refer to a temporary state.

[0022] In an advantageous development of the invention, it can be provided that the display of an activation recommendation and / or a deactivation recommendation occurs at least at the beginning of a route section to which it relates. This means that an activation recommendation and a deactivation recommendation can be issued directly and intuitively in a meaningful context for the driver. In this case, in the case of an additional advance and / or permanent display of an activation recommendation and / or deactivation recommendation, the output at the beginning of the corresponding route section can be provided by highlighting this already existing output, for example, a flashing transition from an advance notice to a permanent activation recommendation for the route section, and / or by an additional output.In addition to such a gradation within an activation recommendation and / or deactivation recommendation, however, a recommendation of a lower recommendation level can also be issued permanently at different recommendation levels, while the recommendation of a higher recommendation level, in particular a topicality-related recommendation, can be given additionally, in particular more conspicuously, for a short time at the beginning of the route section.

[0023] As already mentioned, an activation recommendation and / or a deactivation recommendation is preferably only generated via the second output element if the technical activation criteria are also met. This then results in an additional output, in addition to the indication of technical activation, if there are indications that a piloted driving function would be desirable or useful for the current driver in the current operating situation.

[0024] In particular, when a driver-related, situationally appropriate activation state is reached, the activation recommendation can be issued, and conversely, the deactivation recommendation. It is also preferred if the display of an activation recommendation, particularly one that is topical, is limited to a predetermined period of time, for example, 5 seconds. In this way, the driver's attention is captured at the beginning of the route section where activation is generally appropriate, but the driver is not further distracted by the display. This is preferably the case with recommendations with a higher recommendation level.

[0025] A particularly advantageous embodiment of the invention provides that the second output element comprises an acoustic output means via which the activation recommendation is acoustically output. In particular, a visual and additional acoustic output are conceivable. Thus, as soon as there are indications that the piloted driving function would be particularly beneficial for the current driver in the current operating situation and / or that the piloted driving function would be better deactivated, an acoustic indication can be provided via a voice output, for example, such as "Would you like to activate the highway pilot now?" This is particularly useful if background information, as explained in more detail below, is also to be output, since it simulates a seemingly understanding, thoughtful conversation partner.In a specific embodiment, a continuously visually issued activation recommendation of a lower recommendation level can be supplemented, in particular for a short time, with a recommendation of a higher recommendation level that is issued at least acoustically and / or more conspicuously.

[0026] In this context, it is also particularly advantageous if, in the case of an acoustic output, a driver's response is captured using an acoustic recording device and used to derive control information for the autopilot system, in particular for activating or deactivating the autopilot system. While it may of course still be possible to provide the piloted driving function via corresponding manually operated operating means, it is particularly preferred, when a voice output for an activation recommendation or a deactivation recommendation is provided, to also receive a vocal response from the driver via a suitable recording device, for example an interior microphone, which may be present in a hands-free system, in order to make the driver's corresponding activation request as easy to enter as possible.For example, if the voice output includes "Do you want to activate the piloted driving function now?", the driver's response "yes" can lead to the generation of corresponding activating control information and its use in the autopilot system.

[0027] In a particularly preferred embodiment of the method according to the invention, if the activatability information does not indicate activatability but the recommendation information indicates an activation recommendation, the operating situation can be checked to determine whether at least one recommendable driving intervention by the driver leads to the activatability being established. If the recommendable driving intervention can be determined, driver information describing this is output via the second output element and / or a further output element. The at least one driving intervention can, in particular, relate to a lane change and / or a change in road class and / or a change in speed, in particular a reduction in speed. In particular, in the case of a change in road class, a route comprising the target road class is determined and recommended by means of a navigation system of the motor vehicle.Such a design can also be based on recommendation levels, so that, for example, such a check for recommendable driving interventions is only performed for activation recommendations with a higher recommendation level. For example, if the system boundary information describes the use of the piloted driving function only in certain lanes of a road, and the motor vehicle is moving in a correspondingly impermissible lane, so that the technical activatability information indicates that the piloted driving function cannot be activated, a corresponding note can be output as recommendation information, particularly acoustically and / or visually as text and / or as a graphic, for example: "To activate the motorway pilot, please first change to the right lane."The same applies to road classes that are not permitted for the piloted driving function, so that, for example, activating a motorway pilot as a piloted driving function is not possible on a country road. A message can also be displayed here, for example, "To activate the motorway pilot, please select an alternative route via the motorway." In a particularly preferred embodiment, this can be implemented in conjunction with the vehicle's navigation system, which can, for example, determine and suggest an alternative route using the permitted road class, e.g., the motorway.

[0028] Another example of recommendation information is provided when the vehicle is currently exceeding a maximum speed for using the piloted driving function according to system limit information, for example, traveling faster than 130 km / h with an autopilot. In this case, a message such as "To activate the motorway pilot, please first reduce your driving speed to below 130 km / h" could be issued.

[0029] A particularly advantageous embodiment also arises when the recommendation information comprehensively determines background information describing the reason for an activation recommendation and / or a deactivation recommendation, and the background information is issued with the respective recommendation. Thus, the reason for the recommendation information can be included, for example, "This allows you to conveniently and securely process your emails" or "We will shortly enter a tunnel." In this way, the driver is easily informed why an activation recommendation or deactivation recommendation is being given at this particular time. This can create a kind of "aha" moment for the driver, giving them the impression that the autopilot system is "thinking along," so to speak.

[0030] For the concrete determination of the recommendation information, a number of configurations are conceivable, which can be particularly advantageously implemented and used in addition to one another in order to be able to decide as precisely as possible for the current driver in particular how situationally sensible the use of the piloted driving function would currently be for the driver.

[0031] In a first concrete embodiment, it can be provided that the recommendation information is determined by evaluating historical data describing past driver behavior. This means that it is analyzed how the current driver, in particular, but possibly also other drivers, have behaved in the past with regard to the autopilot system in various operating situations. Such historical data does not necessarily have to be limited to the driver's own vehicle, but can be. In this way, especially with reference to the current driver, the system described here can, so to speak, adapt to the driver and anticipate their preferences regarding the autopilot system and its piloted driving function.Corresponding historical data can, for example, be collected within the motor vehicle itself by collecting activation and deactivation events, in particular in response to issued activation and deactivation recommendations.

[0032] Specifically, for example, it can be provided that an operating situation to be analyzed is assigned to at least one operating situation class for which historical data indicating the driver's preferred behavior is available, which is used to determine the recommendation information. This means that operating situations can be summarized into operating situation classes, for example, "driving through a tunnel on a highway" and the like. By observing past driver behavior, in particular by using statistical methods, preferences for the various operating situation classes can be determined and used to determine the recommendation information. Embodiments are also conceivable in which an operating situation can be assigned to different operating situation classes and the preferred behaviors, possibly weighted, are combined to determine recommendation information.

[0033] In the specific example, it can be provided that at least one operating situation class describes route sections on which the driver has used or deactivated the autopilot system in the past, and / or route features and / or environmental features for which the driver has activated or deactivated the autopilot system in the past, and / or time periods in which the driver has activated or deactivated the autopilot system in the past, and / or a number of people in the motor vehicle for which the driver has activated or deactivated the autopilot system in the past, and / or a lane on which the driver has activated or deactivated the autopilot system in the past.

[0034] For example, if there is a route currently being traveled on which the technical activatability information indicates that use of the piloted driving function of the autopilot system is technically possible, it can still be determined by analyzing the history data that the use of the piloted driving function is rather undesirable.For example, it may have been analyzed that the driver deliberately deactivated the piloted driving function several times in corresponding operating situations, for example when driving through tunnels and / or uphill / downhill gradients (detection, for example, via a navigation system or general predictive route data), when driving in adverse weather conditions such as rain, snowfall and / or black ice (detection via windscreen wiper activity, a rain sensor, weather data from the Internet and / or car-to-car information), when driving in the dark (detection, for example, via a light sensor), but also for certain, defined route sections, which in turn can be tracked, for example, via a navigation system in conjunction with a GNSS sensor, in particular a GPS sensor.Similarly, the driver's preference for using the piloted driving function may also depend on the number of people in the vehicle if the driver has previously only used the piloted driving function when traveling alone. The presence of other people in the vehicle can be detected, for example, via seat occupancy sensors, seat belt fastening sensors, and the like.

[0035] The driver's past behavior regarding the use of the piloted driving function in relation to lanes can also be analyzed. For example, if the driver is currently driving in the overtaking lane of a multi-lane highway and has previously only used the piloted driving function in the far right lane or in a single lane, a recommendation for activation or deactivation can be derived or suppressed accordingly. Information about lanes can be determined based on data from a camera directed at the area in front of the vehicle and / or from corresponding radar sensors and / or based on digital map material from a navigation system (number of lanes).

[0036] Finally, the historical data can also describe a temporal preference profile, for example, by statistically analyzing the periods during which the driver prefers to use the piloted driving function of the autopilot system. For example, it can be analyzed on which days of the week and / or at which times the piloted driving function is more likely to be used or not used, in order to take this into account when determining the recommendation information. Information from a corresponding timer, especially a clock, can also be considered.

[0037] A further specific embodiment of the present invention provides that the recommendation information is determined by evaluating activity data describing activities currently being performed or to be performed by the driver. If the driver has already begun typical secondary activities that would make the use of the piloted driving function particularly useful, or if such secondary activities are pending, for example, because a particularly high number of emails have arrived and / or the driver's calendar indicates a telephone conference, this can result in an activation recommendation; likewise, terminating such secondary activities can lead to a deactivation recommendation. Specifically, it can therefore be provided, for example, that an activation recommendation is generated for activity data describing an activity that cannot be performed while driving the vehicle.Such activities include, for example, writing / reading text messages, editing calendar entries, conducting internet research, watching a film, and the like. The activity data can be determined, for example, by recording user inputs on a user interface of the motor vehicle, an interior microphone, in particular the aforementioned acoustic recording device, and / or operating data of a mobile device coupled to the motor vehicle, for example, a smartphone.

[0038] As a further specific embodiment, it can be provided that the recommendation information is determined by evaluating attention data describing the driver's current distraction and / or attention. In this case, it can be specifically provided that image data showing the driver's eyes and / or data about the duration of the current journey and / or a time and / or information about the monotony of a route section and / or information about a conversation held by the driver, determined in particular by means of an acoustic recording device, are used as attention data relating to the fatigue. Therefore, if, for example, the driver exhibits symptoms of incipient fatigue or lack of concentration, the use of the piloted driving function may appear particularly useful.A driver's fatigue level can be determined, for example, via an interior camera or its image data, particularly by detecting eyelid closure. A long journey, a late hour, and / or a monotonous route can also be signs of driver fatigue and / or lack of concentration. It is particularly advantageous to link this to a driver assistance system for break recommendation, as has already been proposed in the prior art. Such driver assistance systems also analyze driver data and derive a break recommendation from this, if the driver's fatigue or alertness makes this appropriate. The driver assistance system for break recommendation can therefore provide useful, previously evaluated data for determining the recommendation information.

[0039] Lively discussions / conversations with other vehicle occupants and / or on the telephone can also distract the driver. Here, too, the use of the piloted driving function can be particularly useful. Such conversations and / or telephone calls can be initiated, for example, via the aforementioned recording device, in particular an interior microphone, seat occupancy sensors, and / or seat belt buckle sensors related to the occupants. A telephone call can also be detected via a mobile device linked to the vehicle, in particular a smartphone.

[0040] As already mentioned, the aforementioned configurations are preferably used in combination to determine recommendation information. In a suitable configuration in combination with recommendation levels, for example, higher recommendation levels can be assigned to activation recommendations determined based on activity data and / or driver data than to activation recommendations determined based on historical data. Of course, assignments to recommendation levels based more on a general analysis of the operating status are also conceivable, for example, whether the recommendation trigger is short-term or more permanent and / or which safety criteria are met.

[0041] With regard to activity data, it should be noted that further training can provide for the activity and thus a related activation recommendation to be assigned a time period. This time period can be linked to the time information, particularly for the activatability information, in order to determine the activation recommendation and / or assign it to a recommendation level. For example, if the driver plans to watch a film or continue watching it, a longer period of technical availability should be available to make this worthwhile, for example, at least 10 to 20 minutes. A text message, on the other hand, is faster to write, so a technical activation period of one to three minutes may be sufficient here.Especially in this context, an activation recommendation can advantageously include background information, so that, for example, an acoustic output such as "You could activate the autopilot for approximately 15 minutes to continue watching your movie" can be provided. However, if the piloted driving function were only available for a short time, an activation recommendation regarding the movie cannot be determined or only with a very low degree of recommendation.

[0042] In a particularly advantageous development of the present invention, it can be provided that the first output element and the second output element are each assigned to different display assemblies and / or display locations of the display device. It is particularly advantageous to use a first output element that is assigned to a combination display of the motor vehicle, for example, behind the steering wheel, and a second output element that is arranged on a center console or a navigation display, in particular on a display there. In this way, the output elements are not only separated in terms of content (technical availability - driver-related recommendation), but also spatially, so that the different content is still accessible to the driver even with a similar design.

[0043] Specifically, a backlit and / or colorable and / or supplementable symbol, in particular an icon, can be used as the first output element. Thus, for example, a symbol can be used that indicates the activatability status "Autopilot system = available" with a white color, but then turns green when the piloted driving function is activated. If the technical activatability information indicates that the piloted driving function is currently unavailable, no symbol can be displayed at all. This can be supplemented accordingly, for example, if advance notice is required, so that the symbol can be displayed in yellow, for example, and a decreasing bar indicates the time information as the interval until activatability.The first output element and its display enable the driver to determine whether the piloted driving function can be activated in principle, i.e. whether all technical activation conditions are met.

[0044] In the aforementioned specific embodiment, the second output element can preferably be implemented as part of a display, which can also be assigned to the navigation system, or it can be a multifunction display. The use of a display that can also be used by a navigation system allows, for example, route sections where the use of the piloted driving function is recommended to be highlighted. In addition, a corresponding display of the recommended information can be represented, for example, by the text "piloted driving function: recommended." Such a display is particularly suitable for outputting time information.It should be noted that it is also conceivable in principle to make at least the visual outputs comparable, for example to display the text "Traffic jam pilot: available" on the display if the latter is only given as an activation recommendation for a limited period of time, as explained at the beginning.

[0045] A corresponding design is also conceivable in combination with an acoustic output, as described.

[0046] In addition to the method, the invention also relates to a motor vehicle comprising an autopilot system configured for fully automatic control of the motor vehicle, a display device with a first output element indicating the activatability of the autopilot system and a second output element, and a control device configured to implement the method according to the invention. All statements regarding the method according to the invention can be applied analogously to the motor vehicle according to the invention, with which the aforementioned advantages can thus also be achieved.

[0047] In particular, the present invention allows, in summary, to achieve greater acceptance and comprehensibility of the piloted driving function, to increase the benefit for the driver and to avoid driver annoyance.

[0048] Further advantages and details of the present invention will become apparent from the exemplary embodiments described below and from the drawings. These show: Fig. 1 shows a schematic diagram of a motor vehicle according to the invention, Fig. 2 shows a flow chart of an exemplary embodiment of the method according to the invention, Fig. 3 shows a display concept for the method according to the invention, Fig. 4 shows a possibility for integrating the display of time information, Fig. 5 shows a further display concept for the method according to the invention, and Fig. 6 shows a time sequence for display events.

[0049] Fig. 1 shows a schematic diagram of a motor vehicle 1 according to the invention. The motor vehicle 1 has an autopilot system 2 designed for the fully automatic guidance of the motor vehicle 1 within certain system boundaries described by system boundary information, which can be activated or deactivated by a driver via corresponding operating means (not shown in detail here), if available. The motor vehicle further has a navigation system 3 with a corresponding geodetic position sensor 4, a plurality of environmental sensors 5, interior sensors 6, in this case comprising an interior camera 7 and a recording means 8 designed as an interior microphone, as well as further vehicle systems 9, also comprising intrinsic sensors that can provide operating status data of the motor vehicle in the current operating situation.Driving situation data, which also describe the current operating situation, are provided in particular by the navigation system 3 and its digital map material, as well as the environmental sensors 5, or the evaluation of their sensor data. To output information to a driver, the motor vehicle 1 further comprises a display device 10, which in this case comprises several output elements 11, 12, and 13, which will be explained in more detail below. Finally, a control device 14 is provided, which can also comprise a control unit of the autopilot system 2 and is designed to carry out the method according to the invention.

[0050] This is illustrated by an example in Fig. 2 explained in more detail. Two types of information regarding the activation / deactivation of autopilot system 1 are cyclically determined and updated in parallel.

[0051] In a step S1, as is generally known in the prior art, a determination of technical activatability information describing the fundamental technical activatability based on the system boundary information takes place. Finally, as is generally known, the current operating situation and upcoming operating situations, insofar as predictive route data is known in sufficient quantity for this purpose, for example, based on the environmental sensors 5 and the navigation system 3, are checked to determine whether the area of ​​application of the piloted driving function of the autopilot system 2 described by the system boundaries of the system boundary information is present. For route sections for which technical activatability has been determined, the technical activatability information indicates precisely this.The operating situation is described by operating data of motor vehicle 1 and driving situation data, which may contain a variety of information, in particular regarding the currently traveled and upcoming route (predictive route data), weather conditions, and traffic conditions. It should be noted that motor vehicle 1 may also have a communication device (not shown in detail here) for communicating over the internet and / or with other motor vehicles in order to obtain corresponding driving situation data.

[0052] In a step S2, parallel to step S1, further information is determined, namely, in addition to the technical activatability information, driver-related recommendation information that describes an activation recommendation and / or a deactivation recommendation based on the driver's preferences regarding the autopilot system 2 and the driver's state related to vehicle control. This means that in step S2, it is anticipated whether activating the piloted driving function, which may, for example, be a traffic jam pilot, a highway pilot, or the like, appears sensible for the driver based on their preferences and / or their current state.

[0053] Both the activatability information and the recommendation information are additionally determined using time information, which ultimately describes the extent of the route sections for which the technical activatability is given or for which activation is recommended. In particular, the time information can specify a time and / or distance until activatability / activation or deactivation recommendation and / or a spatial and / or temporal duration of the activatability / activation recommendation.

[0054] As part of the recommendation information, background information is always determined in this case, describing the reason for the activation or deactivation recommendation, as will be explained below by way of example. In addition, recommendations, in particular at least activation recommendations, are also assigned recommendation levels indicating a degree of recommendation, to which different output types can be assigned. Multiple recommendations can also exist at any one time.

[0055] Various types of data are used to determine the recommendation information as driver data. First, this is historical data describing past driver behavior. In step S2, an operating situation to be analyzed is assigned to at least one operating situation class for which historical data indicating preferred driver behavior is available, which is used to determine the recommendation information. In particular, the historical data describes cases in which the driver has deliberately activated or deactivated the piloted driving function. For example, despite technical activation, the piloted driving function may not be desired by the driver when driving through tunnels, on uphill and / or downhill gradients, in adverse weather conditions, in the dark, or for certain defined route sections. This can be mapped accordingly using operating situation classes.Corresponding driving situation data and operating data are obtained, as already described, in particular from the vehicle systems 9, the environmental sensors 5, and the navigation system 3. Predictive route data, in particular from the navigation system 3, can be used to identify, for example, tunnel passages and inclines / declines; adverse weather conditions can result from the operation of a windshield wiper and / or from sensor data from a rain sensor and / or from weather data from the internet and / or car-to-car information. Sensor data from a light sensor can describe the brightness outside the motor vehicle, while defined route sections are derived from the navigation system 3, taking into account the position sensor 4.

[0056] Other operating situation classes can, for example, relate to the number of people in the motor vehicle. If, for example, there are drivers who prefer to use piloted driving functions when there are several people in the motor vehicle, this can be determined accordingly, with the presence of passengers in the motor vehicle being detected, for example, via seat occupancy sensors, seat belt fastening sensors, and the like. Preferences regarding certain lanes can also be mapped, with the currently traveled lane being detected, for example, by a camera directed at the area in front of the motor vehicle 1 or radar sensors as environmental sensors 5, while the number of existing lanes can be determined, for example, from data from the navigation system 3 and / or again from the camera directed at the area in front.

[0057] Further driver data used in step S2 to determine the recommendation information includes activity data describing activities currently being performed or to be performed by the driver. If, for example, it is determined that the driver has already begun typical secondary activities that make the use of the piloted driving function particularly useful, a corresponding activation recommendation can be generated. Secondary activities that should not be performed by the driver while driving the vehicle include, for example, writing and / or reading text messages, editing calendar entries, internet research, and / or watching a film. Corresponding operating data of the motor vehicle can be inferred, for example, from the driver's operating actions, information from a coupled mobile device, in particular a smartphone, and / or the acoustic recording means 8.A time period can be assigned to an activity, which can be placed in context with time information describing the length of the technical activation capability to determine an activation recommendation itself and / or a recommendation level. For example, it can be determined whether the activity can reasonably be performed within the availability range.

[0058] The recommendation information is further determined by evaluating attention data relating to the driver, which describes the driver's current distraction and / or attention level. In particular, based on the data from the interior camera 7, for example, it can be observed whether the driver is exhibiting symptoms of incipient fatigue or lack of concentration, which would make the use of the piloted driving function advisable. The state of fatigue can be determined, for example, via an image analysis of the driver's eyes (eyelid closure), with further indicators including a long journey time, a late hour, and a monotonous route (data from the navigation system 3); particularly preferably, input data from a driver assistance system is used for the break recommendation as a further vehicle system 9.A distraction can also be caused by a conversation with a telephone partner and / or a passenger, in which case the acoustic recording means 8 (interior microphone), seat occupancy sensors, seat belt fastening sensors and / or a coupled mobile device (smartphone) can be used for detection.

[0059] Especially when evaluating driver and activity data, higher-level activation recommendations may arise. These recommendations relate to a current, short-term, and / or more safety-critical operating condition and may be added to a lower-level activation recommendation, for example, for a specific section of road. Such recommendations can also be described as longer-term and current-related.

[0060] The technical activatability information determined in step S1 is output by means of a first output element 11 of the display device 10 of the motor vehicle 1. In a step S3, a check is performed to determine whether and when the autopilot system 2 will be technically activatable, so that, for example, activatability can be displayed in step S4 and non-activatability in step S5. Activatability information output in step S4 can also refer to an imminent technical activatability, for example, by using the time information and outputting it to the first output element 11.

[0061] With regard to the recommendation information, a step S6 is also initially checked to determine whether an activation recommendation and / or a deactivation recommendation exists for the current and / or a future route section. If this is the case, a step S7 is initially checked to determine whether the corresponding route section can also be technically activated. If this is not the case in step S7, a check is performed in step S8 to determine whether the current operating situation allows at least one recommendable driving intervention by the driver that would result in the technical activation being established. Such a driving intervention could, for example, include a lane change or a speed reduction in order to ensure that the technical activation is established as soon as possible, if the piloted driving function may only be used in certain speed ranges or on certain lanes.However, it can also be checked in advance, for example, recommending a change in road class, such as from a country road to a motorway, in order to activate the autopilot, for example in the case of a motorway pilot. A corresponding alternative route can then be determined and output using the navigation system 3 of the motor vehicle 1. In any case, if at least one driver intervention establishes the technical activation capability and an activation recommendation is also available, corresponding driver information describing the driving intervention is generated and output using the output element 13, which is also used here as a second output element and is designed as an acoustic output means. In particular, a voice output such as "To activate the motorway pilot, please first change to the right lane / reduce speed / select an alternative route via the motorway" can be provided.This output of the driver information takes place in a step S9.

[0062] Activation recommendations and deactivation recommendations can be output in a step S10 via the second output elements 12, 13, wherein the output element 12 is an optical output element and the output element 13 is an acoustic output means. The output of an activation recommendation or a deactivation recommendation is expediently made at the beginning of a route section to which it relates, depending on the recommendation level, for example, limited to a predetermined period of time, here five seconds, or permanently. The determined background information is also output, preferably by means of voice output via the second display element 13, which is designed as an acoustic output means.For example, an activation recommendation related to a longer route section can be permanently displayed visually and supplemented by an activation recommendation with a higher activation level, which is issued, in particular, acoustically. This results in outputs such as "Would you like to activate the Autobahnpilot now? This would allow you to conveniently and safely check your emails." or "Would you like to deactivate the Autobahnpilot now? We will shortly enter a tunnel." (In the latter case, the historical data determined that the driver was reluctant to use the Autobahnpilot in tunnels.)

[0063] A first display concept for the optical output of the technical activatability information and the recommendation information is shown as an example in Figur 3 The first output element 11 is a backlit symbol 16 integrated into an instrument cluster 15 located behind the steering wheel. If the symbol 16 is backlit in green, the piloted driving function is activated; if it is backlit in white, it can be activated; if it is not visible, it cannot be technically activated. Yellow backlighting in conjunction with a decreasing bar display (based on the time information) can be used if the function is activatable in the future.

[0064] Spatially separated in the area of ​​a center console 17, the second output element 12 is provided as a text field 18 of a display 19, on which data from the navigation system 3 can also be arranged. The output of activation / deactivation recommendations there is supplemented by the acoustic output means, which can ultimately be arranged anywhere, as the second output element 13. It should also be noted at this point that the driver can also respond verbally to an acoustic output, for which purpose the recording means 8 (interior microphone) is used to record a vocal response from the driver, which can then be evaluated to produce corresponding control information for the autopilot system 2. The acoustic output means (output element 13) and the acoustic recording means 8 (interior microphone) can also form parts of a hands-free system.

[0065] Fig. 4 Finally, Figure 2 shows the integration of time information 20 into a display 21. For example, the frame of the "2 to 3 minutes" display can be green when the autopilot is activated and the remaining activation time is indicated, and yellow when the activation is possible / recommended. This can, of course, also be further explained by other output components.

[0066] In the Fig. 5 In the further display concept shown, at least the first output element 11 and the optical second output element 12 are integrated within the instrument cluster 15, but spatially separated, since a display 19 of the navigation system or a multifunction display is also realized there.

[0067] Fig. 6 Finally, a schematic diagram shows a possible time sequence for outputting the technical activatability and activation / deactivation recommendations. In the shaded time ranges, the technical availability is given according to the activatability information, so that at least at times 22, the first output element 11 is triggered to indicate this change, if necessary also as in Fig. 3shown preparatory. Time points 23 indicate activation recommendations of lower activation levels, which, for example, are derived from the historical data and refer to a longer route section. The corresponding, preferably purely visual, output can be permanent for the duration of the activation recommendation. At time point 24, for example, an activation recommendation of a higher recommendation level, thus a second recommendation level, is added, for example because the driver has started or intends to start an activity that can be performed more safely with the automated driving function activated.

[0068] Therefore, at time 24 - in addition to the permanent display of the other activation recommendation - this further activation recommendation is at least acoustically output, for example: "If you now activate the autopilot, you can carry out the activity."

[0069] Time 25 marks an example of a deactivation recommendation, as at that point, for example, the vehicle is entering a tunnel.

Claims

1. Method for operating a motor vehicle (1) which has an autopilot system (2) for the completely automatic driving of the motor vehicle (1), regarding which, as a function of a current and / or future operating situation, described by driving situation data and / or operating status data of the motor vehicle (1), and an item of system limits information describing the area of application of the autopilot system (2), an item of technical enabled status information is determined, wherein the motor vehicle (1) comprises furthermore a display apparatus (10) with a first output element (11) displaying the enabled status of the autopilot system (2) according to the technical enabled status information, characterised in that in addition to the technical enabled status information as a function of the operating situation and preferences with regard to the autopilot system (2) and / or driver data describing the state of the driver with regard to the guidance of the vehicle, a driver-related item of recommendation information is determined, as a function of which a second output element (12, 13) of the display apparatus (10) displaying an enabled status recommendation according to the recommendation information is actuated, wherein the enabled status information and the recommendation information are determined and updated in parallel in a cyclical manner.

2. Method according to claim 1, characterised in that an enabled status recommendation is displayed only for the route section for which the area of application according to the enabled status information is present.

3. Method according to any one of the preceding claims, characterised in that the recommendation information comprises at least one recommendation stage describing a degree of recommendation, as a function of which the output of the activation recommendation is adapted, in particular respectively different second output elements and / or output control parameters are assigned to different stages.

4. Method according to claim 3, characterised in that a lower degree of recommendation is assigned to a route section-related activation recommendation determined on the basis of a driver-related suitability of a route section than to an activation recommendation related to a current activity and / or a current state of the driver.

5. Method according to any of the preceding claims, characterised in that the display of an activation recommendation, in particular one which regards up-to-dateness, takes place at least at the beginning of a route section to which it relates.

6. Method according to claim 5, characterised in that the display of an activation recommendation, in particular one which regards up-to-dateness, is outputted so as to be limited to a predetermined time duration, in particular 5 s, and / or the second output element (12, 13) comprises an acoustic output means (13) through which the activation recommendation, in particular one which regards up-to-dateness, is acoustically outputted.

7. Method according to claim 6, characterised in that in the case of an acoustic output, a response of the driver using a recording means (8) is captured and used for deriving an item of control information for the autopilot system (2), in particular for activating or deactivating the autopilot system (2).

8. Method according to any one of the preceding claims, characterised in that in the case of an item of enabled status information displaying no enabled status, but in the case of an item of recommendation information displaying an enabled status recommendation, it is verified by evaluating the operating situation whether at least one recommendable driving intervention on the part of the driver results in the enabled status being established, wherein in the case of a driver intervention being able to be determined, an item of driver information describing this is outputted by way of the second output element (12, 13) and / or a further output element (11, 12, 13).

9. Method according to claim 8, characterised in that the at least one driving intervention relates to a changing lane and / or the change of a road class and / or a speed reduction, wherein in particular in the case of a change of a road class by means of a navigation system (3) of the motor vehicle (1), a route comprising the target road class is determined and recommended.

10. Method according to any of the preceding claims, characterised in that the recommendation information is determined comprising an item of background information describing the reason for an activation recommendation and the background information is outputted with the respective recommendation.

11. Method according to any of the preceding claims, characterised in that the recommendation information is determined by evaluating historical data describing the driver behavior in the past and / or activity data describing activities of the driver which are being currently carried out or which are to be carried out and / or alertness data describing a current distraction and / or alertness of the driver.

12. Method according to claim 11, characterised in that an operating situation which is to be analyzed is assigned to at least one operating situation class for which historical data displaying a preferential behavior of the driver are present, which are used for determining the item of recommendation information.

13. Method according to claim 11 or 12, characterised in that in the case of activity data describing an activity which is not to be carried out while the vehicle is being driven, an activation recommendation is generated.

14. Method according to any one of claims 11 to 13, characterised in that image data showing the eyes of the driver and / or data regarding the duration of the current journey and / or a time and / or information regarding the monotony of a route section are used as the alertness data regarding tiredness, and / or information, determined in particular by means of an or the acoustic recording means (8) regarding a conversation carried out by the driver, are used as the alertness data relating to distraction.

15. Motor vehicle (1) having an autopilot system (2) configured for the completely automatic driving of the motor vehicle (1), a display apparatus (10) with a first output element (11) displaying an enabled status of the autopilot system (2) and a second output element (12, 13), and a control apparatus (14) configured to carry out a method according to any of the preceding claims.