Notification management method for vehicle-based human-machine interface and vehicle having notification management system

Abstract

The invention relates to a notification management method for a vehicle-based human-machine interface having at least one notification channel. A notification management system forwards notifications for at least one vehicle occupant and / or vehicle function module to a notification channel or holds the notifications depending on a priority associated with the notifications. The method according to the invention is characterized in that the priority associated with the notifications is defined by a priority number; a notification is selected and forwarded to a notification channel if its priority number exceeds a channel threshold assigned to the notification channel and said notification has the highest priority number for the respective notification channel; and the channel threshold is time-dependent and is set between a minimum threshold and a maximum threshold by the notification management system based on driving data and / or vehicle environment data and / or vehicle data and / or state data of the human-machine interface and / or at least one advance notification delivery and / or vehicle occupant observation data at predetermined time intervals in a normal operating mode.

Description

[0001] The present invention relates to a notification management method for a vehicle-based human-machine interface of the type defined in more detail in the preamble of claim 1, and a vehicle having a notification management system.

[0002] The further development of driver assistance systems is accompanied by an increasing demand for information management in in-vehicle infotainment systems, which are increasingly expanding into complex human-machine interfaces. In this context, multiple interaction channels are provided for information delivery and influencing the driver. The classic interaction channel for displaying visual information is the graphical user interface (GUI), which is typically designed as a touch-sensitive display in the vehicle's console. In addition to large-size liquid crystal displays, projection systems that generate images on the vehicle's interior surfaces are increasingly used for this purpose. Data glasses worn by the driver and communicating wirelessly with the infotainment system also provide possible visual interaction channels. The use of acoustic interaction channels is also important, such as through voice assistants, warning tones, or recognizable message melodies.

[0003] Furthermore, human-machine interfaces can also use tactile signals and other influences that affect the driver to convey information. Subconscious measures are also possible to increase attention and generally improve travel comfort. For example, targeted airflow or stimuli of heat, cold, or odor can be used as alternative interaction channels. Seat massage devices also represent a possible interaction channel for vehicle-based human-machine interfaces used for notification delivery.

[0004] Beyond delivering vehicle and environmental data, people often want to receive entertainment notifications and stay connected while traveling. Therefore, possible notifications via the human-machine interface (HMI) could include playing media content such as movies or music videos, or audio content such as audiobooks, music clips, podcasts, etc. Furthermore, inputs of social media content or podcasts initiated by the HMI, or outputs of data generated by chat or video conferencing programs, should be possible. In this scenario, the HMI handles notifications not only for the driver but also primarily for other vehicle occupants.

[0005] The increased information density and expanded interaction possibilities necessitate selecting from a vast array of possible notifications—referred to as proactive notifications—not directly inquired by the driver but issued by the human-machine interface (HMI). This requires deciding when and through which available interaction channel to respond to the driver or vehicle occupants. Distraction, fatigue, or overexertion due to the notification sequence must be avoided, especially for the driver. Furthermore, the continuous stream of proactive notifications and the chosen delivery types should not lead to boredom or distortion of the HMI. In particular, relevant information within the notification sequence must be delivered in a driver-perceptible and timely manner. These challenges are addressed in the formulation of a method and system for notification management.

[0006] Methods for determining message priority are known from other technical fields. For example, US20210337039A1 describes a priority system for messages generated by multiple applications on an electronic device. Based on the priority assigned to the respective applications during installation, a rule-based selection is made for processing application notifications to be forwarded to a single user interface (in this case, a single display). A typical use case is a computer system on which multiple notification-generating software programs, such as email programs or games, run. The priority system ensures that no more than a predetermined number of application notifications are forwarded to system users within a predetermined time period, wherein, in the case of multiple notifications arriving in parallel, only information from the application with the highest priority is selected for display. Applying this rule-based concept with initially configured priorities to the human-machine interface of a vehicle results in a complex system, particularly due to the multiple interaction channels on the vehicle side, which has high administrative costs for configuration.

[0007] Another message prioritization method is known from EP 1 287 444 B1, in which email processing is provided as the primary application. It is proposed to provide a classifier for messages, which determines the urgency and / or relevance of emails in particular. Messages to be sent to users are then selected based on rules, by querying the classifier and using profiles initially created by at least the recipient. Typically, different profiles are created on the user's end, depending on location and corresponding activities; for example, different profiles can be provided for work, leisure, vacation, travel, etc. During activities outside of work or residence, the message prioritization system automatically sends selected emails to the user's designated mobile device, rather than their desktop. Switching between profiles is achieved through user input or by querying user input, such as in a personal electronic calendar.

[0008] In the context of vehicle-based human-machine interfaces (HMIs), the message prioritization system proposed in EP 1 287 444 B1 can be applied, but this application requires complex configuration by the user before starting to drive. Defining priority rules individually to use the basic functions of a complex in-vehicle HMI already requires significant effort from the user before starting to drive. Activating all functions requires a deeper understanding of the rule-based profile settings, which cannot be performed without expert knowledge of the relevant vehicle-based HMI.

[0009] US 9,769,106 B2 discloses a method for mobile terminals to display and prioritize visual messages based on rules using an adaptive tiling design on the mobile terminal's display. To this end, a predefined set of rules is used to subdivide messages into categories, which are then displayed in a category-specific manner on different areas of the display. Messages within the same category are displayed in order corresponding to their priority. To determine priority within message categories, user behavior analysis is performed. The average duration of the user's response to messages from the corresponding message source is determined. Applying the described message prioritization method to vehicle-based human-machine interfaces presents a fundamental difficulty: the wide range of message types present in vehicle applications cannot be uniformly categorized. Another difficulty stems from the complexity of vehicle human-machine interfaces with multiple interaction channels. Furthermore, the user behavior analysis required for prioritization, particularly the duration of their response to messages from known sources, is not feasible for multiple proactive in-vehicle notifications.

[0010] The object of this invention is to provide an improved notification management method for vehicle-based human-machine interfaces, by means of which notifications are sent in a timely manner, and regarding the selected notification channel, particularly to the driver, are delivered in a way that does not impair the driver's attention and does not find it annoying. Specifically, in the case of multiple possible notification channels, the notification management method for proactive notifications should be user-executable without complex system configuration. Furthermore, the vehicle equipped with this improved notification management system must be specified.

[0011] According to the invention, this objective is achieved by a notification management method having the features of claim 1. Advantageous designs and improvements, as well as vehicles having a notification management system for performing the notification management method, are derived from the related claims.

[0012] A notification management method for a vehicle-based human-machine interface having at least one notification channel, wherein the notification management system forwards notifications for at least one vehicle occupant and / or vehicle functional module to the notification channel, or retains the notifications, based on the priority associated with the notification.

[0013] The notification management method according to the present invention is characterized in that,

[0014] - The priority associated with a notification is defined by a priority number;

[0015] - If its priority number exceeds the channel threshold allocated to the notification channel and the notification has the highest priority number for the corresponding notification channel, then the notification is selected and forwarded to the notification channel; and

[0016] - The channel threshold varies over time and, in normal operating mode, is set between a minimum and a maximum threshold by the notification management system based on driving data and / or vehicle environment data and / or vehicle data and / or human-machine interface status data and / or at least one advance notification delivery and / or vehicle occupant observation data at predetermined time intervals.

[0017] In this context, the notification itself can be purely communicative, but it can also include control signals that, in addition to controlling information elements such as displays, can control functions in vehicle modules, such as massage devices in vehicle seats. This notification / control of a functional module can occur alongside a communication notification, or it can include a communication notification—for example, as haptic feedback—or it can exclude a communication notification.

[0018] In this context, according to the invention, instead of a strict set of rules for determining priority, each notification is associated with a typical decimal priority number, which can be understood as a resource in a monetary sense, with which forwarding of the notification channel can be "purchased". According to this picture of the invention, a market value is defined for notification forwarding, i.e., a corresponding channel threshold, which varies over time within a predetermined range between a minimum and a maximum threshold. A notification can then obtain a supply of notification channels; that is, if its priority number at least exceeds the required threshold, and it is currently the "highest bidder" among multiple notifications meeting the threshold condition, it becomes active, and the user can perceive it through the selected notification channel. Special cases of matching priority numbers can be resolved by querying another comparison criterion, such as the dwell time in a waiting loop, which can be used as a special reward for determining the final priority number.

[0019] The threshold setting must be updated within a predetermined time interval. In this case, the typical rate of state change of the vehicle (e.g., car, truck, transport vehicle, bus, etc.) and the generally available data processing speed are used. Specifying the time interval in the millisecond range is feasible.

[0020] To determine the threshold for the notification channel, at least one of the known criteria described above is used, wherein the first group involves driving data, vehicle environment data, and vehicle data. In one embodiment, for the "driving data" criterion, the current driving speed is considered, wherein, particularly for high driving speeds, the possibility of preventing the driver from concentrating potential interference notifications is provided, thus generally increasing the threshold.

[0021] In another embodiment, vehicle environment data is correlated, allowing for inquiries about whether driving occurred in congested traffic or in areas of highway construction with narrowed lanes, requiring extra driver attention and necessitating high channel thresholds. Other criteria in the vehicle environment domain apply to nighttime driving or driving under adverse weather conditions. In this context, the temporal embedding of events also falls under the term "vehicle environment data." Accordingly, the day of the week or calendar month in which the driving occurred is also understood as vehicle environment data.

[0022] For alternative implementations, consider the data used for threshold generation, which can be assigned to standard "vehicle data." This includes, for example, human-machine interface devices, where, in the case of a large number of available notification channels, these channels are often perceived as troublesome by the driver when overused, and a high channel threshold is set to reduce the number of notifications penetrating to vehicle occupants.

[0023] Another advantageous implementation for determining the channel threshold considers the current state data of the human-machine interface. For example, if the acoustic notification channel is activated by playing an entertainment audio file (e.g., a podcast), the assigned channel threshold is increased such that the voice message is played only if it is considered particularly relevant and given a priority number higher than the increased threshold.

[0024] It is advantageous to consider a design scheme that includes at least one advance notification. This, for example, prevents notifications from following each other too closely in time. Furthermore, the type and duration of at least one prior activity notification can serve as a criterion for threshold settings.

[0025] In a preferred embodiment, vehicle occupant observation data is correlated with the determination of a channel threshold. For example, this could be a response to an already activated notification, such as a proactive notification affecting traffic congestion ahead. Then, if the driver requests a route alternative, for example via a voice assistant, the channel threshold for notification channels provided for the delivery of social media content is significantly increased to prevent interference. Vehicle occupant observation data can also be used to determine the number of people in the vehicle, so that the channel threshold is typically increased in the case of multiple occupants.

[0026] Furthermore, vehicle occupant observation data can be recorded over longer time periods through person-specific assignments. For example, if a driver habitually activates the seat heaters at a certain temperature, or if the seat massage function is frequently turned on after a certain driving duration, the threshold of the notification channels associated with these comfort features can be lowered to suit the individual, making it easier to execute proactive notifications—activations that are not performed by the user themselves.

[0027] In one possible implementation, the priority number assigned to a notification is static. In another advantageous improvement, the priority number is also a dynamic variable, at least before being delivered to the notification channel. In this case, preferably, the notification management system again defines the priority number based on driving data and / or vehicle environment data and / or vehicle data and / or at least one advance notification delivery via the human-machine interface and / or vehicle occupant observation data and / or the duration of dwell time in the notification channel's waiting cycle and / or the duration of the notification's active state in the notification channel, between a minimum priority value above a minimum threshold and a maximum priority value below a maximum threshold.

[0028] In advantageous embodiments, the priority number of a notification indicating a significant decrease in the state of charge of the electric vehicle's traction battery at high driving speeds can increase over time. A further increase may occur if vehicle occupant observation data shows that the driver has not taken sufficient action to manage the charging pole. In another preferred embodiment, the priority of a warning message increases if vehicle environmental data detects optical anomalies on the road at temperatures in freezing areas. For further embodiments, the type of previous notification delivery can be considered. For example, if a push notification about sports news is delivered to vehicle occupants, the priority number of other social media content related to sports can be reduced to decrease the probability of delivering potentially boring, repetitive content to vehicle occupants.

[0029] In the improved scheme, the priority number of the notification is queried even after it has been forwarded to the notification channel, and preferably, this priority number is dynamically adjusted. Preferably, the forwarded notification remains active on the notification channel until its priority number falls below the assigned channel threshold again. For example, a text message currently displayed on the vehicle display may have a priority number that decreases over time, such that the priority number disappears after a certain period for a constant channel threshold. Furthermore, changes in the channel threshold may occur, for example, due to driving conditions that require the driver's full concentration and lead to an increase in the channel threshold. This eliminates visual stimuli on the display that could affect attention.

[0030] When proactive notifications result in a continuous flow of information, they are considered particularly disturbing. In a preferred embodiment, after forwarding the notification to the notification channel, the notification management system increases the associated channel threshold in the next time interval. Preferably, further messages are completely suppressed for a predetermined time period by setting the allocated channel threshold to a maximum threshold that no possible priority number can exceed within a selected time period. Particularly advantageous is an embodiment that includes a "cooling-off phase" after the notification channel activation, for which the initially increased channel threshold is decreased over a predetermined time period following the forwarding of the notification.

[0031] For a typical human-machine interface (HMI) of a vehicle, there are several notification channels. In a preferred embodiment, the notification management method according to the invention enables the selection of notification channels with high hit reliability suitable for the corresponding notification. Preferably, in such an HMI, a separate time-varying channel threshold is defined for each individual notification channel. Furthermore, notifications provided simultaneously to at least two notification channels are assigned priority numbers specific to the respective notification channels. A particularly advantageous embodiment is one in which a change in the channel threshold of the first notification channel also causes a change in the channel threshold of at least the second notification channel. For example, a first audio message prompting the driver to pause may exist on a first notification channel for primary voice output and additionally on a second notification channel for secondary voice output, wherein the secondary voice output involves appending additional information to the primary voice output. In both notification channels, the priority number of the first audio message should initially be lower than the corresponding channel threshold, and therefore it is retained. Then, if a relevant second audio message arrives on the first notification channel, indicating, for example, a critically low charge state of the traction battery and having a priority number higher than the assigned channel threshold, the primary voice output is activated. As a result, the channel threshold for the secondary voice output is lowered, so that the original waiting notification with a pause request also has a priority number higher than the channel threshold and is directly appended as a secondary voice message. Therefore, due to low battery power, the driver is first instructed to activate the charging station, and then, for driving safety reasons, is advised to take a break.

[0032] To further develop this invention, at least one notification channel of the human-machine interface can be switched from a normal operating mode to a rule-based mode based on driving data and / or vehicle environmental data and / or vehicle data and / or vehicle occupant observation data and / or external vehicle notifications. In this case, for at least one notification channel selected for the rule-based mode, the notification management system sets a channel threshold to a minimum or maximum threshold. If the maximum threshold is selected, the affected notification channel will be completely blocked. Conversely, setting the minimum threshold will allow any notifications provided to the affected notification channel to be activated.

[0033] Furthermore, the vehicle according to the invention has a notification management system for a human-machine interface, which is designed to execute the notification management method according to the invention.

[0034] Other advantageous designs for the notification management method also arise from the embodiments, which will be described in more detail below with reference to the accompanying drawings.

[0035] in:

[0036] Figure 1 The time process of a first embodiment of the notification management method according to the present invention is shown;

[0037] Figure 2 The time process of a second embodiment of the notification management method according to the present invention is shown; and

[0038] Figure 3 The diagram is illustrated in a simplified manner according to... Figure 2 The notification channel of the second embodiment.

[0039] Figure 1 A first embodiment of the notification management method according to the present invention, based on a simplified time flow diagram, is shown. At time t1, the appearance of an active notification 4.1 generated by the control unit of the electric vehicle due to a critical low charge state of the traction battery is visible in the waiting loop of schematically symbolized notification channels 1.1, 1.2, and 1.3. In this case, notification channel 6.1 represents the message channel on the display, which forms part of the human-machine interface, and is not shown in detail.

[0040] The additional notification channels 1.2 and 1.3 are audio channels assigned to the voice assistant. In this case, notification channel 1.3 is configured for primary voice output without further conditions, while notification channel 1.2 is provided for secondary voice output, which occurs only if it can be appended to the primary voice output that immediately precedes it in time. Accordingly, notification channel 1.2 is placed in a rule-based mode and blocked from output at time t1 when this appended condition is not present, where the channel threshold 6.2 associated with notification forwarding occupies the maximum threshold 3. For notification channel 1.1 in normal operating mode, the channel threshold 6.1 is between the minimum threshold 2 and the maximum threshold 3.

[0041] During the waiting loop of notification channel 1.1, notification 4.1 is assigned a static priority number of 5.1, which is higher than the channel threshold 6.1 required to forward to notification channel 1.1 at time t1. Therefore, an immediate notification output is generated, wherein the database is accessed to generate the message text corresponding to notification 4.1.

[0042] For notification channel 1.3, notification 4.1 provides a priority number 5.3 at time t1 that is lower than the assigned channel threshold 6.3. Therefore, no main voice message is initially output. The priority number 5.3 is dynamically set and increases over time, i.e., with the increase of the critical low-charge state duration. The assigned channel threshold 6.3 is also dynamic, as shown in the figure, rising to a higher level over time. This is caused by changing vehicle environment data, where the vehicle passes through dangerous locations, such as highway construction sites, thus requiring greater driver attention. Accordingly, the notification management system adjusts the channel threshold to a higher value to reduce the information flow to the driver.

[0043] Then, at time t4, the priority number 5.3 exceeds the allocated channel threshold 6.3, causing the notification management system to forward notification 4.1 to notification channel 1.3, where the database is queried again to convert notification 4.1 into a main voice message. The cessation of the main voice message at time t4 causes a change in the human-machine interface state data, resulting in notification 4.1 being removed from the waiting loops of notification channels 4.2 and 4.3. Therefore, switching notification channel 1.2 to normal operation mode due to the output of the main voice message via notification channel 1.3 has no perceptible effect, as its waiting loop had already been cleared.

[0044] for Figure 2 In the illustrated embodiment, there are three notifications 4.2, 4.3, and 4.4 in the form of system messages competing for two possible notification channels 1.4 and 1.5, wherein... Figure 3 The schematic simplified illustration shows that the two notification channels 1.4 and 1.5 are formed by two areas of different sizes on the display 7 assigned to the human-machine interface 8.

[0045] from Figure 2 It can be seen that notification channel 1.4 is superior to notification channel 1.5 due to the lower channel threshold of 6.4. However, initially, notifications 4.2, 4.3, and 4.4, included in the waiting loop of notification channels 1.4 and 1.5 at times t1, t2, and t3 with time offsets, do not have sufficient priority numbers 5.4, 5.5, and 5.6 for forwarding. Due to the dynamic increase of priority numbers 5.4, 5.5, and 5.6, they approach the two channel thresholds 6.4 and 6.5 in a further time process, where notification 4.2 first exceeds the threshold 6.4 of notification channel 1.4 and is forwarded to the notification channel. This involves changes in the state data of the human-machine interface 8, which leads to further dynamic adjustments of priority numbers 5.4, 5.5, and 5.6. In this case, the priority number 5.4 assigned to forward notification 4.2 increases by a constant value and then decreases. This measure ensures that notification 4.2 remains active on notification channel 1.4 for a predetermined time and only becomes inactive when its priority number 5.4 falls below the channel threshold 6.4 again. During this period, the change in the status data of the human-machine interface 8 caused the priority numbers 5.5 and 5.6 of notifications 4.3 and 4.4 to no longer increase.

[0046] The activation of the first notification channel 1.4 affects the second notification channel 1.5. It can be seen that as notification 4.2 is displayed on the first notification channel 1.4, the channel threshold 6.5 of the second notification channel 1.5 increases at t4. Therefore, opening another window on display 7 is associated with an increased "cost," where the increase in channel threshold 6.5 relaxes over time. However, this reduction in channel threshold 6.5 is insufficient to stop the reactivation of the preferred notification channel 1.4 at t6, where the priority number 5.5 exceeds the channel threshold 6.4, and the next notification 4.3 is forwarded for display. The additional activation of notification channel 1.5 via notification 4.4 occurs only for the time period from t7 to t8.

Claims

1. A notification management method for a vehicle-based man-machine interface (8) having at least one notification channel (1.1,..., 1.5), wherein, - the notification management system forwards the notifications (4.1,..., 4.4) for at least one vehicle occupant and / or vehicle function module to the notification channel (1.1,..., 1.5) depending on the priority associated with the notification or keeps the notification (4.1,..., 4.4); characterized in that - the priority associated with the notification (4.1,..., 4.4) is defined by a priority number (5.1,..., 5.6); - the notification (4.1,..., 4.4) is selected and forwarded to the notification channel (1.1,..., 1.5) if its priority number (5.1,..., 5.6) exceeds the channel threshold (6.1,..., 6.5) assigned to the notification channel (1.1,..., 1.5) and the notification has the highest priority number (5.1,..., 5.6) for the respective notification channel (1.1,..., 1.5); and - the channel threshold is time-dependent and, in a normal operating mode, is set by the notification management system based on driving data and / or vehicle environment data and / or vehicle data and / or state data of the human-machine interface and / or at least one advanced notification delivery and / or vehicle occupant observation data at predetermined time intervals between a minimum threshold (2) and a maximum threshold (3); - for a human-machine interface with multiple notification channels (1.1,..., 1.5), the notification management system sets a separate time-dependent channel threshold (6.1,..., 6.5) for each of the notification channels (1.1,..., 1.5), and in each case, a separate priority number (5.1,..., 5.6) is assigned to the notifications (4.1,..., 4.4) of at least two of the notification channels (1.1,..., 1.5).

2. The notification management method according to claim 1, characterized in that the priority number of the notification (4.1,..., 4.4) is time-dependent at least before delivery to the notification channel (1.1,..., 1.5) and, in a normal operating mode, is set by the notification management system based on driving data and / or vehicle environment data and / or vehicle data and / or at least one advanced notification delivery by the human-machine interface and / or vehicle occupant observation data and / or the duration of stay in a waiting cycle of the notification channel (1.1,..., 1.5) and / or the duration of the active state of the notification (4.1,..., 4.4) in the notification channel (1.1,..., 1.5) at predetermined time intervals to a value between a priority minimum value above the minimum threshold (2) and a priority maximum value below the maximum threshold (3).

3. The notification management method according to claim 1 or 2, characterized in that ​ ​ ​ After forwarding the notifications (4.1,..., 4.4) to the notification channels (1.1,..., 1.5), the notification management system increases the assigned channel threshold (6.1,..., 6.5) in the next time interval.

4. The notification management method according to claim 3, characterized in that after forwarding the notifications (4.1,..., 4.4) to the notification channels (1.1,..., 1.5), the channel threshold (6.1,..., 6.5) assigned to the notification channels (1.1,..., 1.5) is set to the maximum threshold (3) for a predetermined time period.

5. The notification management method according to any one of claims 3 or 4, characterized in that after the assigned channel threshold (6.1,..., 6.5) is increased for a predetermined time period after forwarding the notifications (4.1,..., 4.4), the assigned channel threshold (6.1,..., 6.5) is decremented.

6. The notification management method according to any one of claims 1 to 5, characterized in that the notifications (4.1,..., 4.4) forwarded to the notification channels (1.1,..., 1.5) remain active at the notification channels until the priority number (5.1,..., 5.6) of the notifications (4.1,..., 4.4) is below the assigned channel threshold (6.1,..., 6.5).

7. The notification management method according to any one of claims 1 to 6, characterized in that a change of the channel threshold of a first notification channel (1.1,..., 1.5) causes a change of the channel threshold (6.1,..., 6.5) of at least a second notification channel (1.1,..., 1.5).

8. The notification management method according to any one of claims 1 to 7, characterized in that based on driving data and / or vehicle environment data and / or vehicle data and / or vehicle occupant observation data and / or vehicle exterior notifications, at least one notification channel (1.1,..., 1.5) of the human-machine interface is switched from a normal operating mode to a rule-based mode, and for at least one notification channel (1.1,..., 1.5) selected for the rule-based mode, the notification management system sets the channel threshold (6.1,..., 6.5) to the minimum threshold (2) or the maximum threshold (3).

9. A vehicle with a notification management system of a human-machine interface, characterized in that the notification management system is capable of performing the notification management method according to any one of claims 1 to 8.

Images