Method, computer program and apparatus for reproducing a notification in a vehicle

Abstract

In the method for reproducing notifications in a vehicle according to the application, notifications are received (1) from a plurality of components of the vehicle. In the case of a plurality of notifications being present at the same time, these notifications are prioritized (2) with respect to one another on the basis of the respectively corresponding assigned categories. The notifications which have been prioritized are reproduced (3) in accordance with their respective priorities.

Description

Technical Field

[0001] This invention relates to a method for reproducing notices in a means of transportation. The invention also relates to an apparatus for reproducing notices in a means of transportation and a computer program for implementing the method according to the invention. Background Technology

[0002] In motor vehicles, various types of information are output, especially to the driver, but also to occupants of other vehicles. Therefore, almost all modern motor vehicles have an instrument cluster above the steering column, which displays vehicle parameters such as speed or RPM, current fuel tank or battery level, control and warning lights (e.g., for direction indicators, high beams, engaged parking brake, seatbelt unfastened, or malfunctions and defects of important vehicle components), and other information from the onboard computer. Environmental parameters such as outside temperature can also be displayed.

[0003] In addition, this or other information can also be displayed on a head-up display or a monitor located in the center console. Infotainment systems, in particular, typically use monitors located in the center console, which integrate car radio, media playback, navigation, telephone, software applications (so-called Apps), and, if necessary, other functions located in the central operating unit.

[0004] In addition to displays and control lights, output possibilities for acoustic signals, such as alarm tones or voice outputs, are typically provided. Furthermore, haptic feedback can also be output, for example, via a piezoelectric system integrated into the operating element.

[0005] Various notifications can also be displayed on a monitor or reproduced (or played) via voice output. Patent document US 2018 / 0336423 A1 describes using a vehicle camera to detect objects in the vehicle environment and output messages accordingly, for example, through a display on a head-up display or voice output. Here, based on machine learning methods, different messages are output according to the event type, such as insufficient safe distance, roads with many curves, lanes blocked by accident vehicles, or traffic light changes, and according to the corresponding degree of danger. If the driver does not react within a defined time period, the vehicle function can be automatically triggered. Similar methods are also disclosed in patent documents US 2009 / 0187343A1 and US 2018 / 0281788 A1. Summary of the Invention

[0006] The technical problem to be solved by the present invention is to provide a method, computer program and apparatus for improving the reproduction of notifications in vehicles.

[0007] This technical problem is solved by the method for reproducing notices in a vehicle according to the present invention, the computer program according to the present invention, and the apparatus for reproducing notices in a vehicle according to the present invention. Preferred embodiments of the present invention are given in the specification.

[0008] This invention is based on the understanding that, in a vehicle, notifications to the driver are generated by the functions of many different hardware or software components implemented as separate hardware or software components.

[0009] For example, warnings of dangerous situations can be generated and output by navigation applications, prompts for necessary service measures can be generated and output by central control equipment, and notifications via telephone applications can alert the driver to incoming calls or display messages received via email, messenger services, or news portals. These notifications are generated independently of each other. It is possible that different types of notifications are generated almost simultaneously and should be communicated to the driver.

[0010] In the method for reproducing notifications in a vehicle according to the present invention, notifications are received from multiple components of the vehicle. When multiple notifications exist simultaneously, these notifications are prioritized relative to each other based on their respective corresponding categories. The prioritized notifications are then reproduced according to their respective priorities.

[0011] This allows for centralized regulation of the reproduction of notifications generated by different components of the vehicle, avoiding display conflicts or information overload caused by displaying too much information simultaneously. In particular, this avoids dangers caused by distraction from driving tasks or ignoring safety-related notifications.

[0012] Advantageously, notifications with the highest priority are reproduced immediately, while notifications with lower priority are cached and reproduced at a later time.

[0013] According to one embodiment of the present invention, when multiple notifications of the same category exist simultaneously, the latest message in time is preferably reproduced first.

[0014] According to another embodiment of the invention, a notification of a category corresponds to one of a plurality of possible values ​​belonging to a value range, wherein, in the case of multiple notifications of the same category existing simultaneously, the notification with the maximum or minimum value is determined to be prioritized and reproduced first.

[0015] Advantageously, a plurality of playback channels for reproducing the notification are provided, wherein the plurality of playback channels include one or more visual channels, one or more auditory channels and / or one or more tactile channels, the visual channels being implemented through one or more displays and / or LED light chains, the auditory channels being implemented through one or more speakers, and the tactile channels being implemented through one or more actuators.

[0016] Furthermore, high-priority notifications can be advantageously output simultaneously on multiple playback channels.

[0017] It is also advantageous to stipulate that multiple different notifications are output simultaneously on multiple different playback channels.

[0018] Preferably, a notification of a category is displayed for a minimum duration before being replaced by the display of other notifications.

[0019] Similarly advantageously, notifications of one category displayed on the screen can be overlaid or overshadowed by notifications of a higher category.

[0020] According to one embodiment of the present invention, notifications are sent from multiple components of a vehicle to a central control device or central software component of the vehicle, wherein the central control device or central software component prioritizes the received notifications.

[0021] The computer program according to the invention includes instructions that, when executed by a computer, cause the computer to receive notifications from multiple components of a vehicle, prioritize these notifications relative to each other based on their respective corresponding categories when multiple notifications exist simultaneously, and reproduce the prioritized notifications according to their respective priorities.

[0022] The term "computer" should be interpreted broadly here. In particular, it also includes control devices, microcontrollers, embedded systems, and other processor-based data processing devices. Computer programs may be provided for electronic retrieval or stored on computer-readable storage media.

[0023] The device for reproducing notifications in a vehicle according to the present invention includes

[0024] - Input terminal, used to receive notifications from multiple parts of the vehicle;

[0025] - A priority determination unit, into which received notifications are input, and in the case of multiple notifications existing simultaneously, this priority determination unit prioritizes these notifications based on their respective assigned categories; and

[0026] - Output, which provides prioritized notifications for reproduction according to their respective priorities. Attached Figure Description

[0027] Other features of the invention will be derived from the following description taken in conjunction with the accompanying drawings.

[0028] Figure 1 A flowchart illustrating an embodiment of the method according to the present invention is shown schematically;

[0029] Figure 2 This example illustrates the timeline of notifications being excluded and added based on category; and

[0030] Figure 3 A block diagram schematically illustrates the device according to the invention in combination with other components of a vehicle. Detailed Implementation

[0031] To better understand the principles of the present invention, embodiments of the invention are described in more detail below with reference to the accompanying drawings. Of course, the present invention is not limited to these embodiments, and the described features can be combined or modified with each other, as long as they do not depart from the scope of protection of the present invention.

[0032] Figure 1 An embodiment of a method for reproducing notifications in a vehicle according to the present invention is illustrated schematically. According to step 1 of the method, notifications are received from multiple components of the vehicle. Here, a notification is understood as any message addressed to the driver or other occupants of the vehicle. These messages may be, for example, warnings about serious or imminent dangerous situations, or messages related to technical problems of the vehicle, concerning the current vehicle environment, or traffic conditions on the vehicle's future route. Similarly, prompts regarding required service measures, suggested route changes, or recommendations for the driver's driving style may also be output. Prompts regarding communication with persons outside the vehicle may also be made. It is also possible to provide instructions regarding, for example, the current settings of the vehicle's air conditioning equipment. These notifications are generated by different software and / or hardware components of the vehicle and received and processed by another central software or hardware component of the vehicle. Therefore, the central vehicle component must be available before a notification is triggered by one of the other vehicle components.

[0033] The notifications are categorized by being associated with one of several categories. Here, the categorization of notifications can be performed in the respective vehicle components, which assign a category to each notification generated by that vehicle component and then send that category along with the notification. However, the categorization can also be performed in the central vehicle component, which assigns a category to each notification upon receipt. Regardless of where the categorization takes place, it is important that each notification is categorized, and that the central vehicle component knows and can handle all possible categories.

[0034] This utilizes the categories already defined by the notification panel for different notification types.

[0035] Therefore, categories can be defined for different notification types in open or proprietary standards and regulations, such as based on legal provisions, the FuSi classification within the framework of the ISO 26262:2011 standard, internationally valid standards for electrical and electronic systems of road vehicles in the automotive field, or other content-related demarcations.

[0036] In step 2 of the method, this enables the adjustment of reproduction when multiple notifications occur simultaneously by determining the priority of these notifications relative to each other based on their respective categories.

[0037] The following is an example of classifying notifications into categories A through K, which can be used to determine priority levels:

[0038] Category A A dangerous situation that is immediately imminent, requiring immediate action or requiring a driving intervention with a time limit of less than 2 seconds. Category B Numerous transportation restrictions and time-sensitive action requests, where intervention time is allowed >2 seconds. Category C Indirect dangers may arise in the surrounding area or along the planned route. Category D System limitations necessitate the implementation of service measures. Category E Communication initiated by personnel outside the vehicle to the driver Category F Driving style or route guidance needs to be adjusted. Category G The current system limitation does not reduce safety but only reduces comfort during driving, and it does not automatically resolve itself. Category H The current system limitation does not reduce safety but only reduces comfort during driving, and it automatically resolves this limitation. Category I The system may be subject to future limitations, or it may be improved. Category J Predictive messages from the application make driving tasks more comfortable without requiring direct user input. Category K Global status messages, success messages, and feedback from the application can be sent without requiring direct user input.

[0039] However, it is also possible to specify categorization based on other standards, or coarser or finer categorization.

[0040] Subsequently, in step 3 of the method, the notification of priority determination has been made based on their respective priorities, thereby avoiding reproduction conflicts or information overload caused by reproducing too much information at the same time.

[0041] In principle, notifications within the vehicle can be reproduced to the driver or other passengers and, if necessary, interacted with, through different types of Human Machine Interfaces (HMIs). Visual channels implemented via one or more displays are particularly suitable as reproduction channels because they can implement a wide range of modalities, such as displaying notifications as pop-ups, symbolically, or as animations. In particular, safety-critical notifications are preferably reproduced as pop-ups, which directly draw attention and highlight urgency upon their appearance. If a notification is already displayed on a monitor, it can be overridden, superseded, or replaced by a higher-priority notification.

[0042] However, notifications can also be delivered via the auditory channel, and therefore especially via voice output through one or more speakers. Alarm sounds can also be output as supplementary aids, displayed via LED light chains, or through haptic feedback. Furthermore, it can be specified that the vehicle window glass or a so-called display control unit contains a display and operating elements for the display.

[0043] Furthermore, the touchscreen display can be configured for display, allowing users to perform corresponding functions by touching the graphical user interface at the location of the notification. This also allows for the retrieval and output of further information about the notification, such as detailed text messages, images, and video clips. The display on the central touchscreen display enables particularly comfortable operation by the user within the center console area. However, for displays on the vehicle's instrument cluster or head-up display, this interaction can also be achieved through voice input or mechanical operation keys or buttons corresponding to the display.

[0044] The central vehicle component can assign playback channels to the corresponding notification outputs. In this case, the central vehicle component contains information about all, in principle, possible playback channels used to reproduce the notification. The central vehicle component also knows the status of the corresponding playback channels, i.e., whether the necessary components are installed in the vehicle and whether they are activated or potentially defective. For displays, it is also indicated whether they are in the driver's field of vision, thereby ensuring that the driver can also perceive the notification sent to him.

[0045] Similarly, priorities can be assigned to different components used for reproduction. Thus, for example, a display in the line of sight could have priority 1, a light bar or audio reproduction channel priority 2, and other components within the display area priority 3. In this case, the central vehicle component can determine which of these components the reproduction should occur on based on the category of the notification.

[0046] In addition, the central vehicle component manages notifications on all playback channels, and when necessary, manages notifications on multiple playback channels simultaneously, so as to, for example, synchronize the display of notifications on playback channels, and enable notifications to be moved from one playback channel to another or to be accessed again at a later time.

[0047] In particular, if a notification with the highest priority exists, it is reproduced without delay. Since these notifications reflect immediate danger, they can be output in parallel through multiple playback channels, for example, as a combination of a flashing display on the screen, voice output of the notification, and vibration output from the steering wheel. If a notification with lower priority exists simultaneously and is overtaken by a notification with higher priority, the overtaken notification is buffered and reproduced at a later time. However, multiple notifications of different categories can also be displayed simultaneously on different playback channels.

[0048] When multiple notifications of the same category exist simultaneously, the most recent notification in time can be displayed first. This notification will remain displayed for a minimum duration before being replaced by another notification of the same category.

[0049] This minimum display duration also applies to situations where multiple notifications of different categories or priorities exist simultaneously. Depending on the implementation and legal framework of the HMI, this may result in notifications being displayed on a different display than those originally assigned according to category or priority. This occurs when the minimum display duration of the notification has not yet ended, and therefore the notification must continue to be reproduced on the originally assigned display.

[0050] However, it's also possible to specify a hierarchy within a category by assigning one of several possible values ​​from a range to each notification. If two notifications from the same category arrive, the one with the assigned value is prioritized and displayed first. This hierarchy within a category can also be determined using the notification panel mentioned above.

[0051] Figure 2 This example illustrates the timeline of notifications being pushed out and picked up based on their category. Categories A through K correspond here to the categories exemplarily given above, but for clarity, only notifications in categories A through E are used in the example shown. Notifications in the highest categories A through C represent direct or indirect danger messages or large-scale traffic restrictions and are therefore displayed immediately. If a notification of a lower priority category is pushed out by a notification of a higher priority category, the former is cached and reproduced at a later time if it remains important after a waiting period.

[0052] In this scenario, notifications are ordered and reproduced in memory according to their priority. Notifications of lower priority categories, such as messages from news portals, are then deleted from memory. Conversely, especially for safety-critical and transportation-related notifications, permanent storage can be specified so that users or third parties can retrieve them again.

[0053] In the example shown, the first notification to arrive belongs to category C. This notification is displayed immediately. Shortly afterward, a notification from category B arrives. Since the notification from category B has a higher priority than the previous notification, it is displayed at this time, while the notification from category C is stored in memory and not displayed. The notification from category E that arrives next is stored directly in memory and is arranged below the notification from category C according to its lower priority. The display of the notification from category B is then interrupted by the arrival of a notification from category A, which is displayed immediately due to its highest priority. In this case, since the minimum display time for the notification from category B has not yet ended, it is stored in memory like other notifications from category C that arrived at the same time as the notification from category A. The notification from category A is then displayed until its minimum display time ends or there is no longer an immediate danger. Next, the notification from category B is retrieved from memory and is now displayed again until its minimum display time ends. Then, the two notifications from category C are displayed, with the more recent notification displayed first. After the minimum display duration of these notifications has ended, the notifications of category E that were not previously displayed are retrieved from memory and reproduced.

[0054] In the example shown, cached notifications are still classified as either important, new, or current, and are therefore re-accessed for reproduction. The component that generated the notification manages whether it is still new. In this case, the central vehicle component queries this status before accessing the notification.

[0055] Figure 3 A simplified block diagram of the device 4 according to the invention in combination with other components of a vehicle is shown schematically. For example, the device 4 is a control device, computer, microcontroller, or embedded system, and is equipped with a processor and a memory storing instructions that, when executed by the processor, cause the device 4 to perform the steps according to one of the methods described above.

[0056] Device 4 has an input terminal 5 for receiving notifications sent from various vehicle components 10, 11 via a vehicle bus 12. The received notifications are input to a priority determination unit 6, where the priority of these notifications is determined based on their respective assigned categories, and these notifications are subsequently provided via an output terminal 7 for reproduction according to their respective priorities. Input terminal 5 and output terminal 7 can here be combined into a bidirectional interface.

[0057] Notifications can be cached in memory unit 8. Memory unit 8 can consist of a single memory module, or it can consist of multiple separate memory modules for notifications of different categories or priorities. For example, the memory module can be designed as random access memory (RAM), dynamic random access memory (DRAM), EPROM, or flash memory, wherein continuous power supply is used to ensure that safety-critical or vehicle-related notifications are not lost when necessary. Notifications requiring service intervention or that are permanently important can also be retained in the memory unit until the user actively “reads” and subsequently deletes them, or these notifications can be marked as “read” and retained in the memory unit.

[0058] In addition, a memory control unit 9 is provided, which regulates the data flow between the priority determination unit 6 and the memory unit 8 and arranges the notifications in the memory according to their priorities. Furthermore, the memory control unit can ensure that notifications of lower priority categories are deleted from the memory after they are reproduced.

[0059] Finally, a user interface (HMI) 13 is provided, through which the above information is output to the vehicle user and, when necessary, interaction with the user is performed.

[0060] This invention can be applied to various motor vehicles such as cars, motorcycles, trucks, RVs or buses, but is not limited to use in such vehicles.

[0061] List of reference numerals

[0062] 1-3 Method Steps

[0063] 4. The device according to the present invention

[0064] 5 input terminals

[0065] 6 Priority Determination Unit

[0066] 7 Output Terminals

[0067] 8 memory units

[0068] 9. Memory Control Unit

[0069] 10, 11 Vehicle parts

[0070] 12 transportation buses

[0071] 13 User Interface

Claims

1. A method for reproducing a notification in a means of transportation, wherein, - Receive (1) notifications from multiple parts of the vehicle; - In the case of multiple notifications existing simultaneously, these notifications are prioritized based on their respective assigned categories (2); and - Prioritized notifications are reproduced according to their respective priorities (3), in, Multiple playback channels are provided for reproducing the notification. The central transportation component assigns priorities to different components used for reproduction, and determines which of these components the reproduction should be performed on based on the category of the notification. In this scenario, a notification of one category displayed on the monitor is overshadowed by a notification of a higher category. The central vehicle component simultaneously manages notifications on multiple playback channels, moving notifications from one playback channel to another. In this scenario, a notification of a certain category is displayed for a minimum duration before being replaced by other notifications, such that the notification is displayed on a different display than the one assigned to it based on its category or priority.

2. The method according to claim 1, wherein, Notifications with the highest priority are reproduced immediately, while notifications with lower priority are cached and reproduced at a later time.

3. The method according to claim 1 or 2, wherein, When multiple notifications of the same category exist simultaneously, the latest message in time is displayed first.

4. The method according to claim 3, wherein, Notifications of a category correspond to one of several possible values ​​within a range of values, and in the case of multiple notifications of the same category, the notification with the maximum or minimum value is prioritized and reproduced first.

5. The method according to claim 1, wherein, The plurality of reproduction channels include one or more visual channels, one or more auditory channels and / or one or more tactile channels, wherein the visual channels are implemented through one or more displays and / or LED light chains, the auditory channels are implemented through one or more speakers, and the tactile channels are implemented through one or more actuators.

6. The method according to claim 5, wherein, High-priority notifications can be output simultaneously on multiple playback channels.

7. The method according to claim 5 or 6, wherein, Multiple different notifications are output simultaneously on multiple different playback channels.

8. The method according to claim 1, wherein, A notification of one category displayed on the screen is overlaid by a notification of a higher category.

9. The method according to claim 1, wherein, Notifications are sent from multiple components of the vehicle to the vehicle’s central control unit or central software component, and the central control unit or central software component prioritizes the received notifications.

10. A computer program product having instructions that, when executed by a computer, cause the computer to perform the steps of the method according to any one of claims 1 to 9.

11. A device for reproducing notifications in a vehicle, having - Input terminal (5), the input terminal being used to receive notifications from multiple components of the vehicle; - Priority determination unit (6), the received notification is input to the priority determination unit, and in the case of multiple notifications at the same time, the priority determination unit determines the priority of these notifications based on their respective corresponding categories; - Output terminal (7), the output terminal is used to provide notifications that have been prioritized so that they can be reproduced according to their respective priorities; and - Multiple playback channels for reproducing the notification, - A central transportation component is configured to assign priorities to different components used for playback. The central transportation component determines which of these components a notification should be played on based on its category. A notification of one category displayed on a display is overshadowed by a notification of a higher category. The central transportation component manages notifications on multiple playback channels simultaneously, moving notifications from one playback channel to another. A notification of one category is displayed for a minimum display duration before being replaced by other notifications, such that the notification is displayed on a different display than the display assigned according to category or priority.

Images