Method for operating an operating system in a vehicle and operating system for a vehicle
By detecting vehicle situation data, determining the correlation value of the information application, and reducing the display area to output relevant information in the graphical operation interface, the problem of handling diversified data flows in the automotive environment is solved, and the rapid acquisition of information and optimized space is achieved.
Patent Information
- Application Number
- CN202080079912.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2019-11-18
- Filing Date
- 2020-10-26
- Publication Date
- 2025-06-06
- Estimated Expiration
- 2040-10-26
AI Technical Summary
Modern electronic operating systems are difficult to effectively process and output diversified data streams from different sources in automotive environments, especially when vehicle drivers need to focus on navigating and observing traffic environments.
By detecting the current situation data of the vehicle, the correlation value of the information application is determined, and the information status is activated in the graphical operation interface, the display area is reduced to form an information area, and the relevant graphic information objects are output.
It realizes the simple and quick acquisition of relevant information in the vehicle operating system, allowing users to easily identify new information and perform corresponding operations, while optimizing the utilization and adaptability of the display space.
Smart Images

Figure CN114730270B_ABST
Abstract
Description
Technical Field
[0001] The invention relates to a method for operating an operating system in a vehicle and to an operating system for a vehicle. Background Art
[0002] The increasing availability of information from different sources, as ensured, for example, by the Internet, poses new challenges to users of modern electronically operated systems. In the context of automobiles, a trend can also be seen towards the integration of more and more data, which is provided not only by the vehicle itself, but also by external devices. For example, driving assistants, additionally provided services, communication services, social media, news services and other offers from third-party providers make data and notifications available, which, despite their diversity and different relevance, should still be acquired and processed by the user. Other possible services, which are provided, for example, as online services, relate, for example, to the management of parking spaces, loading and unloading of vehicles, vehicle services and other offers.
[0003] The large amount of incoming information is sometimes modeled as a dynamic data stream ("stream" or "feed" in English). However, there are no known solutions for outputting such a stream that are specifically designed for the requirements in a vehicle. It is particularly important here that the user, in particular the driver of the vehicle, can only focus his attention on the operating system to a limited extent, because the guidance of the vehicle and the observation of the traffic environment require his full attention. Summary of the invention
[0004] The object of the present invention is to provide a method and an operating system of the type mentioned at the outset in which a user can obtain relevant information simply and quickly.
[0005] According to the present invention, this object is achieved by the method described below and the operating system described below.
[0006] In the method according to the invention, display data of a graphical user interface having at least one first display area are generated and output, wherein the graphical user interface has a basic state and an information state. Context data about the current context of the vehicle are detected, and a first relevance value for a first information application is determined as a function of the detected context data. The information state is activated as a function of the determined first relevance value for the first information application, wherein when the information state is activated, the first display area is reduced in size such that an information area is formed. A graphical information object is generated as a function of the first information application and is output in the information area.
[0007] This advantageously allows relevant content to be output in a particularly simple and clearly recognizable manner. The user can thus easily recognize when new relevant information is provided and, for example, requires an action. At the same time, the space available in the vehicle for displaying graphical data is optimally utilized and flexibly adapted.
[0008] The output of the user interface takes place on a display surface which is particularly fixedly mounted in the vehicle, for example on the display surface of a central display in the region of the center console or dashboard of the vehicle. In a further embodiment of the invention, the output can alternatively or additionally take place in a composite instrument panel of the vehicle or by means of an output unit from the field of augmented reality ("augmented reality", "virtual reality"), for example in a field of view display (head-up display). Furthermore, in another embodiment, the display can take place on the display surface of a mobile user device (for example a mobile phone or tablet), which is located in the vehicle and is detachably coupled to the vehicle, for example via a data connection.
[0009] The graphical user interface is designed in a manner known per se. In particular, the graphical user interface comprises a graphical representation for a human-machine interface. In this case, the technical device can be operated by means of control elements, for which, for example, buttons or symbols that are presented can be used. In particular, the user interface can include switching and operating elements that present the operation of functions in a way that is accessible to a person. For example, the value of a parameter can be presented and its setting can be visualized by means of a setting element. The user interface can also include elements for displaying information and thus achieve output that can be interpreted by a person.
[0010] In the present invention, the basic state of the graphical user interface is defined in such a way that no information area is provided. This does not exclude that information is also output in the first display area; however, no graphical objects having the specific characteristics of the information area are included, in which the graphical information objects are presented in the present invention. In particular, in the basic state, no information objects are dynamically displayed, as described below. Conversely, the graphical user interface has an information area in the information state, and in this information area information objects are output according to the method according to the present invention.
[0011] In one embodiment of the method according to the invention, the detected context data include characteristics of the vehicle, the operating state of the vehicle, characteristics of the travel of a user using the vehicle and / or user data of the user. Advantageously, the context data are detected particularly strongly for the vehicle and the travel or operation of the vehicle. This allows a particularly intelligent response or system reaction to the changing context of the vehicle to be formed.
[0012] Unlike other methods, for example, in which newly arrived messages are to be output on an operator interface, in the present invention, the relevance value of the first information application is determined with reference to the vehicle or the context of the vehicle. As a result, in this method, the output of the information object or the activation of the information state is particularly strongly aligned with the needs of the user in the vehicle, in particular the driver of the vehicle.
[0013] In the present invention, contextual data can be related to various fields of vehicle use. The characteristics of the vehicle include fixed parameters (such as the size of the vehicle) or variable parameters (such as the opening state of doors and windows and the occupancy of the vehicle by passengers). In addition, it can include charging status, remaining energy reserves, driving range, possible technical problems or vehicle-related stops. In addition, the state of driving or the state of parking can be such a feature. The operating state of the vehicle can, for example, be related to the driving or stationary state of the vehicle, and can also include information about the speed and / or acceleration and the state of the driver assistance system. The contextual data related to the driving of the vehicle can be related to surrounding environment data, which can be detected by the vehicle's sensors or called from external sources, such as information about the location of the vehicle and its surroundings, objects in the vehicle and the vehicle's surroundings, and information about traffic technology devices, weather conditions or special targets in the surroundings. However, the surrounding environment data can also include traffic data, congestion data or other information about traffic status and traffic warnings. The surrounding environment data can also be related to the settings and / or status of the navigation system, such as the destination of the route or the planned route direction, and the duration of the planned route can also be considered. Further features may be the type of trip (e.g. on the way to work, on a weekend trip or on a holiday), the distinction between a one-way trip or a trip with a planned return trip. The user data may include different personalization data, such as the identity of the driver, co-pilot or other passengers. Furthermore, data of an electronic calendar or schedule, contact data, information on telecommunications (e.g. with text messages or voice connections) may be included; in addition, physiological data may be included, such as physiological data about fatigue or stress levels and special needs of the driver or passengers, and data about habits or preferences may be detected based on the usage history or evaluated by learning algorithms. The contextual data may also relate to the time of day or time of day and the distinction between weekdays and weekends.
[0014] The context data are detected in a manner known per se, for example by means of sensors of the vehicle or by a data connection to an external unit (via which the detection is performed). In addition, the context data can be retrieved from a storage unit provided, for example, in the vehicle or in an external device.
[0015] In particular, a continuous detection and updating of the context data is provided, and the method is carried out iteratively as a function of the respective current context data. That is, the first relevance value of the first information application can be constantly re-evaluated and the presentation of the information object can be adapted accordingly. This allows changing conditions and newly emerging information, such as newly arrived messages or newly emerging events, to be taken into account.
[0016] The first information application is in particular designed as a computer program. The first information application can relate to different functions for which information is to be output and / or interaction possibilities are to be provided in the vehicle for a user. In principle, information applications within the meaning of the present invention can here relate to all applications that can generate displays for a user of the vehicle.
[0017] Information applications are in particular messages or notifications, in particular messages or notifications from external units or external communication partners. Information applications can also be additional content, which is output in addition to the data output in the first display area. For example, the user can configure the content in the first display area himself, for example by manually calling or ending an application in the vehicle or by activating or deactivating a function to which a certain information output and / or display of operating options on the display surface is associated. The information objects output in the information area are automatically generated according to their relevance to the respective context of the vehicle in such a way that particularly relevant content is output to the user from the constantly dynamic and changing data stream.
[0018] The determination of the first relevance value can be carried out in a manner known per se. In particular, an absolute or relative value is assigned to the first information application at a certain point in time. In particular, the relevance value assesses the relevance of the information application relative to other information applications or determines the relevance absolutely for a certain user. A weighting parameter can be provided, according to which the relevance of a certain information application can be determined based on the context data, wherein in particular the current program state and / or program events are taken into account.
[0019] For example, information applications can be assigned to a category for which a certain parameter of the weighting is determined on the basis of the context data. For example, when continuous navigation of the vehicle is determined on the basis of the context data, the relevance value of an information application relating to the drivability of the route can be evaluated as being particularly relevant, in particular if the information about the drivability relates to a specifically planned route. Furthermore, information applications relating to direct telecommunication between a user and another user can be assigned to a category with a particularly high relevance, for example in order to display incoming calls on the basis of the corresponding information application with a high priority and to enable the user to directly accept or reply.
[0020] In particular, the first display area and the information area are configured as windows or widgets in the graphical user interface. In particular, a widget occupies the entire information area. In addition, the graphic information object can be configured as a sub-widget or sub-window subordinate to the information area. Therefore, the graphic object can be configured as a sub-widget in the information area configured as a widget.
[0021] In this sense, a "window" is understood to be a delimited area of a graphical user interface in particular, in which data provided by the associated application is output. Here, all graphical output data of an instance of the associated application are output only in the window in particular. In this sense, a "widget" is a program integrated into a graphical user interface, that is, when the widget is output in the graphical user interface, the execution of the program is realized. In addition, other solutions for presenting content in certain areas of the graphical user interface can be used similarly. A sub-widget is a widget that is subordinate to another widget. In particular, a sub-widget is arranged in a surface assigned to a superior widget in the graphical user interface.
[0022] In particular, the information object can be designed as a "feed card" in the present invention. In the sense of the present invention, this is understood to be a displayed area that is designed, for example, according to the type of display area, tab, window or widget known per se, in which relevant information is output at a time point or during a time period or an operating possibility is provided. The feed card can also be arranged as an information object in other display areas, windows, widgets or objects and assigned to an information application as an information source or operating target for which the relevant data is output in each case.
[0023] The information object (e.g., a feed card) comprises, in particular, text elements and / or graphic symbols, which can also be configured as hyperlinks or operatively configured in another way, based on which the user can, for example, access the associated information application. In addition, fixed sizes and design templates can be set for the information objects, such as single-line or multi-line designs, smaller and larger sizes (for which certain levels are defined), defined areas for text and / or graphic elements, and presets for color and / or typographic designs.
[0024] In a configuration scheme of the present invention, the arrangement and / or size of the graphic information object can be constructed according to the first relevance value. For example, the higher the associated relevance value, the larger the information object can be presented. In addition, the larger the relevance value, the closer the information object can be arranged to a certain position in the information area, for example, the closer to the edge of the information area. Conversely, the smaller the relevance value, the closer the information object can be arranged to another position, for example, the closer to the opposite edge of the information area. In addition, the order of multiple information objects can be determined according to the relevance values of different information applications, wherein in this case, the information objects are displayed below each other or side by side in a certain order in the information area. Other characteristics of the presentation of the information object, such as graphic parameters such as color, saturation, transparency or contrast, can also be constructed according to the relevance value. For example, an information object with a low relevance value can be presented in a certain way, especially when it is below a relevance threshold, such as grayed out or presented in other ways that are more difficult to clearly obtain than information objects with higher relevance values.
[0025] In the present invention, the graphic information object itself can also be configured as a widget, i.e. a program that can generate information output or provide an operable element. In addition, the graphic information object can be configured as a sub-widget that belongs to another widget and can be assigned to a single instance of an information application. In addition, the widget can detect inputs and generate corresponding control signals for other devices and / or programs.
[0026] In another embodiment, the first relevance value is compared with a relevance threshold value and a graphical information object is generated if the first relevance value exceeds the relevance threshold value. In particular, the information area is generated only if the information application has a relevance value that exceeds the relevance threshold value. This ensures that the information object is output only if the relevance of the information object exceeds a certain minimum value.
[0027] In this case, the relevance value can be designed in particular to be time-dependent, that is to say that the relevance value changes over time. Thus, the first information application can have a different relevance at a certain point in time than at another point in time. In addition, a duration of output assigned to the first information object can be determined. That is, the information object is output for a certain duration and can then be hidden again, for example if another information object is to be output. In addition, the information object can be hidden after the expiration of the duration, or the output of the information object can be terminated in another way and the information object or the first information area can disappear from the display again, in particular by enlarging the first display area again and then extending, for example, over the surface of the first information area.
[0028] In particular, the graphic information object relates to an incoming message of a telecommunication system, i.e., in particular a text message received from a telecommunication partner, and comprises at least one automatic reply option. The automatic reply option can be selected by an operator action. After the selection, in particular depending on the automatic reply option, a reply to the telecommunication partner is generated and sent. The automatic reply option is formed in particular as a function of the detected context data, for example by means of artificial intelligence or machine learning methods. Thus, the user is advantageously enabled to react to the message quickly and in a context-appropriate manner.
[0029] For example, the system receives a text message with a request from a remote communication partner. A choice of answer options, if necessary a plurality of answer options, is automatically generated and displayed to the user. This is done in particular based on the detected context data. A reply option is selected by an operator action and the corresponding reply is automatically sent to the remote communication partner.
[0030] In particular, the graphical information object relates to a schedule conflict and comprises at least one automatic notification option. The automatic notification option can be selected by an operator action. After the selection, a notification is generated and sent to the remote communication partner, in particular according to the automatic notification option. The automatic notification option is formed in particular according to the detected situation data, for example by means of artificial intelligence or machine learning methods. As a result, if a schedule conflict occurs due to a change in the vehicle situation, for example in the case of a traffic jam, the relevant notification can be generated particularly quickly.
[0031] For example, a delay in driving is detected, which results in the inability to keep the schedule determined based on the schedule data. A contact is determined based on the schedule data included in the context data and a notification is generated. The notification option, or a selection of multiple notification options if necessary, is displayed to the user. The notification option selected based on the operation action is used to generate a notification and send the notification to the contact.
[0032] When changing from the basic state to the information state, the first display area is reduced in the method and thus frees up an information area in which the graphical information objects of the first information application are then output. This change can be displayed in various ways known per se.
[0033] In a further development of the invention, when the first display area is reduced, the picture sequence is generated in such a way that a movement of at least one edge of the first display area is presented. In particular, alternatively or additionally, a movement of the entire first display area can be presented. The output is thus advantageously performed in such a way that the transition from the basic state to the information access (Info-Zugang) can be particularly quickly and intuitively perceived by the user through an animated presentation.
[0034] For example, the lateral edge of the first display area is moved in such a way that the first display area is reduced in size. In the freed area thus formed, an information area is constructed, which is now arranged laterally next to the first display area. This process is carried out in particular by an animated reduction of the display area. That is, in the method, the first display area is not covered by the content of the graphic information object, as is the case, for example, in the presentation of known pop-up windows. Instead, the display in the graphical user interface is changed in such a way that a freed information area is provided and the graphic information object is arranged there.
[0035] In one embodiment of the method, the graphical user interface further comprises a second display area, which is arranged adjacent to the first display area in the basic state of the graphical user interface. Here, when the information state is activated, an information area is formed between the first display area and the second display area. Thus, the information area can be advantageously moved between the plurality of display areas.
[0036] The display area can be limited by a displayed frame, but the display area can also have a virtual border. Adjacent display areas can be displayed with a spacing between their edges, wherein as long as no other objects are or cannot be arranged between the display areas, it is still assumed to be adjacent.
[0037] In various embodiments, the size of the two display areas, between which the information area is formed, can be varied, in particular by separating the first display area and the second display area from one another, wherein the second display area can also be reduced if necessary. Furthermore, the edges of display areas that are adjacent to one another in the basic state can be moved away from one another. On the other hand, it is possible to implement a reduction only for one display area, while the other display area remains unchanged. Furthermore, the arrangement of the display areas can be adapted by movement.
[0038] In another embodiment, when the information state is activated, the graphic information object is moved from the edge of the information area into the information area in a moving manner. In particular, an animation, i.e. a sequence of images, is output here, by which the impression of a continuously moving information object is created. This advantageously makes it possible to present the movement of the graphic information object from the outside into the user interface. In particular, the graphic information object appears in such a way that it falls into or is pushed into the information area.
[0039] Furthermore, the information objects can be visualized or otherwise appear in the graphical user interface with a continuously increasing intensity, brightness, contrast or size. By moving the graphical information objects, a reclassification of a plurality of information objects can also be presented, which are presented, for example, as sub-widgets within a parent widget or window. Conversely, the information objects can disappear in a similar manner, for example by moving the information objects out of the information area or by making them disappear, for example, when the relevance value of the information objects falls below a certain threshold.
[0040] In another improvement, other known graphic presentations can be used to make the information object appear in the information area. For example, the information object can be visualized using a varying brightness or other presentation parameters, the information object can be enlarged or reduced and formed by other effects for appearing in the presentation.
[0041] In the method, it can also be arranged that the information object disappears or disappears from the user interface. This may occur, for example, if another information object of an information application with a higher relevance is to be displayed, or if the relevance value of the first information application no longer exceeds a certain threshold value. For example, the disappearance can be presented in such a way that the information object is moved out of the information area. In particular, the presentation of the movement points in the same direction as when the information object emerged. For example, the information object with a higher relevance value first "falls" into the information area from above, and then it "falls" out of the information area downward when the relevance value is lower or another information object is to be displayed, so as to release the information area again. Similarly, if the information object is first "pushed" into the information area from the side, the information object can then be "pushed" to the opposite side.
[0042] In the method, it is provided in particular that only at most one information object is always completely presented in the information area. In particular, when changing between different information objects, for example if a graphic information object is replaced by a second information object, both information objects are partially presented. In a further embodiment, a plurality of information objects can be displayed simultaneously in the information area, wherein the arrangement and / or configuration of the information objects relative to one another is determined in particular as a function of the respective current relevance values.
[0043] In a further development, a second relevance value of a second information application is also determined, and a second graphical information object is generated by means of the second information application. The second graphical information object is output in the information area, wherein the sequence and / or the display duration of the first graphical information object and the second graphical information object are determined as a function of the comparison of the first relevance value and the second relevance value. This advantageously allows a plurality of information objects to be output, in particular one after the other in a certain sequence and / or for a correspondingly certain duration.
[0044] In particular, the information objects assigned to the information application with the higher relevance value are displayed first in the order or for a longer time in terms of the display duration. The relevance value is determined as a function of the context data, wherein in particular the respectively current context data are taken into account. That is, when the context data are updated, the relevance value can change and this can also result in a changed order or a changed display duration of the information objects.
[0045] Furthermore, a dynamic reclassification of the displayed information objects can be output, in particular by means of an animation, in which a movement of an information object to a different position within the displayed series of information objects is output.
[0046] In one embodiment, a first graphical information object and a second graphical information object are displayed in sequence, wherein the first graphical information object is displayed first and then the second information object is displayed instead of the first information object, wherein the first information object or the second information object can be displayed by an operating action. This advantageously allows the history of the displayed information objects to be called up.
[0047] For example, an information object is displayed by moving it from the edge of the information area into the information area. If another information object is displayed, the already displayed information object can be displaced by the new information object. For example, an information object is pushed into the information area from above, or an information object "falls" into the information area. A further information object to be displayed in the information area also comes from above, while the previously displayed information object is moved downward or "falls out of the information area". Similarly, a lateral movement can be presented, or a new information object can be moved from the lower edge upward to the position where it should eventually be displayed.
[0048] Furthermore, a plurality of information objects may be displayed simultaneously, wherein a set of presentable information objects is defined, wherein a subset of the set of information objects is displayed simultaneously; the subset may also comprise exactly one information object.
[0049] The operating action for displaying the first or second information object comprises in particular a swiping gesture, by which a series of presented information objects is moved, so that a subset of the currently displayed information objects is changed. For example, the presented information objects are dropped into the information area, wherein the new information object displaces the previously presented information objects downwards. The presentation is performed such that the currently presented and previously presented information objects are arranged along a virtual strip, which can be moved in the vertical direction by the swiping gesture.
[0050] In this case, a previously presented information object can be configured in different ways when it is presented again by an operating action. In particular, the associated relevance value can be changed and the information object can be marked as outdated when it falls below a relevance threshold. This can be implemented in different ways in a manner known per se, for example by graying out the information object with lower color saturation, brightness or reduced contrast. In addition, it can be provided that, in the case of an outdated information object, the previously given operability is no longer possible or is only possible within a limited scope.
[0051] In another embodiment, the first graphical information object comprises an operating element, the actuation of which is detected, and an additional information area is formed in which the graphical additional information object is output. The additional area can thus be advantageously used to output additional information and / or to allow additional operability for the currently displayed information object or an information application assigned to the information object.
[0052] In this case, the additional information object is output, in particular, outside the information area. The additional information object can cover other areas, for example, in the form of a pop-up window, an additional window or a widget, or as an extension of a window or a widget presented in the information area.
[0053] In the method, the additional information object can also be presented in such a way that it occupies another display area of the graphical user interface, in particular the first display area or the second display area mentioned above, and replaces the previously presented content if necessary. For example, the information object is presented in the information area, and - if necessary after an operating action (such as tapping or otherwise manipulating in the area of the information object) - in particular then the display area arranged adjacent thereto is replaced by the display of the additional information object belonging to the information application.
[0054] If such a replacement of the content of further display areas is provided, it can also be provided that the display areas of the graphical user interface are each assigned a priority value. Based on the priority value and in particular the relevance value of the corresponding information object, it can be determined whether the content of the display area can be replaced by the additional information object or in which display area of the graphical user interface such a replacement is to be performed. That is to say, for example, if an additional information object is to be presented additionally after an operation in the area of an information object, it can be determined based on the priority value of an adjacent display area whether the content of this display area should be replaced by the additional information object; in this case, the relevance value of the information application with respect to the additional information object is also taken into account.
[0055] The additional information object can be presented in the information area together with the information object and can be removed from display together with the information object after a certain duration or after detecting an operating action. In addition, similar to what is described above for the information object, the additional information object can be stored in the history and called again by an operating action.
[0056] In the method, after the information object has been output, the information area can also be removed from the graphical user interface again, wherein the first display area is enlarged again. In particular, the gap previously created by reducing the first display area is thus closed again. For example, the information object disappears after a certain display duration or after a certain user operation, or the relevance value of the associated information application becomes smaller, so that the relevance value, for example, falls below a relevance threshold value, and the associated information object is no longer to be presented.
[0057] The operating system for a vehicle according to the present invention comprises: a control unit configured to generate display data of a graphical user interface having at least one first display area; an output unit configured to output the display data, wherein the graphical user interface has a basic state and an information state; and a context detection unit configured to detect context data about the current context of the vehicle. The control unit is further configured to determine at least one first relevance value of a first information application based on the detected context data, activate the information state based on the determined first relevance value of the first information application, wherein when the information state is activated, the first display area is reduced in size so that an information area is formed, and a graphic information object is generated based on the first information application and output in the information area.
[0058] The operating system according to the invention is designed in particular to be run with the aid of the method according to the invention described above. The operating system therefore has the same advantages as the method according to the invention. BRIEF DESCRIPTION OF THE DRAWINGS
[0059] The present invention will now be explained based on embodiments with reference to the accompanying drawings.
[0060] Figure 1 A vehicle having an embodiment of an operating system according to the present invention is shown,
[0061] FIG. 2A to FIG. 2C shows an example of a display that may be generated by an operating system,
[0062] FIG. 3A to FIG. 3F shows additional embodiments of displays that may be generated by an operating system, and
[0063] FIG. 4A to FIG. 4G Additional examples of displays that may be generated by an operating system are shown. DETAILED DESCRIPTION
[0064] refer to Figure 1 A vehicle having an embodiment of an operating system according to the present invention is explained.
[0065] The vehicle 1 comprises an output unit 2 which is designed in this exemplary embodiment as a display 2. The display 2 is coupled to a control unit 3 of the vehicle 1. The vehicle 1 further comprises a situation detection unit 4 which in this exemplary embodiment comprises various sensors and detection devices.
[0066] In this embodiment, the situation detection unit 4 is configured to detect surrounding data in the vehicle surroundings, wherein cameras and radar sensors are used. Objects, vehicles and other traffic participants around the vehicle 1 can be detected based on the data of these sensors. In addition, a GPS sensor is provided, by which the position of the vehicle 1 can be determined. In addition, the situation detection unit 4 has an interface to the CAN bus of the vehicle 1, via which, for example, the speed and acceleration of the vehicle 1 and other vehicle data can be detected. With the help of another interface to a new mobile user device (not shown), the situation detection unit 4 can access the user data of the user, which in this embodiment includes a contact database, a remote communication system for text and voice communication, and schedule data. In other embodiments, alternatively or additionally, other sensors, such as lidar, ultrasound or a device for observing the interior of the vehicle, can be used, or an interface to another device (such as a social network, a cloud service or other external service) can be provided.
[0067] The display 2 is designed in a manner known per se and in this embodiment is integrated as a central display into the dashboard of the vehicle 1. The display can be integrated into a touch screen in which a touch-sensitive surface is arranged on the display surface of the display 2 and user inputs can be detected.
[0068] refer to FIG. 2A to FIG. 2C An exemplary embodiment of a display that can be generated by an operating system is explained. Here, the exemplary embodiment of an operating system according to the invention explained above is used as a starting point.
[0069] exist Figure 2A In the case shown in , the graphical user interface 20 has a display area 21. The display area is a surface area formed in the user interface 20 and reserved for outputting information related to the subject. In this embodiment, the display area 21 is configured as a widget 21, that is, the display area includes the output of data and the provision of operating possibilities for applications integrated into the graphical user interface 20. The widget 21 can, for example, be related to navigation, media playback, remote communication and / or applications for other tasks.
[0070] Furthermore, further display elements are provided in the graphical user interface 20, in particular the output of the current speed of the vehicle 1 and the output of settings relating to the seat heaters, which however will not be discussed further below. Figure 2A The presentation of a large display area in is referred to as “full screen presentation” of display area 21.
[0071] exist Figure 2B In the case shown in FIG. 1 , the graphical user interface 20 has a plurality of display areas 22a to 22o arranged in a matrix. Here, the display areas 22a to 22o are also configured as widgets 22a to 22o. In addition, the display areas can be configured as program symbols, which can be transformed into the following by manipulating the program symbols: Figure 2A The full screen presentation in which the corresponding associated application is called.
[0072] exist Figure 2C In the case shown in FIG. 1 , the display areas 23a to 23g are Figure 2A In the case shown, the area occupied by the full screen presentation of the display area 21 is distributed irregularly. Here, in this embodiment, the display areas 23a to 23g are also configured as widgets 23a to 23g. It can be provided that by operating the widgets 23a to 23g, the following is established for the correspondingly assigned application. Figure 2A Full screen presentation in.
[0073] In this embodiment, it is configured that FIG. 2A to FIG. 2C , in particular by means of an operating action including, for example, a swiping gesture, a rotation or movement of an operating element, or other manipulations. In addition, an operating element can be provided in the operating interface 20, by manipulating the operating element, FIG. 2A to FIG. 2C Switch between different situations.
[0074] in accordance with FIG. 3A to FIG. 3F The exemplary embodiment of the display that can be generated by the operating system shown in FIG.
[0075] exist Figure 3A In the case shown in , the graphical user interface 30 has a first display area 31 and three further display areas 32a to 32c. The further display areas 32a to 32c are arranged in the right area of the user interface 30 and are configured to be smaller than the first display area 31 in the left part of the user interface 30 in terms of their extension.
[0076] In this exemplary embodiment, the user can configure the contents and / or operating options outputted in the first display area 31 and the further display areas 32a to 32c himself in a manner known per se. For example, the output of a navigation system is outputted in the first display area 31 .
[0077] In an embodiment of the method according to the invention, this state is defined as a basic state of the graphical user interface 30. The context data of the vehicle 1 are continuously detected by means of the context detection unit 4 and evaluated by the control unit 3. At the same time, a large number of information applications are implemented, through which different data can be output and operating possibilities can be provided. The information application is implemented in particular in the vehicle 1, for example by means of a computing unit or other device coupled to the control unit 3. In particular, the information application is implemented by a mobile user device coupled to the vehicle 1. In addition, the information application can be provided by a device outside the vehicle, for example by an external server, in particular in the case of online services or cloud services. For example, the available information applications can be formed according to the identity of the user or according to the vehicle 1, for example when the information application is coupled to a user of the system implementing the information application. For different information applications, a relevance value is determined based on the detected context data, which indicates how relevant the instance of the information application is in the current context of the vehicle 1. For this purpose, in this embodiment, a series of preset weights are used for different information applications, wherein, however, the weights can also be formed according to the current context.
[0078] For example, a high relevance value is determined for an information application through which an incoming call is output via a telecommunication system and the user can answer the call. An information application for outputting information about a special target in the spatial surroundings of the route currently traveled can be evaluated as having a high relevance value when the vehicle 1 is currently in a position near such a special target. In addition, an information application for outputting information about the activity of a driver assistance system or for detecting user input to a driver assistance system can have a high relevance if the activity of a driver assistance system for guiding the vehicle 1 is evaluated as necessary or useful in the current situation.
[0079] Conversely, a low relevance value may be determined, for example, when the information application concerns information about a special object that is far away from the current position of vehicle 1 .
[0080] In this embodiment, the following relevance threshold is preset, and the relevance value of each information application is compared with the relevance threshold. If the relevance threshold is exceeded, it is assumed that an information object should be generated for the information application, for example, to display important information to the user and / or enable the user to perform important operations. Conversely, if the relevance threshold is not reached, it is assumed that the information application is not sufficiently relevant in the current context.
[0081] In other embodiments, the relevance threshold can be formed dynamically depending on the situation. For example, if the user, in particular the driver of the vehicle 1, is faced with strong challenges in the current situation, for example due to a chaotic traffic situation, and cannot handle displays with less relevance, a higher relevance threshold is determined. In other words, if a strenuous or difficult traffic situation that should not disturb the driver is identified based on the current situation data, the relevance threshold is determined to be correspondingly high. Conversely, a lower relevance threshold can be determined if the vehicle has just come to a standstill, if the relevant user is not the driver of the vehicle, or if the vehicle is guided by means of an at least partially automatic driver assistance system.
[0082] exist Figure 3B In the case shown in , it is recognized that the relevance value of a certain information application exceeds the relevance threshold value in the current context. Therefore, a graphic information object 34 assigned to the information application should be output, which is configured as a widget 34 for the information application. For this purpose, a reduction of the first display surface 31 is presented, by moving the right edge of the first display surface to the left. As a result, a vacant surface is generated, in which an information area 33 is configured. In this embodiment, only the size of the first display area 31 is changed, however, in other embodiments, alternatively or additionally, the size of the other display areas 32a to 32c can also be changed in such a way that the information area 33 is generated. In addition, in particular, in addition to the reduction, a movement of the first display area 31 or the other display areas 32a to 32c can also be presented in order to establish the information area 33.
[0083] exist Figure 3C In the case shown in FIG. , the information object 34 is as it is in Figure 3B In the information area 33 shown in FIG. 34 , the information object 34 is presented. In particular, the information object 34 is displayed as a so-called feed card. The information object 34 is designed as a widget 34 .
[0084] In this embodiment, it is configured that Figure 3B The situation shown in Figure 3C In the transition to the appearance of the information object 34 in the information area 33, the animation presentation is generated in such a way that the first information object 34 "falls" into the information area 33. That is, the information object 34 moves in the graphical user interface 33 in a downward motion from the upper edge of the information area 33, and then stops approximately in the middle of the information area 33. In other embodiments, the information object 34 can appear in a different way, for example by "pushing" it into the information area 33 from the side, by appearing, or in other ways known per se.
[0085] In this embodiment, it is also provided that the information object 34 is presented in such a way that the impression of a perspective is produced in such a way that the information object 34 appears tilted backward relative to the plane of the display surface in which the graphical user interface 30 is displayed, which results in a trapezoidal outline of the information object 34 in the projection onto the plane of the display surface. The other display areas 31, 32a to 32c, on the other hand, have a substantially rectangular outline. In other embodiments, it can be provided that the information object 34 is also designed to have a rectangular or other outline, and furthermore, a highlighting (Hervorhebung) formed in a manner known per se can be provided, by which the information object 34 stands out relative to the other display areas 31, 32a to 32c.
[0086] exist Figure 3D In the case shown in , the graphical user interface 30 also includes an additional information object 35, in this case again a widget 35, which replaces the other display areas 32a to 32c in the right area of the graphical user interface 30. In the exemplary embodiment shown, this state is achieved by actuating the information object 34, wherein the actuation calls up a more extensive presentation of the associated information application. In this exemplary embodiment, the information object 34 and the additional information object 35 are presented in a perspective manner such that they present two feed cards pivoted relative to the plane of the graphical user interface 30, wherein the additional information object 35 presents a visual continuation of the information object 34, thereby also expressing a connection in terms of content.
[0087] Figure 3E and Figure 3F The situation shown in FIG. 1 corresponds essentially to the situation shown in FIG. 11 and FIG. 12 . Figure 3C and Figure 3D However, the additional information object 35 is formed in the area to the left of the information object 34 and replaces the first display area 31. The pivoting of the information object 34 presented in perspective relative to the plane of the graphical user interface 30 is correspondingly reversed.
[0088] In this embodiment, the presentation is similar to the above, by determining the priority of the content output in the first display area 31 and the content output in the other display areas 32a to 32c, in particular according to the current context data. Figure 3C and Figure 3D (i.e. the additional information object 35 is in the right area) or similar Figure 3E and 3F(i.e. the additional information object 35 is output in the area to the left of the information object 34). In other words, it is determined which content is currently more important and which content can be at least temporarily covered or displaced by the additional information object 35. In this case, in a further embodiment, a threshold value can also be determined, when the threshold value is exceeded, the content cannot be covered or replaced by the additional information object 31, so that in particular the additional information object is not presented when all display areas 31, 32a to 32c exceed the threshold value.
[0089] In another embodiment, the user may also determine on which side of the information object 34 the additional information object 35 should be output through an operation action, for example, through a swiping gesture in a corresponding direction.
[0090] In another exemplary embodiment, the information object 35 can be output as a pop-up window, wherein in particular the information object 35 at least partially covers the Figure 3A In another embodiment, the additional information object 35 can be output as a pop-up window, wherein in particular, at least part of the information object 35 is covered. Figure 3C or Figure 3E Presentation of the graphical operating interface 30 shown in .
[0091] in accordance with FIG. 4A to FIG. 4G The exemplary embodiment of the display that can be generated by the operating system shown in FIG. 1 is used to illustrate another exemplary embodiment of the method according to the present invention. Here, the exemplary embodiment of the operating system according to the present invention explained above is taken as a starting point. In addition, the detailed description of the above referenced method will not be repeated. FIG. 3A to FIG. 3F The illustrated ones show similarly constructed elements.
[0092] exist Figure 4A In the case shown, the graphical user interface 40 comprises a first display area 41 , in which data of a navigation system and data of a media playback are output, and an information area 42 , which is designed here as a widget 42 .
[0093] In another embodiment, it can be set to be similar to the above reference FIG. 3A to FIG. 3F The illustrated display generates information region 42 only when a relevance value exceeding a certain relevance threshold is determined for the information application; first display region 41 may initially extend substantially over the entire width of graphical user interface 40 and then be reduced to form information region 42 .
[0094] Information objects 42a to 42j are output in the information area 42, and are constructed as sub-widgets 42a to 42j. That is, the information objects belong to the widget 42 that presents the information area 42 and are output within the surface occupied by the widget. In this embodiment, the information objects 42a to 42j each include a graphic presentation, which is formed in particular according to the information application respectively assigned, so that the user can immediately recognize what type of information or operation possibility it is. The information object also includes a text element. The information object can also be presented with a border and, if necessary, a shadow. In addition, it can be achieved by a graphic presentation method known per se that the information objects 42a to 42j are highlighted or moved to the foreground for presentation relative to other information objects 42a to 42j.
[0095] In this embodiment, similar to what has already been described above, a relevance value is determined for a large number of information applications and compared with a relevance threshold value. When the relevance threshold value is exceeded, the corresponding information object 42a to 42j is output in the information area 42. The information objects 42a to 42j are presented below each other, wherein the sequential arrangement of the information objects and the size of the information objects are established according to their relevance value. The higher the relevance value, the higher the information object 42a to 42j is output. In addition, the information objects 42a to 42j identified as particularly relevant are enlarged and presented in a forward position.
[0096] FIG. 4A to FIG. 4G The display shown in presents an exemplary sequence of displays during which the context of the vehicle 1 changes over time, in particular because the vehicle 1 moves, because communications are performed, because the user performs operating actions and because external data and notifications are received.
[0097] exist Figure 4A In the case shown in , the detected situational data include, for example, the current position of the vehicle 1 at a certain location, the route in the direction of the airport, and weather information provided by an external unit. The information area 42 here includes a first information object 42a, with which information about the current weather in the current surroundings of the vehicle 1 is output, and a second information object 42b, which is assigned to an information application, with the help of which the airport has been identified as a possible travel destination and an operating option is provided to the user in order to call up flight information about the arrival at the airport.
[0098] exist Figure 4BIn the case shown in , the information area 42 includes a further information object 42c, which replaces the output of weather data, since a higher relevance was determined for it. The further information object 42c outputs the content of a text message, in which the sender is presented with a name and a profile picture. The further information application evaluates the content of the text message, which includes a description of the flight number, an indication of the upcoming landing, and an indication of a planned pick-up at the airport.
[0099] exist Figure 4C In the case shown in , the information area 42 includes an information object 42d, which has information about the flight mentioned in the text message, namely the destination airport and terminal where the flight arrives and can be picked up. Figure 4B Compared to the situation shown in FIG. 4 , the information object 42 b is replaced, through which the flight data is provided for access.
[0100] exist Figure 4D In the case shown in , it is assumed that the user has started navigating to the airport, for example by actuating an information object 42d with a description of the airport terminal. Route guidance is output in the first display area 41. The information area 42 here includes a further information object 42e, which replaces the information object 42c with the output of a text message, in which the user is confirmed that navigation has started.
[0101] exist Figure 4E In the case shown in , navigation is continued and information objects 42 f , 42 g are output in the information area 42 , which inform the user of the progress of the navigation or the estimated arrival time of the flight.
[0102] exist Figure 4F In the case shown in , an automatic reply option is provided, with which the user can react to the previously output text message. For this purpose, an information object 42h is output, which includes an indication of the time of arrival at the airport and the pick-up location that can be notified to the communication partner. In this embodiment, the information object 42h is arranged between the information object 42g related to navigation and the information object 42f related to the estimated arrival time of the aircraft.
[0103] exist Figure 4G In the case shown in , it is assumed that the user has agreed to send the corresponding message, for example by manipulating the information object 42h for the automatic reply option. An information object 42j confirming the sending of the automatically generated reply and an information object 42i reflecting the text of the automatic reply are output.
[0104] In the case of a transition between different arrangements and configurations of the graphic information objects 42a to 42j, different presentations can be output, in particular with an animated presentation in which the output appears sequentially through the picture. Individual information objects 42a to 42j can appear or disappear, wherein in particular appearance and disappearance are presented. In addition, the information objects 42a to 42j can be highlighted, for example, by means of a graphical presentation possibility known per se or by changes that occur in space, wherein, for example, the information objects 42a to 42j are moved to the foreground, which can be presented, for example, by a change in size and / or a shadow. The information objects 42a to 42j can also be rearranged, wherein the movement of the information objects relative to each other and relative to the information area 42 can be presented. In addition, the content of the information objects 42a to 42j can be updated, wherein the content within the information objects 42a to 42j is changed and, in particular, replaced by new content.
[0105] In addition, user interaction with individual information objects 42a to 42j or with the elements included therein can be performed. For this purpose, a detection unit is provided, such as a touch-sensitive surface of a touch screen (through which the output of the graphical operating interface 40 is also performed), or other types of detection. The interaction can, for example, include, for example, tapping or clicking on the graphic information objects 42a to 42j, wherein, in particular, a single tap or multiple taps can be distinguished, as well as taps of different types, such as left and right taps, one finger or multiple fingers. In addition, contacts that last longer, so-called long presses, can be detected, and additional operating possibilities are provided, such as in the sense of context menus or additional options. In addition, a wiping gesture or other operation can be provided, so as to discard the graphic information objects 42a to 42j, for example, by sliding them out of the information area 42, for example, if the user evaluates a certain information object 42a to 42j as irrelevant.
[0106] In a further embodiment, it is also provided that information objects 42a to 42j which are no longer relevant or are less relevant than other information objects 42a to 42j are presented further down in the information area 42 than more relevant information objects 42a to 42j. Over time, this leads to the information objects 42a to 42j sliding downward to such an extent that they are pushed out beyond the lower edge of the information area 42 and are no longer visible. That is, a large number of information objects 42a to 42j can be presented, wherein, however, only a true subset is actually presented. The arrangement of a large number of information objects 42a to 42j corresponds to the history of the information objects 42a to 42j, since the information objects 42a to 42j presented earlier continue to be included. In particular, the presentation of such information objects 42a to 42j which are no longer relevant is changed, for example, by being presented in gray. Less relevant or older information objects 42a to 42j can still be called up here by an operating action, such as a swiping gesture in the area of the information area 42, thereby moving the series of information objects 42a to 42j presented below each other and presenting a new subset. In addition, such operating actions can also be used to learn the preferences of the user, for example with the help of machine learning. The learned data can in turn be detected and taken into account as context data.
[0107] The graphical user interface 30, 40 shown in the embodiment realizes information output and / or operation possibility based on situation data. For example, this information can be related to information about the user's learned behavior, such as behavior patterns in certain classified situations, when shopping, on the way to work or on the way to refuel, picking up children or similar behavior patterns. In addition, a large amount of information can be considered, such as information about driving style, communication style (for example, by phone or through video or text messages), media consumption, leisure activities, residential networking environment (so-called smart home) and information about the current location and stay in a limited environment, the type of current driving, weather conditions, contact list, if necessary, co-passengers, current traffic conditions and driver's stress level, driving time and driving distance, load or similar information. Based on this large amount of information about the current situation, it can be determined when the user should be notified of certain information and operation possibilities should be provided. This mainly occurs when the user can also cognitively receive and process the information, that is, when the driving situation and situation allow, for example, location-related services to be displayed.
[0108] Furthermore, the information that can be presented can be prioritized depending on the relevance value, so that relevant content is presented particularly clearly, while other content is simultaneously reduced, or even irrelevant information units and displays are completely hidden.
[0109] Thus, it can be determined when certain information and operating options should be provided to the user, for example, regarding services and offers. Thus, for example, advertising content can be output in such a way that it corresponds to the actual interests of the user in a certain context and can be well understood by the user.
[0110] In contrast to known methods, the invention provides for the management of information objects according to their relevance. Content and additional objects can be presented in a graphical user interface in order to display messages, information and services. In this context, in particular, special display blocks in the graphical user interface, which are in particular configured as information areas, serve as display containers for presenting content.
[0111] The information objects here have a particularly flexible operating depth which can be designed as desired by adapting the size, arrangement and content, from simple triggering of actions (eg by manipulation or tapping) to operating services and complex functional areas.
[0112] Furthermore, the information area can be formed in the central area of the graphical user interface in order to thereby be able to provide a particularly suitable display area for the information object.
[0113] In this case, the information area can be used as a platform managed, for example, by the system provider. As a result, relevant outputs of other providers (for example advertising partners or service providers) can be integrated into the operating system particularly easily. The number of services that can be provided can thus be significantly expanded depending on their relevance.
[0114] Furthermore, a fixed format can be set for the content in the information object, thereby in particular implementing its own colors and design patterns, the so-called corporate design, for the operating system. Third-party providers can display their offers, applications or apps in the information area with their own corporate design (look and feel).
[0115] The information area can also be designed as a central display area of a graphical user interface, in which the relevant functional possibilities, operating possibilities and information possibilities are provided. In addition, for example, a navigation map can be output if it is relevant. The information area can thus be used as a collection container for content relevant to the current situation and circumstances. The range of services can be expanded dynamically without having to integrate and operate a large number of individual information applications. An intelligent, context-sensitive operating system is achieved, which leads to a significant simplification of operation.
[0116] In further exemplary embodiments, voice operation is possible, wherein the overall visual scope of the graphical operating interface can be advantageously reduced as a result.
[0117] Furthermore, the information and operating possibilities of the mobile device can be integrated in a graphical operating interface, thereby providing a central operating unit. The interface receives relevant information and transmits control signals, for example, when the user performs an operating action.
[0118] The operating system has greater openness and scalability for new applications. New functions and information applications can be easily integrated to accompany the vehicle in a scenario-based and context-related manner.
[0119] Reference numerals list
[0120] 1 Vehicle
[0121] 2 output unit; display
[0122] 3Control Unit
[0123] 4Situation Detection Unit
[0124] 20 Graphical operation interface
[0125] 21 display areas, widgets
[0126] 22a to 22o display area, widget
[0127] 23a to 23g Display area, widgets
[0128] 30 Graphical operation interface
[0129] 31 First display area
[0130] 32a to 32c Second display area
[0131] 33 Information area
[0132] 34 Graphics information objects, widgets
[0133] 35 Additional information objects, widgets
[0134] 40 Graphical operation interface
[0135] 41 First display area
[0136] 42 Information area; widgets
[0137] 42a to 42j Information object; child widget.
Claims
1. A method for operating an operating system in a vehicle (1), in which method: Generating and outputting display data of a graphical operating interface (20; 30; 40) having at least one first display area (31; 41); in, The graphic operation interface (20; 30; 40) has a basic state and an information state; detecting context data about a current context of the vehicle (1); determining a first relevance value of a first information application based on the detected context data; activating the information state according to the determined first relevance value of the first information application; wherein, When the information state is activated, the first display area (31; 41) is reduced in size such that an information area (33; 42) is formed; and generating a first graphic information object (34; 42a to 42j) based on the first information application and outputting the first graphic information object in the information area (33; 42); wherein The first correlation value is constructed to be time-dependent; in comparing the first correlation value with a preset correlation threshold; and If the first relevance value exceeds the relevance threshold, the first graphic information object (34; 42a to 42j) is generated.
2. The method according to claim 1, It is characterized in that The detected context data includes characteristics of the vehicle (1), the operating status of the vehicle (1), characteristics of a user's travel using the vehicle (1) and / or user data of the user.
3. The method according to any one of the preceding claims, It is characterized in that When the first display area (31; 41) is reduced, the picture sequence is generated in such a way that a shift of at least one edge of the first display area (31; 41) is presented.
4. The method according to claim 1 or 2, It is characterized in that The graphical operation interface (20; 30; 40) further comprises a second display area (32a to 32c), wherein the second display area is arranged adjacent to the first display area (31; 41) in a basic state of the graphical operation interface (20; 30; 40); wherein: When the information state is activated, the information area (33; 42) is formed between the first display area (31; 41) and the second display area (32a to 32c).
5. The method according to claim 1 or 2, It is characterized in that When the information state is activated, the first graphical information object (34; 42a to 42j) is moved in a moving manner from the edge of the information area (33; 42) into the information area (33; 42).
6. The method according to claim 1 or 2, It is characterized in that further determining a second relevance value for the second information application; and generating a second graphic information object (42a to 42j) according to the second information application; and The second graphic information object (42a to 42j) is output in the information area (33; 42); wherein: The sequence and / or display duration of the first graphic information object (34; 42a to 42j) and the second graphic information object (42a to 42j) is determined based on a comparison of the first relevance value and the second relevance value.
7. The method according to claim 6, It is characterized in that The first graphic information object (34; 42a to 42j) and the second graphic information object (42a to 42j) are displayed in sequence; wherein, Firstly, the first graphic information object (34; 42a to 42j) is displayed; and Then, the second graphic information object (42a to 42j) is displayed instead of the first graphic information object (34; 42a to 42j); wherein, The first graphic information object (34; 42a to 42j) or the second graphic information object (42a to 42j) can be displayed by an operating action.
8. The method according to claim 1 or 2, It is characterized in that The first graphic information object (34; 42a to 42j) comprises an operating element; detecting manipulation of the operating element; and An additional information area is formed, in which a graphical additional information object (35) is output.
9. An operating system for a vehicle (1), comprising A control unit (3) configured to generate display data for a graphical user interface (20; 30; 40) having at least one first display area (31; 41); An output unit (2), the output unit being configured to output the display data; wherein: The graphic operation interface (20; 30; 40) has a basic state and an information state; and a context detection unit (4) configured to detect context data regarding a current context of the vehicle (1); wherein The control unit (3) is further configured to determine at least one first relevance value of the first information application based on the detected context data; activating the information state according to the determined first relevance value of the first information application; wherein, When the information state is activated, the first display area (31; 41) is reduced in size such that an information area (33; 42) is formed; and generating a graphic information object (34; 42a to 42j) based on the first information application and outputting the graphic information object in the information area (33; 42); wherein The control unit (3) is configured to change the first correlation value in a time-dependent manner; wherein The control unit (3) is configured to compare the first correlation value with a preset correlation threshold; and If the first relevance value exceeds the relevance threshold, the graphic information object (34; 42a to 42j) is generated.
Citation Information
Patent Citations
Presenting and interacting with audio-visual content in a vehicle
US20160328244A1