Method and apparatus for providing a user interface

Abstract

Method for providing a user interface, in particular in a vehicle, comprising at least two display areas (2-1 to 2-4) and an operating device (4), wherein - a graphic object (6) is displayed in the first display area (2-1) and - the graphic object (6) is moved to the second display area (2-2) by means of the control device (4), whereby an anchor object (7) is displayed for the graphic object (6) in the first display area (2-1), which allows operation of the object (6) displayed in the second display area (2-2) by means of the control device (4), wherein the operating device in the first display area (2-1) comprises a touch-sensitive surface (4) and wherein the graphic object (6) is assigned to a vehicle equipment and settings for the graphic object (6) and / or the assigned vehicle equipment can be made by means of the anchor object (7) and the operating device, characterized in that When the touch-sensitive surface (4) is briefly tapped at the position where the anchor object (7) is displayed, a menu (8) is opened which contains several buttons that allow the control or operation of the object (6) displayed in the second display area (2-2) and / or the associated vehicle equipment.

Description

[0001] The present invention relates to a method and a device for providing a user interface, particularly in a vehicle. The device comprises at least one display device that provides at least two display areas. It further comprises an operating device and a control device for controlling the display in the display areas, such that a graphic object can be displayed in the first display area and the graphic object can be moved to the second display area by means of the operating device.

[0002] A vehicle typically displays various pieces of information, primarily vehicle-related data, which are presented visually to the driver. Traffic-related data can also be displayed. Previously, analog mechanical gauges were used to display this information. These were usually located within the instrument cluster, close to the driver's primary field of vision behind the steering wheel. The instrument cluster primarily displays the vehicle's speed, fuel level, coolant temperature, and other operational information.

[0003] With the increase in electronic systems in vehicles, it became necessary to display a greater amount of information within the vehicle. Modern vehicles, for example, include a variety of driver assistance systems, the information from which must be displayed. Furthermore, many vehicles include a navigation system. Such a navigation system can display digital geographical maps with a route and, if applicable, additional information. Finally, modern vehicles include communication and multimedia applications, including a mobile phone interface and systems for playing music and speech. The vehicle must also be able to display information for these applications.

[0004] For this reason, vehicles often use multifunction operating systems, which include one or more multifunction displays and controls for operating the various features within the vehicle. Operation is supported and guided by the information displayed on the multifunction display. Furthermore, the operating system allows the user to select which information is displayed on the multifunction display.

[0005] To flexibly display the diverse range of information, freely programmable displays are used, which often also replicate the functions of conventional mechanical instruments. For example, German patent DE 10 2006 032 118 A1 describes a combination instrument for a motor vehicle that includes a display capable of variably showing the vehicle's speed, engine speed, engine temperature, fuel level, and / or time. It is also possible to display information from a navigation system, telephone, music system, infotainment system, and / or air conditioning system.

[0006] In addition to the instrument cluster, a display device is often arranged above the vehicle's center console, which can show further information. This display device is used in particular as a multifunction display and for showing a geographical map from a navigation system. Such a multifunction display is described, for example, in DE 199 41 956 A1.

[0007] The multifunction displays are operated in conjunction with an operating system to provide a user interface. The operating system comprises various control elements. For example, DE 199 41 956 A1 describes several selection and function keys for controlling the vehicle equipment. DE 199 41 960 A1 describes a multifunction control element for selecting function groups and individual functions, which includes a bidirectionally rotatable cylinder that is also movable perpendicular to the axis of rotation.

[0008] In addition to the remote controls described above, it has also been proposed to equip the display area itself with a touch-sensitive surface, thus providing a so-called touchscreen. With such a touchscreen, operation is achieved by the user touching the touchscreen, for example, with their fingertip. The position of the touch and, if applicable, the movement during the touch are recorded, evaluated, and assigned to an operating step. To assist the user during operation, virtual switches can be displayed on the screen as graphic buttons. A display device with a touch-sensitive surface, used in conjunction with a navigation system, is described, for example, in DE 10 2005 020 155 A1.

[0009] The user interface of a vehicle has very specific requirements, as it can be operated by the driver, among others. It is therefore crucial that the operating process and the associated information processing do not distract the driver while driving. The operating process should therefore require as little attention from the driver as possible and be quick to execute.

[0010] In DE 10 2008 028 392 A1, the movableness of a display object between two display devices and a division of the display object into parts are described.

[0011] DE 10 2005 010 843 A1 describes the display of a pictorial message using a head-up display, which can be stored as a recallable icon in an icon bar.

[0012] Further state of the art is described in DE 100 56 305 C1, US 2008 / 0066008 A1, WO 98 / 13 224 A1, DE 101 17 410 A1 and DE 10 2007 052 ​​343 A1.

[0013] The object of the present invention is to provide a method and a device of the type mentioned at the outset, in which the user can operate equipment, in particular vehicle equipment, in a simple and intuitive manner via the user interface.

[0014] According to the invention, this problem is solved by a method with the features of claim 1 and a device with the features of claim 7. Advantageous embodiments and further developments are described in the dependent claims.

[0015] In the method according to the invention, a graphic object is displayed in the first display area. Using the operating device, the graphic object is moved to the second display area, whereby an anchor object for the graphic object is displayed in the first display area, which allows the object displayed in the second display area to be operated by means of the operating device.

[0016] In the method according to the invention, the operation of objects that can be displayed in different display areas is supported by the display in the first display area. If the graphic object is not displayed in this first display area, an anchor object remains in the first display area, via which the operation of remotely displayed graphic objects is still possible. In this way, the user can also operate remotely displayed graphic objects without the support for the operation of the graphic object switching to another display area or having to execute the operation in a different way. The user therefore does not have to switch to a different mode of operation.

[0017] According to one embodiment of the inventive method, when the anchor object is activated, the graphic object can be moved back so that it is displayed again in the first display area. The anchor object thus holds the graphic object, which is displayed in another display area, in the first display area.

[0018] According to the invention, the graphic object is assigned to a vehicle equipment system. In this case, settings for the graphic object and / or the assigned vehicle equipment system can be adjusted using the anchor object and the operating device. The graphic object can, for example, display information about the vehicle equipment system. In this case, the vehicle equipment system can be operated, settings for the vehicle equipment system can be adjusted, the vehicle equipment system can be controlled, and / or settings for the information display can be adjusted using the graphic object. The graphic object, which is displayed outside the first display area, thus serves only as a display object. The graphic object is operated via the anchor object, which is displayed in the first display area.

[0019] According to a further embodiment of the inventive method, the area occupied by the anchor object in the first display area is smaller than the area previously occupied by the graphic object in the first display area. Thus, if a graphic object is moved from the first display area to another display area, space becomes available in the display area of ​​the first display area for further information displays. In this way, a primary display area can be kept free of display content that is not currently needed but should still be displayed. The graphic objects can then be quickly retrieved and returned to the primary display area via the anchor objects.

[0020] According to a further development of the method according to the invention, operating operations performed by means of the operating device are supported by a display in the first display area. In particular, buttons that are displayed in the first display area can be actuated by means of the operating device. These buttons can be encompassed by the graphic objects that are displayed in the first display area. Furthermore, the anchor object can be designed as a button.

[0021] For the purposes of this invention, a button is understood to be a control element of a graphical user interface. A button differs from elements and areas used solely for information display, so-called display elements or display areas, in that it is selectable. When a button is selected, its associated function is executed. This function can only result in a change to the information display. Furthermore, buttons can also be used to control devices whose operation is supported by the information display. Buttons can thus replace conventional mechanical switches. Buttons can be created and displayed arbitrarily on a freely programmable display area. Additionally, it may be provided that a button can be selected. In this case, the associated function is not yet executed.The selected button is highlighted compared to other buttons. Selecting and / or highlighting a button can be done using a cursor or by directly interacting with a touch-sensitive display.

[0022] According to the invention, the operating device comprises a touch-sensitive surface in the first display area. The second display area, or further display areas, do not have a touch-sensitive surface. In this case, the user can make inputs via the touch-sensitive surface on the first display area. With the method according to the invention, such inputs can also be made to graphic objects that are not displayed in the first display area. Interaction can take place via the associated anchor objects. Thus, if a graphic object is displayed in a display area that does not have a touch-sensitive surface, it is not necessary with the method according to the invention for this graphic object to be operated in any other way. The user can always use the touch-sensitive surface of the first display area.This makes input via the user interface very simple and intuitive. For example, the user does not have to switch to mechanical controls when making inputs that belong to graphical objects which are not displayed in the display area with the touch-sensitive surface.

[0023] The device according to the invention is characterized in that the control device controls the display in the first display area in such a way that an anchor object is displayed for the graphic object, which allows operation of the object displayed in the second display area by means of the operating device when the graphic object has been moved into the second display area.

[0024] The device according to the invention is particularly designed to be able to partially or completely perform the process steps described above. The device also offers the same advantages as the method according to the invention.

[0025] According to one embodiment of the device according to the invention, the operating device comprises a touch-sensitive surface in the first display area. The second display area, as well as any further display areas, do not have a touch-sensitive surface. The first display area is thus part of a so-called touchscreen.

[0026] The second display area is located, for example, in the vehicle's instrument cluster. This display area cannot have a touch-sensitive surface, as contact with it by the driver or any other vehicle occupant while driving is not possible for safety reasons. Furthermore, the second display area, or additional display areas, are located in a part of the vehicle that is inaccessible from the driver's position. Such inaccessible areas are located, in particular, where the driver cannot safely reach them while driving without significantly changing their seating position. These areas are located, in particular, in front of the passenger side and in the rear of the vehicle. The second display area can also be provided by a head-up display. Such a display area also cannot be equipped with a touch-sensitive surface.

[0027] According to a further development of the device according to the invention, buttons displayed in the first display area can be actuated by means of the operating device. These buttons can be actuated either by touching the button on the touch-sensitive surface of the first display area or by using a cursor control, in which a cursor displayed in the first display area is controlled by an external operating element.

[0028] The invention will now be explained using an exemplary embodiment with reference to the drawings. Fig. Figure 1 schematically shows an embodiment of the device according to the invention. Fig. 2 illustrates the arrangement of different display areas in the vehicle, The Fig. 3A and Fig. Figure 3B schematically shows the display in two display areas, which are generated by an embodiment of the method according to the invention, in which a graphic object is displayed in the first display area. the Fig. 4A and Fig. Figure 4B schematically shows the displays in two display areas generated by the embodiment of the method according to the invention, in which the graphic object has been moved to the second display area, and the Fig. 5A and Fig. Figure 5B schematically shows the displays in two display areas generated by the embodiment of the method according to the invention, in which the graphic object is operated by means of the anchor object.

[0029] With reference to the Fig. 1 and Fig. Section 2 describes the structure of the exemplary embodiment of the device according to the invention: The device comprises a display device, which can in particular be divided into several individual display devices 1-1 to 1-4. The display devices 1-1 to 1-4 provide different display areas 2-1 to 2-4 in the vehicle. As shown in Fig. As can be seen in Figure 2, display area 2-1 is located centrally in the vehicle above the center console, i.e., between the driver and front passenger. Display area 2-2 is housed in the vehicle's instrument cluster. It is therefore located behind the steering wheel. Display area 2-3 is provided by a head-up display. It is projected into the driver's field of vision. Finally, display area 2-4 is located in the front passenger's field of vision.

[0030] The display content shown by the display devices 1-1 to 1-4 in the display areas 2-1 to 2-4 is controlled by a control device 3. The control device 3 is connected to a vehicle bus 5, via which it can exchange data bidirectionally with various vehicle systems. By means of the control device 3, different display content, which can be assigned to different vehicle systems, can be presented to the vehicle occupants on the different display areas 2-1 to 2-4.

[0031] Furthermore, an operating device is provided through which the user can make inputs. Using this operating device, the user can, in particular, operate vehicle systems and control the type of information displayed in display areas 2-1 to 2-4. In the embodiment described here, the operating device comprises a touch-sensitive surface 4, which is provided on a display area of ​​the display device 1-1, which provides display area 2-1. The display device 1-1 thus comprises a so-called touchscreen. Display area 2-1 is arranged in the vehicle in such a way that it can be easily touched by the driver, even while driving.

[0032] In addition to or as an alternative to the touch-sensitive surface 4, the operating device can also include a device for detecting a gesture performed in front of the display area 2-1 without requiring contact with the display area 2-1. For example, a user's hand or finger can perform the gesture in front of the display area 2-1. The detection device records the three-dimensional position of the hand within a specific area in front of the display area 2-1. This area might be, for example, 40 cm to 10 cm in front of the display area 2-1. When the user's hand moves into this area, the detection device recognizes this and interprets the approach as an intention to operate the device. The detection device then records the position and movement of the user's hand within this area.Various hand gestures can be recognized and interpreted as input. The detection system can include, for example, infrared light sources and infrared light receivers. Furthermore, the hand's position and its changes over time can also be detected using an optical system.

[0033] The following refers to the Fig. 3, Fig. 4 to Fig. Section 5 describes an embodiment of the method according to the invention, which can be carried out by the device described above. In this embodiment, the following is described: Fig. 3A, Fig. 4A and Fig. 5A schematically reproduces the display in display area 2-2 of the vehicle's instrument cluster and in the Fig. 3B, Fig. 4B and Fig. 5B shows the display of the display area 2-1, in which the touch-sensitive surface 4 is provided.

[0034] In the initial state, a graphical object 6 is displayed in the display area 2-1, as shown in Fig. Figure 3B shows that the graphic object can contain, for example, directional information from the navigation system. However, it can also visualize information from other vehicle systems.

[0035] The graphic object 6 can be moved from display area 2-1 to another display area using the operating device. In the embodiment described here, the graphic object 6 is moved to display area 2-2 in the vehicle's instrument cluster. During the operating process by which the graphic object 6 is moved to another display area 2-2, the user can, for example, start from the in Fig.As shown in Figure 3B, the user touches the touch-sensitive surface 4 of display area 2-1 with their fingertip at the graphic object 6 and then moves their fingertip on the touch-sensitive surface 4 towards the vehicle's instrument cluster. The control device 3 controls the display in display area 2-1 so that the graphic object 6 moves with the user's fingertip. For this purpose, the position of the touch on the touch-sensitive surface 4 is transmitted to the control device 3. When the graphic object 6 is located at the left edge of display area 2-1, a signal can be triggered in the control device 3, causing the graphic object 6 to jump to display area 2-2 in the vehicle's instrument cluster. The position of the graphic object 6 in display area 2-2 can be determined automatically by the control device 3.

[0036] When the graphic object 6 has been moved to the other display area 2-2, the control device 3 adjusts the display area 2-1 so that an anchor object 7 is displayed in display area 2-1. The anchor object 7 allows the graphic object 6 displayed in display area 2-2 to be operated via the touch-sensitive surface 4 at display area 2-1. The user can perform an operation via the anchor object 7 on the touch-sensitive surface 4 that brings the graphic object 6 back into display area 2-1. For example, the user can touch the touch-sensitive surface 4 at the position of the anchor object 7 and slide to the right on the touch-sensitive surface 4. Such a movement can be interpreted by the control device 3 as an input to bring the graphic object 6 back into display area 2-1.The control device 3 then controls the display area 2-2 and the display area 2-1 in such a way that the graphic object 6 is no longer displayed in the display area 2-2, but instead in the display area 2-1.

[0037] Furthermore, an operation can be performed on the touch-sensitive surface 4 to control a vehicle device associated with the graphic object 6, or to adjust the settings of this vehicle device or the display mode of the graphic object 6. For example, the user can briefly tap the touch-sensitive surface 4 at the position where the anchor object 7 is displayed. This opens a menu 8 containing several buttons. These buttons enable the desired control or operation. The input is supported by the display in display area 2-1, for example, by showing the buttons of menu 8 even though the associated graphic object 6 is displayed in a separate display area 2-2. After the input is complete, menu 8 can be closed.

[0038] Of course, it is possible for multiple graphic objects to be displayed in display areas 2-2 to 2-4, with anchor objects then being displayed in display area 2-1 for each of these graphic objects.

[0039] As an alternative to operating and controlling graphic objects 6 that are displayed outside the display area 2-1 by means of the touch-sensitive surface 4 provided at the display area 2-1, inputs can also be made - as described above - by means of cursor control via an external control element or via gesture recognition in front of the display area 2-1. REFERENCE MARK LIST 1-1 to 1-4 display devices 2-1 to 2-4 display areas 3 Control device 4 touch-sensitive surfaces 5-vehicle bus 6 graphic object 7 Anchor Object 8 Menu

Claims

Method for providing a user interface, particularly in a vehicle, comprising at least two display areas (2-1 to 2-4) and an operating device (4), wherein: - a graphic object (6) is displayed in the first display area (2-1) and - the graphic object (6) is moved to the second display area (2-2) by means of the operating device (4), wherein an anchor object (7) is displayed for the graphic object (6) in the first display area (2-1), which allows operation of the object (6) displayed in the second display area (2-2) by means of the operating device (4), wherein the operating device in the first display area (2-1) comprises a touch-sensitive surface (4) and wherein the graphic object (6) is assigned to a vehicle equipment and settings for the graphic object (6) and / or the assigned vehicle equipment can be made by means of the anchor object (7) and the operating device, characterized in thatthat the touch-sensitive surface (4) is briefly tapped at the position where the anchor object (7) is displayed, a menu (8) is opened which contains several buttons that enable the control or operation of the object (6) displayed in the second display area (2-2) and / or the associated vehicle equipment. Method according to claim 1, characterized in that when the anchor object (7) is actuated, the graphic object (6) can be moved back so that it is displayed again in the first display area (2-1). Method according to one of the preceding claims, characterized in that the area occupied by the anchor object (7) in the first display area (2-1) is smaller than the area previously occupied by the graphic object (6) in the first display area (2-1). Method according to one of the preceding claims, characterized in that operating operations carried out by means of the operating device are supported by a display in the first display area (2-1). Method according to one of the preceding claims, characterized in that buttons can be actuated by means of the operating device, which are displayed in the first display area (2-1). Method according to one of the preceding claims, characterized in that the second display area (2-2) does not comprise a touch-sensitive surface. Device for providing a user interface, in particular in a vehicle, comprising: - at least one display device (1-1 to 1-4) which provides at least two display areas (2-1 to 2-4), - an operating device, - a control device for controlling the display in the display areas (2-1 to 2-4), such that a graphic object (6) can be displayed in the first display area (2-1) and the graphic object can be moved to the second display area (2-2) by means of the operating device (4), wherein, when the graphic object (6) has been moved to the second display area (2-2), the control device (3) controls the display in the first display area (2-1) such that an anchor object (7) is displayed for the graphic object (6), which allows operation of the object (6) displayed in the second display area (2-2) by means of the operating device.wherein the operating device in the first display area (2-1) comprises a touch-sensitive surface (4) and wherein the graphic object (6) is assigned to a vehicle equipment and settings for the graphic object (6) and / or the assigned vehicle equipment can be made by means of the anchor object (7) and the operating device, characterized in that a menu (8) can be opened by briefly tapping the touch-sensitive surface (4) at the position where the anchor object (7) can be displayed, which contains several buttons that enable the control or operation of the object (6) displayed in the second display area (2-2) and / or the assigned vehicle equipment. Device according to claim 7, characterized in that the second display area (2-2) does not comprise a touch-sensitive surface. Device according to claim 7 or 8, characterized in that the second display area (2-2) is arranged in the instrument cluster of the vehicle. Device according to one of claims 7 to 9, characterized in that the second display area (2-2) is arranged in an area of ​​the vehicle that is not accessible from the driver's position. Device according to one of claims 7 to 9, characterized in that the second display area can be provided by a head-up display (1-3). Device according to one of claims 7 to 11, characterized in that buttons can be actuated by means of the operating device (4) which are displayed in the first display area (2-1).

Images