Method and control device for invoking functions and for activating settings of a vehicle

EP4514641A1Pending Publication Date: 2025-03-05BONGERS PETER
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
EP2023723869
Authority / Receiving Office
EP · EP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2022-04-29
Filing Date
2023-04-28
Publication Date
2025-03-05

AI Technical Summary

Technical Problem

The increasing number of functions and settings in vehicles distracts drivers from the road due to the need for eye contact to operate conventional controls, leading to safety risks, especially with the unreliable performance of gesture and voice controls.

Method used

A computer-aided method and control system that displays functions and settings within the driver's field of vision using a software-generated display area, allowing operation without visual contact through a haptically intuitive input device like a mouse, ensuring the driver can access and activate functions without diverting attention from the road.

Benefits of technology

Enables safe operation of vehicles by allowing drivers to access and control functions and settings without looking away from the road, reducing the risk of accidents and accommodating various vehicle manufacturers and future updates through adaptable software.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 1.1
    Figure 1.1
Patent Text Reader

Abstract

The invention relates to a human-machine interface (HMI) for invoking functions and for activating settings of a vehicle (100), the functions and the settings being represented by elements (5) in a display region (1) which is located in the visual field of a person driving the vehicle (100). An input marker (6) in the display region (1) can be moved by means of an input means (7) which is to be intuitively operated by the operator, for example, a touchpad or a joystick, in particular a mouse (8), onto the element (5) of a function or onto the element (5) of a setting to be activated.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] Peter Bongers

[0002] Method and control system for calling up functions and operating settings of a vehicle

[0003] The invention relates to a computer-aided method and a computer-aided control system for calling up functions and operating settings of a vehicle, also referred to as a "computer-aided human / machine user interface" or "Human Machine Interface (HMI)".

[0004] Safe driving of a vehicle requires the person driving the vehicle – hereinafter referred to as the person – to pay full attention to observing the traffic scene.

[0005] Not least to increase driving comfort and, in particular, driving safety, vehicles are equipped with computer-aided control systems with a wide range of functions. It is already known to design these control systems so that their range of functions can be expanded. For this purpose, the control system can be provided with access to networked services.

[0006] In addition to typical vehicle functions, service and business activities can be offered via the control systems, such as parking, shopping, and overnight accommodation. The variety of options is virtually unlimited and will expand in the future. Vehicles today also regularly offer a multitude of setting options. Examples include settings for steering, engine, braking, and chassis characteristics, and especially safety and warning functions. Furthermore, vehicles often feature high-quality multimedia systems that allow their sound to be adjusted to the listening habits of the driver or passengers.

[0007] Due to the ever-increasing number of functions and setting options, accessing all functions and adjusting all settings using conventional devices that require eye contact, such as column switches, steering wheel buttons, etc., is no longer possible. The HMIs used in today's vehicles often include input devices that require eye contact for operation. This distracts the driver from observing the traffic scene. This significantly increases the risk of a traffic accident.

[0008] This danger is all the more pronounced as functions in different vehicles are regularly accessed in different ways, which in turn are operated differently than any vehicle settings. For example, some vehicles have both mechanical switches for accessing functions and rotary controls for operating vehicle settings. Due to the large number of functions and setting options, these switches and rotary controls are then assigned to different functions and settings, for which touchscreens, for example, are provided. With the latter in particular - unlike with a switch or rotary control - haptic detection of a control element is usually not possible, meaning that the person must always look at the touchscreen at the moment of use. This inevitably results in periods during which the person no longer has the traffic scene in view.

[0009] To remedy this, it is already known to provide gesture or voice control systems for calling up functions and adjusting vehicle settings. In practice, however, it has been shown that gesture or voice control systems often do not function with the desired reliability. In particular, gestures are often not recognized or misinterpreted by the gesture control system, and voice control only works if the person uses the word selection provided in the system to call up the respective function or adjust the respective setting. The person is thus forced to learn the vehicle-specific "commands" if they want to use the voice control system correctly. To facilitate the use of voice control, some vehicles are known to display word sequences recognized by the system on a display for calling up functions and adjusting settings.However, this distracts the person from the traffic, which in turn increases the risk of an accident.

[0010] Against this background, the object of the invention is to provide an improved method and an improved control system for calling up functions and for operating settings of a vehicle, in other words an improved HMI of a vehicle, which enables safe driving of the vehicle despite the growing range of functions.

[0011] The method according to the invention provides for at least the functions and settings which cannot be called up or operated using conventional means which can be operated without visual contact to be displayed in a computer-assisted manner, ie by means of software, by means of elements in a display area which is in the field of vision of the person driving the vehicle.

[0012] For the display area to be within the person's field of vision, its lateral edges must be within the person's horizontal viewing angle. The maximum lateral extent of the display area is therefore limited by the person's horizontal viewing angle. This is typically 124 degrees. However, the lateral extent of the display area is preferably selected so that its edges lie within a viewing angle of + / - 30 degrees from a forward viewing direction that coincides with the vehicle's longitudinal axis.

[0013] To ensure that the upper edge of the display area is within the person's field of vision, it must be positioned within the vertical viewing angle. To achieve this, it is offset by a maximum angle of 50 degrees from the person's horizontal line of sight, preferably by a maximum of 25 degrees. The lower edge of the display area is offset by a maximum angle of 70 degrees, preferably by a maximum of 30 degrees, from the person's horizontal line of sight. These measures ensure that the driver always has the entire display area, and thus all of the elements displayed therein, in view without having to turn away from the traffic scene.

[0014] The small angle values ​​indicated above for the horizontal and vertical viewing angles, which are to be preferred, limit an angular range which is also referred to below as the "optimal viewing angle".

[0015] Furthermore, the method according to the invention provides that the individual elements can be selected in the display area using a computer-assisted input marker, i.e., a software-generated input marker, also called a "cursor." To move the input marker, an input means is provided according to the invention, which can be operated intuitively by the person, i.e., solely based on the haptics of the input means and without visual contact.

[0016] The elements can thus be selected with the input device and the functions can be called up or the settings can be activated without the person having to take their eyes off the traffic scene.

[0017] Since the input marker and the elements are generated computer-aided by software, the design of the input marker and the elements, as well as their arrangement, can be adapted to the wishes and requirements of different vehicle manufacturers, for example. For example, the method according to the invention can be adapted to a vehicle manufacturer's corporate identity. The method according to the invention is therefore universally applicable and can also be adapted to future vehicle developments and future changes in legal regulations through simple software updates.

[0018] It is also conceivable to design the method according to the invention or to operate it with such software that different and / or fewer elements are generated in the display area during operation of the vehicle than when the vehicle is stationary.

[0019] Because of this flexibility of the method according to the invention, it would also be conceivable to provide personalized versions of the software that could then be used in different vehicles. People who regularly drive different vehicles can then access a preferred version of the method tailored to their personal needs, regardless of the type or manufacturer of the respective vehicle.

[0020] It would also be conceivable to provide a version of the software that standardizes the inventive method for specific vehicles, e.g., by displaying the elements in a specific, predefined arrangement relative to one another in the display area. In this case, the person no longer has to adapt to vehicle-specific differences when accessing functions and adjusting settings of the respective vehicle. Thus, even when driving different vehicles, the person is not distracted from the traffic situation by differences in operation. The use of this version would be conceivable, for example, for vehicles intended for use in so-called "car sharing," in which people drive different vehicles depending on spontaneous availability and spontaneous need.

[0021] As already explained above, it is essential that the display area is within the field of vision of the person driving the vehicle. This can be achieved, for example, by projecting the display area onto at least part of a windshield or a screen of the vehicle. It is also conceivable that, in addition to the projection, parts of the vehicle's dashboard that are within the person's field of vision could include one or more displays, which then form at least part of the display area.

[0022] The invention particularly also relates to a control system belonging to the HMI for a vehicle for calling up functions and for activating vehicle settings, with which the method according to the invention can be carried out. According to the invention, it has a display area arranged in the field of vision of a person operating the vehicle. The maximum lateral extent of the display area is limited by the horizontal viewing angle of the vehicle driver. This is usually 124°. Preferably, the lateral extent of the display area is selected such that its edges lie within a viewing angle of + / - 30° from a forward viewing direction of the vehicle driver that coincides with a longitudinal axis of the vehicle.To ensure that the upper edge of the display area is within the driver's field of vision, it is positioned at an angle of no more than 50°, and preferably no more than 25°, from the driver's horizontal line of sight. The lower edge of the display area is positioned at an angle of no more than 70°, and preferably no more than 30°, from the driver's horizontal line of sight. These measures ensure that the driver always has the entire display area, and thus all elements displayed within it, in view without having to turn away from the road.

[0023] Furthermore, the control system according to the invention comprises a control unit, by means of which elements associated with the functions and settings can be generated in the display area with computer support. The control unit is designed such that an input mark, also called a "cursor," can be generated within the display area with computer support, by means of which the functions can be selected and controlled.

[0024] According to the invention, the control system further comprises an input means which is connected to the control unit and which can be operated intuitively by the person driving the vehicle, with which input means the input cursor can be moved in the display area with computer support and the functions can be called up and the settings can be activated by selecting the corresponding elements.

[0025] In a preferred embodiment of the control system, the display device comprises a projection device that interacts with at least part of a windshield of the vehicle. For this purpose, the projection device can be designed, for example, in the manner of a known head-up display.

[0026] Alternatively or additionally, the display device may comprise a display which is arranged, for example, in a part of the vehicle's dashboard which is in the field of vision of the person operating the vehicle.

[0027] Furthermore, it is conceivable to provide additional display devices for passengers that can be used for other purposes independent of the operation of the vehicle. These display devices are then preferably designed separately from the display device for the person driving the vehicle, so that the latter is not distracted by the additional display devices.

[0028] The input means can be designed in any way that allows intuitive operation. "Intuitive operation" means that the safe operation of the input means is guaranteed without visual contact of the person driving the vehicle, solely based on haptic perception. For this purpose, the input means can comprise, for example, a touchpad or a joystick. However, a touchpad requires the driver's visual attention; in particular, to operate the touchpad, the driver must shift their perspective from the driving situation to the touchpad, at least for a brief moment. Furthermore, with a touchpad, care must be taken to ensure that when adjusting a cursor or an electronic slider with a fingertip, such as when adjusting the volume, the finger or the touch of the finger does not lose control of the electronic element, such as the slider or cursor.Such operation therefore requires increased attention from the driver. Therefore, the input device particularly preferably comprises a mouse. The invention recognizes that this is particularly well suited for intuitive operation, even without special visual attention.

[0029] It should be clear that the term mouse refers to a generally familiar input device for computers. Such an input device is usually held in the hand of the operator and can be moved laterally, or in particular shifted, to control a cursor. This is preferably done using a laser scanner within the mouse, which detects the movement of the mouse by scanning the surface on which the mouse is moved. A so-called scroll wheel can bring additional control fields into the visualized area. This allows, for example, a cursor to be moved across the entire display surface in a particularly simple and secure manner and can be used to select programs or an app.

[0030] In a particularly preferred embodiment, the mouse comprises an ergonomically shaped housing that includes actuation means such as buttons and / or a rotary knob. The control device is then configured such that moving the mouse on a surface and / or scrolling with a rotary knob moves the input cursor within the display area, and actuating the actuation means selects the desired element and thus calls up the associated function or activates the associated vehicle setting. The mouse can be wired or wireless.

[0031] Preferably, the mouse and the surface on which it can be moved are designed with magnetic means that can be selectively activated and deactivated by the control unit, such that the mouse can be held on the surface and moved into an initial position due to magnetic forces. An electromagnetic mouse pad can be provided for this purpose. An electromagnetic field can preferably be generated from below the mouse or a mouse pad. Preferably, the magnetic means are controlled by software in the control unit during operation of the vehicle such that the mouse can be manually moved on the surface and, if necessary, lifted off the surface, and - particularly preferably - moved back into an initial position on the surface if it is not manually deflected.For this purpose, the magnetic means can - again preferably - be controlled by the control unit such that they are switched off the moment the person driving the vehicle manually operates the mouse. For example, the mouse can be magnetically held in a predefined position while driving, and can move freely when the mouse is touched or grasped by switching off the magnetic field. When the mouse is released, for example when the driving situation requires both hands to grip the steering wheel, the mouse can be pulled into the predefined position and held by the then reactivated magnetic field. The mouse can thus be secured against sliding sideways off the surface, in particular the mouse pad, in the event of lateral forces, such as when cornering. The magnetic hold of the mouse can therefore preferably be switched on and off. The mouse preferably has a metal base.This allows it to interact particularly effectively with the electromagnetic pad.

[0032] The control unit is designed, or the software running on it is programmed, in such a way that the cursor is moved on the display area by moving the mouse on the surface. The surface and a side of the mouse housing facing the surface are preferably flat for this purpose.

[0033] The invention also relates to a vehicle with a control system according to the invention.

[0034] The invention will be further illustrated below with reference to the accompanying figures. They show:

[0035] Fig. la) an illustration of the horizontal field of vision of a person driving a vehicle;

[0036] Fig. lb) the vertical field of vision of a person driving a vehicle;

[0037] Fig. 2 shows a front area of ​​a passenger compartment of a vehicle, in which areas which are outside the field of vision of a person driving the vehicle when their line of sight is directed horizontally forward to observe the traffic situation are shown with cross lines;

[0038] Fig. 3 shows the front part of a passenger compartment of a vehicle, in which areas that are in the field of vision of a person driving the vehicle when their line of sight is directed horizontally forward to observe the traffic situation and which are shown lined, for example, to form display areas, and

[0039] Fig. 4 shows an embodiment of an intuitively operable input device.

[0040] As graphically symbolised in Figs. 1a) and 1b), the horizontal field of vision of a person looking forward in a horizontal direction typically extends over an angular range of 124°. The vertical field of vision typically extends over an angular range of 50° upwards from the horizontal and over an angular range of 70° downwards from the horizontal. A person driving a vehicle can visually perceive events without changing their horizontally forward-facing direction of gaze if these events occur in the field of vision of the person driving the vehicle. If these events occur outside the field of vision, the person must change their direction of gaze in order to perceive these events.

[0041] As also shown in Figures 1a) and 1b), the perception of optical events by a person with a horizontal forward gaze is particularly possible when these events occur within a horizontal viewing angle of + / - 30° and a vertical viewing angle of + / - 25° to - 15° from the horizontal. The resulting field of vision of a person driving a vehicle shall hereinafter be referred to as the "optimal field of vision."

[0042] In conventional vehicles, the design of the procedure or control system for accessing functions and adjusting vehicle settings always requires the driver to change their viewing direction. This is especially true when display areas containing visually perceptible elements symbolizing functions and settings are located outside the driver's optimal field of vision.

[0043] When driving such vehicles, it is therefore necessary for the person to constantly change their line of sight. This limits the possibility of safe driving. For clarity, areas that are unsuitable for displaying elements symbolizing vehicle functions or settings are shown in Fig. 2 with cross-lined lines. Fig. 2 thus shows a prior art example in which these display areas are all arranged in a dashboard 2 and a center console 3 in a passenger compartment 4 of a vehicle.

[0044] These cross-lined areas are also not suitable for calling up functions or adjusting settings if the corresponding input means must be visually perceived. This is the case, for example, if the input means are symbols displayed on a touchscreen. It goes without saying that proven input means, such as column switches and pedals, which can be safely operated without visual contact, can also be used in the cross-lined areas. Fig. 3 shows an area of ​​a passenger compartment 4 of a vehicle 100 which is equipped with a control system 200 according to the invention and whose functions can thus be called up and whose settings can be adjusted using the method according to the invention.For this purpose, the functions and settings are symbolized by visually perceptible elements 5, which are displayed in a display area 1 located within the optimal field of vision of the person driving the vehicle (not shown in Fig. 3). Also located in the display area is an input marker 6, which can be moved using an input device 7 so that the elements 5 can be selected individually. For this purpose, the input device is designed to be operated intuitively, i.e., without optical contact.

[0045] In the illustrated embodiment, the input means 7 comprises a mouse 8, as shown by way of example in Fig. 4. It comprises an ergonomically designed housing 9 which can be grasped by the hand of the person operating the vehicle without eye contact and whose orientation can be determined solely based on haptic perception. In the illustrated embodiment, the housing 9 of the mouse 8 has a flat underside 10 which rests on a flat surface 11. The housing 9 and the surface 11 are designed such that the underside 10 is attracted to the surface by magnetic forces, so that the housing can be moved on the flat surface from an initial position which the mouse 8 assumes due to the magnetic forces.

[0046] The mouse 8 further comprises actuating means 12 in the form of buttons 13 protruding from the surface of the housing 9. The mouse 8 is functionally integrated into the control system 200 of the vehicle 100 such that a displacement on the surface 11 causes the input marker 6 to move in the field of view 1, so that the input marker 6 can be moved to individual elements 5. With the aid of the actuating means 12, in the illustrated embodiment by pressing a button 13, the function or setting symbolized by the element 5 selected with the aid of the input marker 6 can be called up or actuated.

[0047] In the exemplary embodiment of a vehicle 100 according to the invention shown in Fig. 3, the display area 1 extends over a portion of a windshield 14 of the vehicle 100. To form at least a portion of the display area, the vehicle 100 is equipped with a corresponding projection device of a known design, also referred to as a head-up display. In addition, the vehicle 100 includes a display 15, which is known per se. This display can be configured to form a portion of the display area 1.

[0048] Reference list:

[0049] Vehicle Control system Display area Dashboard Center console Passenger compartment Elements Marker Input device Mouse Housing Underside Surface

[0050] Actuating device button

[0051] Windshield display

Claims

Claims: A method for accessing functions and adjusting settings of a vehicle (100), wherein the functions and settings are represented by elements (5) in a display area (1) located within the field of vision of a person driving the vehicle (100), and wherein an input marker (6) in the display area (1) is moved to the element (5) of a setting to be adjusted by means of an input device (7) that is intuitively operated by the person driving the vehicle. The method according to claim 1, characterized in that at least a part of the display area (1) is generated by a projection onto a windshield (14) of the vehicle (100). The method according to claim 1 or 2, characterized in that at least a part of the display area (1) is generated by a display on a screen (15) located within the field of vision of the person driving the vehicle on a part of the dashboard (2) of the vehicle (100).A method according to any one of claims 1 to 3, characterized in that the input means (7) comprises a mouse (8), and the input marker (6) is set by moving the mouse. A method according to claim 4, characterized in that the display area (1) can be changed by means of the mouse, in particular by means of a scroll wheel. A control system (200) for calling up functions and operating settings of a vehicle (100), with a display area that is arranged in the field of vision of a person operating the vehicle, wherein the display area (1) has elements (5) that are assigned to the functions and settings. with an input marker (6) within the display area, with which the elements (5) can be individually controlled and selected, and with an intuitively operable input means (7) by means of which the input marker (6) can be moved, the functions can be accessed, and the settings can be adjusted. Control system according to claim 6, characterized in that the control system (200) comprises a projection device that interacts with at least a part of a windshield (14) of the vehicle. Control system according to claim 6 or 7, characterized in that the control system comprises a display which is arranged in the field of vision of the person driving the vehicle and is preferably arranged in a part of an instrument panel (2) of the vehicle (100). Control system according to any one of claims 6 to 8, characterized in that the input means (7) comprise a touchpad or a joystick, preferably a mouse (8).A control system according to any one of claims 6 to 9, characterized in that the input means (7) comprise a mouse (8). A control system according to any one of claims 9 or 10, characterized in that the mouse (8) has an ergonomically shaped housing (9) comprising an actuating means (12), which is preferably secured to a surface (11) against unintentional lifting and / or slipping from the surface (11) by means of magnetically acting means. A control system according to claim 11, characterized in that the magnetically acting means can be activated, in particular such that they are activated when the housing of the mouse (8) is not manually actuated by an operator. A vehicle with a control system according to any one of claims 6 to 12.

Citation Information

Patent Citations

  • Touch-sensitive display device with integrated mechanical control element for motor vehicles

    DE102008040755A1