Method for a trouble-free operation of applications in a motor vehicle

Abstract

The invention relates to a method for a trouble-free operation of applications in a motor vehicle by a motor vehicle user. The method has at least the following steps: - detecting a first operation of an application of the motor vehicle, the first operation being carried out by a motor vehicle user, and the first operation involving an operating element and an operating movement; - determining at least one function of the motor vehicle, the function being controllable by means of one or more operating elements which are provided within the motor vehicle in spatial proximity to the first operation; and - outputting an output signal for deactivating the determined function.

Description

[0001] 24-3068

[0002] 1

[0003] METHOD FOR THE TROUBLESHOOTING-FREE OPERATION OF APPLICATIONS IN A MOTOR VEHICLE

[0004] The present disclosure relates to a method for the trouble-free operation of applications in a motor vehicle. The disclosure relates equally to a computer program and / or computer-readable medium, a data processing device, and a motor vehicle.

[0005] The interaction between vehicle users and the various systems and functions of a motor vehicle is a crucial aspect of vehicle operation. Modern motor vehicles incorporate a multitude of systems and functions that can be controlled via various interfaces. These interfaces can include physical switches or buttons, touchscreens, voice control systems, or other types of user interfaces. The correct operation of these systems and functions is essential for the safety and comfort of the driver and passengers. However, incorrect operation can occur if the driver accidentally activates the wrong control or if the vehicle misinterprets the driver's intention. Such errors can lead to undesirable changes in vehicle function and can be potentially dangerous.

[0006] Furthermore, the sheer number of available systems and functions, as well as the complexity of their controls, can be confusing for the driver, especially when attempting to operate a specific function while driving. This can lead to distractions that may compromise the safety of the driver and passengers. Therefore, there is a need for procedures and systems that simplify the operation of vehicle systems and functions and minimize operating errors.

[0007] EP 3894256 B1 describes an operating system for a vehicle comprising a control unit and at least two adjacent, touch-sensitive user interfaces. The control unit is designed to manage the display of a plurality of controls on the user interfaces, register a user selection in an area of ​​a displayed control, and then control a function associated with the selected control. During the user selection of the chosen control on one of the user interfaces, the control unit locks at least one function associated with at least one other control on another of the user interfaces. 24-3068

[0008] 2

[0009] Modern vehicles now incorporate a multitude of different functions, applications, and systems located within the driver's reach in the cockpit, each requiring a different method of operation. This increases the risk of accidentally activating a function, which can distract the driver from the road.

[0010] In light of the prior art, one objective of the present disclosure is to provide a method suitable for enriching the prior art and improving at least the aforementioned aspects of the prior art. In particular, one objective of the disclosure is to provide a method that enables trouble-free operation of applications in a motor vehicle, thereby increasing safety and user-friendliness. The risk of operating errors should be minimized.

[0011] The problem is solved by the features of the independent claims. The dependent claims contain further developments of the disclosure.

[0012] The problem is then solved, according to one aspect of the disclosure, by a method for enabling a motor vehicle user to operate applications in a motor vehicle without interference. The method comprises at least the following steps:

[0013] - Detecting the operation of an application of the motor vehicle, wherein the operation is performed by a motor vehicle user and wherein the operation comprises a first control element and an operating movement;

[0014] - Determining at least one function of the motor vehicle, wherein the function is controllable by means of one or more second control elements which are arranged within the motor vehicle in close proximity to the operation; and

[0015] -Outputting an output signal to deactivate the identified function.

[0016] Detecting the operation of a vehicle application can be achieved, for example, through sensors such as touch sensors, motion sensors, and / or cameras. The operation could be, for example, touching a touchscreen, pressing a switch, or using gesture control.

[0017] Determining at least one function of the motor vehicle can be accomplished, for example, by a control unit of the motor vehicle. The function can be, for example, a vehicle function such as the control of the air conditioning, radio, navigation system, mirrors, or power windows. The operating elements can be, for example, switches, buttons, rotary knobs, or touchscreens. The spatial proximity between the first operation 24-3068

[0018] 3

[0019] The primary control element, and at least one secondary control element used to control the function, can be defined in various ways. For example, controls whose distance to the control movement and / or the primary control element is less than a predefined threshold, as evidenced by video analysis, can be identified as secondary controls. The functions controllable by the secondary controls can be known to the control unit and thus determined based on the identified secondary controls.

[0020] The output signal to deactivate the identified functions of the vehicle can be generated, for example, by the vehicle's control unit. This output signal can be, for instance, an electrical signal sent to the relevant systems and / or functions of the vehicle to deactivate them.

[0021] This method prevents the vehicle user from accidentally altering vehicle functions due to the inadvertent operation of secondary controls while using a vehicle application. This can be particularly useful in situations where the vehicle user is distracted, for example, while driving, or when operating applications that require increased attention, such as adjusting the exterior mirrors.

[0022] According to one embodiment, the operation is detected by at least one sensor in the vehicle. The sensor can be, for example, a touch sensor, a motion sensor, or a camera.

[0023] According to one embodiment, the system can additionally or alternatively detect the position, gaze direction, head pose, and / or head movement of the vehicle user, and / or the position and / or movement of a hand belonging to the vehicle user. For example, a camera system in the vehicle captures at least a partial 3D skeleton of the vehicle user, detecting joints and / or directions of movement of parts of the skeleton. Based on this, operating movements can be detected and attributed to the user. Several pieces of information can be evaluated together to precisely determine the underlying operating intention of the vehicle user. For example, by detecting the vehicle user's gaze direction, it can be determined which control element the vehicle user is focusing their attention on. The control element in question can thus be more reliably identified as part of the operation.Additionally or alternatively, the position and / or movement of a hand can be detected by the 24-3068.

[0024] 4

[0025] The system can determine which controls the vehicle user intends to perform. Additionally or alternatively, the detected operating movement and the position of the first control can be used to identify secondary controls located in close proximity to the operating movement and / or the first control.

[0026] According to one embodiment, operation comprises repeatedly pressing the first control element and / or at least temporarily directing the vehicle user's gaze. The control element can be, for example, a switch, a button, a rotary knob, or a touchscreen. By repeatedly pressing the control element, the vehicle user can, for example, navigate through various menus or options of an application. The vehicle user can direct their gaze toward a display or screen connected to the control element. Alternatively or additionally, the vehicle user's gaze can be directed toward vehicle systems that are adjusted by the control element. This can occur when adjusting the exterior mirrors if the control element is located inside the vehicle, but the vehicle user's gaze is directed toward the mirror.The vehicle user's gaze direction is preferably detected by a camera or other sensor in the vehicle. The information captured about the vehicle user's gaze direction can be used to reliably recognize the desired operation of the application.

[0027] According to a further embodiment, spatial proximity is determined based on the spatial distance between the first control element and a second control element of the identified function. Spatial proximity can be detected, for example, by sensors such as distance sensors or cameras. In particular, spatial proximity is determined from predefined positions of potential second control elements and the detected control element. The acquired information about spatial proximity can be used to precisely identify the vehicle functions to be deactivated as a precaution and to reliably generate the output signal for deactivating the identified functions.

[0028] For example, functions whose controls are located no further than a predefined maximum distance from the first operation can be deactivated. The respective distance can be continuously determined, for example, based on video signals from the vehicle interior using automatic image processing. In particular, functions can be deactivated that are within a range relative to the first operation defined by the typical movement radii of the arm, hand, or fingers of a vehicle user performing the operation, especially a driver. 24-3068

[0029] 5

[0030] According to a further embodiment, the method also includes determining the plausibility of the operation based on the controllability of the application depending on the operation, wherein the output signal is determined based on this plausibility. Plausibility can be assessed, in particular, by considering the location, speed, direction of travel, and / or route of the vehicle. A predefined threshold or rule can be used to determine plausibility. For example, an operation in which a gearshift lever is to be moved to the park position while the vehicle is traveling at a higher speed on a road can be classified as implausible. In another example, operating a control lever to adjust an exterior mirror can constitute a plausible operation if it is performed repeatedly.

[0031] Plausibility checking is a method used to roughly assess whether a value or result is plausible—that is, acceptable, logical, and comprehensible. It doesn't always verify the correctness of the value or result; rather, it aims to identify any obvious inaccuracies. One advantage of plausibility checks is that they can be performed with minimal effort.

[0032] The plausibility of the operation can be determined based on information about the vehicle's current driving situation. For example, the plausibility of the operation may be classified as low if the vehicle is traveling at high speed or if it is in a complex traffic situation. In such cases, the output signal may be suppressed or delayed to avoid distracting or disturbing the vehicle user due to an unexpected deactivation.

[0033] Operating applications in a motor vehicle can be challenging for the driver, especially when they also have to control the vehicle.

[0034] Incorrect operation can lead to dangerous situations, for example, if vehicle functions are accidentally activated or deactivated. Furthermore, the multitude of available functions and controls in modern vehicles can be confusing for the driver and lead to operating errors. The present disclosure provides a method for the trouble-free operation of applications in a motor vehicle. By detecting an application operation and subsequently identifying vehicle functions located in close proximity to that operation, potential operating errors can be prevented.24-3068

[0035] 6

[0036] The system detects and avoids accidental activation or deactivation of detected functions. Outputting a signal to deactivate these functions prevents them from being accidentally activated or deactivated, thus increasing driver safety. A significant advantage is that vehicle applications can be operated more safely and intuitively. By considering the driver's position, gaze direction, head posture and / or movement, as well as the position and / or movement of their hand, the system can accurately determine which function the driver intends to operate. This enables precise and error-free operation of the vehicle applications.

[0037] The above can be explained in other words, and with reference to a specific embodiment described as not limiting to the present disclosure, in the following example: The basic principle is the detection of a state in which the vehicle user is performing a continuous operating action. An example is the adjustment of the exterior mirrors, where the vehicle user repeatedly readjusts the mirror position, particularly for both exterior mirrors. Assuming that the vehicle user intends to perform only this operating action and not other operating actions simultaneously, operating elements that are physically located in the operating path and are prone to erroneous activation can be temporarily deactivated until the continuous operating action is completed.Similarly, nearby controls can be deactivated when adjusting the display height, vehicle seats, interior mirrors, or low beam headlights.

[0038] According to one aspect of the disclosure, a computer program and / or a computer-readable medium is provided. The computer program and / or the computer-readable medium includes instructions that, when executed by a data processing device, cause the device to perform the method according to the disclosure and / or steps thereof. Optionally, the computer program and / or the computer-readable medium includes instructions that, when executed by a data processing device, cause the device to perform the process steps described as advantageous or optional in order to achieve an associated technical effect.

[0039] According to one aspect of the disclosure, a data processing device for a motor vehicle is provided. The data processing device is configured to perform the method according to the disclosure. Optionally, the data processing device is configured to perform a process step described as advantageous or optional. 24-3068

[0040] 7

[0041] to carry out and / or to implement a process feature in order to achieve an associated technical effect.

[0042] According to one aspect of the revelation, a motor vehicle comprising the data processing device according to the revelation is provided.

[0043] The invention is described below in purely exemplary terms with reference to the figures.

[0044] Fig. 1 schematically shows a motor vehicle according to one aspect of the disclosure;

[0045] Fig. 2 schematically shows a flowchart of a process according to one aspect of the disclosure; and

[0046] Fig. 3 shows a schematic representation of a computer program and / or computer-readable medium according to one aspect of the disclosure.

[0047] In the figures, identical or corresponding elements are marked with the same reference symbols.

[0048] Figure 1 schematically shows a motor vehicle 50 according to one aspect of the disclosure. The vehicle user 1 is in the motor vehicle 50 and performs an operation 2 to operate an application 3 of the motor vehicle 50. The operation 2 comprises a first control element and an operating movement (not shown). A data processing device 51 performs a plausibility check and determines the plausibility 6 of the operation 2. If the operation 2 is plausible, an output signal 5 is issued to deactivate functions 4a, 4b, and 4c of the motor vehicle 50. The functions 4a, 4b, or 4c can be controlled by means of one or more second control elements (not shown) located in close proximity 7 to the operation 2.

[0049] Figure 2 schematically shows a flowchart of a method 100 according to one aspect of the disclosure. The method 100 according to Figure 2 is a method 100 for the trouble-free operation of applications 3 in a motor vehicle 50 by a motor vehicle user 1.

[0050] In step 105, an operation 2 of an application 3 of the motor vehicle 50 is detected. Optionally, a plausibility 6 of the operation 2 can be determined (see step 125) based on the controllability of the application 3 depending on the operation 2. The determination of plausibility 6 in step 125 is carried out in particular taking into account a location, a speed, a direction of travel and / or a route of the motor vehicle 50. In step 110, at least one of the functions 4a, 4b or 4c of the motor vehicle 50 is determined, whereby the 24-3068

[0051] 8

[0052] One or more second control elements for controlling functions 4a, 4b, or 4c are arranged within the motor vehicle 50 in close proximity 7 to the control 2. Step 110 may depend on the optionally determined plausibility 6. The function 4a, 4b, or 4c determined in step 110 may be unintentionally triggered during the execution of the control 2. To prevent this, an output signal 5 is output in step 115. In response to the output signal 5, function 4a, 4b, and / or 4c is deactivated (see step 120). The output 115 of the output signal 5 and the resulting deactivation 120 of the determined function 4a, 4b, and / or 4c may depend on the plausibility 6.

[0053] The person skilled in the art recognizes that the method 100 according to Figure 2 can also be carried out in a different sequence than the one shown. In particular, it is possible to exchange, shift, repeat and / or carry out steps of the method 100 simultaneously.

[0054] Figure 3 shows a schematic representation of a computer program and / or computer-readable medium 200 according to one aspect of the disclosure. The computer program and / or computer-readable medium 200 comprises instructions 201 which, when the program or instructions 201 are executed by a data processing device 51, cause the device to perform the method 100 and / or the steps of the method 100 according to Figure 2.

[0055] The commands 201 can be in the form of program code in any code or language, in particular code suitable for controlling and / or monitoring motor vehicles 50. The computer program and / or computer-readable medium 200 can be or include any digital data storage device, such as a USB flash drive, hard drive, CD-ROM, SD card, or SSD card. The computer program need not necessarily be stored on such a computer-readable storage medium, but can also be accessed via the Internet or otherwise. 24-3068

[0056] 9

[0057] Reference symbol (part of the description)

[0058] 1 motor vehicle user

[0059] 2 Operation

[0060] 3 Application

[0061] 4a Function

[0062] 4b Function

[0063] 4c function

[0064] 5 Output signal

[0065] 6. Plausibility

[0066] 7 spatial proximity

[0067] 50 motor vehicles

[0068] 51 Data processing device

[0069] 100 procedures

[0070] 105 Recognizing an initial operation

[0071] 110 Determine at least one function

[0072] 115 Outputting an output signal

[0073] 120 Deactivating the identified functions

[0074] 125 Determining plausibility

[0075] 200 computer program and / or computer-readable medium 201 commands

Claims

24-3068 10 Claims 1. Method (100) for the trouble-free operation of applications (3) in a motor vehicle (50) by a motor vehicle user (1), wherein the method comprises: - Recognition (105) of an operation (2) of an application (3) of the motor vehicle (50), wherein the operation (2) is performed by a motor vehicle user (1) and wherein the operation (2) comprises a first control element and an operating movement; - Determine (110) at least one function (4) of the motor vehicle (50), wherein the function (4) is controllable by means of one or more second control elements which are arranged within the motor vehicle (50) in close proximity (7) to the control (2); and -Output (115) of an output signal (5) to deactivate (120) the determined function (4).

2. Method (100) according to claim 1, wherein the operation (2) is detected by at least one sensor in the motor vehicle (50).

3. Method (100) according to claim 1 or 2, wherein a position, a direction of gaze, a head pose and / or a head movement of the motor vehicle user (1) and / or a position and / or a movement of a hand of the motor vehicle user (1) is detected.

4. Method (100) according to one of the preceding claims, wherein the operation (2) comprises repeated actuation of the first control element and / or at least temporary adjustment of the direction of view of the motor vehicle user (1).

5. Method (100) according to one of the preceding claims, wherein the spatial proximity is determined on the basis of a spatial distance of the operation (2) to a second operating element of the determined function (4).

6. Method (100) according to one of the preceding claims, wherein the operation (2) comprises several operating steps.

7. Method (100) according to any of the preceding claims, wherein the method (100) further comprises: 24-3068 11 - Determining (125) a plausibility (6) of the operation (2) on the basis of a controllability of the application (3) depending on the operation (2), wherein the output (115) of the output signal (5) is carried out depending on the plausibility (6); in particular where the determination (125) of plausibility (6) is carried out taking into account a location, speed, direction of travel and / or route of the motor vehicle (50).

8. Computer program and / or computer-readable medium (200), comprising instructions (201) which, when the program or instructions (201) are executed by a data processing device (51), cause the device to perform the method (100) and / or the steps of the method (100) according to any one of claims 1 to 7.

9. Data processing device (51) for a motor vehicle (50), wherein the data processing device (51) is configured to perform the method (100) according to any one of claims 1 to 7.

10. Motor vehicle (50) comprising the data processing device (51) according to claim 9.

Images