Motor vehicle having at least one user-operated functional unit and / or comfort unit, and operating device and method for operating a functional unit and / or comfort unit

Abstract

The invention relates to a motor vehicle (1) having at least one functional unit and / or comfort unit (32, 34) which can be operated by a user (N), and having an operating device (2) for operating said functional unit and / or comfort unit (32, 34), wherein the operating device (2) has a touch-sensitive display surface (22) which can be touch-operated by the user (N). According to the invention, the operating device (2) has a location-detecting device (24) which is suitable and intended for detecting at least one first contact region (B1), in which the user (N) touches the display surface (22), and at least one second contact region (B2), in which the user (N) touches the display surface (22); and a desired-location-determining device (26) which is suitable for determining a desired contact region (BW) for the user (N) on the basis of the first contact region (B1) and the second contact region (B2).

Description

[0001] Description

[0002] Motor vehicle with at least one user-operated functional and / or comfort unit, operating device and method for operating a functional and / or comfort unit

[0003] The present invention relates to a motor vehicle, and in particular a road vehicle, which has at least one and preferably a plurality of functional and / or comfort features that can be operated by a user, for example a driver and / or a vehicle occupant. An operating device is provided for operating the at least one functional and / or comfort feature.

[0004] It is a known technique to use touch-sensitive displays, also known as touchscreens. This has proven to be a very convenient solution for controlling these functional and / or comfort units. However, problems can arise if the user, for example due to illnesses such as Parkinson's disease or other conditions that are difficult or impossible for the user to compensate for during vehicle movement, is unable to operate these touchscreens precisely. These conditions can include relative movements between the user (e.g., the driver) and the control device, which may be caused by vehicle vibrations resulting from uneven road surfaces.

[0005] Therefore, people with Parkinson's disease or similar conditions (such as other illnesses, stress, nervousness, caffeine intolerance or allergy-like reactions with symptoms leading to shaky hands or imprecise hand movements) may experience difficulty using touchscreen interfaces in vehicles in a targeted manner within a short time due to shaky hands.

[0006] Similarly, individuals may encounter difficulties in quickly and accurately entering their desired input on a touch-sensitive display surface when exposed to external factors that lead to unwanted and (during a short input time) imprecise touches during their input attempt. These touches are often difficult or even impossible for the individual to control. For example, vibrations or other vehicle movements (e.g., caused by uneven road surfaces or automatically initiated driving maneuvers), as well as external influences and / or distractions from the environment, such as other vehicle occupants, could lead to unintended relative movements between the individual and the display surface, or imprecise touches of the display surface during the input attempt.

[0007] This condition can lead to unintentional decisions, frustration, and potential safety issues while driving. Existing touchscreen systems are insufficient to accommodate users with shaky hands. Therefore, a solution is needed that allows the aforementioned groups to safely operate such controls.

[0008] Solutions known from the state of the art to support people with trembling hands, especially in connection with touchscreen interfaces, are limited and mostly include general accessibility functions and no specific adaptations for the vehicle.

[0009] For example, adjustments to touchscreen sensitivity are known. On some devices, users can better adjust the touchscreen sensitivity. This compensates for unsteady hands. However, this does not completely solve the problem of multiple unintentional touches.

[0010] Simply adjusting the sensitivity does not completely solve the problem of multiple unintentional interferences. Multiple touches can lead to inaccurate selections. Furthermore, this approach requires users to find the optimal sensitivity setting, which can be cumbersome and may not entirely resolve the issue.

[0011] Furthermore, styluses and assistive devices are known to exist that have been developed for people with motor impairments and can contribute to improving their sense of touch. However, these devices require the user to hold and control an additional device, which may not be practical in a vehicle. Moreover, the handling of such assistive devices can still be difficult for users with severe limitations.

[0012] Voice control systems are also known. Voice control allows users to interact with the interface using spoken commands. This reduces the need for touch interactions. However, voice control systems are not always reliable and may not be suitable for all users or situations.

[0013] Reliability issues persist. Speech recognition systems can be unreliable, especially in noisy environments like a car (for example, due to background noise). Such systems will not always correctly understand the user's commands. Furthermore, privacy concerns may arise.

[0014] Larger touch surfaces are also known. Some user interfaces are equipped with larger touch surfaces to make operation easier for users with limited motor skills. One difficulty here is the impairment of function selection. This approach improves accessibility but does not eliminate the problem of multiple touches and / or unintentional touches.

[0015] Furthermore, limitations arise in interface design. Enlarging the touch surfaces or individual icons may lead to less efficient use of screen space. This makes the user interface cluttered and navigation more difficult.

[0016] Furthermore, precision is limited. While larger targets can be helpful, they do not solve the fundamental problem of interpreting user input. It is not always possible to identify an intended touch point among multiple unstable touches. Overall, these solutions do not provide a comprehensive answer to the needs of people with Parkinson's disease or similar conditions when interacting with vehicle touchscreens.

[0017] US Patent 9,996,184 B1 discloses a touchscreen arrangement for people with limited mobility. This arrangement uses an assistive device, such as a stylus, to operate the touchscreen. The document also mentions a method that takes into account the angular component of the user's movement.

[0018] KR 20190091755 A discloses a device that captures an input pattern of a Parkinson's patient. This involves individual training to adapt to the behavior of a specific user.

[0019] An adaptive user interface is known from EP 3565284 A1. The present invention is therefore based on the objective of facilitating the (desired) operation of motor vehicles or devices in general by, for example, physically restricted persons.

[0020] This is achieved according to the invention by the subject matter of the independent claims. Advantageous embodiments and further developments are the subject matter of the dependent claims.

[0021] A motor vehicle according to the invention has at least one functional and / or comfort unit that can be operated by a user and an operating device for selecting and / or operating this functional unit, wherein this operating device has a touch-sensitive display surface (in particular a so-called touchscreen) which can be operated by the user in particular by touch.

[0022] According to the invention, the operating device includes a location detection device which is suitable and designed to detect at least one first touch area in which the user touches the display surface, as well as at least one second touch area in which the user touches the display surface. Preferably, the location detection device is suitable and designed to detect a plurality of touch areas in which the user touches the display surface.

[0023] Furthermore, the operating device includes a desired location determination device which is suitable (and intended) to determine a desired contact area of ​​the user based on the first and second contact areas. Preferably, the desired location determination device is suitable (and intended) to determine the desired contact area based on the plurality of contact areas.

[0024] Preferably, the operating device allows different operating modes, wherein preferably in one operating mode the desired location determination device is activated in order to determine the desired location or the desired touch area on the basis of the at least first touch area and the second touch area and preferably on the basis of the plurality of touch areas.

[0025] The functional unit can be various systems of the motor vehicle, such as an infotainment system and / or a lighting system and / or a navigation system and / or a climate control and / or heating system and / or a media playback system (e.g. music) and / or an information playback system (e.g. news and / or weather reports) and / or a communication system (to provide access to (mobile) messages transmitted to a vehicle occupant and / or to provide a telephone call) of the motor vehicle.

[0026] The functional unit is preferably suitable and intended to execute at least one (vehicle) function based on user input on the display surface, such as making a setting change and / or establishing a telecommunications connection, for example, to receive or start a telephone call. Preferably, the user input is determined based on the defined desired touch area.

[0027] The comfort unit is preferably suitable and intended to perform at least one comfort function to increase the driving comfort of an occupant, such as air conditioning and / or temperature control and / or ventilation. In particular, the comfort unit performs the comfort function taking into account user input on the display surface of the control device. Preferably, the user input is determined based on the defined desired touch area.

[0028] This invention proposes a novel system to support users with limitations, particularly those related to health, such as Parkinson's disease or similar conditions, when interacting with a vehicle. The invention is also applicable, for example, to patients with Tourette syndrome, other illnesses, or conditions (such as stress, nervousness, caffeine intolerance, or allergy-like reactions) who exhibit symptoms such as trembling hands.

[0029] In addition, the proposed method or operating device is also applicable if external circumstances or factors, such as vehicle movements (e.g., shaking and / or rattling movements of the vehicle, rapid steering and / or acceleration maneuvers of the vehicle) lead to imprecise or unintended user inputs and / or to comparatively uncontrolled and / or (relative) movements between the user (or their hand) and the display surface that cannot be influenced or are not sufficiently controlled.

[0030] The proposed procedure or operating device can also be used in cases of external influences on the user (e.g., by other vehicle occupants) and / or distractions of the user (e.g., by other vehicle occupants or the environment) during their input attempt. The operating mode with the desired location tracking device activated can be permanently enabled.

[0031] It is also conceivable that the operating mode with the desired location tracking device activated is activated automatically. To trigger the automatic activation, an input precision measurement device (as part of the vehicle and / or a user's terminal device and / or the operating unit) may be provided, which is suitable and intended to determine and / or record an input precision parameter characteristic of the precision of a user input.

[0032] The input precision determination device can, for example, determine the input precision based on sensor data acquired by a sensor device in the vehicle. This sensor device could be, for example, an interior camera or a sensor device that captures data on events in the vehicle interior, which detects the user's state of mind or captures sensor data that, for example, detects movement of the user and / or the user's hand and / or an input finger, or other symptoms characteristic of the user's state of mind, which in particular correlate with imprecise hand movements, and preferably determines the input precision based on this sensor data. The sensor data can be acquired during the user's input attempt.

[0033] Alternatively or additionally, the sensor data can also be acquired before the user attempts to input the desired location, and the input precision can be determined (for example, during the operation of another control element of the vehicle). This means that when the user attempts to input the desired location, the operating mode with the desired location tracking function is already activated on the display surface of the control unit (preferably during the first input attempt). This allows for targeted and rapid input from the user, according to their wishes, right from the first input attempt.

[0034] Alternatively or additionally, it is also conceivable that the input precision value is set and / or stored on a (mobile) device (such as a smartphone) of the user and / or within a user profile in a vehicle-internal memory device. For example, at the start of a journey, the input precision value can be queried and / or transmitted to the control unit, and activation of the control profile with the desired location determination function can depend on this input precision value. Preferably, the input precision determination device is (additionally or alternatively) suitable and designed to determine the input precision value based on touch areas detected by the location detection device of the control unit.When determining the input precision parameter, the user's dwell time at the touch area and / or the speed and / or acceleration and / or (strength) of a change in direction of a user's movement path on the display surface and / or the height of the user's contact pressure on the display surface can be taken into account (and compared with predefined user-specific and / or user-non-user-specific average values).

[0035] For example, a comparatively very short dwell time (within a predefined area) and / or a strong change of direction and high acceleration and / or a multiple change of touch areas within a predefined and / or predefinable (input) time period can indicate an imprecise and / or shaky and / or unintentional and / or not fully controlled / intended touch movement on the display surface by the user.

[0036] Additionally or alternatively, the input precision determination device can also be suitable and intended to take into account environmental data acquired by a vehicle's environmental sensing device and / or vehicle condition data acquired by a vehicle condition sensing device when determining the input precision parameter. Preferably, the environmental data and / or the vehicle condition data indicate a vehicle movement (such as vibration and / or shaking and / or strong acceleration and / or steering maneuvers) and / or are characteristic of it. For example, an external camera of the vehicle, acting as an environmental sensing device, could acquire environmental data that is characteristic of or indicates an unevenness of a road surface or roadbed and / or a road alignment and / or a traffic situation.

[0037] In addition, the input precision determination device can also be suitable and designed to take navigation data (such as road type like motorway) and / or driving data (such as the current speed of the vehicle) into account when determining the input precision value. For example, at (predicted and / or detected) comparatively high driving speeds (e.g., over 100 km / h), the input precision value can be determined in such a way that the activation of the operating mode with the desired location determination device activated is triggered based on this value. The operating device preferably has interfaces, in particular touchscreen interfaces. The operating device aims to mitigate the effects of trembling hands and increase the reliability of operation.

[0038] This can lead to unintended selections on the screen. The preferred (operating) mode described in this invention, hereinafter also referred to as Parkinson's mode, activates a support function that detects multiple imprecise touches and slight slips. It is proposed that within a short time, an average "touchpoint" (or the desired location mentioned above) is selected and / or determined from these user interactions, and the intended function is selected accordingly. This improves the user experience and enhances driving safety by allowing users to concentrate better on the road.

[0039] The desired location detection device is primarily responsible for monitoring and recording all touch inputs and light swiping on the touchscreen within short timeframes, typically a few milliseconds to a few seconds.

[0040] Preferably, the desired location detection device records the coordinates of each point of contact and / or each area of ​​contact.

[0041] Preferably, the location tracking device also records the duration of each contact with the display surface (e.g., the screen). It is conceivable that this is achieved by simply taking into account a predefined pressure or force applied by the user to the display surface.

[0042] From this data, the desired location that the user wanted to touch can be determined, as explained in more detail below. It is possible that different coordinates are weighted differently. Preferably, the coordinates are recorded with a time reference.

[0043] When determining the desired touch area or location, or the desired location coordinates, it is possible to weight the individual determined coordinates differently. For example, the coordinates determined first and last in time can be weighted less. This determination can also depend on the user's medical condition and / or the user's state of mind (stress, nervousness, allergy-like symptoms, (food) intolerances) and / or the type of external influencing factor that causes or could cause imprecise or insufficiently precise user input. In a preferred embodiment, the desired touch area is characteristic of an operating area of ​​the display surface that the user intends to touch (during user input to operate the functional and / or comfort unit).

[0044] In a further preferred embodiment, the desired touch area is the area that the user intended to touch. The desired location detection device thus preferably determines the location the user intended to touch by detecting the areas touched by the user.

[0045] The touch areas can consist of one or more touch points. They can also refer to specific touch surfaces, particularly when the user swipes across certain (display) areas of the touchscreen. It's also conceivable that larger areas could be detected, for example, if the user accidentally touches the display surface with multiple fingers.

[0046] Preferably, the multitude of touch areas are non-contiguous areas of the display surface. In particular, the touch areas of the multitude of touch areas (in pairs) are non-overlapping with each other.

[0047] Preferably, each touch area (or multiple touch areas) is an area of ​​the display surface that is continuously touched by the user. A touch area therefore differs from a subsequent touch area in that the user has not touched the display surface in the interim, or has not touched it with sufficient pressure (e.g., with less than a specified and / or predefinable contact pressure).

[0048] It is also conceivable that at least some of the touch areas of the multitude of touch areas overlap, at least partially (or even completely). For example, the user might first touch a first (touch) area of ​​the display surface, which is located to the right of a target control element that the user intends to operate (and is directly adjacent to it), then touch a second (touch) area of ​​the display surface, which is located to the left of the target control element (and is directly adjacent to it), and finally touch (essentially) the same (touch) area of ​​the display surface again, this time to the right of the target control element. In another preferred embodiment, several touchable or touch-operated control elements are arranged on the touch-sensitive display surface.Preferably, the desired location determination device selects (at least) one (and preferably exactly one) control element from the multiple control elements based on the determined desired contact area.

[0049] The desired touch area can be an area of ​​the display surface that corresponds (essentially exactly) to the area of ​​a control element displayed / arranged on the display surface. It is also conceivable that the desired touch area is determined depending on the arrangement of at least one or more control elements displayed / arranged on the display surface. Preferably, however, the desired touch area is determined independently of the position of at least one or more control elements displayed / arranged on the display surface. This offers the advantage that the probability can subsequently be determined with respect to several control elements (preferred and adjacent to the determined desired touch area).

[0050] Preferably, the processor and / or the location tracking device determines or selects the control element that the user (with a high probability) intended to touch. For example, different icons or (e.g., graphic or textual) elements may be arranged and / or displayed on the display or user interface.

[0051] In another preferred embodiment, the desired touch area is determined based on the plurality of touch areas without the requirement that at least one detected touch area from the plurality of touch areas overlaps with the desired touch area. In other words, an area of ​​the display surface can be determined as the desired touch area that was not touched at all by the user (during their input attempt) (and / or was only touched at an outer edge). For example, the plurality of touch areas considered in determining the desired touch area can be arranged around the determined desired touch area.

[0052] For example, the determined desired touch area cannot overlap with either the first or the second touch area.

[0053] Preferably, the desired contact area is determined such that it occupies a central and / or mid-position with respect to the multitude of contact areas considered in determining the desired contact area. For example, the desired contact area can be determined such that it forms or includes / encompasses / covers a (geometric) center of gravity of the multitude of contact areas considered in determining the desired contact area.

[0054] In a further preferred embodiment, the determination of the desired touch area takes into account a geometric shape and / or an area size of at least one touch area and / or at least one touch path detected on the display surface by the position detection device, which leads to a touch area of ​​the plurality of touch areas. Preferably, a temporal sequence of the user's touches is considered. A touch path leading to a touch area of ​​the plurality of touch areas is understood to mean, in particular, the temporal sequence of the touches that comprise the touch area. Regarding the geometric shape, a distinction can be made, for example, between circular or circular-like (e.g., oval) touch areas and elongated touch strips.It is also conceivable that the touch pattern from the different geometric shapes (such as the ratio of the circular and / or oval touch areas from the entire multitude of touch areas considered) and / or orientations of the touch strips to each other and / or (spatial) distribution of the touch areas is taken into account when determining the desired touch area.

[0055] For example, the main extension directions of the touch strips could be used to infer the location of the desired touch point or the (target) control element intended for actuation.

[0056] The desired location detection device can preferentially determine the average location of all user touches on the display surface. Furthermore, the desired location detection device can select the element that is closest to this average location.

[0057] In addition, the desired location determination device can preferably also select the (operating) element that the user most likely wanted to select by weighting individual actual contact points or contact areas.

[0058] The desired location determination device can calculate a probability characteristic of an intended actuation of each control element based on the multitude of touch areas (and / or the touch paths assigned to the respective touch areas) considered when determining the desired touch area. Preferably, the control element with the highest probability is selected as the (user-intended or target) control element. It is also conceivable that the desired location determination device uses a machine learning touch model to determine the desired touch area, preferably trained using a training dataset in which the training data comprises several user input attempts, including the multitude of touch areas generated by the user (and the respective intended desired touch area).Preferably, the user(s) who generate the training data are users who exhibit the above-mentioned symptoms, which lead to imprecise (shaky) user input, and / or who are exposed to (for example, the above-described) external influencing factors, which lead or may lead to imprecise and / or uncontrolled user input that cannot be sufficiently executed (in a targeted manner) by the user.

[0059] It is also conceivable that the touch model can be (re)trained using machine learning (especially for user-specific fine-tuning) via the user's touch areas recorded by the location tracking device, as well as information about the user's intended input. This could also include data for correcting erroneous or unintentional user input.

[0060] It is also conceivable that the desired location determination system takes into account a history of previous uses of the control unit. For example, if the user has selected the navigation system significantly more often in the past, this can also be considered, such as if a determined desired contact point lies between the location of the navigation system element and an adjacent element.

[0061] In a further advantageous embodiment, the desired location determination device includes an averaging device which calculates an average value (for determining the desired contact area) based on a plurality or multitude of detected contact areas. This average value is then preferably used to determine the location that the user most likely intended to select. Preferably, at least three contact areas, more preferably at least four, and more preferably at least five contact areas are detected.

[0062] In another preferred embodiment, certain contact areas are disregarded when determining the desired contact area, such as areas that are not within a predefined radius around a specific mean value range or that are significantly farther from other contact areas. In this way, for example, unintentional user contact can be excluded and not used to evaluate the desired area. If, for instance, the user accidentally touches areas far from the desired area when their hand approaches the display, this can be ignored during the averaging process and thus does not distort the calculation.

[0063] Preferably, an averaging algorithm processes the data (especially location data) collected by the recognition module or the location detection device. Preferably, the averaging algorithm calculates an average contact point, taking into account several, and preferably all, recorded points. As mentioned above, individual points can be disregarded or the points can be weighted differently.

[0064] Preferably, touch inputs and / or touch areas within a predefined timeframe are taken into account. This preferably includes averaging the x and y coordinates of the touches, in particular to determine a center point. This center point preferably represents the selection intended by the user.

[0065] It is possible to fine-tune the algorithm to adjust the sensitivity and time frame. This tuning can be based on user preferences, the severity of the shaking (or even depending on a medical condition).

[0066] The main preferred process engineering differences between the present invention and previously known solutions are as follows:

[0067] A preferred algorithm is an averaging algorithm for touch inputs.

[0068] Unlike existing solutions, the "Parkinson mode" described here uses a specific algorithm to average multiple imprecise touches and / or minor slips (preferably within a short or predetermined time). This approach calculates a central touch point and / or a central touch area (referred to above as the desired location).

[0069] This central touchpoint represents the user's intended selection. This is a novel method not found in current systems.

[0070] By calculating an average touch point, the system significantly increases precision and reliability. Reliable touch interactions can be achieved for users with shaky hands, thereby reducing unintentional selections. Furthermore, a detection module, particularly in the form of the aforementioned location detection device, is preferably provided.

[0071] This location tracking device is used for the targeted monitoring and recording of touch inputs and areas (especially those caused by sliding), particularly within a predefined short timeframe. This is ideally suited to the unique interaction patterns of individuals.

[0072] This is specifically tailored to Parkinson's disease, which distinguishes the present invention from general adjustments of touch sensitivity available in existing systems.

[0073] The device and / or the operating unit preferably processes touch data in real time, thus ensuring that the interface reacts immediately and preferably precisely according to the intended actions of the user.

[0074] Preferably, the motor vehicle and / or the operating device includes an interface adaptation module. This interface adaptation module is preferably designed as an adaptive interface. The interface adaptation module preferably adapts the vehicle's touchscreen interface based on the calculated data.

[0075] For example, an average touch point can be determined. This adaptive function ensures that the user selects the function intended by the user, thus guaranteeing user-friendly operation and an error-free experience.

[0076] Customization options are also preferably provided. The interface customization module ideally allows for adjustments to sensitivity and detection intervals based on individual user needs. This is a specific extension not typically available in existing solutions.

[0077] A holistic solution is still being proposed, in contrast to other solutions that only address part of the problem (e.g., voice control, larger touch).

[0078] In this way, the "Parkinson's mode" offers a comprehensive solution for detection and processing, and integrates adjustments for trembling hands, for example. The system and its operating unit function seamlessly within the vehicle's existing touchscreen interface, if required.

[0079] Users will only need to make minor adjustments, resulting in an intuitive and trouble-free experience.

[0080] The invention proposes a novel detection and averaging mechanism. Multiple touches are detected, and an average touch point is determined from these. The device can then adapt in real time based on this determined average touch point.

[0081] By determining an average or mean touch point from a large number of inaccurate touches, the system can make more accurate selections, thereby reducing the number of unintended commands.

[0082] Dynamic adjustment is enabled; in this operating mode, the touchscreen makes the interfaces more accessible and user-friendly for users with shaky hands, thus also reducing frustration.

[0083] In addition, user distractions are reduced. By ensuring accurate user input, the control system allows users to concentrate more on driving and less on correcting incorrect inputs, thus creating safer driving conditions.

[0084] Ideally, the settings are customizable. Users can adjust sensitivities and touch detection time periods to suit their individual needs. In particular, adjustments can be made for individual degrees of hand tremor.

[0085] The invention can be seamlessly integrated into existing systems and / or vehicles, and in particular into existing touchscreens, requiring only minor modifications, resulting in an easily implementable solution for manufacturers.

[0086] No additional equipment is required. Furthermore, no additional handling devices such as styluses or similar items are necessary. Moreover, user confidence in operating touchscreens can be increased.

[0087] It should be noted that the operating device described here can be used not only for motor vehicles, but also for other devices such as machines, household appliances, terminal devices, computers, smartphones, tablets, devices which can perform at least one function based on user input, or public input terminals (such as payment machines).

[0088] The solution described here reduces the intellectual and physical demands on the user who wants to operate a touchscreen, which allows for better concentration on road traffic, especially in motor vehicles.

[0089] In this way, the “Parkinson mode” can offer an advanced, user-friendly and safety-enhancing solution for users with shaky hands, especially with regard to touchscreens in a motor vehicle.

[0090] In a further advantageous embodiment, the desired location determination device is suitable and intended to detect, within a specified period of time, the touches of the display surface (detected by the location detection device) and the areas of contact and / or locations and / or areas of location of these touches.

[0091] Preferably, this period can be predefined, for example depending on a medical condition of the user and / or on a type of state of mind of the user (stress; nervousness; allergy-like symptoms, (food) intolerances) and / or type of external influencing factor (external intervention, distraction; vehicle movement) which causes and / or can cause imprecise or insufficiently precise user input.

[0092] Preferably, this period (or the duration of the period) is greater than 50 ms, preferably greater than 100 ms, and particularly preferably greater than 200 ms. Preferably, this period is less than 10 s, preferably less than 5 s, preferably less than 3 s, and preferably less than 1 s.

[0093] The specified time period can preferably remain constant.

[0094] It is also conceivable that the (predefined) time period is variable. For example, the (predefined) time period could depend on the timing of the user's touches on the display surface. Preferably, the time period is determined based on a touch-free period during which the display surface is not touched by the user. For instance, the time period could start running as soon as the user touches the display surface for the first time after a predefined touch-free period. When determining the length of the time period, the next touch-free interval that is greater than a predefined duration is preferably used. Additionally or alternatively, a maximum length / duration of the time period can be specified.

[0095] In this way, for example, a maximum time duration can be specified for a user's input attempt.

[0096] It is also conceivable that the specified time period is chosen depending on the spatial arrangement of the touch areas detected within that period. For example, if a subsequent touch by the user is too far away from the previous touch areas, this could be interpreted as an indication that the user wishes to make another / different input.

[0097] Preferably, the desired location determination device and / or the location detection device determines, based on the specified time period, which contact areas (detected by the location detection device) are to be considered when determining the desired contact area (as carried out or to be carried out by the desired location determination device). Preferably, the desired location determination device only considers the multitude of contact areas (detected by the location detection device) that lie within the specified time period.

[0098] In another preferred embodiment, the desired location tracking device is suitable and intended to detect and / or evaluate the user's touches on the display surface in real time. In this way, user input commands can be executed immediately.

[0099] In a further advantageous embodiment, the location detection device and / or the desired location determination device can be activated and / or deactivated (via the operating device and / or the location detection device). It is also conceivable that the location detection device and / or the desired location determination device and / or the operating mode with the desired location determination device activated can be activated and / or deactivated by means of a user input at the operating device.

[0100] In a further advantageous embodiment, the operating device and / or the location detection device and / or the desired location determination device is configurable.

[0101] This allows, in particular, the sensitivity of the display surface, the response time, and the period for registering touches to be adjusted and / or configured. Ideally, such configuration can also be automated and, in particular, take into account user input.

[0102] In another advantageous embodiment, the operating device has a comparison device which compares a determined desired location of contact with an actual location of contact.

[0103] Preferably, the presumed or desired touch location is determined and compared with the actual location of the desired control element on the display. This allows systematic deviations to be taken into account, for example, if the user always touches the display slightly to the right of the actually desired element.

[0104] Preferably, the comparison device is suitable and designed to output a comparison value that is characteristic of this comparison between the determined desired touch location and the actual location of the control element to be operated.

[0105] This comparative value can also be taken into account in the future to determine the desired location.

[0106] A (motor) vehicle can be a motor vehicle, which is, in particular, a driver-operated vehicle ("driver only"), a semi-autonomous vehicle, an autonomous vehicle (for example, at autonomy levels 3, 4, or 5 (according to the SAE J3016 standard)), or a self-driving vehicle. Autonomy level 5 refers to fully automated vehicles. The vehicle can also be a driverless transport system. The (motor) vehicle can be driven by a driver or drive autonomously. Furthermore, in addition to a road vehicle, the (motor) vehicle can also be an air taxi, an aircraft, or another means of transport or vehicle type, such as an aircraft, watercraft, or rail vehicle.

[0107] The present invention further relates to an operating device for operating a functional unit and / or comfort unit, in particular a motor vehicle and / or a machine and / or a device comprising the functional unit and / or comfort unit to be operated (which is suitable and intended to perform a function depending on at least one user input), wherein this operating device has a touch-sensitive display surface which can be operated by the user by touch.According to the invention, the operating device has a location detection device which is suitable and intended to detect at least one first touch area in which the user touches the display surface, as well as at least one second touch area in which the user touches the display surface, and preferably a plurality of touch areas in which the user touches the display surface (within a predetermined period of time).

[0108] Furthermore, the operating device has a desired location determination device which is suitable and intended to determine a desired contact area and / or desired contact location of the user (at which the user wanted to touch the operating surface) on the basis of the first contact area and the second contact area (and preferably on the basis of the plurality of contact areas).

[0109] Preferably, the operating device is designed in one of the ways described above (individually or in combination with each other of the preferred embodiments).

[0110] The device comprising the operating functional unit and / or comfort unit (which is suitable and intended to perform a function depending on at least one user input) can (as already mentioned above) be devices such as machines, household appliances, (mobile or stationary) terminal devices, computers, smartphones, tablets, or public input terminals (such as payment machines).

[0111] The present invention further relates to a method for operating user-operated functional and / or comfort units, in particular of a motor vehicle, by means of an operating device for operating these functional and / or comfort units. This operating device has a touch-sensitive display surface which is operated by the user by touch.

[0112] According to the invention, the operating device includes a location detection device which detects at least one first touch area in which the user touches the display surface, and at least one second touch area in which the user touches the display surface. A desired location determination device determines a desired touch area of ​​the user based on the first and second touch areas. It is therefore also proposed that at least two, and preferably a plurality, of touch points or touch areas in which the user touches the operating surface are detected, and from this the location that the user (presumably) intended to touch is inferred.

[0113] In a preferred method, the desired location determination device determines the user's desired contact area by averaging the values ​​of at least the first contact area and the second contact area.

[0114] Ideally, the desired location determination feature adapts to the user, for example, if it is detected that a user systematically reaches for a destination outside of it. This can be achieved, for instance, through the comparison feature mentioned above.

[0115] In a further preferred embodiment, the motor vehicle has an adjustment and / or setting device. This adjustment device is suitable and designed to adapt the operating device of the motor vehicle and, in particular, the touch-sensitive display surface of the operating device, especially to accommodate the average touch point.

[0116] Once the desired location determination system has identified the desired touch point, the adaptation and / or setting system will select the function that corresponds to this point or location of the input device. For example, if the determined desired location corresponds to the icon that starts a navigation system, then the navigation system will be started.

[0117] This customization feature advantageously ensures that the selected function matches the function intended by the user. In this way, the risk of incorrect selections is reduced.

[0118] Preferably, the mode referred to here as "Parkinson's mode" can be selected manually by the user via a specific button or via a control on the touchscreen. Alternatively, it would be possible for this mode to be selected automatically via a preset.

[0119] Once this "Parkinson's mode" is activated, the detection device preferably continuously monitors touch inputs and even slight sliding movements on the input surface or touchscreen. It preferably records both the coordinates of the respective touch points and the time of the touch within a specific time frame.

[0120] The recorded contact points and / or contact times are fed into the averaging algorithm, which calculates an average contact point.

[0121] Preferably, the density and distribution of the individual contacts are taken into account. Preferably, a suitable weighting is also applied to determine the most probable contact point.

[0122] The adaptation device detects the most likely touch point and assigns it the corresponding function on the touchscreen. The intended function is then preferentially executed, ensuring that the user selects the function they want.

[0123] For example, a user tries to select a playlist on the vehicle's touchscreen. Due to shaky hands, they perform a multitude of quick and light touches around the desired touch point.

[0124] The desired location tracking device records all these contacts within a short period of time, recording the coordinates of the respective contacts.

[0125] The averaging algorithm processes these coordinates and determines an averaged point of tangency that is close to the center of the multitude of averaged coordinates.

[0126] The adaptation system assigns this averaged point or location to the location of the playlist and selects it. As a result, the playlist is successfully selected, thus increasing the user's or driver's success rate in making selections and allowing them to concentrate on driving.

[0127] By accurately interpreting the user's intended actions, Parkinson Mode significantly reduces user frustration caused by unintentionally selecting functions or units. This allows the user to focus more on driving instead of struggling with the touchscreen, thus increasing safety. As mentioned above, the system allows for adjustments in sensitivity and detection duration, enabling customization for individual users. The Parkinson Mode described here can be integrated into existing vehicle touchscreen systems with only minor modifications, making it a versatile solution.While with conventional touchscreens, touching the surface usually results in the immediate triggering of a specific function, here, in an intermediate step, a large number of touches are used to first determine which function should be triggered by the user, and this is ultimately selected.

[0128] In another preferred embodiment, the Parkinson mode described here is supported by additional features. For example, voice recognition can be used. This allows users to activate or deactivate the Parkinson mode, for instance.

[0129] Machine learning can also be used. For example, machine learning algorithms can be employed to automatically adjust the system's sensitivity to the user's touch patterns.

[0130] In another preferred embodiment, the device includes a feedback mechanism. This can, for example, provide haptically perceptible and / or audible (and / or visual) feedback to confirm a successful selection. In this way, the user can be assured of a corresponding input.

[0131] The present invention further relates to a computer program or computer program product, comprising program means, in particular a program code, which represents or encodes at least some and preferably all of the process steps of the method according to the invention and / or (in particular or exclusively) those computer-implemented process steps of the method according to the invention which are executed by the (above-described) location detection device and / or the (above-described) desired location determination device) and preferably one of the described preferred embodiments and is designed for execution by a processor device.

[0132] The present invention further relates to a data storage device on which at least one embodiment of the computer program according to the invention or a preferred embodiment of the computer program is stored. Further advantages and embodiments will become apparent from the accompanying drawings:

[0133] It shows:

[0134] Fig. 1 shows an operating device according to the invention;

[0135] Fig. 2 shows the operating principle of the device according to the invention; and

[0136] Fig. 3 shows a representation for determining a user requirement.

[0137] Fig. 1 shows a representation of a motor vehicle 1 according to the invention. This vehicle has a control unit 2 for operating various functional units (and / or comfort units, such as a heating system and / or an air conditioning system) of the motor vehicle, such as a sound system or a navigation system. This control unit 2 has a touch-sensitive display surface 22. The user can touch this surface and select a specific function (of the functional unit and / or comfort unit) by touching it.

[0138] Reference numbers 42, 44, 46 and 48 refer to display elements or...

[0139] Control elements, which are depicted here on the display surface 22 and which can be selected by touch, as is known in the prior art. The reference symbol N denotes the (trembling) hand of a user attempting to select a specific control element 42, 44, 46, 48. The multiple dashed outlines of the hand illustrate previous positions of the hand during the user's attempt to select a specific control element 42, 44, 46, 48. The multiple dashed outlines, or the multiple positions of the hand, which may also touch at least one or more touch areas B1 of the display surface 22, may be caused, for example, by a trembling movement of the hand.

[0140] Fig. 2 shows a schematic representation illustrating the invention. Here again, the touch-sensitive display surface 22 is depicted. The user attempts, for example, to select a control element 48 or display element 48. However, due to hand tremors, different actual touch areas B1, B2, B3, B4, and B5 are reached. It can be seen that the user, for example due to illness, is unable to select the correct control element 48 or display element 48. In the prior art, this would lead to incorrect operation, as, for example, adjacent control elements would be selected.

[0141] Reference numeral 24 designates a (schematically represented) location detection device that detects the (contact) point or the contact area B1 to B5. In a preferred embodiment of the invention, it is proposed that all contact areas B1 - B5 that occur within a specific time frame are detected.

[0142] The desired location determination device 26 determines the user's probable desired touch area BW from the respective areas B1 - B5. A corresponding function, for example the function linked to the control element 48 or display element 48, is then stored according to this desired touch area BW.

[0143] For this purpose, a mean-value formation device 28 is preferably provided, which here, for example, determines the location coordinates of the individual areas B1 to B5 and thus determines the desired touch area BW.

[0144] Reference symbol 30 shows a (schematically represented) comparison device that compares the desired location with the actual location of the control element 48. In this way, for example, a systematic deviation can be detected, which may occur, for example, due to certain medical conditions or as a result of visual impairment.

[0145] As a result of the operation or touch performed, i.e., as a result of the desired operating element determined by the location detection device, corresponding functional units 32 and 34 can be selected or set.

[0146] Figure 3 illustrates this procedure. It shows that, based on the determined touch areas B1 to B5, the actually intended touch point BP is determined, and based on this, the user's (selection or operating) wish is determined.

[0147] While in the prior art a specific function is triggered directly as a result of touching a specific point, the invention proposes that not the (operating) element that was (apparently) touched is triggered directly, but rather the (operating) element that is calculated and that reflects the user's wish.

[0148] It is noted that all features described with reference to the method are also disclosed for the apparatus, which in particular means that the apparatus has features suitable and intended for carrying out the respective methods. Furthermore, features described with reference to the apparatus are also applicable to the method(s). This means that the methods are carried out using the corresponding apparatus features.

[0149] It is pointed out that all features disclosed in the application documents are disclosed as essential to the invention and are claimable, in particular insofar as they individually or in combination contribute to the advancement of the art. It is further pointed out that the individual figures also describe features which may be advantageous on their own. The person skilled in the art will immediately recognize that a particular feature described in a figure may be advantageous even without incorporating further features from that figure. Furthermore, the person skilled in the art will recognize that advantages may also arise from a combination of several features shown in individual or different figures. List of reference numerals

[0150] 1 motor vehicle

[0151] Operating device

[0152] 22 Display surface of the control unit

[0153] 24 Location registration device

[0154] 26 Desired location determination device

[0155] 28 Averaging device

[0156] 30 Comparative Institution

[0157] 32, 34 Functional units of the motor vehicle

[0158] 42-48 Controls

[0159] B1 - B5 Touch areas

[0160] BP averaged point of contact

[0161] BW intended point of contact, desired point of contact

Claims

- 27 - Patent claims 1. Motor vehicle (1) with at least one functional and / or comfort unit (32, 34) operable by a user (N) and with an operating device (2) for operating this functional and / or comfort unit (32, 34), wherein this operating device (2) has a touch-sensitive display surface (22) which can be operated by the user (N) by touch, characterized by the fact that The operating device (2) comprises a location detection device (24) which is suitable and intended to detect at least one first touch area (B1) in which the user (N) touches the display surface (22), as well as at least one second touch area (B2) in which the user (N) touches the display surface (22), and preferably a plurality of touch areas (B1, ..., Bn) in which the user (N) touches the display surface (22), and a desired location determination device (26) which is suitable to determine a desired touch area (BW) of the user (N) on the basis of the first touch area (B1) and the second touch area (B2), and preferably on the basis of the plurality of touch areas (B1, ..., Bn).

2. Motor vehicle (1) according to claim 1, characterized by the fact that The desired touch area (BW) is characteristic of an operating area of ​​the display surface (22) intended by the user to be touched.

3. Motor vehicle (1) according to at least one of the preceding claims, characterized in that Several touch-operable control elements (42, 44, 46, 48) are arranged on the touch-sensitive display surface, and the desired location determination device selects a control element (48) from the several control elements (42, 44, 46, 48) based on the determined desired touch area (BW).

4. Motor vehicle (1) according to at least one of the preceding claims, characterized in that The desired touch area (BW) is determined based on the multitude of touch areas (B1, ..., Bn) without the requirement that at least one detected touch area (B1 , B3) of the multitude of touch areas (B1, ...,Bn) overlaps with the desired touch area (BW).

5. Motor vehicle (1) according to at least one of the preceding claims, characterized in that When determining the desired touch area (BW), a geometric shape and / or an area size of at least one touch area (B1,..,Bn) and / or at least one touch path detected on the display surface by the location detection device (24), which leads to a touch area of ​​the plurality of The contact areas (B1,...,Bn) are taken into account.

6. Motor vehicle (1) according to at least one of the preceding claims, characterized in that the desired location determination device (26) has an averaging device (28) which forms an average on the basis of a large number of recorded contact areas (B1, B2).

7. Motor vehicle (1) according to at least one of the preceding claims, characterized in that the desired location determination device (26) is suitable and intended to detect, within a specified period of time, the touches of the display surface (22) and the areas of contact and / or locations and / or areas of location of these touches.

8. Motor vehicle (1) according to at least one of the preceding claims, characterized in that The desired location tracking device (26) is suitable and intended to detect and / or evaluate the user's touches of the display surface (22) in real time.

9. Motor vehicle (1) according to at least one of the preceding claims, characterized in that The location detection device (24) and / or the desired location determination device (26) can be activated, deactivated and / or configured.

10. Motor vehicle (1) according to at least one of the preceding claims, characterized in that the operating device (2) includes a comparison device (30) which compares a determined desired location of contact with an actual location of contact.

11. Operating device (2) for operating a functional and / or comfort unit (32, 34), in particular a motor vehicle (1) and / or a machine and / or a device comprising the functional and / or comfort unit (32, 34), wherein this operating device (2) has a touch-sensitive display surface (22) which can be operated by a user by touch, characterized by the fact that the operating device (2) comprises a location detection device (24) which is suitable and intended to detect at least a first touch area (B1) in which the user touches the display surface (22), as well as at least a second touch area (B2) in which the user touches the display surface (22), and a desired location determination device (26) which is suitable to determine a desired touch area (BW) of the user on the basis of the first touch area (B1) and the second touch area (B2).

12. Method for operating a user-operated functional and / or comfort unit (32, 34), in particular of a motor vehicle (1), by means of an operating device (2) for operating this functional and / or comfort unit (32, 34), wherein this operating device (2) has a touch-sensitive display surface (22) which is operated by the user by touch, characterized by the fact that the operating device (2) has a location detection device (24) which detects at least a first touch area (B1) in which the user touches the display surface (22) and at least a second touch area (B2) in which the user touches the display surface (22), wherein a desired location determination device (26) determines a desired touch area (BW) of the user on the basis of the first touch area (B1) and the second touch area (B2).

13. Procedure according to the preceding claim, characterized by the fact that The desired location determination device (26) determines the desired contact area (BW) of the user by averaging the results of at least the first contact area (B1) and the second contact area (B2).

Images