A method for providing a position information of a finger of a driver of a motor vehicle relative to a touch display, a computer program product, a non-tran

Abstract

The invention relates to a method for providing a position information (14) of a finger (16) of a driver (18) of a motor vehicle (10) relative to a touch display (20) of the motor vehicle by a support system (12) of the motor vehicle, comprising the steps of: capturing a relative position (26) of the finger relative to the touch display by a capturing device (22) of the support system; determining a contact position (28) at the touch display depending on the captured relative position by an electronic computing device (24) of the support system; mirroring a displayed information (30) of the touch display on a display device (32), which is assigned to the driver; and displaying the contact position as the position information on the display device. Furthermore, the invention relates to a computer program product, a non-transitory computer-readable storage medium, as well as to a support system.

Description

[0001] The present invention relates to the field of automobiles. More specifically, the present invention relates to a method for providing a position information of a finger of a driver of a motor vehicle relative to a touch display of the motor vehicle by a support system according to the pending claim 1. Furthermore, the present invention relates to a corresponding computer program product, a corresponding non-transitory computer-readable storage medium, as well as a corresponding support system. BACKGROUND INFORMATION

[0002] An unmistakable trend in automotive design is the proliferation of touch screens in automotive interiors. Touch screens are increasingly replacing physical interfaces, for example buttons, switches, and levers, to control vehicle functions. Auto makers are likely embracing this trend for several reasons. One reason is that customers increasingly demand that vehicles provide a digital infotainment experience for example in phones and tablets. Furthermore, unlike physical interfaces, touch screen user interfaces can adapt based on context. Lastly, unlike physical interfaces, the touch screen can adapt over time via over-the-air updates, enabling the infotainment unit to meet the customers need's for years after the vehicle was manufactured.

[0003] Despite these advantages, touch screens are unable to match an important attribute of physical interfaces, in particular the tactile feedback. For example, users can get tactile feedback from buttons by feeling their gaps, shapes, indentations, and protrusions. Thus, users can precisely control their interactions with little to no visual feedback. This allows drivers to control the vehicle’s functions while keeping their field-of-view safely focused on the road.

[0004] Conversely, touch screens are often flat homogeneous surfaces that offer no tactual feedback. This is a safety hazard while driving. The drivers are forced to divert their focus away from their road and towards their fingers position relative to the touch screen. SUMMARY OF THE INVENTION

[0005] It is an object of the invention to provide a method, a corresponding computer program product, a corresponding non-transitory computer-readable storage medium, as well as a corresponding support system, by which a precise operation of a touch display can be performed, and in parallel the driver is not distracted from a driving operation of the motor vehicle.

[0006] This object is solved by a method, a corresponding computer program product, a corresponding non-transitory computer-readable storage medium, as well as a corresponding support system according to the independent claims. Advantageous embodiments are presented in the dependent claims.

[0007] One aspect of the invention relates to a method for providing a position information of a finger of a driver of a motor vehicle relative to a touch display of the motor vehicle by a support system of the motor vehicle. A relative position of the finger relative to the touch display is captured by a capturing device of the support system. A contact position at the touch display is determined depending on the captured relative position by an electronic computing device of the support system. A displayed information of the touch display is mirrored on a display device, which is assigned to the driver. The contact position as the position information is displayed on the display device.

[0008] Therefore, the invention solves the problem of the driver’s diversion in their field-of-view away from the road ahead so that they can reliably interact with their vehicles infotainment touch screen / touch display. It aims to improve the driver’s visual feedback so that the absence of tactile feedback is less apparent.

[0009] To do so, it replicates a view of the driver’s finger and it’s positioned relative to the touch displays user’s interface within the driver’s forward-looking field-of-view. Specifically, it replicates these visual cues on the driver’s display, for example an instrument cluster, and / or the head-up-display.

[0010] According to an embodiment the display device is provided as a head-up-display of the motor vehicle for the driver.

[0011] In another embodiment the display device is provided as an instrument cluster of the motor vehicle for the driver.

[0012] In another embodiment a proximity of the finger is taken into consideration for determining the contact position.

[0013] In another embodiment the mirrored display information is zoomed in depending on the relative positon and / or the contact position.

[0014] In another embodiment a zooming factor is adapted depending on a distance of the finger relative to the touch display.

[0015] In particular, the method is a computer-implemented method. Therefore, another aspect of the invention relates to a computer program product comprising program code means for performing a method according to the preceding aspect.

[0016] Another aspect of the invention relates to a non-transitory computer-readable storage medium comprising at least a computer program product according to the preceding aspect.

[0017] A still further aspect of the invention relates to a support system for providing a position information of a finger of a driver of a motor vehicle relative to a touch display of the motor vehicle, comprising at least one capturing device and one electronic computing device, wherein the support system is configured for performing a method according to the preceding aspect. In particular, the method is performed by the support system.

[0018] A still further aspect of the invention relates to a motor vehicle comprising at least the support system according to the preceding aspect.

[0019] Advantageous embodiments of the method are to be regarded as advantageous embodiments of the computer program product, the non-transitory computer-readable storage medium, the support system as well as the motor vehicle. The support system as well as the motor vehicle therefore comprises means for performing the method.

[0020] A computing unit / electronic computing device may in particular be understood as a data processing device, which comprises processing circuitry. The computing unit can therefore in particular process data to perform computing operations. This may also include operations to perform indexed accesses to a data structure, for example a look-up table, LUT.

[0021] In particular, the computing unit may include one or more computers, one or more microcontrollers, and / or one or more integrated circuits, for example, one or more application-specific integrated circuits, ASIC, one or more field-programmable gate arrays, FPGA, and / or one or more systems on a chip, SoC. The computing unit may also include one or more processors, for example one or more microprocessors, one or more central processing units, CPU, one or more graphics processing units, GPU, and / or one or more signal processors, in particular one or more digital signal processors, DSP. The computing unit may also include a physical or a virtual cluster of computers or other of said units.

[0022] In various embodiments, the computing unit includes one or more hardware and / or software interfaces and / or one or more memory units.

[0023] A memory unit may be implemented as a volatile data memory, for example a dynamic random access memory, DRAM, or a static random access memory, SRAM, or as a non-volatile data memory, for example a read-only memory, ROM, a programmable read-only memory, PROM, an erasable programmable read-only memory, EPROM, an electrically erasable programmable read-only memory, EEPROM, a flash memory or flash EEPROM, a ferroelectric random access memory, FRAM, a magnetoresistive random access memory, MRAM, or a phase-change random access memory, PCRAM.

[0024] Further advantages, features, and details of the invention derive from the following description of preferred embodiments as well as from the drawings. The features and feature combinations previously mentioned in the description as well as the features and feature combinations mentioned in the following description of the figures and / or shown in the figures alone can be employed not only in the respectively indicated combination but also in any other combination or taken alone without leaving the scope of the invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] The novel features and characteristic of the disclosure are set forth in the appended claims. The accompanying drawings, which are incorporated in and constitute a part of this disclosure, illustrate exemplary embodiments and together with the description, serve to explain the disclosed principles. The same numbers are used throughout the figures to reference like features and components. Some embodiments of system and / or methods in accordance with embodiments of the present subject matter are now described below, by way of example only, and with reference to the accompanying figures.

[0026] The drawings show in:

[0027] Fig. 1 a schematic view according to an embodiment of a support system of an embodiment of a motor vehicle; and

[0028] Fig. 2 another schematic view according to an embodiment of a support system.

[0029] In the figures the same elements or elements having the same function are indicated by the same reference signs DETAILED DESCRIPTION

[0030] In the present document, the word "exemplary" is used herein to mean "serving as an example, instance, or illustration". Any embodiment or implementation of the present subject matter described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments.

[0031] While the disclosure is susceptible to various modifications and alternative forms, specific embodiments thereof have been shown by way of example in the drawing and will be described in detail below. It should be understood, however, that it is not intended to limit the disclosure to the particular forms disclosed, but on the contrary, the disclosure is to cover all modifications, equivalents, and alternatives falling within the scope of the disclosure.

[0032] The terms “comprises”, “comprising”, or any other variations thereof, are intended to cover a non-exclusive inclusion so that a setup, device or method that comprises a list of components or steps does not include only those components or steps but may include other components or steps not expressly listed or inherent to such setup or device or method. In other words, one or more elements in a system or apparatus preceded by “comprises” or “comprise” does not or do not, without more constraints, preclude the existence of other elements or additional elements in the system or method.

[0033] In the following detailed description of the embodiment of the disclosure, reference is made to the accompanying drawing that forms part hereof, and in which is shown by way of illustration a specific embodiment in which the disclosure may be practiced. This embodiment is described in sufficient detail to enable those skilled in the art to practice the disclosure, and it is to be understood that other embodiments may be utilized and that changes may be made without departing from the scope of the present disclosure. The following description is, therefore, not to be taken in a limiting sense.

[0034] Fig. 1 shows a schematic view of an embodiment of a motor vehicle 10. The motor vehicle 10 comprises a support system 12. The support system 12 is configured for providing a position information 14 of a finger 16 of a driver 18 of the motor vehicle 10 to a touch display 20 of the motor vehicle 10. The support system 12 therefore comprises at least one capturing device 22 and one electronic computing device 24.

[0035] In particular with the shown support system 12 the position information 14 may be provided for the driver 18. A relative position 26 of the finger 16 relative to the touch display 20 is captured by the capturing device 22. A contact position 28 at the touch display 20 is determined depending on the captured relative position 26 by the electronic computing device 24. A display information 30 of the touch display 20 is mirrored on a display device 32, which is assigned to the driver 18. The contact position 28 is displayed as the position information 14 on the display device 32.

[0036] As shown in Fig. 1, the display device 32 may be provided as an instrument cluster of the motor vehicle 10 for the driver 18. Furthermore, a proximity of the finger 16 may be taken into consideration for determining the contact position 28.

[0037] In particular, Fig. 1 shows, that a view of the driver’s finger 16 is replicated and its position relative to the touch display 20 is also replicated by the user interface with the driver’s forward-looking-field-off-view. Specifically, it replicates the visual cues on the driver’s display, for example the gauge cluster, instrument cluster or furthermore, and / or a head-up-display 34, as shown in Fig. 2.

[0038] The process can be described by the following steps. The functionality is activated by default or via the user setting. When the driver 18 wants to interact with the touch display 20 within the motor vehicle 10 the driver 18 moves the finger 16 towards the touch display 20. This activates the support system 12 and can be sensed in the following ways. For example, an in-vehicle gesture recognition system, proximity sensors integrated within the touch screen or within the vehicle’s interior, visual or depth cameras within the vehicle’s interior, specific touch motions, for example a user dragging for their finger from the outside edge of the touchscreen tour to touch screen region, or furthermore. Once the support system 12 is activated, the infotainments user interface, in particular the touch display 20, is replicated in one or more of the following ways. On the drivers display, in particular the instrument cluster or the gauge cluster. In the standard implementation, the replicated user interface completely replaces the drivers display. In other implementations, the replicated user interface may be semi-transparent. The transparency may be implementation or user-specific. Wherein the user’s interface is semi-transparent, the underline view may be the nominal driver’s display interface or a live feed from a front-facing video camera. Furthermore, as shown in Fig. 2, the display device 32 may be the head-up-display 34.

[0039] The finger 16 or touch points will then be visualized on top of the replicated user interface. The visualized fingers 16 or touch points will correspond to their true positions relative to the touch display 20. This is critical for providing visual feedback for precise point positioning. Positioning can be detected in one of the following ways. The vehicle gesture recognition systems, proximity sensors integrated within the touch display 20 or within the vehicles interior, visual or depth cameras within the vehicle’s interior, or specific touch motions, for example only.

[0040] In some implementations, the represented user interface may be zoomed in relative to the original source. The zoom scale may be set up by the user implementation specific. This may improve precision when trying to tap small regions. In addition, the zoom scale may be a factor of the driver’s finger proximity to the touch display 20. For example, the replicated user interface may become more zoomed in as the driver 18 moves the finger 16 closer to the touch display 20 to press a button.

[0041] The support system 12 will deactivate when the driver 18 moves the finger 16 away from the touch display 20. The display device 32 may return to the nominal operation mode. signs motor vehicle support system position information finger driver touchdisplay capturing device electronic computing device relative position contact position displayed information display device head-up-display Mercedes-Benz Group AG

Claims

1. A method for providing a position information (14) of a finger (16) of a driver (18) of a motor vehicle (10) relative to a touch display (20) of the motor vehicle (10) by a support system (12) of the motor vehicle (10), comprising the steps of:- capturing a relative position (26) of the finger (16) relative to the touch display (20) by a capturing device (22) of the support system (12);- determining a contact position (28) at the touch display (20) depending on the captured relative position (26) by an electronic computing device (24) of the support system (12);- mirroring a displayed information (30) of the touch display (20) on a display device (32), which is assigned to the driver (18); and- displaying the contact position (28) as the position information (14) on the display device (32).

2. The method according to claim 1, characterized in thatthe display device (32) is provided as a head-up-display (34) of the motor vehicle(10) for the driver (18).

3. The method according to claim 1 or 2, characterized in thatthe display device (32) is provided as an instrument cluster (36) of the motor vehicle (10) for the driver (18).

4. The method according to any one of claims 1 to 3, characterized in thata proximity of the finger (16) is taken into consideration for determining the contact position (28).

5. The method according to any one of claims 1 to 4, characterized in thatthe mirrored display information (30) is zoomed in depending on the relative position (26) and / or the contact position (28).

6. The method according to any one of claims 5, characterized in thata zooming factor is adapted depending on a distance of the finger (16) relative to the touch display (20).

7. A computer program product comprising program code means for performing a method according to any one of claims 1 to 6.

8. A non-transitory computer-readable storage medium comprising at least the computer program product according to claim 7.

9. A support system (12) for providing a position information (14) of a finger (16) of a driver (18) of a motor vehicle (10) relative to a touch display (20) of the motor vehicle (10), comprising at least one capturing device (22) and one electronic computing device (24), wherein the support system (12) is configured for performing a method according to any one of claims 1 to 6.

Images