Device for contactlessly triggering at least one function of motor vehicle

By integrating gesture sensor system in taillights, hand movement recognition technology is used to solve the problem of users in the existing technology that need to contact dirty areas or be familiar with the location of key fobs, user-friendly trunk operation is achieved, and the interaction between vehicles and users is simplified. , and supports triggering of multiple vehicle functions.

CN119018093APending Publication Date: 2024-11-26MARELLI GERMANY GMBH
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410647900.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2023-05-24
Filing Date
2024-05-23
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

Prior Art When opening the trunk of a motor vehicle, users need to contact dirty areas or familiar with the location of a keychain or smartphone, and using foot movement sensors poses a risk of uncomfortable and potential dirty areas, especially for users who are not familiar with the vehicle. In other words, the operation is complicated and inconvenient.

Method used

Using contactless hand movement recognition technology, the user's hand movement is recognized by integrating the gesture sensor system into the taillights, using semiconductor light sources and infrared sensors to identify the user's hand movement, avoiding additional cable laying, and passing it to the user through animated lighting effects and mini LED displays. Information to achieve user-friendly interaction.

Benefits of technology

The trunk can be opened without touching dirty areas. Users no longer need to know the location of the keychain or smartphone, which is more convenient to operate, and avoid discomfort and potential contact risks of foot movement sensors and potential dirty areas. It is suitable for multi-functional vehicle operation , such as door locking, reversing lights, etc.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119018093A_ABST
    Figure CN119018093A_ABST
Patent Text Reader

Abstract

A device for contactlessly triggering at least one function of a motor vehicle is proposed, the device comprising a sensor system configured for recognizing a gesture of a user and configured to monitor at least a sub-region of an environment of the motor vehicle for a predetermined gesture being performed by the user of the motor vehicle, and triggering the execution of the function of the motor vehicle to be executed if the sensor system recognizes the execution of the gesture. The device is characterized in that the gesture is a hand movement.
Need to check novelty before this filing date? Find Prior Art

Description

Background Art

[0001] The invention relates to a device for contactlessly triggering at least one function of a motor vehicle. Such a device is known from DE 10 2005032 402 B3. In the known device, the function is contactlessly opening the trunk of a motor vehicle. For this purpose, the area near the rear of the motor vehicle is divided into a farther area and a closer area relative to the rear. The two areas are photoelectrically monitored to determine whether a person moves from a position in the farther area to the closer area in a predetermined direction. In the farther area, the approach of the person is first identified, and the authorization for the person to open is checked by an automatic and wireless dialogue between the motor vehicle and an encoder. The encoder is, for example, an appropriately configured electronic car key. If authorization is established and the person enters the closer area, the motor vehicle generates a control command, which is used to open the trunk.

[0002] It is also known from DE 10 2005 032 402 B3 that an optoelectronic measuring device can be integrated into a rear light and that the light source of the rear light can also be used as a light emitter for the optoelectronic measuring device in addition to being a light source for, for example, brake light, tail light and possibly further signal light functions. The position of an approaching person can be determined using time-of-flight measurement and triangulation. If the person is not at the center rear of the vehicle, this wrong position, which is related to the installation position of the sensor system of the optoelectronic measuring device, can be signaled to them by illuminating only the right light source or the left light source in each case. The illumination of both light sources indicates to the person and thus confirms that they have reached a more distant area in their approach.

[0003] There are currently four other methods and devices for opening the trunk lid of a motor vehicle from the outside. The first method uses a mechanical switch at the rear of the vehicle. The second method uses a switch on the vehicle key fob. The third method uses a foot movement sensor (kick sensor) arranged under the rear of the vehicle, and the fourth method uses a smartphone application.

[0004] Applications using contactless hand movement recognition are currently used only in the interior of motor vehicles, for example to control functions of the infotainment system, such as volume adjustment, answering or ending a phone call, etc.

[0005] Further known methods and devices have the following disadvantages: When using a mechanical switch on the trunk lock, the user must have a free hand and must access a typically dirty area of ​​the vehicle. Vehicle manufacturers also need to attach cables and electronics to the trunk lid or the associated opening in the vehicle body just for opening the tailgate.

[0006] When using a switch on a vehicle key fob or smartphone, the user must know where the corresponding part is located. In addition, the user must grasp the vehicle key fob or smartphone, which can be difficult if their hands are not free.

[0007] The use of a foot movement sensor may be uncomfortable for the user and there is a risk of contacting a potentially dirty area of ​​the vehicle with the foot or leg. In addition, a user who is not familiar with the vehicle may not know the location of the foot movement sensor. The vehicle manufacturer must attach cables and electronics that are only used to open the tailgate to the rear or front of the vehicle in the lower area of ​​the vehicle body. Summary of the invention

[0008] The invention differs from the subject matter of DE 10 2005 032 402 B3 mentioned at the outset in that the gesture is a hand movement. In particular, the disadvantages associated with the known use of foot movement sensors are avoided or thereby avoided.

[0009] Controllability through contactless hand movements allows for user-friendly interaction between the user and the vehicle to open the trunk without having to touch dirty areas or know where the key fob or smartphone is located.

[0010] A preferred embodiment is characterized in that the function comprises locking and / or unlocking of doors and / or windows and / or sunroof, and / or activation of a welcome effect and / or a farewell effect, and / or switching on of reversing lights.

[0011] It is also preferred that the function includes opening the tailgate by an upward hand movement.

[0012] It is further preferred that the function comprises closing the tailgate by a downward hand movement.

[0013] A further preferred embodiment is characterized in that the device comprises a light or a central brake light or a door handle or a window or a windshield or a rear-view mirror, which comprises a gesture sensor system configured to recognize hand movements.

[0014] It is also preferred that the device comprises a motor vehicle taillight including a gesture sensor system configured to recognize hand movements.

[0015] It is also preferred that the device is configured to use semiconductor light sources of a motor vehicle taillight to signal the position of the gesture sensor system.

[0016] By placing the gesture sensor system required for executing the function in the taillight, it is no longer necessary to lay additional cables that are only used for this function into areas such as the trunk environment. Similarly to the cables, the electronics that are already present in the taillight for its light function can also be used in a variety of ways by using these electronics (microcontroller, semiconductor light sources) to recognize hand movements for function control.

[0017] Visual communication of the vehicle with the user is also possible, which is also referred to below as HMI (Human Machine Interface): By using animated light effects, various information can be conveyed to the user, for example about the position of the sensor system for recognizing hand movements, which hand movements can be recognized by the sensor system, and whether a hand movement has been recognized by the sensor system and signal processed. This is particularly advantageous when using the invention at night.

[0018] Another preferred embodiment is characterized in that the device is configured to use one or more existing light sources for the taillight function of the motor vehicle taillights after a hand movement has been recognized (which can be, for example, an upward or downward swiping movement) in order to signal to the user that a gesture has been recognized by illuminating the light source.

[0019] It is also preferred that the device includes a plurality of semiconductor light sources arranged along a line as light sources for the tail light function, and the device is configured to switch on the plurality of semiconductor light sources sequentially for a short period of time so as to produce an optical effect of a swiping movement to confirm the recognition of the hand movement, thereby giving the impression of a swiping movement of a bright area of ​​the luminous surface of the tail light.

[0020] It is also preferred that the device is configured to switch on the semiconductor sources in the case of gesture-controlled closing of the tailgate in the reverse order to the case of gesture-controlled opening of the tailgate.

[0021] A further preferred embodiment is characterized in that the device is configured to use static symbols to signal the position of the gesture sensor system and to inform the user of available hand movements.

[0022] It is also preferred that the device comprises a mini LED display that is integrated into the taillight and enables dynamic interaction with the user.

[0023] It is further preferred that the device is configured to use static holographic 3D symbols to interact with the user.

[0024] A further preferred embodiment is characterized in that the gesture sensor system comprises a camera and / or a radar sensor and / or a lidar sensor and / or a time-of-flight sensor.

[0025] It is also preferred that the gesture recognition sensor system comprises an optical infrared sensor, at least two infrared light emitting diodes and a sensor control unit.

[0026] Further preferably, the gesture recognition sensor system includes a sensor sensitive to visible light, at least two light emitting diodes capable of emitting visible light, and a sensor control unit.

[0027] A further preferred embodiment is characterized in that the gesture recognition sensor system comprises a capacitive sensor.

[0028] It is also preferred that the device is configured to recognize a plurality of different hand movements (recognition in a plane or even in space) and thus make it possible to trigger the execution of a plurality of different functions of the motor vehicle.

[0029] By recognizing different hand movements, various functions can be selectively performed, such as gesture-controlled locking and unlocking of the doors, opening and closing of the windows and sunroof, activation of welcome and farewell effects, and switching on of the reversing lights for illumination purposes.

[0030] It is further preferred that the plurality of functions include at least one of the following functions: opening / closing of the tailgate, activation / deactivation of the position lights or the welcome function, personalization of the taillight characteristics, interaction with the lights (e.g. dimming of the lights depending on the distance of the hand to the taillight), in the case of a mini LED display in the taillight: displaying information, battery charge level, weather; switching on the reversing lights in order to illuminate the area behind the car, opening / closing the windows.

[0031] Further advantages emerge from the description and the accompanying drawings.

[0032] It is to be understood that the features mentioned above and those still to be explained below can be used not only in the respectively specified combination but also in other combinations or alone, without departing from the scope of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] Embodiments of the present invention are shown in the drawings and explained in more detail in the following description. The drawings show in schematic form:

[0034] Figure 1a The hand is shown moving in front of the taillight;

[0035] Figure 1b Shows Figure 1a The subject has an open tailgate;

[0036] Figure 2 shows a taillight with a dedicated lighting static symbol based HMI;

[0037] Figure 3A taillight with a mini LED display-based HMI is shown;

[0038] FIG4 shows a taillight with a holographic symbol based HMI;

[0039] FIG5 shows individual adaptation of taillight features based on hand movement recognition;

[0040] Figure 6 is a block diagram of an optical arrangement of an infrared transceiver sensor in conjunction with an HMI based tail light function;

[0041] Figure 7 is a block diagram of a transceiver sensor optical arrangement for visible light in conjunction with an HMI based taillight functionality;

[0042] Figure 8 is a block diagram of a capacitive gesture sensor combined with an HMI based on a tail light function; and

[0043] Fig. 9 This is a block diagram of a time-of-flight sensor combined with an HMI based on the taillight function. DETAILED DESCRIPTION

[0044] Figure 1a The taillight 10 is shown in detail with a flashing light source 12, a closed tailgate 14, and a user's hand 16 performing a swiping motion 18. A gesture sensor system 20 is used to detect the hand movement. Figure 1b The tailgate 14 is shown with a subsequent opening. Figure 1a object.

[0045] In this first exemplary embodiment, the semiconductor light sources of the taillight 10 are used to first communicate the position of the gesture sensor system 20 to the user, for example by operating one of the semiconductor light sources 12 in a pulsed (ie, flashing) manner.

[0046] The user can then perform a hand movement 18 in front of the sensor system 20 (ie within its detection range) in order to cause the vehicle to perform the function assigned to this hand movement 18. Figure 1a and 1b In the exemplary embodiment shown, the function is the opening of the tailgate 14. After a gesture has been performed, which may be, for example, an upward or sideways swiping movement, one or more light sources 12 for the light function of the taillight 10 are present to signal to the user that the gesture has been recognized by illuminating.

[0047] Figure 2 A second exemplary embodiment is shown. Instead of using the semiconductor light sources of the taillights to interact with the user, a static symbol 23 is used to signal the position of the gesture sensor system and to inform the user of the available gestures and their recognition.

[0048] Figure 3 A third exemplary embodiment is shown. This comprises a special small mini LED display 24 which is integrated into the taillight 10 and enables dynamic interaction with the user. The display has a large number of individually switchable LED pixels, making it possible to display various symbols in high resolution. Figure 3 A symbol of an open lock is shown, for example, when the tailgate is not closed.

[0049] Figure 4a and 4b A fourth exemplary embodiment is shown. This exemplary embodiment is characterized in that high-quality static holographic 3D symbols are used to interact with the user. For example, Figure 4a A hologram 22 is shown representing the closed tailgate 14, and Figure 4b A hologram 24 is shown representing the tailgate 14 being open.

[0050] Figure 5a and 5b A fifth exemplary embodiment is shown. In this exemplary embodiment, the function triggered by the hand movement 18 comprises changing the appearance of the taillight 10, ie in particular the shape of the luminous surface of the taillight 10. In this case, Figure 5a A light emitting surface comprising three, equivalently horizontal, strips 26 is shown. Figure 5b The appearance changing by hand movement 18 is shown, wherein the luminous surface comprises two equivalent vertical strips 28, as an example of individual personalization.

[0051] In general, the present invention can be used to trigger one or more functions, which include at least one of the following functions: opening / closing of the tailgate, activation / deactivation of the position lights or the welcome function, personalization of the taillight characteristics, interaction with the lights (for example, dimming of the lights depending on the distance of the hand to the taillight), in the case of a mini LED display in the taillight: displaying information, battery charge level, weather; switching on the reverse lights in order to illuminate the area behind the car, opening / closing the windows.

[0052] Figure 6 An exemplary embodiment in the form of a taillight 10 is shown as a block diagram of a basic implementation of an apparatus according to the invention. The taillight 10 has a taillight function module 30 for performing signal light functions (tail, stop, turn, etc.) and a gesture recognition module 31 for gesture recognition and HMI. The signaling function is schematically represented by an LED driver 32 connected to a plurality of LEDs 34.1 to 34.n, while the gesture recognition module 31 consists of an optical infrared sensor 38, two (or more) infrared LEDs 40 and a sensor control unit 42. The driver 32 and the sensor control unit 42 are preferably combined in a single control device. Block 43 represents other optional functions.

[0053] The LED 34.1 of the LEDs 34.1 to 34.n of the taillight function is configured to emit a visible light flash once to signal the position of the sensor 38, thereby achieving system and resource optimization. In addition, the full taillight function is also used to confirm the successful recognition of the hand movement 18 to open or close the tailgate 14, for example, by a swipe animation in one direction or another. The sensor control unit 42 controls all infrared LEDs 40 according to a specific pattern and receives corresponding feedback signals from the optical sensor 38.

[0054] The detected information is then transmitted via an internal data bus 44 to the microcontroller 29, which interprets the data and decides whether a hand movement 18 has been recognized for controlling a function. If a hand movement 18 has been recognized, the decision is transmitted via a vehicle data bus 46 to a higher-level vehicle control device (body control module, BCM), which then triggers or executes the relevant function. At least two infrared LEDs 40 are required to recognize one-dimensional gestures, and at least three infrared LEDs 40 are required to recognize two-dimensional gestures.

[0055] exist Figure 7 An embodiment very similar to the one just explained can be seen in FIG. 1 , wherein LEDs 34.3 and 34.5 configured to emit visible light are used instead. Figure 6 This has the advantage of enabling an even greater system and resource optimization, since the gesture sensor system LED is also used for the original light function of the tail light 10 .

[0056] This exemplary embodiment has the disadvantage that a synchronization signal 48 from the sensor control unit 42 to the LED driver 32 is required to synchronize the alternating switching on of the LEDs 34 . 4 , 34 . 5 and the light detection by the optical sensor 38 .

[0057] Figure 8 An exemplary embodiment is shown, in which a capacitive sensor 50 is used instead of the optical sensor 38. The block diagram shows that the microcontroller 30 is still connected to the standard functional LED driver 32 and the sensor control unit 42 via the internal data bus 44. The sensor control unit 42 is connected to two or more electrodes 52, which enable the detection of fluctuations in capacitance. The detected data are transmitted to the microcontroller 30, which decides whether a hand movement 18 has been performed. At least two electrodes 52 are required to recognize a one-dimensional gesture, and at least three electrodes are required to recognize a two-dimensional gesture. The larger the detection range, the larger the electrodes 52 must be.

[0058] The final exemplary embodiment is Fig. 9, where a time-of-flight sensor 54 is used. This is a specific family of optical sensors that can determine the distance of an object by measuring the time it takes for light to leave a light source, be reflected by an object and reach the time-of-flight sensor 54. Sensors of this family are very small (approximately 4×2 mm), and some of them include multiple detector areas housed in a small housing, so that a single time-of-flight sensor 54 can even be suitable for recognizing complex three-dimensional hand movements, although at the expense of a higher computational effort for the evaluation of the sensor signals.

[0059] As Fig. 9 As an alternative to the embodiment shown, the time-of-flight sensor can be replaced by a radar, camera or lidar sensor. In this case, the computing power required to process the sensor data and extract the gesture information is significantly higher, but the complexity and accuracy of the gestures recognized can be significantly improved. This type of approach is particularly interesting if one of these sensors is already integrated into the rear lights (e.g. a turning radar for identifying blind spots). In this case, the software of the sensor must be updated in order to make gesture recognition possible.

[0060] exist Figures 6 to 9 In the exemplary embodiment shown, there are in each case a plurality of semiconductor light sources arranged along a line, which can be switched on at once for a short time in order to produce an optical effect of a swiping movement confirming a hand movement of the user, thereby giving the impression of a swiping movement of a light point, a luminous line or a luminous surface. In addition to confirming the recognition of the gesture in this way, the vehicle also performs the function assigned to the hand movement, for example, opening the tailgate 14. Other display options can likewise be used for communicating with the user, in particular for confirmation. This applies in particular to mini LED displays, symbols and holograms.

[0061] A supplementary use is the closing of the tailgate 14. In this case, in one embodiment, one or more semiconductor light sources are also activated, for example in a flashing manner, in order to indicate the position of the sensor to the user. The user can then perform a closing gesture within the detection range of the sensor in order to initiate the closing of the trunk. The gesture can be, for example, a downward swiping movement of the user's hand. After the gesture has been performed, one or more light sources for the taillight function are already present for signaling to the user that the gesture has been recognized by lighting up. As in the case of opening the trunk, this can be done by switching on a plurality of semiconductor light sources arranged along a line in sequence for a short time in order to produce the optical effect of a swiping movement, thereby giving the impression of a swiping movement. Advantageously, the order in which the semiconductor light sources are switched on for a short time is opposite to the order in the case of gesture-controlled opening of the tailgate 14. In addition to confirming the recognition of the gesture in this way, the vehicle also performs the function assigned to the gesture, here, for example, the closing of the tailgate. For this purpose, the vehicle central control device (body control module) that controls these functions sends corresponding control commands to the actuator system of the trunk lid via the bus system of the vehicle.

[0062] A complex implementation of this technology will be able to recognize multiple different gestures performed in a plane or even in space, thus enabling multiple actions and interactions between the user and the vehicle. The list of possible use cases for such an implementation includes not only the opening and closing of the tailgate, but also the activation / deactivation of the position lights and / or the welcome function, which can be achieved by visual or acoustic effects and / or personalized taillight features (the appearance of the luminous surface of the taillights) and / or interaction with the lights (e.g., dimming of the lights depending on the distance of the hand to the taillights). When mini-LED displays are used in the taillights, the list of possible use cases also includes the display of information, for example, about the battery charge level and / or the weather, and / or turning on the reversing lights in order to illuminate the area behind the car, and / or opening / closing the windows, and / or locking and / or unlocking the doors. For security reasons, all these actions are performed only if the user performing the gesture also has the vehicle key (FOB). This security feature is preferably implemented in / by the vehicle control device.

[0063] The integration of gesture sensor technology in the taillight enables a simple implementation of a human machine interface by using the common light functions of the taillight (e.g., taillight, indicator light, etc.), and is also an ideal location to support the use case of opening / closing the tailgate. To support some of the alternative or complementary use cases in the list of possible use cases, other locations on the vehicle exterior may be equally or better suited to accommodate the hardware required for the gesture sensor system and HMI (e.g., one or more light sources). Suitable locations may be: headlights, central brake lights, door handles, windows or windshields, rearview mirrors, or cameras.

Claims

1. A device for contactlessly triggering at least one function of a motor vehicle, the device comprising a sensor system (20) configured to recognize a user's gesture and configured to monitor at least a sub-area of ​​the motor vehicle's environment for a predetermined gesture performed by a user of the motor vehicle and to trigger the execution of the motor vehicle's function if the sensor system recognizes the execution of the gesture, characterized in that The gesture is a hand movement (18).

2. The device according to claim 1, characterized in that The functions include locking and / or unlocking of doors and / or windows and / or sunroof, and / or activation of a welcome effect and / or a farewell effect, and / or switching on of reversing lights.

3. The device according to claim 1, characterized in that The function includes opening a tailgate (14) of the motor vehicle by an upward hand movement (18).

4. The device according to claim 1 or 3, characterized in that: The function includes closing the tailgate (14) of the motor vehicle by a downward hand movement (18).

5. A device according to any one of the preceding claims, characterised in that The device comprises a light or a central brake light or a door handle or a window or a windshield or a rear view mirror, and the device comprises a gesture sensor system configured to recognize the hand movement.

6. The device according to any one of claims 1 to 4, characterized in that The device comprises a motor vehicle taillight (10) comprising a gesture sensor system (20) configured to recognize the hand movement (18).

7. The device according to claim 6, characterized in that The device is configured to use semiconductor light sources (34.1, . . . , 34.n) of the motor vehicle taillight (10) in order to signal the position of the gesture sensor system (20).

8. The device according to claim 6 or 7, characterized in that The device is configured to use one or more existing semiconductor light sources (34.1, ..., 34.n) for the taillight function of the motor vehicle taillight (10) after the hand movement (18) (which can be, for example, an upward or downward swiping movement) has been recognized, so as to signal the user that the hand movement (18) has been recognized by lighting up the semiconductor light sources (34.1, ..., 34.n).

9. The device according to claim 8, characterized in that The taillight (10) comprises a plurality of semiconductor light sources (34.1, ..., 34.n) arranged along a line as light sources for the taillight function, and the device is configured to sequentially switch on a plurality of the plurality of semiconductor light sources (34.1, ..., 34.n) in a short period of time so as to produce an optical effect of a sweeping movement, thereby giving the impression of the sweeping movement of a bright area.

10. The device according to claim 9, characterized in that When the tailgate (14) is closed by the gesture control, the order in which the semiconductor light sources (34.1, ..., 34.n) are turned on for a short period of time is opposite to the order when the tailgate (14) is opened by the gesture control.

11. The device according to claim 6, characterized in that The device is configured to use static symbols to signal the position of the gesture sensor system (20) and to inform the user of available gestures.

12. The device according to claim 11, characterized in that The device comprises a mini LED display which is integrated into the taillight (10) and enables dynamic interaction with the user.

13. The device according to claim 11, characterized in that The device is configured to interact with the user using static holographic 3D symbols (22, 24).

14. A device according to any one of the preceding claims, characterised in that The gesture sensor system comprises a camera and / or a radar sensor and / or a LiDAR sensor and / or a time-of-flight sensor (54).

15. A device according to any one of the preceding claims, characterised in that The gesture recognition sensor system (20) includes an optical infrared sensor (38), at least two infrared light emitting diodes (40) and a sensor control unit (42).

16. A device according to any one of the preceding claims, characterised in that The gesture recognition sensor system (20) comprises a sensor sensitive to visible light, at least two light emitting diodes (34.3, 34.5) capable of emitting visible light, and a sensor control unit (42).

17. A device according to any one of the preceding claims, characterised in that The gesture recognition sensor system (20) includes a capacitive sensor (50).

18. A device according to any one of the preceding claims, characterised in that The device is configured to recognize a plurality of different gestures and thereby enable a plurality of different functions of the motor vehicle to be triggered to be performed.

19. The device according to claim 18, characterized in that The plurality of functions comprises at least one of the following functions: opening / closing of the tailgate (14), activation / deactivation of the position lights or the welcome function, personalization of the taillight features, interaction with the lights, in the case of a mini LED display in the taillight: displaying information, battery charge level, weather; switching on the reverse lights in order to illuminate the area behind the car, opening / closing the windows.