System and method for triggering a vehicle function of a vehicle
The system addresses the complexity and error-prone nature of evaluating open space gestures by using a signal-based approach within a vehicle, allowing users to trigger functions through gesture-induced signal interruptions, enhancing safety and usability.
Patent Information
- Application Number
- DE102023130587
- Authority / Receiving Office
- DE · DE
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-11-06
- Publication Date
- 2025-05-08
AI Technical Summary
Existing systems for triggering vehicle functions using open space gestures are prone to errors due to the complexity of evaluating such gestures, and they require high arithmetic levels.
A system that uses a transmission device to send a signal within a vehicle, a reception device to receive the signal, and a control device to determine if the signal's intensity has fallen below a threshold, thereby triggering a vehicle function without needing to recognize or evaluate the gesture itself.
This solution provides a safe and easy-to-use method for triggering vehicle functions by allowing users to interrupt a signal with a gesture, eliminating the need for complex gesture evaluation and reducing error likelihood.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[0001] The present invention relates to a system, a vehicle with the system, a method, in particular a computer-implemented method, and a computer program for triggering a vehicle function of the vehicle. The vehicle function can be triggered, in particular, by a clearance gesture performed by a human user, for example, by a driver or another occupant of the vehicle.
[0002] Modern vehicles are no longer limited to providing various push buttons, switches, or other conventional input devices for receiving user input. In particular, in addition to touch-sensitive surfaces, including touchscreens in particular, some automakers have recently added the detection of free-space gestures performed by a human user to the range of available input methods in vehicles. Typically, such gestures are captured by a single 2D or 3D camera in the vehicle when performed within the camera's field of view and are used to control a functionality, such as the volume, an entertainment system, for example, an infotainment system, a vehicle, or to turn a light in the vehicle on or off.However, evaluating such free space gestures with a corresponding algorithm requires a high computational effort and is also error-prone due to its complexity.
[0003] The object of the present invention is to provide a safe and easy-to-use way to trigger a function of a vehicle.
[0004] This object is achieved according to the teaching of the independent claims. Various embodiments and developments of the present invention are the subject of the dependent claims.
[0005] A first aspect of the solution relates to a system for triggering a vehicle function of a vehicle, comprising: (i) a transmitting device configured to transmit a signal in an interior of the vehicle over a predetermined period of time; (ii) a receiving device arranged at a distance from the transmitting device and configured to receive the transmitted signal over the predetermined period of time; (iii) a control device configured to: (iii-a) determine a plurality of values of a signal property, in particular intensity values or amplitudes, of the received signal, at a plurality of times; (iii-b) compare the determined values of the signal property with a predetermined threshold value of the signal property, in particular an intensity threshold value; and (iii-c) trigger a vehicle function if the comparisons have shown that at least one of the determined values is smaller than the predetermined threshold value.
[0006] The terms "comprises," "includes," "includes," "has," "has," "with," or any other variation thereof, as used herein, are intended to cover non-exclusive inclusion. For example, a method, apparatus, or system that includes or has a list of elements is not necessarily limited to those elements, but may include other elements not expressly listed or that are inherent in such method, apparatus, or system.
[0007] Furthermore, unless explicitly stated otherwise, "or" refers to an inclusive "or" rather than an exclusive "or." For example, a condition A or B is satisfied by one of the following conditions: A is true (or present) and B is false (or absent), A is false (or absent) and B is true (or present), and both A and B are true (or present).
[0008] The terms "a" or "an" as used herein are defined as "one or more." The terms "another" and "another," and any other variations thereof, are defined as "at least one other."
[0009] The term “plurality” as used here shall mean “two or more”.
[0010] The term “configured” or “set up” to fulfil a specific function (and respective variations thereof) as used here is to be understood to mean that the corresponding device is already in a design or setting in which it can carry out the function or is at least adjustable - i.e. configurable - so that it can carry out the function after being set accordingly. The configuration can be carried out, for example, by appropriately setting parameters of a process sequence or of switches or similar for activating or deactivating functionalities or settings. In particular, the system can have a plurality of predetermined configurations or operating modes, so that the configuration can be carried out by selecting one of these configurations or operating modes.
[0011] The term "electro-optical transmitting device" or "electro-optical transmitter" as used here refers in particular to a transmitter designed to generate and transmit electromagnetic signals using an electrical energy source. Such transmitters may comprise light-emitting diodes (LEDs), lasers, laser diodes, or other light sources. In particular, the aforementioned light sources are suitable for transmitting electromagnetic signals in a predetermined wavelength bandwidth, particularly in the infrared wavelength range.
[0012] The term "electro-optical sensor" as used here refers in particular to a sensor designed to detect or measure electromagnetic signals and convert them into electrical signals. These sensors can in particular be a charge-coupled device (CCD), a radar sensor, a lidar sensor, or another sensor. Furthermore, such a sensor can also be designed to transmit electromagnetic signals to an object and, in turn, measure the electromagnetic signals reflected back from this object, so that, in a subsequent evaluation, information about the object can be obtained from the transmitted and reflected electromagnetic signals. This is also known as a time-of-flight (TOF) camera.
[0013] The term "acoustic transmitting device" or "acoustic transmitter," in particular "electroacoustic transmitting device," as used here, refers in particular to a transmitting device configured to generate acoustic signals based on sound waves. In particular, an electroacoustic transmitting device is configured to generate acoustic signals based on sound waves using an electrical energy source. These transmitters can be loudspeakers. In particular, such a transmitter can be configured to emit ultrasonic signals.
[0014] The term "acoustic sensor," in particular "electroacoustic sensor," as used here, refers in particular to a sensor designed to detect or measure acoustic signals based on sound waves. In particular, an electroacoustic sensor is designed to convert the detected or measured acoustic signals into electrical signals. These sensors can be microphones, in particular directional microphones, or even an ultrasonic sensor. Furthermore, such a sensor can also be designed to transmit acoustic signals to an object and, in turn, to measure the reflected acoustic signals from this object, so that, in a subsequent evaluation, information about the object can be obtained from the transmitted and reflected acoustic signals.
[0015] The term "signal property" as used here refers in particular to a physical property or parameter of a signal. In particular, this can be an intensity, power, amplitude, wavelength, frequency, or other property.
[0016] The term “interior of the vehicle” as used here refers in particular to the interior of a passenger compartment of a vehicle, for example a car.
[0017] The system according to the first aspect can be used to trigger a vehicle function if a value of the signal property determined by a control device is lower than a predefined threshold. The determined value can be lower than the predefined threshold if the signal sent by the transmitting device was disturbed or interrupted on its way to the receiving device, and as a result, a weakened signal or no signal at all is received by the receiving device for the duration of the disturbance. This disturbance or interruption can be brought about by a clearance gesture by a user of the vehicle. The user can thus trigger a vehicle function with a gesture that disturbs, in particular interrupts, the signal between the transmitting device and the receiving device. In this case, it is not necessary to recognize or evaluate the gesture itself.In this respect, the present system provides a simple way to trigger a vehicle function. For example, a signal path from the transmitting device to the receiving device can run partially near the user's head area, allowing the signal to be interrupted by a head movement of the user, thus triggering the vehicle function.
[0018] Preferred embodiments of the system are described below, which can be combined with each other as well as with the other aspects described, unless this is expressly excluded or is technically impossible.
[0019] In some embodiments, the transmitting device is configured to transmit a continuous signal. This allows for more accurate comparisons because, unlike a pulsed signal, the signal itself is not interrupted, and thus only a disturbance leads to a change in the value of the signal property.
[0020] In some embodiments, the transmitting device is configured to transmit a pulsed signal. A pulsed signal has lower energy than a non-pulsed, particularly continuous, signal. This allows the transmitting device to save energy.
[0021] In some embodiments, the control device is configured to read characteristic information about the transmitting device from the transmitting device, wherein the control device can determine a transmission value of a signal property of the transmitting device using the characteristic information, and wherein the transmission value can be used by the control device as a threshold value for the comparisons. Such characteristic information can relate to manufacturer information about the transmitting device, which is stored in a memory of the transmitting device. In particular, the characteristic information can comprise a power emittable by the transmitting device in conjunction with an emittable wavelength range, in particular in the case of emittable acoustic or electromagnetic waves. From this, a corresponding value of the signal property, in particular an intensity value, can be determined.This value can then be used as a threshold, making it easy to determine the specified threshold.
[0022] In some embodiments, the transmitting device is configured to emit a directed signal, in particular a signal limited in terms of its solid angle. In particular, a directed electromagnetic signal can be emitted by a coherent light source, such as a laser or a laser diode. It is also conceivable to generate a directed signal using a corresponding lens arrangement. An acoustic signal can be at least partially converged into a directed signal, in particular by being transmitted through a hollow body. A directed signal allows a signal received by the receiving device to be detected with an improved signal-to-noise ratio. This allows the value of the signal property to be determined more reliably.
[0023] In some embodiments, the transmitting device comprises an electro-optical transmitter, in particular a light-emitting diode or a laser diode, which is configured to transmit an electromagnetic signal, in particular an infrared signal, and the receiving device comprises an electro-optical sensor configured to receive the electromagnetic signal. By means of an electro-optical signal, a largely loss-free transmission of the signal from the transmitting device to the receiving device can be assumed over an assumed distance in the interior of a vehicle of a maximum of a few meters. Therefore, a disturbance in the signal can be detected particularly precisely. As a result, it is also conceivable that a disturbance that does not lead to a complete interruption can be detected by a reduced intensity value at the receiving device, and a vehicle function can thus be triggered.
[0024] In some embodiments, the transmitting device comprises an acoustic, in particular electroacoustic transmitter, in particular a loudspeaker, which is configured to emit an acoustic signal, in particular an ultrasonic signal, and the receiving device comprises an acoustic sensor, in particular an electroacoustic sensor, in particular a microphone, which is configured to receive the acoustic signal. An acoustic signal can lead to increased safety with regard to vehicle operation and a potential health hazard, in particular to a user's eyesight, compared to an electromagnetic signal. When using an electromagnetic signal, there may be a risk that the signal will be inadvertently deflected towards the eye area of a user, in particular a driver, on a reflective surface such as the interior mirror, a carried smartphone, or a vehicle window.This can distract the driver's attention. In the worst case, the deflected light can lead to impaired eyesight. Therefore, an acoustic signal can be beneficial.
[0025] In some embodiments, the system comprises a plurality of transmitting devices and receiving devices, wherein each transmitting device of the plurality of transmitting devices is assigned to a receiving device of the plurality of receiving devices, such that a respective transmitted signal from one of the transmitting devices is received by the respectively assigned receiving device; wherein each receiving device of the plurality of receiving devices is assigned to a vehicle function, such that if one of the determined values is smaller than the predetermined threshold value, depending on which of the plurality of receiving devices the comparisons have shown, an assigned vehicle function can be triggered accordingly by the control device. This makes it possible for different functions to be triggered by a respective disturbance or interruption of the respectively transmitted signal.For example, one signal path may run in sections near a left-hand area of the user's head, and another signal path of another signal may run near a right-hand area of the user's head. The signals from the described signal paths are received by different receiving devices. This means that a predefined function can be triggered by a head movement to the left or to the right. This can be advantageous when making a selection decision between two alternatives, for example accepting or rejecting an incoming telephone call. Depending on which of the described signal paths is interrupted, a signal with reduced intensity is received by the associated receiving device, and a vehicle function is triggered by the control device.
[0026] A second aspect of the solution relates to a vehicle comprising a system according to the first aspect.
[0027] Preferred embodiments of the vehicle are described below, which can be combined with each other as well as with the other aspects described, unless this is expressly excluded or is technically impossible.
[0028] In some embodiments, the transmitting device and the receiving device of the system are arranged in the vehicle such that a signal path of the transmitted signal from the transmitting device runs partially in a spatial region near the head of a vehicle user, such that the signal path is within range of a head movement of the user. This allows the user to disrupt or interrupt the signal by moving their head, thus triggering a vehicle function. This is particularly advantageous when the user is a driver, since the driver then does not have to take their hands off the steering wheel to trigger the vehicle function.
[0029] In some embodiments, the system's receiving device is designed as an interior camera of the vehicle. This allows a receiving device to be provided simply, cost-effectively, and without requiring additional installation space.
[0030] In some embodiments, the vehicle further comprises an indicator device, in particular a control lamp, for outputting an indicator to the user. The control device of the system is configured to activate the indicator device when a signal is transmitted by the transmitting device and to deactivate it when the transmission is terminated. This enables coordinated transmission of the signal and a possible interruption of the signal to trigger a function. Transmission and reception of the signal without an active decision by the user regarding a possible triggering of a vehicle function can thus be avoided.
[0031] A third aspect of the solution relates to a method, in particular a computer-implemented method, for triggering a vehicle function of a vehicle, comprising the following steps: (i) transmitting a signal in an interior of the vehicle over a predetermined period of time by a transmitting device; (ii) receiving the transmitted signal by a receiving device; (iii) determining a plurality of values, in particular intensity values, of a signal property of the received signal at a plurality of times by a control device; (iv) comparing the determined values with a predetermined threshold value by the control device; (v) triggering a vehicle function by the control device if the comparisons have shown that at least one of the determined values is lower than the predetermined threshold value.
[0032] A fourth aspect of the solution relates to a computer program with instructions which, when executed on a system according to the first aspect, cause the system to carry out the method according to the third aspect.
[0033] The computer program can, in particular, be stored on a non-volatile data carrier. This is preferably a data carrier in the form of an optical data carrier or a flash memory module. This can be advantageous if the computer program as such is to be handled independently of a processor platform on which the one or more programs are to be executed. In another implementation, the computer program can be present as a file on a data processing unit, in particular on a server, and can be downloadable via a data connection, for example the Internet or a dedicated data connection, such as a proprietary or local network. Furthermore, the computer program can have a plurality of interacting individual program modules.
[0034] The features and advantages explained with regard to the first aspect of the solution also apply accordingly to the other aspects described.
[0035] Further advantages, features and possible applications emerge from the following description of preferred embodiments in conjunction with the figures.
[0036] This shows Fig. 1 schematically shows a vehicle with a system according to an embodiment; and Fig. 2 schematically shows a flow diagram to illustrate an embodiment of a method.
[0037] Throughout the figures, the same reference numerals are used for the same or corresponding elements.
[0038] In Fig. 1 schematically shows a vehicle 100 with a system according to an embodiment.
[0039] A first electro-optical transmitter 110 for transmitting a first electromagnetic signal and a first electro-optical sensor 120 for receiving the first electromagnetic signal are arranged in the vehicle 100. The first electro-optical transmitter 110 can comprise an LED or a laser diode, each of which is suitable for emitting an electromagnetic signal in a predetermined wavelength range, in particular in an infrared range, in particular at wavelengths from 700 nm to 1500 nm. The first electro-optical transmitter 110 is arranged on a left-hand side in the interior of the vehicle 100 in the direction of travel, for example in the region of a guide for a seat belt (not shown here) for a driver 170 of the vehicle 100. The first electro-optical sensor 120 is arranged in the region of the interior mirror (not shown here).The described arrangement of the first electro-optical transmitter 110 and the first electro-optical sensor 120 makes it possible for a first signal path from the first electro-optical transmitter 110 to the first electro-optical sensor 120 to pass in sections at a short distance past a left-hand head region of the driver 170, so that the driver 170 is able to interrupt the first signal path by moving his head.
[0040] Similarly, a second electro-optical transmitter 130 for transmitting a second electromagnetic signal and a second electro-optical sensor 140 for receiving the second electromagnetic signal are arranged in the vehicle 100. The second electro-optical transmitter 130 can, in particular, be structurally identical to the first electro-optical transmitter 110. The second electro-optical sensor 140 can, in particular, be structurally identical to the first electro-optical sensor 120. The second electro-optical transmitter 130 is arranged between the driver's seat and the passenger seat. The second electro-optical sensor 140 is arranged in the region of the interior mirror (not shown here).The described arrangement of the second electro-optical transmitter 130 and the second electro-optical sensor 140 makes it possible for a second signal path from the second electro-optical transmitter 130 to the second electro-optical sensor 140 to pass in sections at a short distance past a right-hand head region of the driver 170, so that the driver 170 is able to interrupt the second signal path by a further head movement.
[0041] The first electro-optical sensor 120 and the second electro-optical sensor 140 are each signal-coupled to a control device 150. These signal-coupled connections can be implemented as cable connections and / or as wireless connections, such as Bluetooth or WLAN. As a result, the signals received by the first electro-optical sensor 120 and the second electro-optical sensor 140 can each be evaluated by the control device 150.
[0042] The first electro-optical transmitter 110 and the second electro-optical transmitter 130 are also signal-coupled or connected to the control device 150. These signal connections can be implemented via cable connections and / or wireless connections, such as Bluetooth or WLAN. As a result, the transmission and duration of the first electromagnetic signal and / or the second electromagnetic signal can be controlled by the control device 150.
[0043] The control device 150 is further configured to determine values of signal properties, such as intensity values, from the received signals at predetermined times and to compare these values with a predetermined threshold value, such as an intensity threshold. The predetermined intensity threshold value can correspond to an intensity value of the respective transmitted signal. The intensity value of the transmitted signal can, for example, correspond to a manufacturer's specification of the respective transmitter 110, 130 and can be read out by the control device 150 or determined using readable information.
[0044] If an intensity value of a received signal from one of the sensors 120, 140, determined by the control device 150, is less than the predefined intensity threshold, a vehicle function is triggered by the control device 150. Different vehicle functions are triggered depending on which sensor 120, 140 from the first electro-optical sensor 120 and the second electro-optical sensor 140 determined an intensity that is less than the predefined intensity threshold. Triggering different vehicle functions can be advantageous, for example, when selecting between two alternatives, as is the case with an incoming call.The driver 170 can then, for example, interrupt the first signal path by moving his head to one side and thereby accept the call, or interrupt the second signal path by moving his head to the other side and thereby reject the call.
[0045] Furthermore, a control lamp 160 is arranged in the vehicle in the field of vision of the driver 170. This control lamp 160 can signal to the driver 170 whether a signal is currently being transmitted by one or both of the first electro-optical transmitter 110 and the second electro-optical transmitter 130, so that the signal can be interrupted accordingly by a head movement. For example, a lighting of the control lamp 160 can signal that a signal is being transmitted while it is illuminated, and if the control lamp 160 is not illuminated, that no signal is being transmitted. If it is illuminated, the driver 170 is also signaled that they can interrupt the signal path and trigger a function by moving their head.
[0046] It is also conceivable that the control lamp 160 can light up in different colors or have several lamps with different colors, whereby the driver 170 can be signaled that a signal is being sent, that the signal has been successfully interrupted or that the signal has not been successfully interrupted.
[0047] In Fig. 2 schematically shows a flowchart 200 for illustrating an embodiment of a method for triggering a vehicle function of a vehicle 100 with the following steps: In a first step S210 of the method, an electromagnetic signal, in particular an infrared signal, is transmitted in an interior of the vehicle 100 over a predetermined period of time by an electro-optical transmitting device 110, in particular an LED or a laser diode.
[0048] In a further step S220 of the method, the transmitted signal is received by an electro-optical sensor 120.
[0049] In a further step S230 of the method, a plurality of values of a signal property of the received signal are determined at a plurality of times by a control device 150. In particular, intensity values are determined as values.
[0050] In a further step S240 of the method, the control device 150 compares the determined values with a predetermined threshold value.
[0051] In a further step S250 of the method, a vehicle function is triggered by the control device 150 if the comparisons have shown that at least one of the determined values is lower than the predetermined threshold value.
[0052] While at least one exemplary embodiment has been described above, it should be appreciated that a wide variety of variations exist. It should also be understood that the described exemplary embodiments are merely non-limiting examples and are not intended to limit the scope, applicability, or configuration of the devices and methods described herein. Rather, the foregoing description will provide one skilled in the art with guidance for implementing at least one exemplary embodiment, it being understood that various changes in the operation and arrangement of the elements described in an exemplary embodiment may be made without departing from the subject matter as defined in the appended claims, as well as their legal equivalents. LIST OF REFERENCE SYMBOLS 100 vehicles 110 First electro-optical transmitting device 120 First electro-optical sensor 130 Second electro-optical transmitting device 140 Second electro-optical sensor 150 Control device 160 Control lamp 170 drivers 200 Flowchart S210 Sending a signal S220 Receiving the transmitted signal S230 Determining a plurality of values of a signal property S240 Comparing the determined values S250 Activation of a vehicle function
Claims
[1] System for triggering a vehicle function of a vehicle (100), comprising: A transmitting device (110) configured to transmit a signal over a predetermined period of time in an interior of the vehicle (100); a receiving device (120) which is arranged at a distance from the transmitting device (110) and which is arranged to receive the transmitted signal over the predetermined period of time; a control device (150) which is arranged: to determine a plurality of values of a signal property of the received signal, in particular intensity values (amplitudes), at a plurality of times; to compare the determined values of the signal property with a predetermined threshold value of the signal property, in particular the intensity threshold value; and to trigger a vehicle function if the comparisons have shown that at least one of the determined values is smaller than the specified threshold. [2] System according to claim 1, wherein the transmitting device (110) is arranged to transmit a continuous signal as the signal. [3] System according to claim 1, wherein the transmitting device (110) is arranged to transmit a pulsed signal as the signal. [4] System according to one of the preceding claims, wherein the control device (150) is configured to read out characteristic information about the transmitting device (110) from the transmitting device (110), wherein a transmission value of a signal property of the transmitting device (110) can be determined by the control device (150) using the characteristic information, and wherein the transmission value can be used by the control device (150) as a threshold value for the comparisons. [5] System according to one of the preceding claims, wherein the transmitting device (110) is configured to transmit a directional signal. [6] System according to one of the preceding claims, wherein the transmitting device comprises an electro-optical transmitter (110) arranged to transmit an electromagnetic signal, and the receiving device comprises an electro-optical sensor (120) arranged to receive the electromagnetic signal. [7] System according to one of claims 1 to 5, wherein the transmitting device comprises an acoustic transmitter (110) arranged to transmit an acoustic signal, and the receiving device (120) comprises an acoustic sensor arranged to receive the acoustic signal. [8] System according to one of the preceding claims, further comprising: a plurality of transmitting devices (110, 130) and receiving devices (120, 140), wherein each transmitting device of the plurality of transmitting devices (110, 130) is assigned to a receiving device (120, 140) of the plurality of receiving devices (120, 140), such that a signal transmitted in each case by one of the transmitting devices (110, 130) is received by the respectively assigned receiving device (120, 140); wherein each receiving device (120, 140) of the plurality of receiving devices (120, 140) is assigned to a vehicle function, such that if, depending on which of the plurality of receiving devices (120, 140) the comparisons have shown that one of the determined values is smaller than the predetermined threshold value, an assigned vehicle function can be triggered accordingly by the control device (150). [9] Vehicle (100) comprising a system according to any one of the preceding claims. [10] Vehicle (100) according to claim 9, wherein the transmitting device (110, 130) and the receiving device (120, 140) of the system are arranged in the vehicle (100) such that a signal path of the transmitted signal of the transmitting device (110, 130) runs in sections in a spatial area in the vicinity of a head of a user (170) of the vehicle (100), such that the signal path runs within the range of a head movement of the user. [11] Vehicle (100) according to claim 9 or 10, wherein the receiving device of the system is designed as an interior camera (120, 140) of the vehicle (100). [12] Vehicle (100) according to one of claims 9 to 11, comprising an indication device (160) for outputting an indication to the user (170), wherein the control device (150) of the system is configured to activate the indication device (160) when a signal is transmitted by the transmission device (110, 130) and to deactivate it when the transmission is terminated. [13] Method for triggering a vehicle function of a vehicle (100) comprising the following steps: Transmitting a signal in an interior of the vehicle (100) over a predetermined period of time by a transmitting device (110, 130); Receiving the transmitted signal by a receiving device (120, 140); Determining a plurality of values of a signal property of the received signal at a plurality of times by a control device (150); Comparing the determined values with a predetermined threshold value by the control device (150); and Triggering a vehicle function by the control device (150) if the comparisons have shown that at least one of the determined values is lower than the predetermined threshold value. [14] A computer program comprising instructions which, when executed on a system according to any one of claims 1 to 8, cause the system to carry out the method according to claim 13.
Citation Information
Patent Citations
Method for operating a gesture recognition device and motor vehicle with spatially limited gesture recognition
DE102013009567A1
Motor vehicles with display unit and safety device to prevent driver distraction
DE102013013227A1
Instantaneous sleep activated alarm
US20060187067A1
Head activated vehicle horn controller
US6154134A