Method for authenticating of at least one or more users
A radar-based gesture sensor in vehicles authenticates users by recognizing individual movement patterns, addressing the inconvenience of existing systems and enhancing security and usability through intuitive gesture recognition.
Patent Information
- Application Number
- PCT/EP2025/067737
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-06-26
- Filing Date
- 2025-06-24
- Publication Date
- 2026-01-02
AI Technical Summary
Existing vehicle authentication systems are cumbersome and time-consuming due to the need for manual interaction and additional verification methods, leading to reduced convenience and potential access delays.
A method using a motion or gesture sensor, preferably a radar-based system, to detect and analyze user gestures for authentication, enabling secure and convenient access by recognizing individual movement patterns and signatures.
Enhances security and convenience by allowing intuitive gesture-based authentication, reducing the need for manual input and improving user experience while ensuring personalized vehicle access and control.
Smart Images

Figure EP2025067737_02012026_PF_FP_ABST
Abstract
Description
[0001] Description
[0002] Methods for authenticating at least one or more users
[0003] The present invention relates to a method for authenticating at least one or more users. The invention further relates to a device, a gesture sensor, and a computer program.
[0004] State of the art
[0005] It is known from the prior art that radar sensors are used in vehicles to detect objects and measure distances. This technology enables, for example, improved driver assistance through adaptive cruise control and collision avoidance systems.
[0006] Furthermore, it is known that access systems, such as NFC technology, are widely used to increase safety and convenience in vehicles. These systems enable fast and secure identification and authentication of individuals.
[0007] Disclosure of the invention
[0008] A common disadvantage of access systems is reduced convenience due to the required user interaction, such as operating an electronic vehicle key or placing an authentication device on a receiver, which can be perceived as cumbersome or time-consuming.
[0009] Two-factor authentication can also introduce additional overhead, as the user must provide a second form of verification in addition to their password, such as a code sent via SMS or the use of an authentication token. This can lead to access delays and requires the user to have access to the secondary authentication method.
[0010] It is therefore an object of the present invention to at least partially overcome the disadvantages described above. In particular, it is an object of the present invention to enable improved, more secure and / or more convenient authentication.
[0011] The invention relates to a method with the features of claim 1, a
[0012] A device with the features of claim 11, a gesture sensor with the features of claim 12, and a computer program with the features of claim 15. Further features and details of the invention will become apparent from the respective dependent claims, the description, and the drawings. Features and details described in connection with the method according to the invention naturally also apply in connection with the device, the gesture sensor, and the computer program according to the invention, and vice versa, so that a reciprocal reference is always possible with regard to the disclosure of the invention.
[0013] The invention relates in particular to a method for authenticating at least one or more users of a vehicle, preferably a stationary vehicle, using a motion sensor and preferably a gesture sensor, preferably of the vehicle itself. The motion sensor can therefore be arranged and, in particular, attached to the vehicle, and thus be part of the vehicle.
[0014] The vehicle can be designed as a motor vehicle and / or passenger vehicle and / or truck and / or at least partially autonomous vehicle.
[0015] The method can include the acquisition of motion and, in particular, gesture data. The motion or gesture data can result from the detection of at least one movement, and especially one gesture, by the motion and preferably gesture sensor. The detection of the at least one movement or gesture can be enabled, for example, by radar detection, in which the motion or gesture data results from radar signals and preferably comprises at least one radar image. The radar image is, for example, at least a two-dimensional radar image of the vehicle's surroundings.
[0016] The detected movement or gesture data can result, for example, from an analog-to-digital conversion of received radar signals. The received radar signals may have been reflected by the movement / gesture or the user performing the movement / gesture and then detected by a receiving antenna of the sensor.
[0017] Furthermore, it may be possible for the process to be executed in real time, thus enabling a rapid response to the detected movements.
[0018] Furthermore, the method can include evaluating the acquired movement or gesture data with regard to at least one characteristic of the at least one movement / gesture in order to recognize an individual signature based on this at least one characteristic. This at least one characteristic can, for example, relate to a speed, an acceleration, and / or a direction of movement. For instance, the characteristic could be the maximum acceleration reached during the movement or the direction in which the gesture is performed. Preferably, a pattern composed of several characteristics and their sequence serves to determine the individual signature. This allows for the recognition of an individual signature that makes it possible to attribute the movement or gesture to a specific person.
[0019] The process can then include comparing the recognized signature with at least one predefined signature in order to assign the at least one movement / gesture to the user or at least one of the users. The predefined signature can, for example, be implemented as a digitally stored template. The comparison can be performed as a digital similarity analysis. An assignment to a specific user can then occur, for example, if a similarity is detected that exceeds a certain threshold (e.g., 90% match).
[0020] Furthermore, the procedure may include: initiating at least one vehicle action depending on the fact that at least one movement / gesture could be successfully assigned to the user or at least one of the users.
[0021] In other words, the inventive method allows gesture data to be evaluated for authentication, wherein the gesture data is preferably captured by at least one gesture sensor of the vehicle. In this way, authentication by signature recognition using a gesture sensor can not only increase the security level of a stationary vehicle but also enhance user comfort. The invention is based on the understanding that gestures can exhibit features that indicate individual differences between users performing a gesture. In other words, gestures possess individual characteristics that can be evaluated to identify the user and thus enable authentication. The features described above can represent these individual characteristics, e.g.,in the form of movement patterns and / or movement speed or acceleration and / or posture and / or a sequence of gestures.
[0022] The analysis of these features thus enables the identification of a person based on their individual movement signature. The recognized signature can then be compared with a predefined signature to assign it to the user(s). Based on this assignment, a vehicle action can be initiated, such as opening the front or rear hatch, a vehicle door, or controlling a display, lights, climate control, and comfort functions.
[0023] Furthermore, the use of a gesture sensor with radar technology allows for particularly reliable recognition of gestures such as foot, leg, hand or elbow gestures, enabling simple and user-friendly authentication.
[0024] The ability to recognize various gestures also allows the user to optionally activate specific functions, such as controlling music or the navigation system, by selecting the appropriate gesture. This enables personalized vehicle use and reduces the need to familiarize oneself with different manual operating methods.
[0025] The use of a gesture sensor with radar technology can also enable the recognition of gestures and features during movements such as raising a hand or lowering the head. This can help to better attribute signatures to users and thus further increase security.
[0026] A gesture can be understood as a movement or series of movements performed, for example, with the hands or arms, but possibly also with other body parts such as the leg or foot, and which communicates a specific meaning or intention. In the specific vehicle-related context, this could be, for example, the activation of a vehicle action such as unlocking or opening. Features and details described below in connection with one or more "gestures" also apply equally to one or more "movements." The gesture sensor can therefore also be designed more generally as a motion sensor. The motion sensor can also be implemented as a radar sensor. When a sensor is referred to generally below, the corresponding features and details also apply to the motion, gesture, and radar sensors.
[0027] Furthermore, it may be possible to use the assignment of at least one movement / gesture to the respective user as one of the authentication levels of a multi-factor, and preferably two-factor, authentication process to authenticate the user to the (particularly stationary) vehicle, preferably limited to the state of the vehicle being stationary and / or to the detection of at least one movement / gesture in the environment outside the vehicle, preferably when the respective user approaches the vehicle. It may be stipulated that at least one further authentication level must also be successfully completed for the vehicle action to be initiated. As with multi-factor authentication, in other words, all authentication levels must be cumulatively present for the vehicle action to be initiated. This further increases the security of user authentication.
[0028] By using a gesture sensor, an individual signature can be recognized and compared to ensure that only authorized persons have access to the vehicle. Additionally, this authentication level can be implemented as part of multi- or two-factor authentication for even greater security. Capturing gestures in the environment outside the vehicle enables secure and controlled user authentication, especially as the user approaches the vehicle.
[0029] Furthermore, implementing a radar sensor as a gesture sensor allows for simple and secure installation on the vehicle, for example on the door handle, A-pillar, or B-pillar. This provides easy access for users and increases usability.
[0030] Furthermore, the system or gesture sensor can be used alternatively or additionally as an assistance system for a user or other pedestrians, or as an anti-theft device and / or alarm system. For example, by recognizing certain hand or foot gestures, the vehicle can assess the behavior of pedestrians in the vicinity. An alarm can also be triggered if recognized gestures cannot be attributed to a known user. The alarm can be, for example, an audible and / or visual alarm from the vehicle. Another alarm option is to notify a contact point, such as the vehicle owner, for example, via smartphone.
[0031] Additionally, the sensor / gesture sensor can also serve as a communication device with various vehicle modules. For example, certain hand or foot gestures can trigger the activation of a warning light at the rear of the vehicle if there is a risk of an accident. Or one of the gestures can trigger the start of the air conditioning system.
[0032] The integration of machine learning algorithms also enables the sensor to develop learning functions. For example, it can recognize the individual movement patterns of a specific user and automatically adjust to achieve a higher recognition rate. Alternatively, it can analyze detected error patterns and take corrective action, such as changing the sensor's parameters, particularly those of a gesture sensor. Using wireless technology, movements, and especially gestures, can also be communicated between different vehicles or with a central server. This allows for even greater security and flexibility, for example, through the use of encryption techniques or by verifying authentication data on a server. At least one of the process steps can be performed externally, e.g., on a server, rather than within the gesture sensor itself.
[0033] A further advantage of the invention can be achieved if the gesture data results from the detection of at least one gesture by the gesture sensor and optionally further gesture sensors of the vehicle. The gesture data can be implemented as radar data. Preferably, the respective gesture sensor can be designed as a radar sensor that detects the at least one gesture in the environment outside the vehicle and preferably only when the vehicle is stationary. In this way, it is possible for the gesture data to be generated in the form of radar data by the detection of one or a combination of several gesture sensors. The acquired radar data can then serve as the basis for evaluation. The use of a radar sensor allows for particularly accurate detection of movements and gestures, especially when the vehicle is stationary, and potentially also enables the identification of other movements and gestures.This is also made possible by gesture characteristics such as movement speed. Furthermore, the use of radar-based technology for the gesture sensor allows the system to operate accurately even in turbulent environments or low-light conditions, making it particularly suitable for automotive applications. In addition, the system can be expanded by adding further similar and / or different sensors (sensor fusion) to capture a wide variety of movements / gestures and / or other sensing parameters.
[0034] Furthermore, within the scope of the invention, it is conceivable that, in addition to assigning at least one movement / gesture to the respective user, at least one of the following is provided as a further authentication level: a verification of a password and / or a cryptographic key and / or a biometric feature and / or an electronic feature, e.g., a mobile ID transmitter (e.g., a smartphone).electronic key or smartphone), an evaluation of at least one gesture and / or facial expression of the user at a later time while the vehicle is moving, in particular to further verify authentication, an evaluation of a driving movement and / or characteristic of the vehicle at a later time while the vehicle is moving, in particular to further verify authentication, an evaluation of image and / or video and / or audio data resulting from sensory detection of the at least one user and / or the vehicle's environment, a verification of a voice signature resulting from sensory detection of the at least one user and / or the vehicle's environment, facial recognition of at least one user, an evaluation of a pattern indicated by the at least one gesture.
[0035] In this way, in addition to assigning at least one gesture to the respective user, at least one further authentication factor can be used as an additional authentication level. This further authentication level can contribute to increasing the security and reliability of the authentication process. This has the advantage that the procedure offers a significant increase in the security and reliability of authentication.
[0036] In addition to authentication, the process can also help improve the user experience. The simple and intuitive gesture-based operation allows the user to quickly and easily access various vehicle functions.
[0037] Preferably, within the scope of the invention, it may be provided that the at least one initiated vehicle action comprises at least one of the following vehicle actions:
[0038] Opening or closing a front or rear hatch or door of the vehicle,
[0039] Unlocking a front or rear hatch or door of the vehicle,
[0040] Setting a display device in the vehicle,
[0041] Setting the vehicle's lighting configuration,
[0042] Adjusting the vehicle's air conditioning, and preferably switching the vehicle's heating or cooling systems on or off,
[0043] Setting comfort functions of the vehicle, setting a user-specific pre-configuration of the vehicle, preferably by adjusting seat and / or rear seat settings,
[0044] Adjusting the vehicle's driving behavior,
[0045] Control of an input and / or output device, preferably a display, of the vehicle, which is preferably located on the outside of the vehicle and / or is intended for operation from the environment outside the vehicle,
[0046] User settings selections for the vehicle.
[0047] The respective vehicle action, and in particular the respective setting, can preferably be determined based on the user preferences of the assigned user. This offers the advantage that vehicle actions and settings can be individually adapted to the respective (assigned / identified) user. This enables personalized operation and increases user comfort. Furthermore, different user profiles can be created to cover varying requirements and preferences. The predefined signatures and / or profiles can also be used to restrict or expand access to specific vehicle functions.
[0048] Another possibility is that, based on the assignment of at least one gesture to the respective user and / or based on a classification of at least one gesture, an automated decision is made as to which of several vehicle actions are initiated, particularly depending on a predefined assignment of various predefined gestures to corresponding vehicle actions. The classification can preferably include a classification of a movement pattern. Furthermore, preferably at least one of the predefined gestures can be used to open a front or rear hatch or a door of the vehicle. Additionally, at least one other of the predefined gestures can be used to unlock, lock, or close the hatch / door. This offers a simple and safe way to control various functions in a (stationary) vehicle.Automated decision-making can also increase user-friendliness by eliminating the need for manual input to trigger the function. Classifying movement patterns also ensures that user gestures can be reliably recognized. This classification can be performed, for example, using a pattern recognition algorithm. Alternatively or additionally, further parameters can be considered for automated decision-making. One possible parameter is the placement of the gesture sensor on the vehicle. A different vehicle action can be triggered when a gesture is performed on the door handle or on the A- or B-pillar, compared to when the gesture is detected on the tailgate. Similarly, a different vehicle action can be executed when a gesture is detected on the left side of the vehicle compared to when it is detected on the right side.This flexibility allows the application to be adapted to different requirements and needs.
[0049] The flexible installation of the gesture sensor at various locations on the vehicle allows for a wide range of applications. For example, the gesture sensor can be installed on the door handle to control access to the vehicle's interior, or at the front or rear of the vehicle to control the opening of a hatch or tailgate, or on an A- or B-pillar to control access to the roof rack or other high-lying parts of the vehicle.
[0050] Optionally, the evaluation can take into account a temporal sequence of movements during the gesture and / or a sequence of multiple gestures in order to recognize the individual signature. Preferably, the individual signature can include a movement signature. This results in a higher accuracy in recognizing the individual signature when evaluating the acquired gesture data.
[0051] It can be advantageous if, within the scope of the invention, the gesture is recognized as a hand / arm and / or leg / foot gesture. This variety of possible gestures allows the authentication process to be designed flexibly and adaptably to the needs of the users and / or the vehicle action to be initiated. Additionally, the gesture sensor can also be used to execute complex commands, such as closing the doors and tailgate according to a specific pattern or activating the parking assistant through a particular movement. This enables a further increase in safety and convenience.
[0052] Optionally, the individual movement signatures of multiple people can also be captured and stored. This enables simple and secure authentication, even for groups of people who need access to the vehicle.
[0053] It is also possible that the comparison process includes the following steps:
[0054] Retrieving the predefined signatures of multiple users from a data source,
[0055] The system checks whether the recognized signature matches the specified signatures in order to assign the recognized signature to at least one user, thereby authenticating that user. If the assignment is successful, the individual authentication stage can be considered successfully completed. Depending on the successful completion of at least one further authentication stage according to another authentication factor, the system may then retrieve user preferences based on the assignment. These user preferences can be used to initiate the vehicle action. Specifically, the vehicle action can be initiated according to the retrieved user preferences.
[0056] The invention therefore offers the possibility of increasing the safety and reliability of vehicle actions through the implementation of multi-stage authentication. The gesture sensor can not only confirm the user's identity but also take their settings and preferences into account. For example, the air conditioning or music system can be automatically adjusted to the user's taste.
[0057] Furthermore, within the scope of the invention, it is optionally possible for the sensor / gesture sensor to automate the detection, evaluation, comparison, and / or initiation processes. In addition, the sensor / gesture sensor can also be used to supplement other authentication methods, such as one-time passwords or biometric data. Combining multiple authentication methods can further enhance the security of the system.
[0058] The invention also relates to a data processing device configured to execute the method according to the invention, preferably comprising means for carrying out the steps of the method according to the invention. Thus, the data processing device according to the invention offers the same advantages as those described in detail with reference to a method according to the invention.
[0059] The invention also relates to a computer program, in particular a computer program product, comprising instructions that, when executed by a computer, cause the computer to execute the method according to the invention. The computer program according to the invention thus offers the same advantages as those described in detail with reference to a method according to the invention. Furthermore, the computer program can be at least partially non-volatile and / or available as downloadable software and / or as a cloud service and / or as an executable program and / or as a configuration file and / or as a program library and / or as source code and / or in compiled and / or encrypted and / or compressed form and / or in a combination thereof. The computer can be a data processing device, preferably the data processing device according to the invention.
[0060] The device for data processing according to the invention, and preferably the computer, can be configured to execute the computer program according to the invention.
[0061] For this purpose, the device according to the invention can have at least one processor for data processing. A non-volatile data storage medium can also be provided in which the computer program is stored and from which the computer program can be read by the processor for execution.
[0062] It is also conceivable that the data processing device according to the invention comprises at least one integrated circuit such as a microprocessor, an application-specific integrated circuit (ASIC), an application-specific standard product (ASSP), a digital signal processor (DSP), a field-programmable gate array (FPGA), a microcontroller, or the like. The data processing device according to the invention may further comprise at least one interface for data exchange, e.g., an Ethernet interface, an interface for LAN (Local Area Network), WLAN (Wireless Local Area Network), a system-on-a-chip (SoC), or another radio interface such as Bluetooth.
[0063] The device according to the invention may feature near-field communication (NFC). Furthermore, the data processing device according to the invention can be implemented as one or more control units, i.e., also as a system of control units. The data processing device according to the invention can also be fully or partially located in a cloud and / or as a server in order to provide data processing for a local application via the interface. Accordingly, the data processing device according to the invention can also be designed as a distributed system. It is also possible for the data processing device according to the invention to be implemented as a mobile device, such as a smartphone.
[0064] The invention may also include a computer-readable storage medium comprising the computer program according to the invention. The storage medium is, for example, designed as a data storage device such as a hard drive and / or non-volatile memory and / or a memory card. The storage medium can, for example, be integrated into the computer and / or into the data processing device according to the invention.
[0065] Furthermore, the method according to the invention can also be implemented as a computer-implemented method. Alternatively or additionally, each or all of the disclosed method steps can optionally be computer-implemented and / or automated. The invention also relates to a motion and preferably gesture sensor for a vehicle. The sensor can be designed to detect movements / gestures and to authenticate at least one user in the vehicle, particularly when stationary. For this purpose, the sensor can include a data processing device according to the invention. Thus, the motion or gesture sensor according to the invention offers the same advantages as those described in detail with reference to a method and a device according to the invention.
[0066] It may be advantageous for the motion and preferably gesture sensor to be designed for integration into at least one of the following vehicle components: a door handle, at least one vehicle pillar, preferably an A- and / or B- and / or C-pillar, a headlight, on both sides or on several sides of the vehicle, at least one flap, preferably a front and / or rear flap, located on the outside of the vehicle, located on the inside of the vehicle,
[0067] Sills,
[0068] Bumpers
[0069] Exterior cladding,
[0070] Vehicle pillar trim.
[0071] By integrating the gesture sensor into various vehicle components, such as door handles, pillars, headlights, or tailgates, it enables simple and intuitive operation. Furthermore, it is optionally possible to use the gesture sensor intuitively to control the vehicle's display, lights, climate control, and comfort functions, thereby improving usability and the driving experience.
[0072] Furthermore, it is conceivable that the motion and preferably gesture sensor is designed as a radar sensor. Using a radar sensor as a gesture sensor allows for high accuracy in gesture recognition even under challenging environmental conditions, thus increasing the system's reliability and safety. Moreover, using a radar sensor reduces power consumption compared to other sensor systems, thereby improving the vehicle's battery life. As a result, the solution according to the invention can offer the user a simple and convenient operating method without compromising safety and reliability.
[0073] The motion and preferably gesture and / or radar sensor can be arranged inside or on the vehicle, particularly in the area around the doors and / or tailgate, to detect movements / gestures such as hand, arm, foot or leg movements.
[0074] The sensor housing can preferably be made at least partially of radar-signal-transparent materials such as polycarbonate or acrylic glass to effectively transmit the radar signals. The geometric arrangement of the antennas of one or more sensors on the vehicle can be, for example, in a line or a circle, to detect a wide range of gestures at different distances and angles.
[0075] The housing may include fastening elements. These may be selected to enable stable and permanent mounting of the sensor to the vehicle, e.g., using screws or clamps.
[0076] A gesture recognition technology can utilize advanced algorithms, such as pattern recognition, to interpret radar data and translate it into usable input for the vehicle system. These algorithms can be tailored to identify specific movement patterns typically performed by users when they want to trigger certain commands or actions. For example, a hand gesture in front of the tailgate can be interpreted as a command to open it. The algorithms can also analyze features such as the speed, direction, and / or duration of the gestures to differentiate between various gestures and minimize misinterpretations.Additionally, the sensor / algorithm can be able to differentiate between the gestures of different users by analyzing features such as the shape and dynamics of the gestures, enabling personalized interaction and / or authentication by associating the gesture with the person. Examples of suitable algorithms include Support Vector Machines (SVMs) or decision trees.
[0077] It may be possible to determine motion and, in particular, gesture data resulting from the detection of at least one movement / gesture by the vehicle's (at least one or exactly one) motion or gesture sensor. The (respective) motion or gesture sensor may include one or more radar sensors.
[0078] It is conceivable that the respective sensor is integrated into a side mirror and / or the front bumper and / or the rear bumper and / or the bumper cover and / or the door handle and / or the sill and / or the vehicle pillar such as the A-, B- or C-pillar. This arrangement allows for optimal detection of movements or gestures in the immediate vicinity of the vehicle.
[0079] For example, at least one sensor in the door handle or side mirrors can detect hand gestures used to open or close the doors. Furthermore, at least one sensor in the door handle or vehicle pillar can detect locking or unlocking movements.
[0080] The sensor's mechanical design may include a robust and / or weatherproof housing that protects the sensor from dust, water, and mechanical impacts. The housing may be made of durable materials such as polycarbonate or metal and preferably has a protection rating of at least IP67. The sensor may be mounted on the vehicle in such a way that it is easily accessible for maintenance and replacement.
[0081] The radar sensor may operate in the frequency range of 76 GHz to 81 GHz, enabling high resolution and accuracy in motion and gesture detection. This frequency range allows for the use of smaller antennas while still ensuring precise motion detection. At least one radar sensor utilizes Frequency Modulated Continuous Wave (FMCW) technology, which emits continuous signals with varying frequencies and uses the reflected signals to measure distance and / or speed. Furthermore, the radar sensor's Doppler function can be used to precisely measure the relative speed of movements / gestures and / or objects.By analyzing the frequency shift between the emitted and reflected signal, the sensor can detect and differentiate movements, which is particularly advantageous for the accurate detection of hand and finger movements and other features of the gesture.
[0082] It is conceivable that various algorithms are used for gesture recognition. These include, for example, machine learning algorithms such as neural networks and support vector machines (SVMs), which are trained to recognize and classify specific gestures. These algorithms analyze the gesture data captured by the at least one radar sensor and identify patterns characteristic of certain gestures. Clustering algorithms can also be used to group the captured gesture data and recognize movement patterns.
[0083] It is possible that the processing of gesture data is further carried out by special algorithms that include noise reduction, signal amplification, and the extraction of relevant features. Fourier transforms can be used to analyze the frequency components of the received signals. Wavelet transforms can be used to analyze transient and non-stationary signals in order to extract precise information about the distance, speed, and direction of movement of gestures / objects.
[0084] The electronics of the respective sensor may include at least one high-frequency module and / or at least one signal processing unit and / or at least one communication interface. The high-frequency modules can generate and transmit radar waves, while the signal processing units can analyze the received echo signals. Communication interfaces such as CAN bus or Ethernet enable the integration of the sensor into the vehicle network and data exchange with other vehicle systems.
[0085] It is conceivable that the sensor design includes transmitting and receiving antennas integrated on a single circuit board. The antennas can be designed to offer high directivity and sensitivity. The use of multi-antenna systems (MIMO technology) enables improved spatial resolution and the simultaneous detection of multiple gestures, users, or objects. Adaptive algorithms can dynamically adjust the transmit power and receive sensitivity to achieve optimal results under varying environmental conditions. This comprehensive design and integration of radar sensors allows the vehicle to precisely detect gestures and movements and react accordingly, significantly improving safety and user-friendliness.
[0086] It is possible to design the respective sensor and its associated electronics to operate in an energy-efficient manner. This can be achieved through the use of low-power components and energy management algorithms that optimize energy consumption depending on the operating conditions. For example, the sensors could be put into an energy-saving mode when the vehicle is parked or in a low-traffic environment.
[0087] It is conceivable that the sensor in question has an automatic calibration function that ensures it always operates in an optimized state. This calibration can also be performed while driving or at regular intervals to compensate for deviations caused by aging or mechanical influences. Furthermore, the sensor may be equipped with self-diagnostic functions that continuously monitor its own condition and report any errors or maintenance requirements at an early stage.
[0088] The sensor may be designed to be modular and easily adaptable to different vehicle types and models. This can be achieved, for example, through various mounting options, adapters, and software configurations that allow for easy integration into different vehicle designs.
[0089] It is conceivable that the respective sensor is specifically designed for operation under extreme environmental conditions. This could be achieved through the use of temperature-resistant materials and special coatings that protect the sensors from corrosion and wear.
[0090] It is also possible that the sensor / gesture sensor is equipped with an interface, such as a wireless interface, to connect to a data source like a database. The data can be retrieved and optionally synchronized with the sensor's local data. This wireless interface can be implemented, for example, via cellular networks, Wi-Fi, or Bluetooth. The connection to the data source allows for the direct transfer of current software updates, calibration data, predefined signatures, and / or new gesture recognition profiles to the sensor. Additionally, sensor data can be sent in real time to an external data processing device to perform gesture and / or signature recognition, analysis, and / or optimization. Secure encryption of the data transmission can further ensure that communication is protected against unauthorized access.
[0091] It is conceivable that the respective sensor could be combined with other devices, such as a mobile ID transmitter (electronic vehicle key) or a smartphone, and / or with other sensor types such as cameras, ultrasonic sensors, or lidar sensors to perform sensor fusion. This data fusion enables more accurate and reliable gesture and object recognition by leveraging the strengths of the different sensor types. For example, radar and camera data can be combined to determine both the distance and the visual appearance of a user / object, which improves the accuracy and robustness of recognition, particularly the recognition of the signature and / or features of the gesture.
[0092] It can be implemented that a specific vehicle action is selected and executed depending on the detected movement or gesture. The movement and gesture recognition can identify specific movement patterns as signatures that are assigned to predefined vehicle actions. This enables intuitive control of various vehicle functions, for example, through simple hand gestures.
[0093] It's conceivable that the vehicle action could be the selection of a specific route or journey in the navigation system. For example, a hand movement to the left or right could display or select an alternative route in the navigation system, while an up or down movement changes the map zoom level. It's also possible that the vehicle action could be another vehicle setting. Examples include adjusting the climate control, the seat position, controlling the audio system, or opening and closing windows and doors. Gestures like circling the hand could adjust the audio system volume, while an upward movement could increase the air conditioning temperature.
[0094] Further advantages, features, and details of the invention will become apparent from the following description, in which exemplary embodiments of the invention are described in detail with reference to the drawings. The features mentioned in the claims and in the description can each be essential to the invention individually or in any combination. The drawings show:
[0095] Fig. 1 is a schematic representation to visualize embodiment variants of the invention.
[0096] Fig. 2 shows a further schematic representation for visualizing embodiment variants of the invention.
[0097] Fig. 3 is a visualization of a method according to embodiment variants of the invention.
[0098] In the following figures, identical reference numerals are used for the same technical features even for different embodiments.
[0099] Fig. 1 shows a schematic relationship between the various components according to embodiments of the invention, which enable authentication and control of a vehicle 50 by human gestures.
[0100] A vehicle 50 is stationary, for example, in a parking lot. Various gesture sensors 40 are positioned around the vehicle 50 to monitor its surroundings 5 and recognize a user 20. A control unit 55 can be provided for central control and data processing tasks on the vehicle 50. Authentication can be performed at least partially by the control unit 55 and / or, if applicable, also by the gesture sensor 40. Therefore, at least part of the data processing device 10 can optionally be integrated into the gesture sensor 40.
[0101] In addition to gesture sensors 40, further sensors 40 can also be provided and mounted in various positions on the vehicle 50 to detect the environment 5 and the user 20. These include, for example, sensors 40 for voice signature or facial recognition, and others.
[0102] Figure 2 shows a device 10 for data processing with further details. In the example shown, the device 10 is wholly or partially part of the gesture sensor 40. In alternative versions, the device 10 can also be part of the control unit 55 or be located externally from the vehicle 50, e.g., in a cloud server. To carry out the method 100, the device 10 can include a computer program 15 according to exemplary embodiments of the invention.
[0103] Figure 3 shows a method 100 according to exemplary embodiments of the invention for authenticating at least one or more users 20 in a stationary vehicle 50. For this purpose, a gesture sensor 40 of the vehicle 50, as shown in Figure 1, is used. According to a first method step 101, the method 100 comprises determining gesture data resulting from the detection of at least one gesture by the gesture sensor 40 of the vehicle 50 (see Figure 1). According to a second method step 102, the determined gesture data is evaluated with respect to at least one feature of the at least one gesture in order to recognize an individual signature based on this at least one feature. According to a third method step 103, the recognized signature is compared with at least one predefined signature in order to assign the at least one gesture to the user or at least one of the users 20.At least one predefined signature can be retrieved from a data source 16 (see Fig. 2). The data source 16 can be located, for example, in a data processing device 10 for executing the method 100, in a central control unit 55 of the vehicle 50 (see Fig. 1), or externally from the vehicle 50. Finally, after a fourth method step 104, at least one vehicle action is initiated, depending on whether the at least one gesture could be successfully assigned to the user or at least one of the users 20. The vehicle action can, for example, involve unlocking or opening a vehicle door or tailgate 30.
[0104] The preceding explanation of the embodiments describes the present invention solely by way of examples. Naturally, individual features of the embodiments can be freely combined with one another, provided this is technically feasible, without departing from the scope of the present invention. List of reference numerals
[0105] Vicinity
[0106] device
[0107] Computer program
[0108] Data source
[0109] user
[0110] door, flap
[0111] Sensor, gesture sensor
[0112] vehicle
[0113] control unit
[0114] Procedure first procedural step second procedural step third procedural step fourth procedural step
Claims
Claims 1. Method (100) for authenticating at least one or more users (20) in a stationary vehicle (50) using a gesture sensor (40) of the vehicle (50), comprising: Determine (101) gesture data resulting from the detection of at least one gesture by the gesture sensor (40) of the vehicle (50), - Evaluating (102) the determined gesture data with regard to at least one feature of the at least one gesture in order to identify an individual signature based on the at least one feature, Comparing (103) the recognized signature with at least one predefined signature in order to assign at least one gesture to the user or at least one of the users (20), Initiate (104) at least one vehicle action depending on the fact that at least one gesture could be successfully assigned to the user or at least one of the users (20).
2. Method (100) according to claim 1, characterized in that the assignment of the at least one gesture to the respective user (20) is carried out as one of the authentication levels of a multi-factor and preferably 2-factor authentication for the authentication of the user (20) at the stationary vehicle (50), preferably limited to the state of the stationary vehicle (50) and to the detection of the at least one gesture in the environment (5) outside the vehicle (50), preferably when the respective user (20) approaches the vehicle (50), wherein the at least one further authentication level must also be successfully completed in order for the vehicle action to be initiated.
3. Method (100) according to one of the preceding claims, characterized in that the gesture data results from the detection of at least one gesture by the gesture sensor (40) and optionally further gesture sensors (40) of the vehicle (50), wherein the gesture data is implemented as radar data, and wherein preferably the respective gesture sensor (40) is designed as a radar sensor which detects the at least one gesture in the environment (5) outside the vehicle (50) and preferably only when the vehicle (50) is stationary.
4. Method (100) according to one of the preceding claims, characterized in that, in addition to assigning the at least one gesture to the respective user (20), at least one of the following is provided as a further authentication stage: verification of a password and / or a cryptographic key and / or a biometric feature and / or an electronic feature, evaluation of at least one gesture and / or facial expression of the user (20) at a later time while the vehicle (50) is moving, evaluation of a driving movement and / or property of the vehicle (50) at a later time while the vehicle (50) is moving, evaluation of image and / or video and / or audio data resulting from sensory detection of the at least one user (20) and / or the environment of the vehicle (50), verification of a voice signature,which results from sensory detection of the at least one user (20) and / or the vehicle's environment (50), facial recognition of the at least one user (20), and evaluation of a pattern specified by at least one gesture. Method (100) according to one of the preceding claims, characterized in that the at least one initiated vehicle action comprises at least one of the following vehicle actions: Opening or closing a front or rear hatch (30) or door (30) of the vehicle (50), Unlocking a front or rear hatch (30) or door (30) of the vehicle (50), Setting a display device in the vehicle (50), Setting a vehicle lighting configuration (50), Setting the vehicle's air conditioning (50), and preferably switching the vehicle's heating or cooling devices on or off (50), Setting vehicle comfort functions (50), Setting a user-specific pre-configuration of the vehicle (50), preferably by adjusting seat and / or rear seat settings, Adjusting the vehicle's driving behavior (50), Control of an input and / or output device, preferably a display, of the vehicle (50), which is preferably located on the outside of the vehicle (50) and / or is intended for operation from the environment outside the vehicle (50), - Selection of user settings for the vehicle (50), wherein the respective vehicle action and in particular the respective setting is preferably dependent on a user preference of the assigned user (20).
6. Method (100) according to one of the preceding claims, characterized in that, based on the assignment of the at least one gesture to the respective user (20) and / or based on a classification of the at least one gesture, an automated decision is made as to which of the several vehicle actions are initiated, depending on a predetermined assignment of various predetermined gestures to associated vehicle actions, wherein the classification preferably comprises a classification of a movement pattern, wherein preferably at least one of the predetermined gestures is provided for opening a front or rear hatch or a door of the vehicle (50), and at least one other of the predetermined gestures is provided for unlocking or locking or closing the hatch / door.
7. Method (100) according to one of the preceding claims, characterized in that the evaluation (102) takes into account a temporal sequence of movements during the gesture and / or a sequence of several gestures in order to recognize the individual signature, wherein the individual signature preferably comprises a movement signature.
8. Method (100) according to one of the preceding claims, characterized in that the gesture is recognized as a hand / arm and / or leg / foot gesture.
9. Method (100) according to one of the preceding claims, characterized in that the comparison (103) further comprises the following steps: - Retrieving the predefined signatures of multiple users from a data source (16), Checking whether the recognized signature matches the specified signatures in order to assign the recognized signature to at least or exactly one of the users, and thereby authenticate the user, whereby in the case of a successful assignment the individual authentication level is considered successfully completed and, in particular depending on a successful completion of at least one further authentication level according to a further authentication factor, a retrieval of user specifications based on the assignment is provided, which are used for initiating the vehicle action, and in particular the vehicle action is initiated according to the retrieved user specifications.
10. Method (100) according to one of the preceding claims, characterized in that the detection (101) and / or evaluation (102) and / or comparison (103) and / or initiation (104) are carried out automatically by the gesture sensor (40).
11. Device (10) for data processing, which is configured to perform the method (100) according to one of the preceding claims.
12. Gesture sensor (40) for a vehicle (50), for recognizing gestures and for authenticating at least one user (20) in the stationary vehicle (50), comprising a device (10) for data processing according to claim 11.
13. Gesture sensor (40) according to claim 12, characterized in that the gesture sensor (40) is designed for integration into at least one of the following vehicle components: A door handle, At least one vehicle pillar, preferably an A- and / or B- and / or C-pillar, A headlight, On both sides or on several sides of the vehicle (50), At least one flap, preferably the front and / or rear flap, - Located on the outside of the vehicle, Located inside the vehicle, Sills, Bumpers - Exterior cladding, Vehicle pillar trim.
14. Gesture sensor (40) according to claim 12 or 13, characterized in that the gesture sensor (40) is designed as a radar sensor.
15. Computer program (15) comprising instructions which, when the computer program (15) is executed by a computer, cause it to execute the method (100) according to any one of claims 1 to 10.
Citation Information
Patent Citations
Vehicle control methods, devices, equipment, and media based on external gestures
CN113696851B
Method, control method and system for controlling vehicle from outside vehicle, and vehicle
CN113799733A
System i.e. park assistance system, for controlling movement of motor car from outside by user, has control unit arranged according to detected gesture for controlling recognized gesture associated with movement of motor car
DE102012216174A1
User authentication using mm-wave sensor for automotive radar systems
EP3690485A1
Radar-based authentication
US10503883B1