Locking system for a motor vehicle
The locking system for motor vehicles uses a control unit and wearable key unit with image processing to enable secure and convenient gesture-based control, addressing limitations in existing systems by enhancing user convenience and security through gesture recognition and facial authentication.
Patent Information
- Application Number
- DE202022003093
- Authority / Receiving Office
- DE · DE
- Patent Type
- Utility models
- Current Assignee / Owner
- Filing Date
- 2022-04-19
- Publication Date
- 2024-11-21
- Estimated Expiration
- 2032-04-30
AI Technical Summary
Existing motor vehicle locking systems are limited in convenience, simplicity, and security, particularly in gesture-based control and access recognition.
A locking system for motor vehicles that integrates a control unit and a wearable key unit for wireless communication, combined with an image generation and processing unit to identify users through gestures, facial expressions, and body positioning, enabling secure and convenient control via predefined commands.
Enhances user convenience and security by allowing gesture-based control of vehicle functions, including unlocking doors and starting the engine, while integrating facial recognition for enhanced authentication.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[0001] The invention relates to a locking system for a motor vehicle for, in particular, gesture-based control or access recognition on a motor vehicle.
[0002] In principle, locking systems are known in the prior art and, for example, from documents DE 10 2019 008 962 A1 or DE 43 40 260 A1 which are based on a radio key that communicates with the vehicle, by which an authorized user of the vehicle can be identified and the vehicle can be unlocked, for example, by pressing a button on the radio key or on the vehicle.
[0003] Furthermore, the documents US 2020 / 0269 808 A1, US 2016 / 0300 410 A1, DE 10 2018 103 785 A1, DE 10 2018 204 082 A1, DE 10 2021 200 557 A1 and DE 10 2017 204 078 A1 as well as US 2020 / 238952 A1, US 2008 / 224836 A1 and US 2018 / 290627 A1 also represent relevant state of the art in this field.
[0004] The present invention aims to expand, simplify, and also make safer the possibilities for controlling the motor vehicle and, in particular, for unlocking the motor vehicle.
[0005] The invention is therefore based on the objective of making the control of a motor vehicle and in particular the access recognition more convenient, simpler and safer for the user.
[0006] This problem is solved by the combination of features according to claim 1.
[0007] According to the invention, a locking system for a motor vehicle is proposed for controlling the motor vehicle. The control preferably includes enabling and / or triggering a function of the motor vehicle and, in particular, locking and / or unlocking the motor vehicle. For this purpose, the locking system comprises a control unit and a user-worn key unit, which are configured to communicate wirelessly and preferably in encrypted form with each other for controlling the motor vehicle. The key unit can be, for example, a radio key, a fob, a mobile phone, or other suitable objects. According to the invention, the locking system also includes an image generation unit and an image processing unit connected to the control unit via a signal, i.e., enabling data exchange.The control unit and the image processing unit are designed to identify a person, in particular one captured by the image generation unit, as the authorized user, to capture the user's gestures and / or facial expressions and / or posture and / or body positioning, and to assign these to predetermined control commands for controlling the motor vehicle.
[0008] The basic idea is therefore to extend an access or locking system for a motor vehicle, which, for example, has a so-called "keyless" functionality, in such a way that the vehicle can be controlled by the user's body or by movements of the user's body. Such movements or movements can include, for example, gestures and / or facial expressions and / or posture and / or body positioning or orientation of the user.
[0009] In a simple case, the user can, for example, unlock the vehicle with a gesture, automatically open a door or trunk lid, or trigger another function of the vehicle.
[0010] It would also be conceivable to control the vehicle's movement via gestures. For example, the vehicle could be reversed out of a parking space using gesture control, with the vehicle starting to move when someone waves at it and stopping when someone signals a stop with their hand.
[0011] The control does not have to be limited to, for example, a single gesture. The image processing unit can store various gestures and / or facial expressions and / or body postures and / or body positions or orientations of the user, each of which is assigned a function or control signal for controlling the vehicle's function.
[0012] The image generation unit can include at least one camera and / or one lidar sensor and / or one radar sensor for image generation.
[0013] If the vehicle is equipped with additional driver assistance systems that include an image generation unit, their image generation unit can also be used. Examples include cameras used for surround view, traffic sign recognition, or automated driving.
[0014] Regardless of which components the image generation unit comprises, it is preferably designed to capture the hands, body and face of a person or user, as well as to recognize or capture their respective positioning and orientation and the movements taking place therein.
[0015] The image processing unit and the control unit can also be integrated.
[0016] To identify the user, the control unit is designed to determine the position and / or distance of the key unit relative to the control unit or a predetermined point. The predetermined point could, for example, be the origin of a vehicle coordinate system fixed to the vehicle.
[0017] For this purpose, a signal propagation time measurement between the key unit and the control unit is used, whereby the control unit can, for example, have several antennas in order to determine the position of the key unit from the differences in the signal propagation times between the key unit and the antennas.
[0018] Furthermore, it may be provided that the control unit is designed to identify a person as a user by evaluating the position and / or distance of the key unit and in particular by comparing it with an access zone predetermined relative to the control unit or the predetermined point, and / or to start an image generation by an image generation unit.
[0019] If the key unit or the person carrying the key unit moves into an area defined as an access zone, which in a simple case could be an area adjacent to a door or the trunk of a vehicle, the person can be assumed to be the authorized user and their movements can be evaluated.
[0020] Furthermore, the image processing unit is designed to determine the position and / or distance of a person relative to the control unit or a predetermined point.
[0021] The control unit and the image processing unit are additionally designed to capture gestures, facial expressions, posture, and / or body positioning of a person imaged by the image generation unit, compare these with a predetermined identifier stored in the control unit or the image processing unit—that is, a gesture, facial expression, posture, and / or body positioning of the user defined as a key or identifier—and identify the person as a user if the captured gestures and / or facial expressions match the stored identifier. For example, it might be possible for the person to wave to the vehicle or perform another hand movement as they approach it, thereby identifying themselves as a user.
[0022] This identification using an identifier can be combined with a position comparison between a person and a key unit. Specifically, the control unit can be configured to determine the position of the key unit, and the image capture unit can be configured to determine the position of a person. If the positions match, in combination with an identifier signaled by the person, the person is identified as the user.
[0023] Furthermore, the control unit and the image processing unit can also be configured to capture visible features, particularly of the face and / or the frontal head, of a person imaged by the image generation unit, compare these features with those of previously known users stored in the control unit, and identify the person as the user if the features match. This enables facial recognition, provided the relevant features are already known to the control unit. To increase security, facial recognition can be combined with other methods of user identification, such as comparing the positions of the person and the key and / or identification via a gesture.
[0024] Preferably, the control unit is further configured to control the motor vehicle by means of control commands and, in particular, to unlock the doors or lids of the motor vehicle and / or to start the motor vehicle's engine. In principle, however, a multitude of other functions of the motor vehicle can also be controlled.
[0025] The features disclosed above can be combined in any way, provided that this is technically possible and they do not contradict each other.
[0026] Other advantageous embodiments of the invention are characterized in the dependent claims or are described in more detail below together with the description of the preferred embodiment of the invention with reference to the figures. The figures show: Fig. 1 schematic view of a locking system; Fig. 2. Procedure for recording and assigning a gesture to a control command; Fig. 3. Procedure for storing statistical data for static gestures; Fig. 4. Procedure for storing statistical data for dynamic gestures.
[0027] In Fig. Figure 1 is an exemplary and schematic representation of a variant of a locking system 1 for a motor vehicle 2, by which the motor vehicle 2 can be controlled. The locking system 1 has a control unit 3 and a key unit portable by a user 4, which is not shown here but can be operated by the user 4. The control unit 3 and the key unit communicate wirelessly with each other to control the motor vehicle 2 in the sense of a keyless go or keyless entry system, which is indicated by a signal 7.
[0028] To extend the functionality of such a keyless go or keyless entry system, the locking system 1 further comprises an image generation unit 5 and an image processing unit 6, which is connected to the control unit 3 and the image generation unit 5 via signal transmission. This allows the image generation unit 5 to generate an image and transmit it to the image processing unit 6, which evaluates the image and transmits the result of the evaluation to the control unit 3. In this context, an image can be understood as a single image, a sequence of single images, or a video stream. Accordingly, the control unit 3 and the image processing unit 6 are configured to identify a person, particularly from a group of people, as a user or the authorized user 4, specifically by capturing their gestures and assigning the captured gestures to predetermined control commands for controlling the motor vehicle 2.
[0029] When approaching vehicle 2 on the driver's side, user 4 can, for example, unlock the driver's door with a hand gesture. Gesture 10 can also be simply raising the hand towards a door handle 8 of vehicle door 9. Similarly, when user 4 approaches the passenger side of vehicle 2, user 4 can unlock the passenger door 9 with gesture 10. Furthermore, user 4 can also unlock all doors of vehicle 2 or activate other functions of vehicle 2 with an alternative gesture.
[0030] The Fig. Figures 2 to 4 each show, by means of a flowchart-like representation, methods not belonging to the invention which may be implemented by the locking system according to the invention.
[0031] For the sake of clarity, sections Y and Z of the procedure are shown below. Fig. 2 in the Fig. 3 and Fig. 4 is shown, the procedure according to Fig. 2 even without the sections according to the Fig. 3 and Fig. 4 can be used.
[0032] The procedure according to Fig. Section 2 specifically includes sections X (image-based gesture recognition process), Y (training process for static gestures), and Z (training process for dynamic gestures). The following steps are performed in particular: A. Recognition of an authorized user 4 in an access zone of the vehicle 2. B Start of the image generation unit 5. C. Transmitting an image to the image processing unit 6. D Preprocessing for differentiating static or dynamic gestures, in particular capturing the gesture as a combination of features. E Is the gesture or combination of features captured by the image a static gesture (then s) or a dynamic gesture (then d)? sF Feature extraction from the static gesture or feature combination. dF Feature extraction from the dynamic gesture or feature combination. sG comparison with a feature matrix of static gestures, in which features for a large number of static gestures are stored. dG comparison with a feature matrix of dynamic gestures, in which features for a large number of dynamic gestures are stored. sH Statistical prediction of a static gesture. dH Statistical prediction of a dynamic gesture. Is this a first predetermined static gesture? If yes (1), then transmit a corresponding control command sL to the control unit 3. If no (0), then proceed to the next static gesture. dJ Is this a first predetermined dynamic gesture? If yes (1), then transmit a corresponding control command dL to the control unit 3. If no (0), then proceed to the next dynamic gesture. Is sK a last or nth predetermined static gesture? If yes (1), then transmit a corresponding control command sM to control unit 3. If no (0), then transmit a corresponding control command sN to control unit 3, which may also be an error message. Is dK a last or nth predetermined dynamic gesture? If yes (1), then transmit a corresponding control command dM to control unit 3. If no (0), then transmit a corresponding control command dN to control unit 3, which may also be an error message.
[0033] In steps sH and dH, statistical data is taken into account, which is collected by training a model or incorporated into the gesture selection. Since the exemplary processes shown for the training sequence of dynamic gestures Z and the training sequence of static gestures Y are identical in their execution, the Fig. 3 and Fig. 4 described together.
[0034] According to the Fig. 3 and Fig. 4. It is planned that essentially the following steps will be taken: A data acquisition of specific, static gestures ( Fig. 3) or dynamic gestures ( Fig. 4) of the authorized user 4 in particular as combinations of features. B. Compilation of training data. C Extraction of features for the individual gestures or feature combinations from the training data. D. Generation of a feature matrix from the extracted features. E Assignment of gestures and / or control commands to the gestures or feature combinations stored in the feature matrix by their features. F Training a model, especially a neural network. G Obtaining a trained model to predict a static gesture in step sH ( Fig. 3) or a dynamic gesture in step dH ( Fig. 4). H Evaluation of the model. J. Recording and consideration of metrics extracted during the evaluation.
[0035] The invention is not limited in its implementation to the preferred embodiments specified above. Rather, a number of variants are conceivable which make use of the solution presented even in fundamentally different designs. QUOTES INCLUDED IN THE DESCRIPTION
[0000] This list of documents cited by the applicant was automatically generated and is included solely for the reader's convenience. The list is not part of the German patent or utility model application. The DPMA accepts no liability for any errors or omissions. Cited patent literature
[0000] DE 10 2019 008 962 A1
[0002] DE 43 40 260 A1
[0002] US 2020 / 0269 808 A1
[0003] US 2016 / 0300 410 A1
[0003] DE 10 2018 103 785 A1
[0003] DE 10 2018 204 082 A1
[0003] DE 10 2021 200 557 A1
[0003] DE 10 2017 204 078 A1
[0003] US 2020 / 238952 A1
[0003] US 2018 / 290627 A1
[0003]
Claims
[1] Locking system (1) for a motor vehicle (2), wherein the locking system (1) comprises a control unit (3) and a key unit portable by a user (4), which are designed to communicate wirelessly with each other for controlling the motor vehicle (2), wherein the locking system (1) further comprises an image generation unit (5) and an image processing unit (6) connected to the control unit (3) by signal technology, wherein the control unit (3) and the image processing unit (6) are designed to identify a person as the user (4), to detect gestures and / or facial expressions and / or posture and / or body positioning of the user (4) and to assign these to predetermined control commands for controlling the motor vehicle (2) wherein the control unit (3) is designed to determine a position and / or distance of the key unit by means of a signal propagation time measurement relative to a predetermined point, wherein the image processing unit (6) is designed to determine a position and / or distance of a person relative to the predetermined point, wherein the control unit (3) and the image processing unit (6) are designed to compare the position and / or distance of the person with the position and / or distance of the key unit, and wherein the control unit (3) and the image processing unit (6) are designed to detect gestures and / or facial expressions and / or posture and / or body positioning of a person imaged by the image generation unit (5), to compare these with a predetermined identifier stored in the control unit (3) or the image processing unit (6), and to identify the person as a user (4) if there is a match and if the position and / or distance match. [2] Locking system according to claim 1, wherein the image generation unit (5) has at least one camera and / or a lidar sensor and / or a radar sensor for image generation. [3] Locking system according to claim 1 or 2, wherein the control unit (3) is designed to identify a person as a user (4) by evaluating the position and / or the distance of the key unit and in particular by comparison with an access zone predetermined relative to the control unit (3) or the predetermined point and / or to start an image generation by the image generation unit. [4] Locking system according to one of the preceding claims, wherein the control unit (3) and the image processing unit (6) are designed to detect visible features, in particular of the face and / or the frontal head of a person imaged by the image generation unit (5), to compare these with features of previously known users stored in the control unit and to identify the person as a user (4) if the features match.
Citation Information
Patent Citations
Method for controlling a locking element of a vehicle
DE102017204078A1
Automatic opening of a powered door if someone is present
DE102018103785A1
Procedures for operating a motor vehicle
DE102018204082A1
Locking system, especially for a motor vehicle
DE102019008962A1
Procedure for operating an access control unit
DE102021200557A1
