User recognition system for managing access to a motor vehicle

Abstract

User Recognition System for Managing Access to a Motor Vehicle The invention relates to a user recognition system for managing access to a motor vehicle (V1), the system comprising: - at least one image sensor (11), for imaging a scene outside the vehicle, with a low-power mode and an active mode; - an analysis module, performing facial recognition on images acquired by the image sensor, and generating an access authorization signal when the presence of a user (U0) authorized to access the vehicle is determined; - a radio frequency transceiver (13) and a signal processing module, for detecting the approach of a user (U0); and - a wake-up module, for switching the image sensor (11) from low-power mode to active mode when the approach of a user is detected. Figure 1B

Description

Title of the invention: User recognition system for managing access to a motor vehicle. TECHNICAL FIELD OF THE INVENTION

[0001] The technical field of the invention is that of user recognition, with a view to authorizing or not access to a motor vehicle depending on whether the user has access rights to that vehicle or not. TECHNOLOGICAL BACKGROUND OF THE INVENTION

[0002] Prior art exists user recognition solutions based on the use of a handheld electronic device storing an authentication key. When a user with the handheld electronic device approaches the vehicle, the device and the vehicle establish data communication. The vehicle thus obtains the authentication key stored in the handheld electronic device and compares this key with one or more authorized keys stored in the vehicle. An access authorization signal is generated when the authentication key stored in the handheld electronic device matches one of the authorized keys stored in the vehicle.

[0003] One drawback of these solutions is that they require the user to carry the portable electronic device in order to access the vehicle. To overcome these drawbacks, solutions based on facial recognition have been developed more recently. These solutions use one or more cameras mounted on the vehicle, combined with facial recognition algorithms. An access authorization signal is generated when the facial features in the acquired image match the facial features of an authorized user, as stored in the vehicle.

[0004] One disadvantage of solutions based on facial recognition is that they use cameras, powered by the vehicle's battery, and are much more energy-intensive than the communication devices used to communicate with a portable electronic device.

[0005] One objective of the present invention is to improve existing user recognition solutions for managing access to a motor vehicle. Summary of the invention

[0006] This objective is achieved with a user recognition system for access management, intended to be installed in a motor vehicle, and comprising: - at least one image sensor, configured to acquire at least one image of a respective scene located in use outside the vehicle; and - an analysis module, configured to receive as input images acquired by at least one image sensor, to perform image processing including a facial recognition step, and to generate a vehicle access authorization signal when the presence of a user authorized to access the vehicle is determined.

[0007] According to the invention, each image sensor has a so-called low power consumption operating mode, and a so-called active operating mode in which it acquires at least one image.

[0008] The system according to the invention further comprises: - at least one radio frequency transceiver, configured to emit a radio frequency signal and to receive a return signal resulting from the reflection, on a target, of the emitted radio frequency signal; - a signal processing module, configured to detect the approach of a user relative to the vehicle by analyzing said return signal; and - a wake-up module, configured to receive as input information relating to said approach detection, and to, in response, switch the operating mode of at least one image sensor from low power mode to active mode.

[0009] The invention thus proposes a solution based on facial recognition, making it possible to do without wearing a portable electronic device.

[0010] In order to overcome the limitations related to the energy consumption of image sensors, it is proposed that at least one image sensor, or camera, be placed by default in a low power mode, in which it does not acquire any image and therefore consumes very little energy.

[0011] To ensure that the image sensor is ready to acquire an image of the user when necessary, it is intended to switch to the so-called active operating mode, in which it acquires images of the surrounding scene, upon command from a wake-up module. The wake-up module uses for this purpose information relating to an approach detection, obtained using a radio frequency signal reflected off a user forming a moving target.

[0012] It is understood that the at least one radio frequency transceiver used to wake up the image sensor is permanently activated, or at least for a time period much longer than the active operating range of the image sensor. However, the impact on energy consumption is negligible since the energy consumption of a radio frequency transceiver is very low, much lower than that of an image sensor.

[0013] The invention thus makes it possible to benefit from the practical advantages of facial recognition, while avoiding excessive strain on the vehicle's battery.

[0014] It is thus possible, in particular, to use a plurality of image sensors observing different scenes all around the vehicle, without putting particular strain on the vehicle's battery.

[0015] Furthermore, the invention does not require the addition of additional devices, since motor vehicles are usually equipped with radio frequency transceivers intended, for example, to perform at least one function among obstacle detection, gesture detection, two-way communication, etc.

[0016] Preferably, the analysis module is configured to perform image processing, including facial biometrics, and to generate a vehicle access authorization signal when the presence of an authorized user is determined using this facial biometrics. Facial biometrics here refers to facial recognition accompanied by additional processing to ensure optimal user recognition reliability. This can also be referred to as facial recognition authentication. The additional processing includes, for example, the retrieval of specific points and measurements related to a person's face.

[0017] Advantageously: - the analysis module also includes an active operating mode, in which it analyzes images from the image sensor and performs at least one facial recognition on these images, and a low-power operating mode, in which it consumes less energy and does not analyze said images; and - the wake-up module is further configured to switch the operating mode of the analysis module from its low-power mode to its active mode, in response to the receipt of information relating to said approach detection.

[0018] The gain in terms of energy saving is thus further improved, the average energy consumption of the computers being minimized.

[0019] Preferably, the system according to the invention further comprises a presence sensor, configured to detect the presence of a user in the immediate vicinity of the vehicle, and the wake-up module is configured to receive input information relating to said presence detection, and to switch the operating mode of at least one image sensor when it determines that a user is approaching the vehicle and then that a user is present in the immediate vicinity of the vehicle. This variant ensures that the image sensor only acquires images of the scene in response to a request from the user, this request being materialized by a gesture until the user is in the immediate vicinity of the vehicle (less than 3 cm), preferably until contact with the vehicle.

[0020] The presence sensor may include at least one piezoelectric sensor.

[0021] Alternatively, the presence sensor may include a mechanical actuator belonging to a motor vehicle door handle. This may be a push button located outside the vehicle for use, or any other mechanical device linked to the standard vehicle opening mechanism by operating a handle.

[0022] According to another variant, the presence sensor may include at least one capacitive sensor.

[0023] Advantageously, the at least one radio frequency transceiver comprises a plurality of radio frequency transceivers, each associated with a respective detection zone. These may be UWB anchors, distributed, for example, at the four corners of the vehicle or in a "diamond" pattern (in the middle of each side of the vehicle). Each of said radio frequency transceivers is advantageously configured to emit an Ultra Wideband radio frequency signal, with a frequency spectrum of 200 MHz or more.

[0024] Advantageously, the system according to the invention comprises at least two image sensors, each associated with a respective field of vision around the vehicle, and: - the signal processing module is configured to also determine user location information; and - the wake-up module is configured to switch the operating mode of only one of said image sensors, using said user location information.

[0025] This involves, in particular, having several cameras, each associated with a field of vision, and only activating the camera facing the approaching user. Advantageously, the system comprises four image sensors: two at the exterior mirrors, one at the front of the vehicle, and one at the rear of the vehicle, pointing respectively to the left, right, front, and rear of the vehicle.

[0026] In an advantageous embodiment: - the signal processing module is configured to also determine user location information; and - the access authorization signal generated by the analysis module is accompanied by an identification of at least one opening of the vehicle to be opened and / or unlocked, the at least one opening being determined according to said location information.

[0027] This refers in particular to opening and / or unlocking the opening at which the user approaches.

[0028] The system according to the invention may further comprise at least one lighting device, the wake-up module being further configured to activate said device illumination during the switching of the operating mode of at least one image sensor.

[0029] This includes activating headlights and rearview mirrors.

[0030] Activation of the lighting device may include a sequence of successive switching on and off (for example a so-called welcome sequence, signaling to the user that the vehicle has detected his intention to access). BRIEF DESCRIPTION OF THE FIGURES

[0031] The figures are presented for illustrative purposes only and are in no way limiting of the invention. • Fig. 1 A schematically illustrates a first embodiment of a user recognition system according to the invention; • Fig.1B schematically illustrates some elements of Fig.1A, in use in a motor vehicle; • Fig. 2A schematically illustrates a second embodiment of a user recognition system according to the invention; • Fig. 2B schematically illustrates some elements of Fig. 2A, in use in a motor vehicle; • Figure 3 schematically illustrates a third embodiment of a user recognition system according to the invention; • Figure 4 schematically illustrates a fourth embodiment of a user recognition system according to the invention; and • Figure 5 schematically illustrates a fifth embodiment of a user recognition system according to the invention. DETAILED DESCRIPTION

[0032] A first embodiment of a user recognition system 10 according to the invention is described first, with reference to Figures 1A and 1B.

[0033] The system 10 is mounted for use in a motor vehicle VI, in order to discriminate between a user U0 authorized to access the vehicle V1 and unauthorized users.

[0034] The system 10 comprises at least one image sensor 11, or camera. In the example illustrated in [Fig. 1A], but not limited to, the system 10 comprises a single image sensor 11.

[0035] Each image sensor 11 is configured for use to acquire at least one image of a respective scene SI located outside the vehicle.

[0036] The image sensor 11 is for example mounted at the level of an exterior rearview mirror of the vehicle, here the driver's side exterior rearview mirror.

[0037] The system 10 also includes an analysis module 12, configured to receive as input images acquired by the image sensor 11, to perform processing image including a facial recognition step, and to generate a signal, Me, authorizing access to the vehicle VI when the presence of a UO user authorized to access the vehicle VI is determined.

[0038] The facial recognition algorithm will not be described in detail here, as a person skilled in the art can easily obtain all the necessary details from the literature.

[0039] The analysis module 12 comprises at least one computer equipped with at least one memory storing authentication data relating to the face of at least one user authorized to access the vehicle.

[0040] According to the invention, the image sensor 11 has at least two operating modes, including: - an active operating mode, in which it acquires images intended to be used by the analysis module 12 to perform facial recognition; and - a low-power operating mode, in which it has lower energy consumption but in which it does not allow the acquisition of images used by the analysis module 12 for facial recognition.

[0041] Preferably, in low power mode the image sensor 11 does not acquire any image, not even a lower quality image.

[0042] Advantageously, the ratio of energy consumption between the active and low power modes of the image sensor 11 is greater than or equal to ten, or even greater than or equal to twenty.

[0043] The system 10 also includes one or more radio frequency transceivers 13. Each radio frequency transceiver 13 is configured for use to transmit an emitted signal Se outwards from the vehicle VI, and to receive a return signal Sr resulting from the reflection, on a target, of the emitted signal Se.

[0044] Here, but not in a limiting way, the system 10 comprises a single radio frequency transceiver 13.

[0045] The transceiver may comprise a separate transmitter and receiver, including a separate transmitting antenna from a receiving antenna. Here, but not limited to, the transceiver forms a radio frequency transmitter 13, in which the same antenna performs both signal transmission and reception.

[0046] The radio frequency transmitter 13 comprises, in a manner known per se, an oscillator for generating an electrical signal at the origin of the emitted radio frequency signal, one or more radio frequency antennas for transmitting the emitted signal and receiving the return signal, and where applicable one or more mixers for mixing the emitted signal and the return signal in order to perform signal demodulation.

[0047] Advantageously, each radio frequency transceiver 13 is configured to transmit broadband signals known as UWB, for "Ultra Wide Band". In particular, each transceiver Radio frequency 13 is configured to emit signals with a frequency spectrum of 200 MHz or greater, preferably 250 MHz or greater. These are advantageously pulsed signals carried by a radio frequency carrier. Such transceivers 13 are commonly mounted on motor vehicles to perform at least one function, such as obstacle detection, gesture detection, two-way communication with a handheld electronic device, etc.

[0048] The system 10 also includes a signal processing module 14, configured to receive input data from at least one radio frequency transmitter 13, and to perform signal processing to detect, from this data, the approach of a user U0 relative to the vehicle VI. These processing steps will not be described in detail here, as those skilled in the art can easily obtain all the necessary details from the literature.

[0049] The signal processing module 14 advantageously includes at least one computer, separate from or in common with the computer of the analysis module 12, and equipped with at least one memory storing one or more threshold values ​​enabling the discrimination of a user's approach situation from any other situation.

[0050] Finally, the system 10 also includes a wake-up module 15, configured to receive as input information relating to said approach detection, provided by the signal processing module 14, and to, in response, switch the operating mode of at least one image sensor 11 from low power mode to active mode.

[0051] The wake-up module 15 advantageously includes at least one computer, separate from or combined with the computer of the signal processing module 14.

[0052] Advantageously, the analysis module 12 also includes an active operating mode, in which it analyzes images from the image sensor 11 and performs at least one facial recognition on these images, and a low power operating mode in which it consumes less energy and does not analyze said images.

[0053] In use, the image sensor 11 is in low-power operating mode by default. The same applies to the analysis module 12 when it is in low-power operating mode.

[0054] When a user U0 approaches the vehicle VI, his approaching movement is detected using the radio frequency transmitter 13 and the signal processing module 14.

[0055] It is noted that the radio frequency transmitter 13 can be in a permanently active state, that is to say, continuously emit a radio frequency signal capable of being reflected by a moving target. Alternatively, the radio frequency transmitter 13 can also have a low power consumption operating mode, and be woken up when the user UO is detected by an auxiliary sensor with a longer range present in the vehicle VI, for example a Bluetooth® sensor on board the vehicle and capable of communicating with a device worn by the user UO.

[0056] When the approach of user UO is determined, using the radio frequency transmitter 13 and the signal processing module 14, the information is transmitted by the signal processing module to the wake-up module 15.

[0057] The wake-up module 15 then controls the switching of the image sensor 11 from low-power mode to active mode. If necessary, the wake-up module 15 also controls the switching of the analysis module from low-power mode to active mode.

[0058] The image sensor 11, once switched to active mode, can thus acquire at least one image of user U0 and transmit this image to the analysis module 12. The analysis module 12 receives these images and performs at least one facial recognition-type processing on them in order to determine whether the approaching user U0 is authorized or not to access the vehicle VL

[0059] When it is determined that the approaching user U0 is authorized to access vehicle VI, the analysis module 12 generates a vehicle access authorization signal, denoted signal Me.

[0060] The vehicle access authorization signal is sent to a module for unlocking and / or opening at least one opening of vehicle VI, not shown in the figures. Advantageously, the vehicle access authorization signal controls the opening and / or unlocking of all the openings of vehicle VL

[0061] The system 10 thus forms a user recognition system for managing access to the VL vehicle

[0062] Figures 2A and 2B schematically illustrate a second embodiment of a user recognition system 20 according to the invention. The embodiment shown in Figures 2A and 2B will be described only in terms of its differences from the embodiment shown in Figures IA and IB.

[0063] The numerical references of figures 2A and 2B correspond respectively to the numerical references of figures IA and IB with the tens digit replaced by a "2".

[0064] The user recognition system 20 further includes a presence sensor 26 configured to detect the presence of a user in the immediate vicinity of the vehicle VI, on the outside of the vehicle.

[0065] The presence sensor 26 preferably allows the detection of a hand contact against an external surface of the vehicle VI by a user.

[0066] The presence sensor 26 may include a simple push button, suitable for being pressed by a user to signal their presence.

[0067] In addition or alternatively, the presence sensor 26 may include at least one piezoelectric sensor, attached to an external surface of the vehicle V1 and configured to detect mechanical vibrations induced by physical contact between the user and the vehicle.

[0068] In addition or alternatively, the presence sensor 26 may include at least one capacitive sensor, comprising a capacitive electrode disposed in the immediate vicinity of an external surface of the vehicle VI. Such a capacitive sensor is capable of detecting the immediate proximity of a part of the user's body, which forms a capacitor with the capacitive electrode.

[0069] The wake-up module 25 is configured to receive, from the presence sensor 26, information relating to the detection of the presence of a user in the immediate vicinity of the vehicle.

[0070] The wake-up module 25 is configured to switch the operating mode of the image sensor 21 from low-power mode to active mode when the following two conditions are met: 1 / Detection of the approach of a user U0 relative to the vehicle VI, using the radio frequency transmitter 23 and the signal processing module 24; followed by a 2 / Detection of the presence of a user in the immediate vicinity of the vehicle VI, using the presence sensor 26.

[0071] The verification of the two conditions may include a check of consistency, in particular temporal consistency, between the two detections, in order to ensure that the approaching user U0 is the same as the one whose presence is detected by the presence sensor 26.

[0072] This embodiment therefore imposes an additional condition on image capture by the image sensor 21. In other words, it is not enough for a user U0 to approach the vehicle VI for the image sensor 21 to acquire images of the external scene; this user must also perform a deliberate action consisting of touching the vehicle VL.

[0073] In addition to reduced energy consumption, this embodiment has the major advantage of only allowing filming in public spaces upon the express request of the user U0, this express request being materialized by voluntary contact against an external surface of the vehicle VL

[0074] Figure 3 schematically illustrates a third embodiment of a user recognition system according to the invention.

[0075] The system in [Fig.3] differs from the system in Figures IA and IB only in that it comprises a plurality of radio frequency transmitters 33, each associated with a respective detection zone ZD.

[0076] In the example illustrated in [Fig.3], but not limited to, the system comprises at least four radio frequency transmitters 33, arranged here, but not limited to, at the four corners of the vehicle.

[0077] This embodiment is particularly advantageous when using, as radio frequency transmitters 33, the UWB transmitters of a two-way communication system on board vehicle VI and also capable of communicating with a portable electronic device or a smart phone.

[0078] The several radio frequency transmitters 33 can share the same signal processing module, or each include their own dedicated signal processing module, connected to the wake-up module.

[0079] Figure 4 schematically illustrates a fourth embodiment of a user recognition system according to the invention.

[0080] The system in [Fig.4] differs from the system in [Fig.3] only in that it comprises a plurality of image sensors 41, each associated with a respective field of view CV around the vehicle.

[0081] In the example illustrated in [Fig. 4], but not limited to, the system comprises at least two image sensors 41, arranged on either side of a longitudinal vertical plane of the vehicle. Here, one image sensor 41 is located on the driver's side and targets an area on the driver's side outside the vehicle, and the other image sensor 41 is located on the passenger's side and targets an area on the passenger's side outside the vehicle. Advantageously, the image sensors 41 are located on each of the two exterior mirrors of the vehicle. Additional image sensors may also be located at the front and rear of the vehicle and target a region in front of and behind the vehicle, respectively, relative to the direction of travel of the vehicle when moving forward.

[0082] In this embodiment, and advantageously, the signal processing module which receives the data from the radio frequency transmitters is configured to further determine user location information.

[0083] The location information can be a set of precise coordinates, in a vehicle reference frame (VI) or in a terrestrial reference frame. Alternatively, the location information can be a precision relative to one of several predefined zones around the vehicle (VL). For example, the space around the vehicle is divided into as many zones as there are image sensors, with each zone associated with one image sensor. In any case, the location information is advantageously determined by triangulation and with the aid of at least two radio frequency transmitters.

[0084] Furthermore, the wake-up module is configured to switch the operating mode of only one of the image sensors 41, depending on the location information. In particular, the switch affects only the image sensor whose field of view includes the user's location. In the example illustrated in [Fig. 4], the operating mode of the driver-side image sensor 41 or the passenger-side image sensor 41 is switched, depending on whether the user has been located on the driver's side or the passenger's side.

[0085] This embodiment thus makes it possible to offer several image sensors, each associated with a field of vision, and to turn on only the image sensor observing on the side of the approaching user.

[0086] It is thus possible to maintain reduced energy consumption, while allowing the user to access the vehicle from any side of the vehicle.

[0087] In an advantageous embodiment not specifically shown, the signal processing module is configured to determine the user's location information, and the access authorization signal generated by the analysis module is accompanied by an identification of a vehicle opening to be opened and / or unlocked, defined according to said location information. Thus, the invention ultimately allows only the opening at which the authorized user approaches to be opened and / or unlocked.

[0088] This variant is advantageously combined with the embodiment of [Fig.4]. In this case, the user's location information is used both to select one image sensor to switch into active mode, and to select one vehicle opening to open and / or unlock.

[0089] Figure 5 schematically illustrates a fifth embodiment of a user recognition system according to the invention.

[0090] The system of [Fig.5] differs from the system of [Fig.4] only in that it further comprises at least one illumination device 57, with the wake-up module configured to activate at least one illumination device 57 when switching the operating mode of at least one image sensor.

[0091] Advantageously, and as illustrated in [Fig. 5], at least one lighting device 57 is formed by the headlights of the vehicle's rearview mirrors.

[0092] In addition or alternatively, the lighting device 57 may further include at least one LED strip and / or at least one LED and diffuser assembly, located at the level of the rearview mirrors.

[0093] When the wake-up module controls the switching of the operating mode of at least one image sensor, it simultaneously controls a predetermined sequence successive switching on and off of the lighting devices 57. The light emitted by the lighting devices 57 helps to illuminate the scene to be imaged using the image sensor, which improves the quality of the images acquired.

[0094] The invention is not limited to the examples described above and covers other embodiments with a different number and / or arrangement of the image sensor(s) and radio frequency transmitter(s). Furthermore, the various embodiments illustrated in Figures IA to 5 can easily be combined. Moreover, while the entire description in the figures refers to simple facial recognition, the user recognition step may implement additional steps for point tracking and facial measurements to improve the reliability of user recognition. This can then be referred to as facial biometrics.

Claims

Demands

1. A user recognition system (10; 20) for access management, intended for installation in a motor vehicle (VI), and comprising: - at least one image sensor (11; 21; 41), configured to acquire at least one image of a respective scene located in use outside the vehicle; and - an analysis module (12; 22), configured to receive as input images acquired by at least one image sensor, to perform image processing including a facial recognition step, and to generate a vehicle access authorization signal (Me) when the presence of a user (U0) authorized to access the vehicle is determined; wherein each image sensor (12; 22) has a so-called low-power operating mode, and a so-called active operating mode in which it acquires at least one image; the system (10;20) being characterized in that it further comprises: - at least one radio frequency transceiver (13; 23; 33), configured to emit a transmitted radio frequency signal (Se) and to receive a return signal (Sr) resulting from the reflection, on a target, of the emitted radio frequency signal; - a signal processing module (14; 24), configured to detect the approach of a user (U0) relative to the vehicle by analyzing said return signal; and - a wake-up module (15; 25), configured to receive as input information relating to said approach detection, and to, in response, switch the operating mode of at least one image sensor (11; 21; 41) from low power mode to active mode.

2. System (20) according to claim 1, characterized in that it further comprises a presence sensor (26) configured to detect the presence of a user in the immediate vicinity of the vehicle (VI), and in that the wake-up module (25) is configured to receive as input information relating to said presence detection, and to switch the operating mode of at least one image sensor (21) when the approach is determined of a user (U0) relative to the vehicle then a presence of a user in the immediate vicinity of the vehicle (VI).

3. System (20) according to claim 2, wherein the presence sensor (26) comprises at least one piezoelectric sensor.

4. System (20) according to claim 2 or 3, wherein the presence sensor (26) comprises a mechanical actuator belonging to a door handle for a motor vehicle.

5. System (20) according to any one of claims 2 to 4, wherein the presence sensor (26) comprises at least one capacitive sensor.

6. System according to any one of claims 1 to 5, wherein the at least one radio frequency transceiver comprises a plurality of radio frequency transceivers (33) each associated with a respective detection zone (DZ).

7. System according to claim 6, wherein each of said radio frequency transceivers (33) is configured to emit an Ultra Wideband radio frequency signal, with a frequency spectrum of width greater than or equal to 200 MHz.

8. A system according to any one of claims 1 to 7, comprising at least two image sensors (41) each associated with a respective field of view (FV) around the vehicle, and wherein: - the signal processing module is configured to further determine user location information; and - the wake-up module is configured to switch the operating mode of only one of said image sensors (41), using said user location information.

9. A system according to any one of claims 1 to 8, wherein: - the signal processing module is configured to further determine user location information; and - the access authorization signal generated by the analysis module is accompanied by an identification of at least one vehicle opening to be opened and / or unlocked, the at least one opening being determined based on said location information.

10. A system according to any one of claims 1 to 9, further comprising at least one illumination device (57), the wake-up module being further configured to activate said device illumination during the switching of the operating mode of at least one image sensor.

11. System according to claim 10, wherein the activation of the lighting device comprises a sequence of successive switching on and off.

Images