Vehicle unlocking system, device and method

Abstract

Systems, devices, and methods for unlocking a vehicle are disclosed. An exemplary vehicle includes an ultraviolet keypad coupled to a vehicle window. The vehicle also includes a camera directed toward the vehicle window and configured to capture keys of the ultraviolet keypad and the irises of a person outside the vehicle. The vehicle also includes a processor configured to detect the keys and the irises, unlock the vehicle based on the detected keys, and modify vehicle settings based on a configuration file corresponding to the detected irises.

Description

Technical Field

[0001] The present invention generally relates to a vehicle unlocking system, apparatus, and method, and more particularly, to using the same camera for both driver identification matching and detecting keys on an ultraviolet keypad displayed in a vehicle window. Background Art

[0002] Typical vehicles can be unlocked with a key. Alternatively, if the driver enters a predetermined key code sequence via an input outside the vehicle, the vehicle can be unlocked without a key.

[0003] The vehicle may also include one or more customizable settings, such as seat position, default operating mode, audio presets, etc. These settings may be changed based on the identity of the driver. Summary of the Invention

[0004] The appended claims define the present application. This disclosure summarizes aspects of the embodiments and should not be used to limit the claims. Other embodiments are contemplated by the technology described herein, as will be apparent to those skilled in the art upon review of the following figures and detailed description, and are intended to fall within the scope of this application.

[0005] Exemplary embodiments of systems, devices, and methods for remote vehicle unlocking are disclosed. One exemplary disclosed vehicle includes a UV ink keypad coupled to a vehicle window, and a camera directed toward the vehicle window and configured to capture keystrokes on the UV keypad and the iris of a person outside the vehicle. The vehicle also includes a processor configured to detect the keystrokes and the iris, and the processor is further configured to unlock the vehicle based on the detected keystrokes. The processor is further configured to modify vehicle settings based on a profile corresponding to the detected iris.

[0006] An exemplary disclosed method includes capturing, via a vehicle camera, keystrokes on a UV keypad coupled to a vehicle window. The method also includes capturing, via the camera, the iris of a person outside the vehicle window. The method further includes detecting, via a vehicle processor, the keystrokes and the iris. The method further includes unlocking the vehicle based on the detected keystrokes. The method further includes modifying vehicle settings based on a configuration file corresponding to the detected iris.

[0007] Another example may include a device for capturing keystrokes on a UV keypad coupled to a vehicle window via a vehicle camera. This example may also include a device for capturing the iris of a person outside the vehicle window via a camera. This example may also include a device for detecting the keystrokes and iris via a vehicle processor. This example may further include unlocking the vehicle based on the detected keystrokes. This example may further include a device for modifying vehicle settings based on a configuration file corresponding to the detected iris.

[0008] According to the present invention, there is provided a vehicle comprising:

[0009] an ultraviolet keyboard coupled to the vehicle window;

[0010] a camera directed toward the vehicle window, the camera configured to capture keys of the UV keyboard and the irises of a person outside the vehicle; and

[0011] A processor configured to:

[0012] Detect keys and irises;

[0013] Unlocking the vehicle based on detected key presses; and

[0014] Modify vehicle settings based on the profile corresponding to the detected iris.

[0015] According to one embodiment of the present invention, a UV keypad coupled to a vehicle window includes a layer of UV reflective material positioned between two layers of glass.

[0016] According to one embodiment of the present invention, the vehicle further includes a UV LED configured to illuminate the UV keyboard, wherein capturing the key presses includes capturing light reflected from a finger of the user.

[0017] According to one embodiment of the present invention, the vehicle further includes a near infrared (NIR) LED, wherein capturing the key press includes capturing NIR light reflected from a finger of the user.

[0018] According to one embodiment of the present invention, the processor is further configured to:

[0019] Determine the lighting conditions surrounding the camera; and

[0020] Based on the lighting conditions around the camera, the light source used to detect the iris is selected.

[0021] According to one embodiment of the present invention, the vehicle further comprises a near infrared (NIR) LED, wherein the processor is further configured to:

[0022] determining that lighting conditions surrounding the camera are below a threshold level; and

[0023] NIR light is responsively selected as the light source for detecting the iris.

[0024] According to one embodiment of the present invention, the processor is further configured to:

[0025] determining that lighting conditions surrounding the camera are above a threshold level; and

[0026] Visible light is responsively selected as the light source for detecting the iris.

[0027] According to one embodiment of the present invention, the processor is further configured to:

[0028] Detecting people approaching car windows; and

[0029] The camera is activated responsively.

[0030] According to one embodiment of the invention, a camera is coupled to a door of a vehicle.

[0031] According to one embodiment of the present invention, the camera is further configured to:

[0032] Capturing the iris; and

[0033] In response to the processor determining that the detected iris corresponds to an allowed profile, the key press is captured.

[0034] According to the present invention, there is provided a method comprising:

[0035] capturing, by a vehicle camera, keystrokes on a UV keyboard coupled to a vehicle window;

[0036] Capturing the iris of the person outside the car window through a camera;

[0037] Detecting keys and irises via the vehicle's processor;

[0038] Unlocking the vehicle based on detected key presses; and

[0039] Modify vehicle settings based on the profile corresponding to the detected iris.

[0040] According to one embodiment of the present invention, a UV keypad coupled to a vehicle window includes a layer of UV reflective material positioned between two layers of glass.

[0041] According to one embodiment of the present invention, the method further includes configuring to illuminate a UV LED of the UV keyboard, wherein capturing the key press includes capturing light reflected from a finger of the user.

[0042] According to one embodiment of the present invention, the method further includes a near infrared (NIR) LED, wherein capturing the key press includes capturing NIR light reflected from a finger of the user.

[0043] According to one embodiment of the present invention, the method further includes:

[0044] Determine the lighting conditions surrounding the camera; and

[0045] Based on the lighting conditions around the camera, the light source used to detect the iris is selected.

[0046] According to one embodiment of the present invention, the method further includes:

[0047] determining that lighting conditions surrounding the camera are below a threshold level; and

[0048] Near infrared (NIR) light is responsively selected as the light source for detecting the iris.

[0049] According to one embodiment of the present invention, the method further includes:

[0050] determining that lighting conditions surrounding the camera are above a threshold level; and

[0051] Visible light is responsively selected as the light source for detecting the iris.

[0052] According to one embodiment of the present invention, the method further includes:

[0053] Detecting people approaching car windows; and

[0054] The camera is activated responsively.

[0055] According to one embodiment of the invention, a camera is coupled to a door of a vehicle.

[0056] According to one embodiment of the present invention, the method further includes:

[0057] Capture irises before capturing keystrokes;

[0058] determining, by the processor, that the iris corresponds to an allowed profile; and

[0059] Capture keypresses responsively.

[0060] According to the present invention, there is provided a vehicle comprising:

[0061] an ultraviolet keyboard coupled to the vehicle window;

[0062] a camera directed toward the vehicle window, the camera configured to capture keys of the UV keyboard and the irises of a person outside the vehicle; and

[0063] A processor configured to:

[0064] In response to detecting the iris, activating the ultraviolet keyboard;

[0065] Unlocking the vehicle based on detected key presses; and

[0066] Modify vehicle settings based on the profile corresponding to the detected iris.

[0067] According to one embodiment of the present invention, a UV keypad coupled to a vehicle window includes a layer of UV reflective material positioned between two layers of glass.

[0068] According to one embodiment of the present invention, the vehicle further includes a UV LED configured to illuminate the UV keyboard, wherein capturing the key presses includes capturing light reflected from a finger of the user.

[0069] According to one embodiment of the present invention, the vehicle further includes a near infrared (NIR) LED, wherein capturing the key press includes capturing NIR light reflected from a finger of the user.

[0070] According to one embodiment of the present invention, the processor is further configured to:

[0071] Determine the lighting conditions surrounding the camera; and

[0072] Based on the lighting conditions around the camera, the light source used to detect the iris is selected.

[0073] According to one embodiment of the present invention, the vehicle further comprises a near infrared (NIR) LED, wherein the processor is further configured to:

[0074] determining that lighting conditions surrounding the camera are below a threshold level; and

[0075] NIR light is responsively selected as the light source for detecting the iris.

[0076] According to one embodiment of the present invention, the processor is further configured to:

[0077] determining that lighting conditions surrounding the camera are above a threshold level; and

[0078] Visible light is responsively selected as the light source for detecting the iris.

[0079] According to one embodiment of the present invention, the processor is further configured to:

[0080] Detecting people approaching car windows; and

[0081] The camera is activated responsively.

[0082] According to one embodiment of the invention, a camera is coupled to a door of a vehicle.

[0083] According to one embodiment of the present invention, the camera is further configured to:

[0084] Capturing the iris; and

[0085] In response to the processor determining that the detected iris corresponds to an allowed profile, the key press is captured.

[0086] According to the present invention, there is provided a method comprising:

[0087] Capturing the iris of a person outside a vehicle window through a camera of a vehicle having the vehicle window;

[0088] activating an ultraviolet keypad coupled to a vehicle window in response to detecting an iris by a vehicle processor;

[0089] Capture the keystrokes on the UV keyboard via a camera;

[0090] Unlocking the vehicle based on detected key presses; and

[0091] Modify vehicle settings based on the profile corresponding to the detected iris.

[0092] According to one embodiment of the present invention, a UV keypad coupled to a vehicle window includes a layer of UV reflective material positioned between two layers of glass.

[0093] According to one embodiment of the present invention, the method further includes configuring to illuminate a UV LED of the UV keyboard, wherein capturing the key press includes capturing light reflected from a finger of the user.

[0094] According to one embodiment of the present invention, the method further includes a near infrared (NIR) LED, wherein capturing the key press includes capturing NIR light reflected from a finger of the user.

[0095] According to one embodiment of the present invention, the method further includes:

[0096] Determine the lighting conditions surrounding the camera; and

[0097] Based on the lighting conditions around the camera, the light source used to detect the iris is selected.

[0098] According to one embodiment of the present invention, the method further includes:

[0099] determining that lighting conditions surrounding the camera are below a threshold level; and

[0100] Near infrared (NIR) light is responsively selected as the light source for detecting the iris.

[0101] According to one embodiment of the present invention, the method further includes:

[0102] determining that lighting conditions surrounding the camera are above a threshold level; and

[0103] Visible light is responsively selected as the light source for detecting the iris.

[0104] According to one embodiment of the present invention, the method further includes:

[0105] Detecting people approaching car windows; and

[0106] The camera is activated responsively.

[0107] According to one embodiment of the invention, a camera is coupled to a door of a vehicle.

[0108] According to one embodiment of the present invention, the method further includes:

[0109] Capture irises before capturing keystrokes;

[0110] determining, by the processor, that the iris corresponds to an allowed profile; and

[0111] Capture keypresses responsively. BRIEF DESCRIPTION OF THE DRAWINGS

[0112] For a better understanding of the present invention, reference may be made to the embodiments illustrated in the following drawings. The components in the drawings are not necessarily to scale, and related elements may be omitted or, in some cases, exaggerated in proportion to emphasize and clearly illustrate the novel features described herein. Furthermore, as is known in the art, system components may be arranged in various ways. Furthermore, in the drawings, like reference numerals designate corresponding components throughout the several views.

[0113] Figure 1A and 1B shows a top view and a side perspective view of an exemplary vehicle according to an embodiment of the present invention;

[0114] Figure 2 Shown Figure 1A and 1B A simplified block diagram of the electronic components of a vehicle;

[0115] Figure 3 An exemplary vehicle door according to an embodiment of the present invention is shown;

[0116] Figure 4A and 4B shows a perspective view of an exemplary vehicle door and window according to an embodiment of the present invention;

[0117] Figure 5 A flow chart illustrating an exemplary method according to an embodiment of the present invention is shown. DETAILED DESCRIPTION

[0118] While the present invention can be embodied in various ways, there are certain exemplary and non-limiting embodiments shown in the drawings and described below, it being understood that the present invention is to be considered illustrative of the invention and is not intended to limit the invention to the specific embodiments described.

[0119] As described above, the exemplary devices, systems, and methods disclosed herein relate to identifying a vehicle driver and enabling the driver to unlock the vehicle using the same camera for both purposes. A vehicle may include technology that enables the vehicle to securely identify the driver or one or more other occupants using biometric data, such as a fingerprint. This data can be used to unlock the vehicle and / or change one or more vehicle settings to personalize the vehicle for the specific person identified. However, fingerprint sensors can result in false positives, can be inaccurate, and can lead to increased costs and manufacturing difficulties.

[0120] Vehicles may also include a keypad or numeric keypad on the door or applique that allows the driver to unlock the vehicle using a simple numeric code. These vehicles enable the driver to unlock the vehicle without using the key. This allows the user to unlock the vehicle if the key is locked inside, lost, or otherwise unavailable to the driver.

[0121] The exemplary embodiments disclosed herein can utilize a single camera to detect buttons on a vehicle window and identify people outside the vehicle based on detected irises. Iris recognition can be more secure than fingerprints, reducing the likelihood of false positives and ensuring that only authorized individuals can unlock the vehicle.

[0122] To provide these and other benefits, the exemplary vehicles disclosed herein can be configured to detect the presence of a person outside the vehicle. For example, this can be accomplished by using proximity sensors to detect a touch on a door handle, or by detecting the presence of a key fob, smart key, or phone as a key (PaaK).

[0123] Upon detecting a person outside the vehicle, the vehicle can activate a camera located inside the vehicle, positioned so that its field of view includes the person's head. The camera can capture an image of the person's face, detect the person's iris, and determine whether the iris corresponds to one or more permitted profiles. In some examples, the camera and / or a connected processor can be configured to perform facial recognition (rather than iris recognition). Furthermore, the camera and / or a connected processor can be configured to determine a facial blood-heart rate signal. Based on the detected face, iris, and / or heart rate signal, one or more vehicle settings can be modified or personalized.

[0124] Upon determining that the iris (or face) corresponds to an allowed profile, the vehicle can begin modifying one or more vehicle settings. For example, a profile can have corresponding seat positions, audio presets, etc. that can be changed based on the person's identity and / or profile.

[0125] Additionally, the vehicle can activate one or more LEDs configured to illuminate an ultraviolet (UV) keypad. A UV keypad can include UV absorbent or reflective material positioned between two or more layers of material that make up the vehicle window. The driver can then place their finger on the keypad to enter a code to unlock the vehicle. A camera can be used to capture the light reflected from the driver's finger, allowing the key presses to be determined. If the camera detects the correct key sequence, the vehicle can be unlocked. However, in some cases, the vehicle may also require iris detection. Therefore, some vehicles may require that the iris corresponds to an approved profile and the correct code be entered into the UV keypad.

[0126] Some examples disclosed herein may involve a situation where a user has a key fob on them. The vehicle may be in a welcome mode, actively or passively searching for a key fob or phone serving as a key. The vehicle may detect the key (within a threshold distance, such as 4-5 meters) and activate the camera to perform personalization. In this example, the UV keypad may not be used for code entry.

[0127] Similarly, if a key (key fob or phone) is present but the vehicle is not in welcome mode, or actively or passively searching for a key fob, the vehicle can detect the presence of a person by touching the vehicle's handle. The camera can then be activated to perform facial or iris detection before the vehicle is unlocked. After performing facial recognition, the vehicle can begin personalizing vehicle settings and can unlock the vehicle based on the detection of the key fob's presence.

[0128] In the examples described herein, before unlocking the vehicle via keypad code entry, the camera can be activated for facial or iris recognition to personalize the vehicle. This ensures that the camera is positioned to capture the user's face. If the vehicle is unlocked first, the doors can be opened and the camera can be moved out of position. Thus, the examples disclosed herein may require facial recognition before unlocking the vehicle, even if facial recognition is not used to unlock the vehicle directly (but rather unlocking is accomplished by detecting a key fob or entering a key code).

[0129] Furthermore, some examples may include the use of either or both facial and iris recognition. Facial recognition may not be as secure as iris detection and may only be used for personalized access (i.e., the presence of a key or input via a UV keypad may still be required). However, iris recognition may be more secure. Thus, some examples may include the ability to switch between using iris recognition for personalized access (i.e., the presence of a key or keypad may still be required) or for secure biometric access (i.e., unlocking the door without the use of a key or keypad input).

[0130] Figure 1A and 1B An exemplary vehicle 100 according to an embodiment of the present invention is shown. Vehicle 100 may be a standard gasoline-powered vehicle, a hybrid vehicle, an electric vehicle, a fuel cell vehicle, or any other type of mobile vehicle. Vehicle 100 may be non-autonomous, semi-autonomous, or autonomous. Vehicle 100 includes components related to mobility, such as a powertrain having an engine, a transmission, a suspension, a drive shaft, and / or wheels. In the example shown, vehicle 100 may include one or more electronic components.

[0131] The vehicle 100 may include a UV keypad 102 coupled to a vehicle window 104, windshield, or rear glass. The vehicle 100 may also include a processor 110. The UV keypad 102 may include a UV absorber or reflective material (such as paint or dye) positioned between layers of glass or other material that make up the vehicle window. When the UV keypad is exposed to ultraviolet light, it will shine or glow, making it visible to people outside the vehicle. The UV keypad may include numbers, letters, or other text that can form a password or enter a code to unlock the vehicle. Figure 3 、 Figure 4A as well as Figure 4B The UV keyboard is discussed in greater detail. The vehicle 100 may also include a camera, various LEDs (UV, near infrared (NIR), visible light, etc.), and one or more other components or devices discussed in further detail below.

[0132] The processor 110 can be configured to perform one or more functions described herein. For example, the processor 110 can be configured to determine when a person is outside the vehicle, detect an iris (or face) based on images captured by a camera, determine that one or more keys of a UV keyboard have been pressed, and modify, for example, one or more vehicle settings. Other actions are also possible.

[0133] Figure 2 An exemplary block diagram 200 is shown illustrating electronic components of vehicle 100 according to some embodiments. In the example shown, electronic components 200 include an onboard computing system 210, an infotainment head unit 220, lights 230, sensors 240, an electronic control unit (ECU) 250, and a vehicle data bus 260.

[0134] The onboard computing system 210 may include a microcontroller unit, controller, or processor 110 and memory 212. Processor 110 may be any suitable processing device or set of processing devices, such as, but not limited to, a microprocessor, a microcontroller-based platform, an integrated circuit, one or more field programmable gate arrays (FPGAs), and / or one or more application-specific integrated circuits (ASICs). Memory 212 may be volatile memory (e.g., RAM including non-volatile random access memory (RAM), magnetic RAM, ferroelectric RAM, etc.), non-volatile memory (e.g., disk storage, flash memory, electrically programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), memristor-based non-volatile memory, solid-state memory, etc.), unchangeable memory (e.g., EPROM), read-only memory, and / or high-capacity storage devices (e.g., hard disk drives, solid-state drives, etc.). In some examples, memory 212 includes multiple types of memory, particularly volatile memory and non-volatile memory.

[0135] Memory 212 may be a computer-readable medium on which one or more sets of instructions (such as software for operating the methods of the present invention) may be embedded. The instructions may embody one or more methods or logic as described herein. For example, the instructions may reside completely or at least partially within any one or more of memory 212, the computer-readable medium, and / or processor 110 during execution of the instructions.

[0136] The terms "non-transitory computer-readable medium" and "computer-readable medium" include a single medium or multiple media, such as a centralized or distributed database, and / or associated caches and servers that store one or more sets of instructions. Furthermore, the terms "non-transitory computer-readable medium" and "computer-readable medium" include any tangible medium that can store, encode, or carry a set of instructions for execution by a processor or cause a system to perform any one or more of the methods or operations disclosed herein. As used herein, the term "computer-readable medium" is expressly defined to include any type of computer-readable storage device and / or storage disk and to exclude propagating signals.

[0137] Infotainment head unit 220 can provide an interface between vehicle 100 and a user. Infotainment head unit 220 can include one or more input and / or output devices (such as display 102 ). Input devices can include, for example, a control knob, an instrument panel, a digital camera for image capture and / or visual command recognition, a touchscreen, an audio input device (e.g., a cabin microphone), buttons, or a touchpad. Output devices can include instrument cluster outputs (e.g., dials, lighting), actuators, a heads-up display, a center console display (e.g., a liquid crystal display (LCD), an organic light-emitting diode (OLED) display, a flat-panel display, a solid-state display, etc.), and / or speakers. In the example shown, infotainment head unit 220 includes hardware (e.g., a processor or controller, memory, storage, etc.) and software (e.g., an operating system, etc.) for an infotainment system (e.g., Ford® Sync® and MyFord Touch®, Ford®, Toyota® Entune®, General Motors® IntelliLink®, etc.). In some examples, infotainment head unit 220 can share a processor with the in-vehicle computing system 210. Additionally, infotainment head unit 220 may display the infotainment system on, for example, a center console display of vehicle 100 .

[0138] The light 230 may include one or more LEDs or other light emitting devices. For example, the light 230 may include one or more UV LEDs 232 and NIR LEDs 234. The UV LEDs may be configured to illuminate the UV keyboard to allow a person to see the keyboard. Without the UV light from the UV LEDs, the keyboard may generally be transparent.

[0139] The NIR LEDs 234 can be configured to provide near-infrared light so that the camera can capture images even in low-light settings. The camera (discussed below) can be configured to detect facial features, keystrokes, and other objects within its field of view. In the presence of sufficient illumination above a threshold brightness, the camera can use visible light. To capture the keystrokes, the visible light may bounce off a person's fingers and be reflected into the camera. Alternatively, if there is not sufficient illumination above the threshold brightness, there may not be enough visible light for the camera to operate effectively. In this case, the NIR LEDs can provide enough light to bounce off a person's fingers to reflect into the camera. The same rules can be applied to the case where the camera captures a person's iris.

[0140] Sensors 240 may be arranged in and around vehicle 100 in any suitable manner and may be configured to determine one or more characteristics of vehicle 100. For example, accelerometer 242 may measure acceleration of vehicle 100, gyroscope 244 may measure pitch, roll, yaw, or other changes in vehicle 100, and camera 246 may be configured to capture and transmit images for processing and / or display by vehicle 100. Other sensors may also be included, such as noise detection sensors, air flow sensors, etc.

[0141] ECU 250 can monitor and control the subsystems of vehicle 100. ECU 250 can communicate and exchange information via vehicle data bus 260. Additionally, ECU 250 can transmit characteristics (such as ECU 250 status, sensor readings, control status, error and diagnostic codes, etc.) to other ECUs 250 and / or receive requests from other ECUs 250. Some vehicles 100 may have seventy or more ECUs 250 located in various locations around vehicle 100 and communicatively coupled via vehicle data bus 260. ECU 250 can include its own circuitry (such as integrated circuits, microprocessors, memory, storage devices, etc.) as well as discrete electronics such as firmware, sensors, actuators, and / or mounting hardware. In the illustrated example, ECU 250 may include a telematics control unit 252, a body control unit 254, and a speed control unit 256.

[0142] The telematics control unit 252 can, for example, use data received by a GPS receiver, the communication module 230, and / or one or more sensors to control the trajectory of the vehicle 100. The body control unit 254 can control various subsystems of the vehicle 100. For example, the body control unit 254 can control the power of the trunk latch, windows, power locks, power sunroof control, anti-theft control system, and / or power mirrors. The speed control unit 256 can control the speed of the vehicle 100 by controlling the brakes, transmission, and / or one or more other systems or devices. Other ECUs are also possible.

[0143] Vehicle data bus 260 may include one or more data buses that communicatively couple onboard computing system 210, infotainment head unit 220, lights 230, sensors 240, ECU 250, and other devices or systems connected to the vehicle data bus. In some examples, vehicle data bus 260 may be implemented according to the Controller Area Network (CAN) bus protocol defined by the International Organization for Standardization (ISO) 11898-1. Alternatively, in some examples, vehicle data bus 260 may be a Media Oriented Systems Transport (MOST) bus or a CAN Flexible Data (CAN-FD) bus (ISO 11898-7). In some applications, CAN and CAN-FD may share the same bus.

[0144] Figure 3 A side view of a vehicle door 300 according to an embodiment of the present invention is shown. The vehicle door may include a window 304, which may include a UV keypad 302. The vehicle door 300 may also include a handle 310.

[0145] Figure 3 The UV keyboard 302 is shown as including five separate boxes, each corresponding to a pair of numbers (1 and 2, 3 and 4, etc.). In some examples, the UV keyboard can include numbers, letters, a combination of letters and numbers, and / or other text. Furthermore, the UV keyboard 302 can include more or fewer boxes so that more or fewer separate inputs can be detected.

[0146] In some examples, the vehicle door 300 and / or the door handle 310 may include one or more sensors configured to detect the presence of a person outside the vehicle. This may include, for example, a capacitive or other type of touch sensor, one or more antennas, etc. These sensors may be used by a processor (such as processor 110) to determine when a person is present in order to activate the UV keypad and / or camera in response.

[0147] Figure 4A and 4B A perspective view of an exemplary vehicle door 400 is shown according to some embodiments. Figure 4AInitially, the figure shows a UV keypad 402 integrated with a vehicle window 404. The vehicle door 400 also includes a camera 406, a UV LED 420, and a NIR LED 422. The figure also shows a person 430 with an iris 432 within the field of view 408 of the camera.

[0148] UV keyboard 402 can include a coating, dye, or other material that is sensitive or reactive to UV light. UV keyboard 402 can be integrated with vehicle window 404 by being positioned between layers 404A and 404B of the vehicle window. Layers 404A and 404B can be specialized glass that, when combined with a thin film layer between the two glass layers 404A and 404B, prevents UV light from outside the vehicle from affecting the UV keyboard. This can be achieved by having a solar UV blocking layer on the surface of the thin film layer adjacent to layer 404A and a UV luminescent ink on the opposite side of the thin film layer adjacent to layer 404B. Alternatively, one or more other layers or materials can be included in the construction of vehicle window 404 so that external UV light does not illuminate the UV keyboard.

[0149] The camera 406 can be configured to have a field of view 408 that encompasses the UV keyboard 402. The field of view 408 can also be wide enough to encompass a person or portion of a person located outside the vehicle. In some examples, the camera 406 can include a wide-angle lens to capture both the UV keyboard 402 and the person 430. Alternatively, the camera 406 can include one or more actuators or movable elements configured to steer the field of view 408 and / or focus to capture either or both of the UV keyboard 402 and the person 430.

[0150] In some examples, camera 406 may be configured to capture irises 432 of person 430 located outside the vehicle. In response to the processor determining that person 430 is located near the vehicle, camera 406 may be activated and / or irises 432 may be captured by camera 406. In practice, this may occur in stages, with the first stage including activating the camera in response to determining that a person is located near the vehicle and also capturing an image of the person's irises in response to detecting the person's face. The processor may perform image processing to determine that the person's face is in the appropriate position to capture the image of the irises, as well as detecting the irises themselves from a larger image of the person's face. Proximity detection may include the vehicle detecting a valid key fob or phone as a key (PaaK) device. While these devices may be valid keys, they can be shared. Therefore, even in the presence of these valid keys, and even when multiple users share a key fob or phone, activating the camera to biometrically identify the user can allow for personalized vehicle settings to be customized for each user.

[0151] In some examples, the iris detection captured by camera 406 and / or the detection by the processor may be performed under non-ideal lighting conditions. For example, the vehicle may be located in a dimly lit garage or parking structure, or at night in a dim or unlit location. In these examples, among other things, it may be useful to have a separate light source that enables the camera to accurately capture a person's iris.

[0152] The NIR LEDs 422 can provide near-infrared light that is invisible to the human eye. Prior to or upon activation of the camera 406, the processor can be configured to determine the lighting conditions surrounding the camera. The lighting conditions can be rated on a scale, where the value depends on the amount of light received by the camera. The processor can compare the lighting conditions to a reference threshold or value, such that lighting conditions above the threshold include sufficient light to capture and detect the iris, while lighting conditions below the threshold do not include sufficient light to capture and detect the iris. The threshold can vary based on one or more factors and can depend on the image processing software used by the processor. For example, more advanced image processing software may require less light in the image than less advanced software while still providing the same confidence in iris detection. Thus, the lighting condition threshold can vary or be different based on the software used.

[0153] Based on the determined lighting conditions, the processor can select a light source for detecting iris 432. For example, if the lighting conditions are above a threshold, the processor can select visible light as the light source. Alternatively, if the lighting conditions are below the threshold, the processor can select an NIR LED as the light source. Camera 406 can capture iris 432 using the selected light source.

[0154] Once iris 432 is captured, the processor may perform image processing to detect the iris. The detected iris may correspond to one or more profiles for the vehicle. A given vehicle may include multiple drivers, each with their own profile and corresponding iris. Each profile may have one or more pre-selected options, such as seat position, audio presets, etc. Upon detecting iris 432, the processor may compare it to multiple stored irises to determine whether it matches. If a match is determined, the vehicle may automatically change settings to values ​​corresponding to the permitted profiles. In some examples, facial recognition may be performed instead of iris detection. As such, it should be understood that the disclosure herein is applicable to both facial recognition and iris detection.

[0155] Figure 4BShown is a UV keyboard 402 integrated with a vehicle window 404 and a finger 440 in the process of selecting one of the frames of the UV keyboard 402 illuminated by light from a UV LED 420. The camera 406 can be configured to capture light reflected from the finger 440 so that a processor can process the images received by the camera 406 and detect the key press.

[0156] In some examples, the UV LED 420 can be configured to illuminate in the direction of the UV keyboard 420 in response to one or more sensors detecting the presence of a person near the vehicle. Alternatively, the UV LED 420 can be configured to illuminate in response to the processor determining that the detected iris corresponds to an allowed profile. In this way, the UV keyboard can only be activated after the iris has been detected.

[0157] In some examples, camera 406 can be configured to capture key presses by reflecting light from a person's finger 440 outside the vehicle. The camera can be configured to use visible light, NIR light, or other types of light. Furthermore, as described above with respect to detecting iris 432, camera 406 and / or the processor can be configured to select a light source based on the lighting conditions surrounding camera 406.

[0158] The camera 406 may be configured to capture multiple keys in succession, and the processor may be configured to detect the keys and determine that a particular pattern has been pressed. In response, the processor may unlock the vehicle.

[0159] In some examples, facial recognition may be performed first, followed by keypad entry. A person's face may be captured and recognized, and a processor may associate a unique or personalized key code with the face. After facial recognition has been performed, the vehicle may begin modifying one or more vehicle settings (i.e., personalizing the vehicle). Additionally, after facial recognition has been performed, the UV keypad may be enabled (i.e., the UV LEDs may be turned on, the camera may be repositioned or angled, etc.). In response to entering the personalized key code, the vehicle may be unlocked.

[0160] Also, in some examples, iris recognition may be performed and the need to use a UV keyboard for entry may be negated. Iris recognition may be accurate enough and secure enough that key code entry is not required.

[0161] Figure 5 An exemplary method 500 is shown according to an embodiment of the present invention. The method 500 may enable a vehicle to use the same camera for iris detection and UV keypad entry to unlock the vehicle and personalize one or more settings of the vehicle. Figure 5The flowcharts of the embodiment of the present invention represent machine-readable instructions stored in a memory and may comprise one or more procedures that, when executed by a processor, may cause the vehicle 100 and / or one or more systems or devices described herein to perform one or more functions described herein. Figure 5 The flowchart shown in describes an exemplary procedure, but many other methods for performing the functions described herein may be used instead. For example, the order of execution of the blocks may be rearranged or performed in series or in parallel with each other, and the blocks may be changed, eliminated, and / or combined to perform the method 500. Moreover, because the method 500 is combined with the blocks Figure 1A 、 Figure 1B 、 Figure 2 、 Figure 3 、 Figure 4A and Figure 4B The method 500 is disclosed with reference to the components, so some functions of these components will not be described in detail below.

[0162] Method 500 may begin at block 502. At block 504, method 500 may include determining whether a driver is within the vicinity of the vehicle. This may include using a sensor on a door handle to detect when a person touches the door handle. Alternatively, the vehicle may include one or more antennas (e.g., Bluetooth or other short-range communication) that can be used to determine when a key fob, smart key, or phone as a key device is within a predetermined range of the vehicle or the driver's door.

[0163] When a person is detected near the vehicle, block 506 of method 500 may include activating the camera. This may include turning on the camera, and / or changing the position or angle of the camera so that the camera's field of view includes the area outside the driver's side window.

[0164] Block 508 of method 500 may include determining lighting conditions around the camera. In some examples, this may include using the camera to detect the amount of light being received. Alternatively, the amount of light may be determined using one or more other vehicle sensors (e.g., an ambient light sensor). If the determined light level is above a threshold level, method 500 may proceed to block 512. However, if the light level is below the threshold level required to detect an iris, method 500 may proceed to block 510.

[0165] Block 510 of method 500 may include activating a NIR LED. The NIR LED may provide light for the camera to capture the face of a person outside the car window. Alternatively, the camera may use visible light or light from other light sources.

[0166] At block 512, method 500 may include determining whether a face is within the camera's field of view (FOV). This may include performing image processing to detect a face. If no face is within the FOV, the camera may continue to wait until a face appears. If a face is determined to be present, method 500 may include detecting the face's iris at block 514.

[0167] At block 516, method 500 may include determining whether the detected iris corresponds to an allowed profile. This may include comparing the detected iris to one or more stored irises, each iris corresponding to one or more allowed profiles. Each allowed profile may correspond to a person who is allowed to drive the vehicle. If the iris does not correspond to an allowed profile, method 500 may end at block 528.

[0168] However, if the iris does correspond to an allowed profile, method 500 may include modifying one or more vehicle settings based on the allowed profile at block 518. This may include changing seat position, audio presets, vehicle mode, etc.

[0169] At block 520 , method 500 may include activating a UV LED. The UV LED may illuminate a UV keyboard positioned in the driver's side window. Method 500 may then include capturing an image of the window with a camera to detect a key press on the UV keyboard at block 522 .

[0170] At block 524, method 500 may include determining whether the detected keystrokes correspond to a correct combination or password. If the keystrokes do not correspond, the system may return to block 522 to detect more keystrokes.

[0171] If the key combination is detected, the method 500 may include unlocking the vehicle at block 526. Additionally, entering the correct key code may allow one or more vehicle settings to be customized or modified without requiring iris or facial recognition. The method 500 may then end at block 528.

[0172] In this application, the use of disjunctive conjunctions is intended to include conjunctions. The use of definite or indefinite articles is not intended to indicate cardinality. In particular, reference to "the" object or "a" and "an" objects is intended to indicate one of a possible plurality of such objects. Furthermore, the conjunction "or" can be used to express features that exist simultaneously rather than being mutually exclusive alternatives. In other words, the conjunction "or" should be understood to include "and / or". The term "comprising" is inclusive and has the same scope as the respective "including".

[0173] The above embodiments, and particularly any "preferred" embodiments, are possible examples of implementations and are merely set forth for a clear understanding of the principles of the invention. Many variations and modifications may be made to the above embodiments without materially departing from the spirit and principles of the technology described herein. All modifications are intended to be included within the scope of the present invention and protected by the following claims.

Claims

1. A vehicle comprising: an ultraviolet keyboard coupled to the vehicle window; a camera directed toward the vehicle window, the camera being configured to capture keys of the UV keyboard and irises of people outside the vehicle; as well as A processor, wherein the processor is configured to: activating the ultraviolet keyboard in response to detecting the iris; unlocking the vehicle based on the detected key; as well as Vehicle settings are modified based on a profile corresponding to the detected iris. 2 . The vehicle of claim 1 , wherein the UV keyboard coupled to the vehicle window comprises a layer of UV reflective material positioned between two layers of glass. 3 . The vehicle of claim 1 , further comprising a UV LED configured to illuminate the UV keyboard, wherein capturing the key presses comprises capturing light reflected from a user's finger. 4 . The vehicle of claim 3 , further comprising a near infrared LED, wherein capturing the key comprises capturing near infrared light reflected from the user's finger.

5. The vehicle of claim 1 , wherein the processor is further configured to: determining lighting conditions surrounding the camera; and A light source for detecting the iris is selected based on the lighting conditions surrounding the camera.

6. The vehicle of claim 5, further comprising a near infrared LED, wherein the processor is further configured to: determining that the lighting conditions surrounding the camera are below a threshold level; and Near infrared light is responsively selected as the light source for detecting the iris.

7. The vehicle of claim 5, wherein the processor is further configured to: determining that the lighting conditions surrounding the camera are above a threshold level; and Visible light is responsively selected as the light source for detecting the iris.

8. The vehicle of claim 1 , wherein the processor is further configured to: detecting a person approaching the vehicle window; and The camera is activated in response.

9. The vehicle of claim 1, wherein the camera is coupled to a door of the vehicle.

10. The vehicle of claim 1 , wherein the camera is further configured to: capturing the iris; and In response to the processor determining that the detected iris corresponds to an allowed profile, the key press is captured.

11. A method comprising: capturing, by a camera of a vehicle having a window, an iris of a person outside the window; activating, by a vehicle processor in response to detecting the iris, an ultraviolet keypad coupled to the vehicle window; Capturing keys on the ultraviolet keyboard by the camera; unlocking the vehicle based on the detected key press; as well as Vehicle settings are modified based on a profile corresponding to the detected iris.

12. The method according to claim 11, further comprising: determining lighting conditions surrounding the camera; as well as A light source for detecting the iris is selected based on the lighting conditions surrounding the camera.

13. The method according to claim 12, further comprising: determining that the lighting condition surrounding the camera is below a threshold level; as well as Near infrared light is responsively selected as the light source for detecting the iris.

14. The method according to claim 12, further comprising: determining that the lighting condition surrounding the camera is above a threshold level; as well as Visible light is responsively selected as the light source for detecting the iris.

15. The method according to claim 11, further comprising: capturing the iris before capturing the key; determining, by the processor, that the iris corresponds to an allowed profile; as well as The key press is responsively captured.

Images