Method and device for unmanned rental of vehicle, supporting two-factor authentication

Abstract

A method for unmanned rental of a vehicle through two-factor authentication, according to an embodiment of the present disclosure, in which at least a part of each step is performed on a server device, may comprise the steps of: receiving reserver information and vehicle use information from a user terminal or a kiosk terminal; receiving, from the kiosk terminal, driver's license information acquired from the kiosk terminal, and first facial image information and first iris information captured by a camera unit of the kiosk terminal; transmitting, to the user terminal, a mobile key capable of controlling a dispatched vehicle in response to a success of a first authentication result, which is a result of comparing a driver's license photo included in the driver's license information with the first facial image information; receiving, from the dispatched vehicle, second iris information captured by an iris capturing camera of the dispatched vehicle; and transmitting, to the dispatched vehicle, a second authentication result in response to a result of comparing the first iris information acquired from the kiosk terminal with the second iris information acquired from the dispatched vehicle.

Description

Method and device for renting an unmanned vehicle supporting two-factor authentication

[0001] The present disclosure relates to a vehicle rental method and device, and more particularly, to an unmanned vehicle rental method and device that provides a vehicle rental service in a non-face-to-face manner.

[0002] With the development of information and communication technology, technologies for reserving or applying for services remotely are spreading.

[0003] Traditionally, the provision of car rental services has been primarily accomplished through the user visiting the car rental service provider's sales office, confirming the user's intention to use the car rental service in person, and entering into a face-to-face contract between the user and the car rental service provider.

[0004] Recently, attempts to provide rental car services remotely, i.e., without human intervention, are on the rise. For example, Korean Patent No. 10-2186339 discloses a technology that provides rental car services through standardized, contactless digital procedures using online, non-face-to-face authentication.

[0005] However, existing technologies for providing non-face-to-face rental car services focus solely on the non-face-to-face contract process for service provision, neglecting to verify the identity of the contracted driver and the actual vehicle driver. In other words, existing technologies only authenticate the driver upon signing the rental car contract, and only after the contract holder is granted control of the vehicle do they verify the identity of the actual driver. In this case, the verification system for the rental car contract holder and the actual driver may be inadequate. Therefore, if the actual driver, not the contract holder, is unqualified, the likelihood of an accident occurring during rental car operation significantly increases.

[0006] This is because existing technologies for providing remote rental car services only require the contractor to verify their identity through identification or mobile phone verification when signing a non-face-to-face rental contract. Therefore, it's possible to rent a car using someone else's identification or mobile phone. Furthermore, after signing a rental car contract, the actual driver and the contract holder's identity are not verified during actual operation.

[0007] One embodiment of the present disclosure provides a method and device for providing an unmanned vehicle rental service.

[0008] One embodiment of the present disclosure provides a management method and device for providing a non-face-to-face vehicle rental service that continuously verifies the identity of a vehicle rental contract holder and an actual driver through two-factor authentication.

[0009] A method for renting an unmanned vehicle using two-factor authentication according to an embodiment of the present disclosure is a method in which at least a portion of each step is performed on a server device, the method including: receiving reservation information and vehicle use information from a user terminal or a kiosk terminal; receiving driver's license information acquired from the kiosk terminal, and first facial image information and first iris information captured by a camera unit of the kiosk terminal from the kiosk terminal; transmitting a mobile key capable of controlling the dispatched vehicle to the user terminal in response to a successful first authentication result, which is a result of comparing a driver's license photo included in the driver's license information with the first facial image information; receiving second iris information captured by an iris capturing camera of the dispatched vehicle from the dispatched vehicle; and transmitting a second authentication result to the dispatched vehicle in response to a result of comparing the first iris information acquired from the kiosk terminal with the second iris information acquired from the dispatched vehicle.

[0010] An unmanned vehicle rental system using dual authentication according to an embodiment of the present disclosure comprises: a kiosk terminal that scans a driver's license to generate driver's license information, generates first facial image information by photographing a face of a reservation holder using a color camera, generates first iris information by photographing an iris of the reservation holder using a first infrared camera, and transmits the driver's license information, the first facial image information, and the first iris information to a server device; a server device that associates reservation information received from a user terminal or the kiosk terminal with a dispatched vehicle and transmits a mobile key capable of controlling the dispatched vehicle to the user terminal in response to a successful first authentication result which is a result of comparing a driver's license photo included in the driver's license information with the first facial image information; And a vehicle terminal mounted on the dispatched vehicle to operate at least a part of a component in response to the mobile key, generate second iris information by photographing the iris of a passenger using a second infrared camera, and transmit the second iris information to the server device, wherein the server device transmits a second authentication result to the dispatched vehicle in response to a result of comparing the first iris information with the second iris information acquired from the dispatched vehicle, and the vehicle terminal can unlock the ignition of the dispatched vehicle based on the second authentication result.

[0011] A method for renting an unmanned vehicle using two-factor authentication according to an embodiment of the present disclosure is a method in which at least a portion of each step is performed on a server device, the method comprising: receiving reservation information and vehicle use information from a first terminal; receiving driver's license information, first facial image information, and first biometric information acquired from the first terminal; associating the reservation information with a dispatched vehicle and transmitting a mobile key capable of controlling the dispatched vehicle to the first terminal in response to a successful first authentication result that is a result of comparing a driver's license photo included in the driver's license information with the first facial image information; receiving second biometric information captured by a biometric information acquisition unit of a second terminal mounted on the dispatched vehicle from the second terminal; and transmitting a second authentication result to the second terminal in response to a result of comparing the first biometric information acquired from the first terminal with the second biometric information acquired from the second terminal of the dispatched vehicle.

[0012] The vehicle rental method and device according to the embodiment of the present disclosure can provide a safe vehicle rental service by performing authentication twice, once when entering into a non-face-to-face vehicle rental service contract and once when operating a dispatched vehicle.

[0013] FIG. 1 is a schematic block diagram of a configuration of a vehicle rental service providing server device and terminals that constitute an unmanned vehicle rental system according to embodiments of the present disclosure, and an exchange of information for providing a vehicle rental service between them.

[0014] FIG. 2 is a drawing illustrating the configuration of a kiosk terminal according to one embodiment of the present disclosure.

[0015] FIG. 3 is a drawing illustrating a vehicle rental method according to one embodiment of the present disclosure.

[0016] FIG. 4 is a diagram illustrating information exchanged for dual authentication of a vehicle rental service providing server device and terminals according to one embodiment of the present disclosure.

[0017] FIG. 5 is a schematic block diagram of a configuration of a vehicle rental service providing server device and terminals according to another embodiment of the present disclosure, and the exchange of information for providing vehicle rental services between them.

[0018] Hereinafter, embodiments disclosed in this specification will be described in detail with reference to the attached drawings. Regardless of the drawing numbers, identical or similar components will be given the same reference numbers and redundant descriptions thereof will be omitted. The suffixes "module" and "part" used for components in the following description are assigned or used interchangeably only for the convenience of writing the specification, and do not in themselves have distinct meanings or roles. In addition, when describing the embodiments disclosed in this specification, if it is determined that a specific description of a related known technology may obscure the gist of the embodiments disclosed in this specification, a detailed description thereof will be omitted. In addition, the attached drawings are only intended to facilitate easy understanding of the embodiments disclosed in this specification, and the technical ideas disclosed in this specification are not limited by the attached drawings, and should be understood to include all modifications, equivalents, and substitutes included in the spirit and technical scope of the present invention.

[0019] Terms containing ordinal numbers, such as "first," "second," etc., may be used to describe various components, but these components are not limited by these terms. These terms are used solely to distinguish one component from another. Terms containing ordinal numbers, such as "first," "second," etc., do not necessarily imply that the component is singular; the components may be plural.

[0020] When a component is referred to as being "connected" or "connected" to another component, it should be understood that it may be directly connected or connected to that other component, but that there may be other components intervening. Conversely, when a component is referred to as being "directly connected" or "connected" to another component, it should be understood that there are no other components intervening.

[0021] In various examples of the present disclosure, “ / ” and “,” should be interpreted as indicating “and / or.” For example, “A / B” can mean “A and / or B.” Furthermore, “A, B” can mean “and / or B.” Furthermore, “A / B / C” can mean “at least one of A, B, and / or C.” Furthermore, “A, B, C” can mean “at least one of A, B, and / or C.”

[0022] In various examples of this disclosure, "or" should be interpreted as meaning "and / or." For example, "A or B" can include "only A," "only B," and / or "both A and B." In other words, "or" should be interpreted as meaning "additionally or alternatively."

[0023] The terminology used in this disclosure is merely used to describe specific various examples and is not intended to limit the present invention. The singular expression includes the plural expression unless the context clearly indicates otherwise. In this disclosure, it should be understood that the terms "comprises" or "has" are intended to specify the presence of a described feature, number, step, operation, component, part, or combination thereof, but do not preclude the possibility of the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0024] Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention pertains. Terms defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant technology, and shall not be construed in an idealized or overly formal sense unless explicitly defined herein. Various examples of this disclosure will now be described in detail with reference to the accompanying drawings.

[0025]

[0026] FIG. 1 is a schematic block diagram of a server device constituting an unmanned vehicle rental system according to embodiments of the present disclosure, and information exchange for providing a vehicle rental service between the server device and terminals. The embodiment referring to FIG. 1 is described on the assumption that the vehicle rental service providing device is a server device (100). The server device (100) communicates with a kiosk terminal (200), a vehicle terminal (300), and a user terminal (400) to make a rental service reservation for one of at least one waiting vehicle. In this specification, the vehicle rental service is used interchangeably with the rental car service. A rental car may refer to a vehicle dispatched by a vehicle rental service.

[0027] The server device (200) according to an embodiment of the present disclosure can perform dual authentication including first authentication when a vehicle rental service contract is made and second authentication when a driver starts driving a dispatched vehicle.

[0028] The server device (100) can perform the first authentication by determining whether the driver's license included in the driver's license information is the same as the contract holder of the car rental service.

[0029] The server device (100) can perform second authentication by determining whether the contractor of the vehicle rental service and the driver of the dispatched vehicle are the same.

[0030] In one embodiment, the first and second authentications may utilize the same authentication modality. For example, the server device (100) may perform the first and second authentications using image-based authentication.

[0031] In other embodiments, the first and second authentications may utilize different authentication modalities. For example, the server device (100) may perform the first authentication based on an image, and the second authentication based on other biometric information. The second authentication may be performed based on biometric information such as iris information, fingerprint information, or vein information. The embodiments described with reference to FIGS. 1 to 4 assume that the server device (100) performs the second authentication based on iris information.

[0032] A user terminal (400) may be connected to a server device (100) via a network. The user terminal (400) may transmit a reservation request for a car rental service to the server device (100). The reservation request may include reservation information and / or vehicle usage information. The reservation information may include personal information. Personal information may include at least one of age, gender, resident registration number, and / or mobile phone number. The reservation information may include membership information required by a service provider, such as a membership number for providing a car rental service. In addition to manual input by the user, the reservation information may include information entered by an application. The user terminal (400) may transmit vehicle usage information, including the vehicle type and / or vehicle usage period for using the car rental service, to the server device (100) as vehicle usage information. In response to the reservation request of the user terminal (400), the server device (100) may transmit information on a waiting vehicle suitable for the vehicle usage information to the user terminal (400). The waiting vehicles may be information on vehicles available for dispatch during the requested vehicle rental service time from the user terminal (400). The user terminal (400) may select at least one of the received waiting vehicles and pay the usage fee. After payment is completed, the server device (100) may confirm the reservation information based on the reservation information transmitted by the user terminal (400), or may confirm the reservation information based on the reservation request information, including the reservation holder information and / or vehicle usage information. The reservation information may include the reservation holder information and / or vehicle usage information.

[0033] Depending on the embodiment, the reservation request or reservation information may include driver's license information. The driver's license information refers to the license information of the driver who will actually drive the rental vehicle, and the driver may be the same as or different from the person making the reservation.

[0034] The user terminal (400) can input reservation information, driver's license information, etc. In another embodiment, reservation information and / or vehicle use information can also be input at the kiosk terminal (200).

[0035] Optionally, the user terminal (400) can obtain driver's license information from the user. The driver's license information may include the driver's license number, the driver's license issuing agency, and / or the driver's license expiration date. Depending on the embodiment, the driver's license information may include a driver's license photo, which is a facial image included in the driver's license. The user terminal (400) can automatically recognize the driver's license information not only through the user's keyboard input, but also through optical character recognition (OCR) of the driver's license image captured by a camera mounted on the user terminal (400). The user terminal (400) can recognize the driver's license holder's photo area in the driver's license and transmit the driver's license information, including the driver's license holder's photo, to the server device (100).

[0036] The user terminal (400) may be implemented as a fixed device or a movable device such as a terminal (100), a mobile phone, a projector, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation device, a slate PC, a tablet PC, an ultrabook, a wearable device (e.g., a smartwatch, a smart glass, a head mounted display (HMD)), etc.

[0037] The network may be a network based on mobile communication or wireless Internet. A network based on mobile communication may be a mobile communication network built according to technology standards or communication methods for mobile communication (e.g., GSM (Global System for Mobile communication), CDMA (Code Division Multi Access), CDMA2000 (Code Division Multi Access 2000), EV-DO (Enhanced Voice-Data Optimized or Enhanced Voice-Data Only), WCDMA (Wideband CDMA), HSDPA (High Speed ​​Downlink Packet Access), HSUPA (High Speed ​​Uplink Packet Access), LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced), etc.).

[0038] A network based on wireless Internet may be a network built according to, for example, WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), WiBro (Wireless Broadband), WiMAX (World Interoperability for Microwave Access), HSDPA (High Speed ​​Downlink Packet Access), HSUPA (High Speed ​​Uplink Packet Access), LTE (Long Term Evolution), or LTE-A (Long Term Evolution-Advanced).

[0039] In one embodiment, the server device (100) may generate vehicle dispatch information along with confirmation of reservation information. The vehicle dispatch information may be generated based on the vehicle type and / or vehicle usage period of the vehicle usage information.

[0040] The server device (100) may, on the other hand, generate vehicle dispatch information at other times. For example, the server device (100) may generate vehicle dispatch information after the first authentication is completed, or may generate dispatch information in response to a request from the kiosk terminal (200). For example, if the reservation holder does not make a reservation on the user terminal (400), but directly makes a reservation on the kiosk terminal (200), the kiosk terminal (200) may transmit information on a waiting vehicle suitable for the vehicle usage information to the kiosk terminal (200) in response to the reservation request transmitted from the kiosk terminal (200). The kiosk terminal (200) may select at least one of the received waiting vehicles and process payment of the usage fee. After payment is completed, the server device (100) may confirm the reservation information based on the reservation information transmitted from the kiosk terminal (200), or may confirm the reservation information based on the reservation holder information and / or vehicle usage information included in the reservation request. The server device (100) can generate dispatch information after reservation information is confirmed.

[0041] The server device (100) can transmit reservation information and / or vehicle use information provided from the user terminal (400) to the kiosk terminal (200). After the reservation holder reaches the kiosk terminal (200), the reservation holder can input unique information such as a reservation number corresponding to the reservation information and / or reservation holder information into the kiosk terminal (200) or provide the server device (100) through an application of the user terminal (400). As described above, if reservation information is not provided from the user terminal (400), entry of reservation information may be requested through the kiosk terminal (200).

[0042] When the reservation information of the person making the reservation is confirmed and driver's license information is not received from the user terminal (400), the server device (100) may request the kiosk terminal (200) to input driver's license information for providing a vehicle rental service.

[0043] The kiosk terminal (200) can output a message requesting the driver to input the driver's license of the driver who will drive the dispatched vehicle into the driver's license scanner of the kiosk terminal (200) through the display (250) or the speaker of the interface unit (260).

[0044] The kiosk terminal (200) can generate driver's license information by scanning a driver's license entered into the driver's license scanner. The driver's license information may be a scanned image of the entire driver's license scanned by the kiosk terminal (200). Alternatively, the driver's license information may include text-based driver's license information and a driver's license photo, obtained through OCR.

[0045] The kiosk terminal (200) can capture a driver's face image and iris image through the camera unit (230). The camera unit (230) can include a color camera and an infrared camera. The color camera can capture the driver's face, and the infrared camera can capture the driver's iris. The kiosk terminal (200) can additionally include an infrared sensor. The kiosk terminal (200) can measure the distance between the driver, who is the subject of the capture, and the kiosk terminal (200) based on the infrared sensor, and can request the driver to move to an appropriate position to capture the driver's face and iris. The kiosk terminal (200) can recognize the driver's eye area or pupil area in the driver's face image captured by the color camera, and control the infrared camera to capture the driver's iris based on the position of the area. If the kiosk terminal (200) fails to recognize the driver's eye area or pupil area in the captured driver's face image, it can output a message requesting the driver to move.

[0046] The kiosk terminal (200) can generate first facial image information using feature points extracted from the captured facial image of the driver and / or the facial image itself. The kiosk terminal (200) can generate first iris information using feature points extracted from the captured iris image of the driver and / or the iris image itself. In the embodiments of the present specification, facial image information and iris information may each mean the captured image itself or feature points extracted from the captured image. When extracting feature points from the image, the processor of the kiosk terminal (200) may perform image processing to extract feature points. In one embodiment, the image processing module that extracts feature points may be some layers constituting a deep learning-based learning model or an image processing program. The deep learning-based learning model may be composed of some layers extracted from a learning model that performs first authentication in the server device (100). The memory device (220) of the kiosk terminal (200) may include a volatile memory device and / or a non-volatile memory device, and the image processing module may be loaded into or from the memory device (220) and executed by the processor (210). The kiosk terminal (200) may transmit the generated first facial image information and first iris information to the server device (100).

[0047] The server device (100) can receive driver's license information, the driver's first facial image information, and the driver's first iris information from the kiosk terminal (200).

[0048] The server device (100) can perform the first authentication by comparing the driver's license photo included in the driver's license information with the driver's first facial image information. That is, the server device (100) can perform the first authentication by determining whether the driver in the driver's license photo and the driver in the first facial image information are the same person.

[0049] Additionally, according to an embodiment, the server device (100) can verify whether the information on the driver's license matches the administrative information through the authentication module (150).

[0050] If the first authentication is successful by comparing the driver's license photo included in the driver's license information with the driver's first facial image information, dispatch information can be confirmed.

[0051] In one embodiment, when a user creates reservation information at a kiosk terminal (200), the search module (160) may provide the vehicle rental service usage fee calculated through the billing module (160) to the kiosk terminal (200) to request payment of the user's usage fee.

[0052] According to an embodiment, the server device (100) may calculate a usage fee based on the type of target vehicle (320) and requested service requested by the user terminal (200) through the charging module (160). The usage fee may be calculated in response to a reservation request transmitted by the user terminal (400) or in response to reservation information generated by the kiosk terminal (200). Calculation of the usage fee may additionally require usage time, etc. depending on the type of requested service, but this is possible using various conventionally known methods, and a detailed description thereof is omitted herein.

[0053] When the usage fee is processed, the server device (100) can store the driver's license information in the storage module (130) by linking it with the information of the dispatched vehicle.

[0054] When a usage fee is processed, the server device (100) can generate authentication information that can be authenticated to the target vehicle (320) through the authentication module (150). The authentication information can be generated as a mobile key and transmitted to the user terminal (400). The mobile key may be a URL-based mobile key.

[0055] The dispatch vehicle (RC) can be controlled by the mobile key of the user terminal (400). For example, the door of the dispatch vehicle (RC) can be opened and locked by the mobile key. Additionally, the Hi-pass power of the dispatch vehicle (RC) can be turned on / off by the mobile key. In this case, the mobile key can include a Hi-pass usage right generated based on reservation information. Control of the mobile key can be performed by the vehicle terminal (300) mounted on the dispatch vehicle (RC). The control command of the user terminal (400) can be transmitted to the vehicle terminal (300) through the server device (100) or can be transmitted to the vehicle terminal (300) from the user terminal (400) via wireless communication. The wireless communication can include short-range communication. Short-range communication can be Bluetooth™, RFID (Radio Frequency Identification), Infrared Data Association (IrDA), UWB (Ultra Wideband), ZigBee, NFC (Near Field Communication), etc.

[0056] The vehicle terminal (300) may include a control unit (310) and a camera unit (320). The control unit (310) of the vehicle terminal (300) may be electrically connected to an electronic control unit (ECU) and / or an on-board diagnostics (OBD) port of a dispatch vehicle (RC). The OBD port may be an OBD-II port. The camera unit (320) may include a color camera and / or an infrared camera. The vehicle terminal (300) may transmit a vehicle status request to the dispatch vehicle (RC) and, in response, receive vehicle status information in a CAN protocol format from the dispatch vehicle (RC) through the OBD II port. In addition, the vehicle terminal (300) may transmit a control signal to the dispatch vehicle (RC) and, in response, receive a control result of the dispatch vehicle (RC) through the OBD II port.

[0057] In one embodiment, when the vehicle terminal (300) receives a door opening request of a dispatched vehicle (RC) by a mobile key of a user terminal (400), it may transmit a door opening control command to the dispatched vehicle (RC) and supply power to the infrared camera of the camera unit (320). The power supply to the infrared camera of the camera unit (320) may be performed by directly supplying power to the infrared camera from the vehicle terminal (300) or by transmitting a control command requesting power supply to the infrared camera to the power supply unit of the dispatched vehicle (RC). Infrared cameras generally require a certain amount of booting time from power supply. The vehicle terminal (300) according to an embodiment of the present disclosure may perform power supply to the infrared camera in response to the door opening of the dispatched vehicle (RC), thereby reducing the time it takes for the driver to perform the second authentication.

[0058] The vehicle terminal (300) can generate an iris image of a driver seated in the driver's seat of a dispatch vehicle (RC) using the infrared camera of the camera unit (320). The vehicle terminal (300) can generate second iris information using feature points extracted from the iris image and / or the iris image itself. The vehicle terminal (300) can transmit the second iris information to the server device (100).

[0059] The server device (100) can perform a second authentication by comparing the second iris information received from the vehicle terminal (300) with the first iris information received from the kiosk terminal (200). The server device (100) transmits the second authentication result to the vehicle terminal (300), and the vehicle terminal (300) can maintain or release the ignition lock of the dispatched vehicle (RC) in response to the second authentication result.

[0060] The vehicle terminal (300) can unlock the ignition of the dispatched vehicle (RC) in response to the second authentication result being successful.

[0061] The vehicle terminal (300) can cut off the power supplied to the infrared camera of the camera unit (320) in response to the driver temporarily stopping driving, turning off the engine of the dispatched vehicle (RC), and a door lock command using the mobile key. The vehicle terminal (300) according to the embodiment of the present disclosure can perform additional second authentication of the driver as needed or perform processing such as monitoring the driver for drowsy driving by performing power cutoff to the infrared camera in response to the engine turning off and the door locking of the dispatched vehicle (RC).

[0062] An embodiment of the present disclosure can determine the identity of the driver of a service contract and the actual driver of a dispatched vehicle (RC) through two processes: first authentication through determining the identity of the first facial image information captured by a kiosk terminal (200) and the driver's license photo, and second authentication through determining the identity of the first iris information captured by the kiosk terminal (200) and the second iris information captured by a vehicle terminal (300). Accordingly, it is possible to prevent the vehicle from being rented using an ID card, mobile phone, etc. of someone other than the actual driver.

[0063] Additionally, the accuracy of determining person identity can be improved by using different authentication modalities for the first and second authentications.

[0064] While the embodiment described with reference to FIG. 1 described second authentication as being performed based on an iris image, it can be performed similarly using other biometric authentication modalities. For example, second authentication may be performed based on fingerprint information, vein information, etc., and the present invention does not specifically limit the authentication modality of second authentication.

[0065]

[0066] Referring to FIG. 2, the configuration of a kiosk terminal according to an embodiment of the present disclosure is described. The kiosk terminal (200) may correspond to the kiosk terminal (200) described with reference to FIG. 1.

[0067] The kiosk terminal (200) may include a processor (210), a memory device (220), a camera unit (230), a driver's license scanner (240), a display (250), and an interface unit (260). The kiosk terminal (200) may additionally include a payment module (270).

[0068] The processor (210) can control the overall operation of the kiosk terminal (200). According to an embodiment, the processor (210) can generate first facial image information and first iris information based on the facial image and iris image captured by the camera unit (230), respectively. The processor (210) can generate the first facial image information and the first iris information through image processing or some layers of a learning model. Some layers of the learning model may be some layers of the learning model that performs the first authentication in the embodiment described with reference to FIG. 1. For example, some layers of the learning model may be encoding layers composed of a plurality of convolutional layers.

[0069] The memory device (220) may temporarily store commands performed by the processor (210), or may store first facial image information and first iris information.

[0070] The camera unit (230) may include a color camera and an infrared camera that performs iris photography.

[0071] The driver's license scanner (240) includes an optical scanner module and can optically scan an inserted driver's license to generate a driver's license scan image. The driver's license scanner (240) can be implemented using conventionally known card scanner technology. For example, the scanner can include a line scanner that detects whether a driver's license is inserted using a sensor mounted on the slot and scans the driver's license while moving it. Alternatively, the scanner can include a camera whose field of view (FOV) is set to the entire inserted driver's license. The processor (210) can generate text-based driver's license information and driver's license information including a driver's license photo through OCR. Alternatively, the processor (210) can generate driver's license information using a photo of the entire driver's license.

[0072] The display unit (250) can be combined with at least a part of the interface unit (260) of the touch sensor. The visual output of the kiosk terminal (200) can be displayed (output) through the display unit (250). The display unit (250) can display information processed in the kiosk terminal (200). In addition to a touch-type interface including a touch-type input means, the interface unit (260) can include a microphone for receiving an audio signal and a user input unit for receiving information from a user. The user input unit can include a mechanical input means (or a mechanical key, button, dome switch, jog wheel, jog switch, etc.). The touch-type input means can be composed of a virtual key, a soft key, or a visual key displayed on a touch screen through software processing, or a touch key placed on a part other than the touch screen.

[0073] In one embodiment, the interface unit (260) may include an output unit for transmitting information to a user. The output unit is for generating output related to visual, auditory, or tactile sensations, and may include at least one of a display unit, an audio output unit, and an optical output unit. The audio output unit may include at least one of a receiver, a speaker, and a buzzer. The optical output unit may include an LED.

[0074] The payment module (270) can read card information from a payment method such as a credit card, check card, or cash card when the payment method is input.

[0075]

[0076] Referring to FIG. 3, the first authentication and second authentication of the server device (100) according to one embodiment of the present disclosure will be described in detail.

[0077] The server device (100) can perform first authentication (AUTH_1) using first information (INFO_1) generated by the kiosk terminal (200), and perform second authentication (AUTH_2) using part of the first information and second information (INFO_2) generated by the vehicle terminal (300). The first authentication and the second authentication can be performed based on the same authentication modality or based on different authentication modalities, depending on the embodiment.

[0078] The first information (INFO_1) may include driver's license information (DL) and first facial image information (CA1). The driver's license information (DL) may be a scanned image of a driver's license or information extracted from a scanned image of a driver's license. For example, at least one of a driver's license photo (DL1), a driver's license number (DL2), other driver's license information (driver's name, driver's license resident registration number, driver's license address, etc.) (DL3), and a driver's license issuing agency / issuance date (DL4) may be extracted from a scanned image of a driver's license.

[0079] The first information (INFO_1) may include first facial image information (CA1) extracted from a user's image (CA) captured by a camera of a kiosk terminal (200). The kiosk terminal (200) or server device (100) may extract the first facial image information (CA1) from the user's image (CA).

[0080] The first information (INFO_1) may include the user's first iris information (CA2) captured by the camera of the kiosk terminal (200).

[0081] The server device (100) can compare the driver's license photo (DL1) of the first information (INFO_1) and the first facial image information (CA1), determine the identity of the person, and perform the first authentication (AUTH_1).

[0082] In one embodiment, the first authentication (AUTH_1) may be performed based on a deep learning-based learning model. The learning model may be a learning model trained to determine whether a driver in a driver's license photo and a person in the first facial image information are identical. The learning model may be a learning model in which images taken from the same person of different ages or the same age are labeled as person identity, or images taken from different people of different ages or the same age are labeled as person identity. The learning model may be a learning model trained to determine whether the person in the first image and the second image are identical based on age-invariant features. That is, the learning model may be configured such that a portion of the network structure distinguishes between age-invariant features and age-related features among a plurality of features. The learning model inputs the output of an encoding layer composed of multiple convolutional layers into an attention module. The feature points extracted by the attention module are split into multiple layers, each combined with the output of the convolutional layers. The final output layer can be divided into a layer for determining age and a layer for determining person identity. Therefore, the feature points extracted by the attention module can be structured to distinguish between age-invariant features and age-related features.

[0083] Age-invariant features can be a learning model trained to distinguish features that are robust to age changes among mixed features extracted from an image and to determine person identity based on the features that are robust to age changes.

[0084] For example, mixed features can be decomposed and then identity-related features can be isolated through hidden factor analysis (HFA). Alternatively, HFA can be extended to a deep learning framework using a latent factor-guided convolutional neural network (LF-CNN).

[0085] Deep learning-based learning models can include CNN or R-CNN (Region-based CNN), C-RNN (Convolutional Recursive Neural Network), Fast R-CNN, Faster R-CNN, R-FCN (Region-based Fully Convolutional Network), YOLO (You Only Look Once) or SSD (Single Shot Multibox Detector), and attention-structured neural networks.

[0086] The learning model can be implemented in hardware, software, or a combination of hardware and software, and when part or all of the learning model is implemented in software, one or more commands, parameters, and / or connection relationship data of nodes constituting the learning model can be stored in the storage module (130) of the server device (100) and loaded into the memory device (120).

[0087] In one embodiment, the server device (100) may calculate the driver's age difference based on the date and time the first facial image information was generated and the driver's license issuance date included in the driver's license information, and perform the first authentication further based on the calculated driver's age difference. The driver's age difference may be the difference between the year the first facial image information was generated and the year the driver's license was issued.

[0088] In one embodiment, the server device (100) may determine the driver's gender based on the driver's resident registration number included in the driver's license information, and perform first authentication further based on the determined driver's gender.

[0089] In addition to the training methods described above, the learning model can be trained based on the driver's gender and / or age. For example, the training data for the learning model can be separated by gender to create multiple gender-specific learning models. Furthermore, the training data for the learning model can be separated by age difference or the ratio can be changed to create multiple age-specific learning models. The server device (100) can select an appropriate learning model from among the multiple learning models based on the driver's gender and / or the calculated age difference.

[0090] The second information (INFO_2) may include second facial image information (CB1) extracted from the user's image (CB) captured by the camera of the vehicle terminal (300). The vehicle terminal (300) or the server device (100) may extract the second facial image information (CB1) from the user's image (CB). The second information (INFO_2) may include second iris information (CB2) of the user captured by the camera of the vehicle terminal (300).

[0091] In one embodiment, the server device (100) can compare the first iris information (CA2) of the first information (INFO_1) with the second iris information (CB2) of the second information (INFO_2), determine the identity of the person, and perform the second authentication (AUTH_2).

[0092] Second authentication (AUTH_2) can be performed by an image processing module or a deep learning-based learning model. The learning model performing second authentication (AUTH_2) may be a CNN-based learning model trained with training data of multiple iris images labeled as matched or mismatched. The image processing module performing second authentication (AUTH_2) may extract and encode features of the pattern appearing in the iris region, and then compare the similarity of the two codes. Various image processing methods known in the art for comparing iris patterns may be used.

[0093] By using different authentication modalities for the first authentication (AUTH_1) and the second authentication (AUTH_2), the accuracy of determining person identity can be improved.

[0094] In another embodiment, the server device (100) may compare the first facial image information (CA1) of the first information (INFO_1) with the second facial image information (CB1) of the second information (INFO_2), determine the identity of the person, and perform the second authentication (AUTH_2). By using the same authentication modality for the first authentication (AUTH_1) and the second authentication (AUTH_2), the implementation cost efficiency may be improved.

[0095] Additionally, the second authentication (AUTH_2) may use both the comparison of the first facial image information (CA1) and the second facial image information (CB1) of the second information (INFO_2), and the comparison of the first iris information (CA2) of the first information (INFO_1) and the second iris information (CB2) of the second information (INFO_2), or may use only one of them depending on the environment. Therefore, the accuracy of determining the identity of a person can be improved, and situations where authentication is not possible due to device errors can be prevented.

[0096]

[0097] Referring to FIG. 4, an unmanned vehicle rental method of an unmanned vehicle rental system according to an embodiment of the present disclosure will be described. The unmanned vehicle rental system may include a server device (100), a kiosk terminal (200), and a vehicle terminal (300) described with reference to FIGS. 1 to 3. Parts that overlap or are similar to the embodiments described with reference to FIGS. 1 to 3 will be omitted for detailed description.

[0098] At step S110, the user terminal (400) can transmit a reservation request to the server device (100). The server device (100) can transmit information on a waiting vehicle to the user terminal (400) in response to the reservation request.

[0099] At step S120, after payment for the usage fee for the selected standby vehicle is completed, reservation information may be confirmed. The server device (100) may confirm the reservation information based on the reservation information transmitted by the user terminal (400) or may confirm the reservation information based on information in the reservation request. The reservation request or reservation information may include reservation holder information and / or vehicle usage information.

[0100] At step S130, the kiosk terminal (200) that has confirmed the reservation information can scan the driver's license input into the driver's license scanner to generate driver's license information and transmit the driver's license information to the server device (100). The kiosk terminal (200) can transmit first facial image information and first iris information acquired through the camera to the server device (100).

[0101] At step S140, the server device (100) can perform first authentication by comparing the driver's license photo included in the driver's license information with the first facial image information.

[0102] At step S150, the server device (100) transmits the result of the first authentication to the kiosk terminal (200), and if the first authentication is successful, it can perform dispatch confirmation or reservation confirmation, etc. Optionally, the kiosk terminal (200) can display a first authentication success message on the display (250).

[0103] At step S160, the server device (100) can transmit a mobile key to the user terminal (400) in response to the success of the first authentication.

[0104] At step S170, the user terminal (400) can transmit a control command to open the door of the dispatched vehicle to the vehicle terminal (300) using the mobile key received from the server device (100). The control command can be directly transmitted from the user terminal (400) to the vehicle terminal (300) based on short-range communication, or can be transmitted to the vehicle terminal (300) through the server device (100) based on wireless Internet.

[0105] At step S180, the vehicle terminal (300) can obtain second iris information of a driver attempting to drive a dispatched vehicle, and at step S190, can transmit the obtained second iris information to the server device (100).

[0106] At step S200, the server device (100) can perform second authentication by comparing the first iris information transmitted by the kiosk terminal (200) with the second iris information transmitted by the vehicle terminal (300).

[0107] At step S210, the server device (100) transmits the result of the second authentication to the vehicle terminal (300), and at step S220, in response to the result of the second authentication being successful, the vehicle terminal (300) can transmit a request for ignition unlock to the dispatched vehicle. The driver can drive the dispatched vehicle, and at step S230, the vehicle terminal (300) can transmit operation information of the dispatched vehicle to the server device (100).

[0108] At step S240, the user terminal (400) can transmit a control command to lock the door of the dispatched vehicle to the vehicle terminal (300) using the mobile key received from the server device (100). This command can also be transmitted directly from the user terminal (400) to the vehicle terminal (300) or transmitted to the vehicle terminal (300) via the server device (100).

[0109] At step S250, the vehicle terminal (300) may transmit a request to the dispatched vehicle to lock the engine of the dispatched vehicle, along with a request to lock the doors of the dispatched vehicle. According to an embodiment, if the location of the user terminal (400) is recognized and the location of the user terminal (400) is outside a preset distance from the vehicle terminal (300), the vehicle terminal (300) may transmit a request to the dispatched vehicle to lock the engine of the dispatched vehicle, along with a request to lock the doors of the dispatched vehicle.

[0110] In one embodiment, if the driver of the dispatched vehicle wishes to operate the dispatched vehicle again, he or she may be requested to re-perform steps (AB) for second authentication. That is, the vehicle terminal (300) may again acquire the driver's iris information (third iris information), and the server device (100) may perform re-authentication by comparing the newly acquired third iris information with the first iris information. Therefore, the possibility of unauthorized driver changes may be reduced.

[0111]

[0112] Referring to FIG. 5, a driverless vehicle rental system according to another embodiment of the present disclosure will be described. The driverless vehicle rental system may include a server device (100a) and a vehicle terminal (300a). Parts that overlap or are similar to the embodiments described with reference to FIGS. 1 to 3 will be omitted for detailed description, and differences will be primarily described.

[0113] Unlike the embodiments described with reference to FIGS. 1 to 3, the unmanned vehicle rental system may not include a kiosk terminal.

[0114] The user terminal (400a) can acquire driver's license information, first facial image information, and first biometric information and transmit them to the server device (100a). The user terminal (400a) can generate driver's license information using a driver's license image captured by the camera unit (420a) or information extracted from the captured driver's license image through OCR and transmit the generated driver's license information to the server device (100a). The first biometric information can be any biometric information having unique characteristics of an individual, such as iris information, fingerprint information, or voice information. The biometric information acquisition unit (430a) can be any one of an infrared camera, a fingerprint sensor, and a voice recorder. The first facial image information can be a facial image captured by a color camera of the camera unit (420a).

[0115] The server device (100a) can perform first authentication by comparing the first facial image information transmitted from the user terminal (400a) with the driver's license photo in the driver's license information. The result of the first authentication can be transmitted to the user terminal (400a). In response to a successful first authentication result, the server device (100a) can transmit a mobile key to the user terminal (400a).

[0116] The vehicle terminal (300a) can transmit the driver's iris image captured through the camera unit (320a), or second biometric information including at least one of fingerprint information, voice information, etc. through the biometric information acquisition unit (430a) to the server device (100a).

[0117] The server device (100a) can perform second authentication by comparing the first biometric information transmitted from the user terminal (400a) with the second biometric information transmitted from the vehicle terminal (300a).

[0118]

[0119] The above-described present disclosure can be implemented as computer-readable code on a program-recorded medium. The computer-readable medium includes all types of recording devices that store data that can be read by a computer system. Examples of computer-readable media include hard disk drives (HDDs), solid-state disk drives (SSDs), silicon disk drives (SDDs), read-only memory (ROM), random-access memory (RAM), CD-ROMs, magnetic tapes, floppy disks, and optical data storage devices. Furthermore, the computer may include a processor of each device.

[0120] Meanwhile, the above program may be specifically designed and constructed for the present disclosure, or may be known and available to those skilled in the computer software field. Examples of the program may include not only machine language code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like.

[0121] The use of the term "above" and similar referential terms in the specification of this disclosure (especially in the claims) may refer to both the singular and the plural. Furthermore, if a range is described in this disclosure, it is intended that the invention encompasses individual values ​​within that range (unless otherwise stated), and is equivalent to describing each individual value within that range in the detailed description of the invention.

[0122] Unless the steps constituting the method according to the present disclosure are explicitly described in a specific order or are otherwise described in a different order, the steps may be performed in any appropriate order. The present disclosure is not necessarily limited by the order in which the steps are described. The use of all examples or exemplary terms (e.g., "for example," etc.) in this disclosure is merely intended to illustrate the present disclosure in more detail, and the scope of the present disclosure is not limited by the examples or exemplary terms unless otherwise defined by the claims. Furthermore, those skilled in the art will appreciate that various modifications, combinations, and variations can be configured according to design conditions and factors within the scope of the appended claims or their equivalents.

[0123] Therefore, the spirit of the present disclosure should not be limited to the embodiments described above, and all scopes equivalent to or equivalently modified from the following claims as well as the following claims are considered to fall within the scope of the spirit of the present disclosure.

[0124]

[0125] Meanwhile, the present invention is supported by the national research and development project described below.

[0126] [Project ID] 1425171436

[0127] [Assignment Number] 00187371

[0128] [Government Ministry Name] Ministry of SMEs and Startups

[0129] [Name of Project Management (Specialist) Agency] Small and Medium Business Technology Information Promotion Agency

[0130] [Research Project Name] Performance-Sharing Common Technology R&D (R&D)

[0131] [Research Project Name] Development of AI KIOSK-based Non-Face-to-Face Car Rental Service Platform Technology

[0132] [Contribution rate] 1 / 1

[0133] [Project Implementation Agency] Korea Small and Medium Rent-a-Car Cooperative

[0134] [Research Period] January 1, 2023 - December 31, 2023

[0135] Embodiments of the present disclosure can be used in a system for renting vehicles unmanned (non-face-to-face).

Claims

1. A method in which at least part of each step is performed on a server device, A step of receiving reservation information and vehicle use information from a user terminal or kiosk terminal; A step of receiving driver's license information obtained from the kiosk terminal, and first facial image information and first iris information captured by the camera unit of the kiosk terminal from the kiosk terminal; In response to a successful first authentication result, which is a result of comparing the driver's license photo included in the driver's license information with the first facial image information, a step of transmitting a mobile key capable of controlling the dispatched vehicle to the user terminal; A step of receiving second iris information captured by an iris capturing camera of the above-described dispatched vehicle from the above-described dispatched vehicle; and A method for renting an unmanned vehicle using dual authentication, comprising a step of transmitting a second authentication result to the dispatched vehicle in response to a result of comparing the first iris information acquired from the kiosk terminal with the second iris information acquired from the dispatched vehicle.

2. In paragraph 1, A step of inputting the driver's license photo and the first facial image information into a deep learning-based learning model to determine the identity of the person between the driver's license photo and the first facial image information, A method for renting an unmanned vehicle using double authentication, wherein the above learning model is a learning model trained to determine the identity of a person in a first image and a second image based on age-invariant features.

3. In paragraph 2, The above learning model is trained further based on the difference in the ages at which the first and second images were taken, and the gender of the person included in the first and second images, The step of determining the identity of the person between the above driver's license photo and the above first facial image information is: A step of further inputting the license date and gender information included in the above driver's license information; and A method for renting an unmanned vehicle using two-factor authentication, wherein the learning model further includes a step of determining person identity based on the license date and the gender information.

4. In paragraph 1, A step of receiving third iris information captured by an iris capturing camera of the dispatched vehicle from the dispatched vehicle, wherein the third iris information is different from the second iris information; and Including a step of transmitting a third authentication result to the dispatched vehicle in response to the result of comparing the first iris information obtained from the kiosk terminal and the third iris information obtained from the dispatched vehicle, A method for renting an unmanned vehicle using two-factor authentication, wherein the third iris information is information captured by an iris camera of the dispatched vehicle in response to the restart of the dispatched vehicle or the reopening of the door after locking.

5. A kiosk terminal that scans a driver's license to create driver's license information, creates first facial image information by photographing the face of the person making the reservation using a color camera, creates first iris information by photographing the iris of the person making the reservation using a first infrared camera, and transmits the driver's license information, the first facial image information, and the first iris information to a server device; A server device that associates reservation information received from a user terminal or the kiosk terminal with a dispatched vehicle and transmits a mobile key capable of controlling the dispatched vehicle to the user terminal in response to a successful first authentication result, which is a result of comparing the driver's license photo included in the driver's license information with the first facial image information; and Including a vehicle terminal mounted on the above-mentioned dispatch vehicle and operating at least a part of the components in response to the mobile key, generating second iris information by photographing the iris of the passenger using a second infrared camera, and transmitting the second iris information to the server device, The server device transmits a second authentication result to the dispatched vehicle in response to the result of comparing the first iris information with the second iris information obtained from the dispatched vehicle, An unmanned vehicle rental system using double authentication, wherein the vehicle terminal unlocks the ignition lock of the dispatched vehicle based on the second authentication result.

6. In paragraph 5, An unmanned vehicle rental system using dual authentication, wherein the vehicle terminal supplies power to the second infrared camera in response to the door of the dispatched vehicle being opened by the mobile key.

7. In paragraph 5, An unmanned vehicle rental system using dual authentication, wherein the vehicle terminal cuts off power supplied to the second infrared camera in response to the vehicle's engine being turned off and the door of the dispatched vehicle being locked by the mobile key.

8. In paragraph 5, An unmanned vehicle rental system using dual authentication, wherein the vehicle terminal sets the ignition lock of the dispatched vehicle in response to the vehicle's ignition being turned off, generates third iris information by photographing the iris of the passenger using the second infrared camera in response to an attempt to restart the vehicle, and transmits the third iris information to the server device.

9. In paragraph 5, The above kiosk terminal is, Recognize the face from the image of the face of the person making the reservation, recognize the iris from the recognized face, and control the first infrared camera based on the position of the recognized iris to generate the first iris information by capturing the iris of the person making the reservation. An unmanned vehicle rental system using two-factor authentication that displays a notification urging the reservation holder to move based on the result of recognizing the iris from the recognized face.

10. A method in which at least part of each step is performed on a server device, A step of receiving reservation information and vehicle use information from the first terminal; A step of receiving driver's license information, first facial image information, and first biometric information obtained from the first terminal; In response to a successful first authentication result, which is a result of comparing the driver's license photo included in the driver's license information with the first facial image information, a step of associating the reservation information with a dispatched vehicle and transmitting a mobile key capable of controlling the dispatched vehicle to the first terminal; A step of receiving second biometric information captured by a biometric information acquisition unit of a second terminal mounted on the dispatch vehicle from the second terminal; and A method for renting an unmanned vehicle using dual authentication, comprising a step of transmitting a second authentication result to the second terminal in response to a result of comparing the first biometric information acquired from the first terminal with the second biometric information acquired from the second terminal of the dispatched vehicle.

Images