Hands-free identity authentication application and service application that involves hands-free identity authentication

Abstract

[Problem] To provide a personal authentication application with which it is possible to execute a personal authentication procedure in a hands-free manner not only when a user file is opened at the start of service use but also when the user file is ended and closed at the end of service use.　[Solution] An open passcode for opening and editing a user file is user ID information that is held in a portable terminal of the user, and a close passcode for normally ending and closing the user file that is in an open state after receiving a service is biological information of the user. The present invention comprises: a hands-free open passcode acquisition process for acquiring, by wireless communication, user ID information of a user who has entered an open passcode input area; and a hands-free close passcode acquisition process for acquiring user biological information of a user who has entered a close password code input spot B. A matching process is respectively executed to execute a personal authentication process in a hands-free manner.　

Description

[Supplement based on Rule 26, 24.02.2026] Hands-free identity verification applications and service applications with hands-free identity verification

[0001] This invention relates to a hands-free user authentication application that operates on a computer system. It also relates to a service application that involves hands-free user authentication. In conventional user authentication applications, the user must perform some operation for authentication, but this invention allows authentication to be performed hands-free, and the services provided are not limited to those offered at various stores and facilities.

[0002] Various service applications operate in the market, and various security measures are in place. For example, to ensure that only authorized users can access the service application, user authentication is often required when starting to use the service application. Depending on the security level, this may involve simply entering a password via keyboard, entering ID information from a user card, or entering biometric information such as fingerprints or vein patterns. In this way, many service applications have a certain level of security set up in order to open the application file and make it operational.

[0003] In any case, with the conventional technologies described above, user authentication for service application access rights is not hands-free; the user must perform one of the following actions: inserting a card, entering a password, or touching a designated device. In other words, hands-free user authentication has not been achieved with conventional technologies.

[0004] For example, when considering service provision using a transportation IC card, an operation of touching the transportation IC card to a ticket gate is required, so it is not hands-free in the first place. Also, the authentication of the person himself / herself, which is crucial, is not actually carried out, and it is only assumed that the person who possesses the transportation IC card is the person with legitimate authority. Since the authentication of the person himself / herself is not carried out when using the service, if the transportation IC card is lost or stolen, it becomes possible for a person who has obtained the transportation IC card illegally to use the service illegally. Also, for example, when considering service provision for using a highway with an ETC card, since data transmission and reception are performed wirelessly between the in-vehicle device with the ETC card inserted and the highway gate device, the operation itself is hands-free. However, the authentication of the person himself / herself is not carried out when using the service, and it is only assumed that the ETC card holder is the person himself / herself. Therefore, when the ETC card is lost or stolen, it becomes possible for a person who has obtained and used the ETC card illegally to use the service illegally.

[0005] As described above, in the prior art, the security of person authentication is often incomplete and inconvenient. In the prior art, when person authentication is performed every time the service is used, person authentication such as requiring a password known only to the person himself / herself, inputting the person's biometric information, or requiring a personal information card is necessary. This person authentication often requires certain operations from the user and is inconvenient from the user's perspective. There is no highly accurate person authentication system in the prior art that can perform person authentication hands-free.

[0006] Furthermore, even in conventional technologies where user authentication was required each time the service was used, authentication was mostly only requested at the start of service use. In other words, once user authentication was successful at the start of service use and the service became available, user authentication was not required thereafter. That is, once user authentication was successful at the start of service use and service use became possible, it was assumed that only the legitimate user had used the service for the entire service period until the end of service use. In other words, when closing the user file after ending service use, or when ending the use of special functions, no password or ID information was required to end the service, and there were no user authentication security settings. Most services could be simply ended by entering a command or pressing a button such as "end" or "close".

[0007] In conventional technology, only Patent No. 6476533 discloses a system that achieves a high level of security by requiring and verifying user authentication at both the time the user file is opened when the service is started and when the user file is closed when the service is finished. Below, we introduce the user authentication procedure in general service applications and the user authentication procedure described in Patent No. 6476533.

[0008] Figure 14 is a diagram that simply illustrates the user authentication procedure in a typical service application, that is, the operation of launching the application, opening the user file, and then closing the user file when service use is terminated. This is just one example, but it is a typical operation of opening and closing a user file in conventional technology.

[0009] As shown in Figure 14(a), application 10 is installed on the computer system. When a user wants to use application 10, they select the application 10 icon displayed on the computer system's monitor using a pointing device such as a mouse, and launch application 10 by double-clicking or performing other actions.

[0010] Additionally, user files 20a, 20b, and 20c, which can be edited by application 10, are installed on the computer system, and their respective icons are displayed on the computer system's monitor. When a user selects the icon of the user file 20 they wish to edit using a pointing device such as a mouse and launches it by double-clicking, application 10 starts up, the user file 20 is loaded, and it becomes editable using application 10, with the data contents displayed on the monitor.

[0011] If the user file 20 has security settings configured, a password input column will pop up to perform user authentication, as shown in the upper part of Figure 14(b). Thus, in some cases, users are required to enter a password before starting to use the application 10, such as editing the user file 20. Depending on the application 10, some may also require the input of ID information from an IC card or biometric information in addition to a password. As shown in the upper part of Figure 14(b), if the user enters the requested password or code information via a keyboard or other input device to successfully open and use the user file 20, and the authentication is successful and the configured security level is met, the user file 20 will open and become usable.

[0012] Next, as shown in the lower part of Figure 14(b), once the desired editing of the user file 20 is complete, the application 10 will simply terminate and the user file 20 will be closed by selecting and clicking the "Exit" or "Close" operation menu or button on the input screen of the application 10 displayed on the monitor using a pointing device such as a mouse. In most applications 10, there is no need to enter a special password or ID information when closing the user file 20, and conventional applications 10 can simply terminate and close the user file 20.

[0013] In other words, when accessing user file 20, the system requests user authentication information based on various security levels to verify whether the user has legitimate usage rights. However, once authentication is successful at the start of use, it is assumed that the user continues to use the service correctly for the entire duration of use, and that the user also correctly terminates the service. Therefore, no special security settings, such as password entry, are required when closing user file 20 after editing is complete. If the operation itself is normal, application 10 can simply terminate and close user file 20.

[0014] Next, we will introduce the user authentication procedure according to Patent No. 6476533. Figure 15 is a simplified diagram illustrating the user authentication procedure according to Patent No. 6476533. As shown in Figure 15, the application 50 includes the application's main function 51, as well as an application file unlocking function 52 and an application file locking function 53. The application's main function 51 is diverse depending on the service used and is equipped with various functions for providing the service. It is also assumed that general-purpose functions such as data input, data output, and data storage functions are included. The application file unlocking function 52 is a function that receives input of an open PIN, verifies the authentication of the open PIN, and if authentication is successful, opens the corresponding user file 60, indicating that user authentication has been successful. The application file locking function 53 is a function that receives input of a close PIN, verifies the authentication of the close PIN, and if authentication is successful, normally terminates and closes the open user file 60, indicating that user authentication has been successful.

[0015] Thus, only Patent No. 6476533 in Patent Document 2 discloses a system that achieves a high level of security by requiring and verifying user authentication at both times: when opening the user file at the start of service use and when closing the user file at the end of service use.

[0016] Japanese Patent Publication No. 2006-277193, Japanese Patent No. 6476533

[0017] To prevent fraudulent use of services by users, it is important to perform user authentication not only at the start of service use but also at the end of service use to improve security and prevent fraudulent use. However, performing user authentication is often inconvenient for users. While a genuine user is naturally aware of their own identity, and understands that they must tolerate the necessary authentication procedures to prevent fraudulent use, having to perform authentication procedures according to the content and operation procedures required by the service application is extremely troublesome. Therefore, ideally, the user authentication procedure at the start of service use using the service application should be performed hands-free, and furthermore, the user authentication procedure at the end of service use should also be performed hands-free, and the authentication should be performed with high quality.

[0018] In conventional technology, biometric authentication, especially with facial recognition, is a noteworthy method of authentication because it is simple, requiring only a camera scan without the need for manual input or taking out tickets or cards and touching them to a device, and it is difficult to impersonate someone else. However, facial recognition authentication had challenges that needed to be addressed. Facial recognition authentication involves matching a registered facial image, which is believed to be the face of the person in question, with a user facial image entered by the user when using the service, and performing a verification process to confirm whether the two facial images match.

[0019] However, there are four problems with using facial images for identity verification. The first problem is that even if the user's facial image entered during use is actually the facial image of someone else, the matching process may be deemed successful, leading to misidentification. Recent improvements in facial image recognition technology have resulted in technologies that are said to have an accuracy rate of 99.99%, but if the accuracy rate is 99.99%, then there will be people with similar faces who will be recognized as the correct person in 10,000 people. For example, in large commercial facilities, large exhibitions, large amusement parks, and large event venues where many service users are mixed together at the same time, tens of thousands or even millions of people may be entering and exiting the same facility simultaneously, and an accuracy rate of 99.99% is insufficient for all users to be authenticated solely by hands-free facial images. Furthermore, there are people with similar faces, such as twins, siblings, and relatives, and the inability to distinguish between them and misidentification is also a major problem.

[0020] The second problem is that even if the user is actually the person in question, the user's facial image entered during use may differ slightly from their registered facial image, leading to a failed matching process and misidentification as someone else. As mentioned above, setting a high degree of match required to clear the matching process as a countermeasure against the first misidentification problem would actually increase the number of cases where the matching process fails even when the user is the person in question. This is because a person's face changes subtly from day to day. It is affected by factors such as whether or not the face is swollen, the intensity of makeup, the shape of the eyebrows, beard grooming, and the type of colored contact lenses worn. Furthermore, facial changes can also occur due to cosmetic surgery. In other words, even if the face at the time of registration and the face at the time of use are those of the same person, they are not 100% identical.

[0021] The third problem is that someone other than the actual user, who has no intention of impersonating them, may accidentally appear in the camera's image and be captured as the user's face, resulting in misidentification. In crowded, large venues, taking a user's image one by one with a camera would be inconvenient for users and would end up requiring them to go through the extra effort and trouble.

[0022] The fourth problem is that when there are millions of registered facial images, the facial image matching process requires matching all registered facial images every time a user's image is entered, which places an extremely heavy load on the computer's processing system. In other words, performing large-scale facial image matching processing exponentially increases the processing load on servers and other computers, posing a significant problem in practical operation.

[0023] Therefore, the present invention aims to provide an authentication application that enables hands-free authentication of the user's identity, in order to ensure high security by performing identity authentication not only at the start of service use but also during and after service use, and to improve user convenience. Furthermore, it aims to provide a service application that includes hands-free identity authentication using the said authentication application.

[0024] To achieve the above objectives, the hands-free personal authentication application of the present invention can be broadly divided into two types. The first type of hands-free personal authentication application of the present invention is a personal authentication application that works in conjunction with a service application that provides a service, and has an open PIN code set in each user's user file, program, or storage area to allow access to and use of the user file, program, or storage area, and a closed PIN code set to terminate access to the user file, program, or storage area, wherein the open PIN code is user ID information held in the user's mobile terminal, and the closed PIN code is the user's biometric information, and an open PIN code input area where an open PIN code input device is installed and a closed PIN code input spot where a closed PIN code input device is installed are defined. Here, the user authentication application performs an open password acquisition process in which it wirelessly acquires user ID information from the user's mobile terminal that has entered the open password input area via the open password input device to the computer system; a closed password acquisition process in which the user acquires user biometric information via the closed password input device at the closed password input spot; and a matching process between the open password and the closed password registered in the user file, the program, or the storage area and the open password and the closed password entered when using the service, thereby performing a user authentication process and enabling hands-free data processing of each service application and use of the service.

[0025] With the above configuration, the user authentication process allows for hands-free input of the open PIN code at the start of use and the closed PIN code, ensuring high security while making the user's input operation for authentication extremely easy. Only those who possess both the fact of ownership of the portable terminal device that inputs the open PIN code wirelessly and the user's biometric information as the closed PIN code can be authenticated as the person in question, resulting in a significantly higher accuracy rate than systems that only verify one of these. Furthermore, even considering large-scale services with millions of registered biometric entries, only a matching process between the open PIN code of the portable terminal and the registered biometric information is required, resulting in an extremely low system load. In addition, because the input of the open PIN code is also required, it is possible to flexibly set the degree of match required to clear the matching process between biometric information, solving the problem of misidentification of someone other than the person in question or failure to recognize the person in question.

[0026] In the above configuration, it is preferable that the open PIN code is the mobile terminal ID information assigned to the user's mobile terminal, the open PIN code input device in the open PIN code input area is a wireless communication device in a wireless communication means that the mobile terminal can respond to, the communication area of ​​the wireless communication device is restricted, and the configuration is adjusted so that the mobile terminal ID information cannot be entered via the mobile terminal unless the user who wishes to enjoy the service intentionally passes through it. Furthermore, in the above configuration, as a means of restricting the communication area of ​​the wireless communication device, the wireless communication device is equipped with a radio wave shielding member that shields communication radio waves, and the wireless communication device is a directional wireless communication device that can only transmit wireless communication in a predetermined direction and cannot transmit wireless communication in other directions. As a result, the communication area is restricted to a predetermined direction, making it possible to limit it to an area that a user who wishes to enjoy the service intentionally enters.

[0027] In the first type of user authentication application described above, the open PIN was the user ID information on the user's mobile device, and the closed PIN was the user's biometric information. However, in the second type of user authentication application, the relationship is reversed, with the open PIN being the user's biometric information and the closed PIN being the user ID information on the user's mobile device.

[0028] In other words, the second type of hands-free personal authentication application of the present invention is a personal authentication application that works in conjunction with a service application that provides a service, and has an open PIN code set in each user's user file, program, or storage area to allow access to and use of the user file, program, or storage area, and a closed PIN code set to terminate access to the user file, program, or storage area, wherein the open PIN code is the user's biometric information, and the closed PIN code is user ID information held in the user's mobile terminal, and an open PIN code input area where an open PIN code input device is installed and a closed PIN code input spot where a closed PIN code input device is installed are defined. Here, the user authentication application performs an open password acquisition process that causes the computer system to acquire the user's biometric information from the user who has entered the open password input area via the open password input device; a closed password acquisition process that, when the user enters the closed password input spot, acquires the user ID information from the user's mobile terminal via wireless communication; and performs a matching process between the open password and the closed password registered in the user file, the program, or the storage area and the open password and the closed password entered when using the service, thereby performing user authentication processing and enabling hands-free data processing to each application file and use of the service.

[0029] In the configuration of this second type of user authentication application, it is preferable that the closed PIN code is mobile terminal ID information assigned to the user's mobile terminal, the closed PIN code input device at the closed PIN code input spot is a wireless communication device in a wireless communication means that the mobile terminal can respond to, the communication area of ​​the wireless communication device is restricted, and the settings are adjusted so that the mobile terminal ID information cannot be entered via the mobile terminal unless the user intentionally passes through it. Furthermore, it is preferable that the wireless communication device is equipped with a radio wave shielding member that shields communication radio waves, the wireless communication device is a directional wireless communication device that can only transmit wireless communication in a predetermined direction and cannot transmit wireless communication in other directions, the communication area is restricted to the predetermined direction, and is limited to the range that the user who wishes to enjoy the service intentionally enters. As a result, it is possible to restrict the communication area to a predetermined direction and limit it to the range that the user who wishes to enjoy the service intentionally enters.

[0030] In either the configuration of the first type of personal authentication application or the configuration of the second type of personal authentication application, the input device for inputting the user's biometric information is a camera, the camera's shooting spot and shooting direction are adjusted so that the face image is not input unless the user intentionally passes through the closed PIN code input spot, and in the face image acquisition in the open PIN code acquisition process or the closed PIN code acquisition process, intent flag information indicating that the user intentionally initiated the personal authentication process is added to the face image data, and in the matching process, it is preferable to also check whether the intent flag information has been added. With the above configuration, when using a face image as biometric information, by adjusting the shooting spot and shooting direction so that the face image is not input unless the user intentionally passes through using the camera, it is possible to restrict the input of unnecessary face images of unintentional passersby and reduce the system load in the matching process. In the case of cashier payments at stores within a facility, the intention of the person to make a payment can be confirmed by holding their face up to the camera at the register, and even if a criminal act is committed by impersonation, the face image of the perpetrator is recorded, thus providing an effect of preventing fraudulent use. In the above explanation, the open PIN entry area is placed first along the user's path, followed by the closed PIN entry spot. However, the order of these locations can be reversed. In other words, the closed PIN entry spot may be placed first along the user's path, followed by the open PIN entry area.

[0031] Next, in large-scale systems used by many people, such as ticket gates at train stations, gates at large amusement parks, or entrances and exits to large facilities, where gate-type ticket machines that control the passage of each individual are unnecessary, and the system is designed for simultaneous entry and exit of many people, the following configuration can be used. In other words, the camera is linked to a face recognition system that recognizes and extracts the faces of people present in the image, and the camera is adjusted so that the face image cannot be input unless the user intentionally passes through. When the face recognition system detects that the user has passed through the camera's shooting direction, intent flag information is added to indicate that the user intentionally initiated the authentication process, and the matching process also checks for the addition of the intent flag information. In large-scale systems used by many people, when considering simultaneous entry and exit of many people, it is not realistic for each person to intentionally face the camera and input a face image. However, if people move along the flow of movement, face images can be captured by cameras above, in front, or at an angle. In this process, by linking the system with a face recognition system that recognizes and extracts human faces present in an image, and individually extracting and acquiring the user's face image, the matching and verification process can be performed efficiently.

[0032] In the above configuration, it is preferable that a closed PIN code input spot is provided adjacent to the open PIN code input spot along the user's movement path, and that upon the user's entry, the closed PIN code acquisition process executes an entry-time face capture synchronization process, which is triggered by the acquisition of the terminal identification number from the user's terminal in the open PIN code acquisition process, and upon the user's exit, the closed PIN code acquisition process executes an exit-time face capture synchronization process, which is triggered by the acquisition of the terminal identification number from the user's terminal in the open PIN code acquisition process, and that is triggered by the acquisition of the user's face image from the camera. With the above configuration, the open PIN code and closed PIN code can be reliably obtained from the user and user terminal during entry and exit from the facility along the user's movement path, and reliable identity authentication can be performed. Furthermore, the identity authentication process of the user's face image is performed by capturing a face image at a pinpoint location in conjunction with the acquisition of the open PIN code, and terminal device authentication and identity authentication are performed simultaneously. Next, we will describe how to handle situations where the Open PIN acquisition process is executed multiple times consecutively, either because the user has passed through multiple different Open PIN input areas in succession, or because the same Open PIN input area has passed through multiple times consecutively. For example, if the system is configured to include a timer that counts the elapsed service usage time, and a log management process that invalidates the input of the Open PIN after a predetermined time has elapsed following the execution of the Open PIN acquisition process based on the timer's count, then even if an error or unintended user acquires the Open PIN, if the acquisition time exceeds the normally expected service usage time, it can be timed out as unintentional. Furthermore, if the Open PIN is acquired multiple times consecutively, a configuration in which the Open PIN acquisition process includes a log management process that invalidates past Open PIN acquisitions in chronological order and only validates the most recent Open PIN acquisition is also preferable.If an open PIN is entered but a close PIN is not, and an open PIN is entered again, this is an error. Therefore, by using the FIFO (First In First Out) rule, it is possible to control the system so that only the acquisition of the latest open PIN is valid.

[0033] Next, for applications to large-scale systems used by many people, such as ticket gates at train stations, gates at large amusement parks, and entrances / exits to large facilities where many users are present, it is possible to devise ways to reduce the load by utilizing artificial intelligence systems, which have been developing in recent years. In the first type of personal authentication system and the second type of personal authentication system described above, each of the open PIN code input devices and the closed PIN code input device holds device ID information, and the system is configured to include an input device ID information prediction process that predicts the device ID information of one or more of the closed PIN code input devices at one or more of the closed PIN code input spots where the user is expected to input the closed PIN code after the open PIN code input. With the above configuration, the device ID information of the closed PIN code input device is also acquired in the closed input process, and in the matching process, a matching process is performed between the input device ID information predicted in the input device ID information prediction process and the input device ID information acquired in the closed PIN code acquisition process, which is expected to reduce the load on the matching process. Furthermore, the prediction accuracy can be improved by using artificial intelligence (AI) to learn and store past user service usage patterns in the prediction process based on input device ID information.

[0034] Next, we will describe the user ID information / mobile device ID information that can be obtained from a mobile device owned by the user and used in the user authentication application of the present invention. The following are some examples. MAC address (Media Access Control address) information is a unique number assigned to all devices connected to a network, and by identifying the MAC address information, the device (hardware) being used can be individually identified. In addition to MAC address information, other information that can be used in the present invention that can be obtained from a mobile device owned by the user includes the following. For example, IMEI (International Mobile Equipment Identity), MEID (Mobile Equipment Identifier), ESN (Electronic Serial Number), ICCID (Integrated Circuit Card Identifier), IMSI (International Mobile Subscriber Identity), Android ID, IDFV (Identifier for Vendor), IDFA (Identifier for Vendor), iCloud Identifier, etc. Regardless of the type of information, these can be obtained as unique ID information that can be obtained from a mobile device owned by the user, and by applying them, they can be used in the present invention.

[0035] Next, regarding the communication methods for wireless communication devices, there are the Wi-Fi Direct wireless communication method and the Ultra Wide Band wireless communication method. However, if a hands-free communication environment is established, other wireless communication methods may also be applied. For example, there are the Zigbee communication method and the Sigfox communication method. In addition, any wireless communication methods developed and popularized in the future can be adopted. Currently, mobile devices such as smartphones can communicate wirelessly with Wi-Fi Direct wireless communication devices without any special settings, which is very convenient. At present, the Wi-Fi Direct method is the most promising, but if any other communication method that enables wireless data communication with mobile devices such as smartphones without any special settings becomes available now or in the future, it can be used as an alternative to Wi-Fi Direct wireless data communication.

[0036] The communication range of wireless communication devices is limited to a radius of 10 meters, which is practical as it ensures that an open password cannot be entered unless the user intentionally enters that area. It is possible to adjust the radius to be even smaller, for example, 7 meters, 5 meters, 3 meters, 2 meters, or 1 meter. Conversely, it is also possible to set a range wider than 10 meters. The communication range can be controlled by adjusting the output power of the wireless communication device or by surrounding it with radio wave shielding materials.

[0037] Next, we will discuss improvements to the billing process. If the service involves a charge for using the service, the service provider's system may be configured to include a billing information input process for inputting billing information related to the provision of the service, and after the open PIN acquisition process and prior to the close PIN acquisition process, the system may receive billing information input from the service provider's system and write the billing information to the user file, and upon successful matching through the matching process, either execute the settlement process based on the billing information written to the user file itself or request the financial institution system to perform the settlement process. With the above configuration, between the open PIN acquisition process and the close PIN acquisition process, the service provider can execute a billing information input process to write the billing information as part of the editing process, and the user can approve the settlement of the charge by entering the close PIN.

[0038] Furthermore, the services that can be provided in the hands-free personal authentication application of the present invention described above are diverse. For example, a service provided in a store or facility, where the open PIN code input area is located along the path from the entrance of the store or facility, and the closed PIN code input spot is located at the cash register or collection point near the exit of the store or facility. For example, applicable services may include those provided in retail stores, online shopping sites, restaurants, service-providing stores, medical facilities, transportation facilities, vehicles, financial systems, and government facilities. Of course, there are many other applicable services besides those listed here. In short, the hands-free personal authentication application of the present invention can be used in a wide variety of and general-purpose applications.

[0039] Next, the present invention provides a service application with hands-free user authentication, which includes a service data editing process step in which the computer system running the service application inputs service provision data obtained from the service application into the service application file, which is opened by the input of the open password, and performs an editing process; and a termination process step in which the service-related functions are terminated either in conjunction with or independently before the termination of the service application file, after the service application file becomes operable by the input of the open password and the service-related functions become available, by the input of the close password. In this way, the present invention can be applied to a variety of service applications by linking it with the hands-free user authentication application of the present invention. Furthermore, the present invention can also be provided as a hands-free user authentication method, similar to the process described in the user authentication application above.

[0040] This diagram illustrates the configuration and data flow of a first type of personal authentication application 100a, service application 200, and user file 300. This diagram illustrates the configuration and data flow of a second type of personal authentication application 100b, service application 200, and user file 300. This diagram illustrates the operation and data flow of the open PIN acquisition process and user file open processing function upon input of an open PIN. This diagram illustrates the service provision by the service application and its interaction with the user file and the data flow after the user file open processing. This diagram illustrates the data flow of the service application termination and settlement processing to the financial institution system after the user file close processing. This diagram briefly shows the settings of the open PIN input area, the configuration of the wireless communication equipment, and the wireless communication area. This diagram shows an example configuration with log management processing and log management control. This diagram briefly shows the settings of the closed PIN input spot and the shooting direction of the camera. This diagram shows an example of application to a large-scale system where there are multiple open PIN input areas A and multiple closed PIN input spots B. This diagram shows a configuration in which the closed PIN acquisition process 120 is equipped with an image conversion process 122. This figure shows a configuration in which the matching process 130 includes an input device ID information prediction process 133. This figure illustrates the difference between the matching process in the prior art and the matching process in the identity authentication application of the present invention regarding the matching process of face images. This figure shows an overview of the operation of a conventional general application. This figure briefly illustrates the configuration of an application disclosed in the conventional Japanese Patent Publication No. 6476533. This figure briefly illustrates the configuration of the application.

[0041] The best mode for carrying out the present invention will be described in detail below with reference to examples. However, the present invention is not limited to these examples. In the following descriptions of each example, the object holding the open and closed PINs will be described as a user file, but it may also be a program or a storage area. In other words, wherever "user file" is written, it may be read as a program or a storage area, and hardware resources such as the user file database may be read as a program storage device or memory device. Example 1 will briefly describe the configuration and data flow of the personal authentication application 100, the service application 200, and the user file 300. Example 2 will describe an application example to a large-scale transportation service where one or more closed PIN input spots may be set upon entry. Example 3 will describe countermeasures for the event in which a user unintentionally enters multiple open PIN input areas consecutively during their journey, resulting in multiple open PIN inputs.

[0042] The basic configuration and basic data flow of the user authentication application 100, service application 200, and user file 300 according to Example 1 will be briefly explained. The user authentication application 100 is linked to the service application 200 that provides the service, and performs hands-free, highly secure user authentication when the user starts using the service, notifies the service application 200 that user authentication has been successful, and then proceeds to provide the service to the user. User authentication is also performed hands-free and highly secure during and after enjoying the service, and notifies the service application 200 that user authentication has been successful, which then terminates the service provision and performs settlement processing with the financial institution system.

[0043] The personal authentication application 100 includes a first type of personal authentication application 100a and a second type of personal authentication application 100b. As shown in FIG. 1, in the first type of personal authentication application 100a, the open password is the user ID information of the user's mobile terminal, and the closed password is the user's biometric information. However, as shown in FIG. 2, in the second type of personal authentication application 100b, the relationship is reversed, the open password is the user's biometric information, and the closed password is the user ID information of the user's mobile terminal.

[0044] FIG. 1 is a diagram for explaining the configuration and data flow of the first type of personal authentication application 100a, the service application 200, and the user file 300. As shown in FIG. 1, the personal authentication application 100a has an open code input area A for inputting an open password with the wireless communication device 111, and a closed password input spot B where a closed password input device 121 for inputting a closed password that is the user's biometric information is installed. FIG. 2 is a diagram for explaining the configuration and data flow of the second type of personal authentication application 100b, the service application 200, and the user file 300. As shown in FIG. 2, the personal authentication application 100b has an open password input area A where an open password input device 121 for inputting an open password that is the user's biometric information is installed, and a closed password input spot B for inputting a closed password with the wireless communication device 111. Here, as shown in FIGS. 1 and 2, the difference between the first type of personal authentication application 100a and the second type of personal authentication application 100b is only that the open password and its input device, and the closed password and its input device are different. Therefore, here, the explanation will be centered on the first type of personal authentication application 100a in FIG. 1. The second type of personal authentication application 100b can be understood by simply swapping those different configurations, so the explanation here is omitted.

[0045] First, the user file 300 and the user file database 400 will be explained. The user file 300 is a file organized for each user and has an open password 310, a close password 320, and a user file data recording area 330. The open password 310 is a password used to open and edit the user file 300 and is the user ID information. In this example, as will be described later, it is the MAC address held on the smartphone 2. The close password 320 is a password used to close the user file 300 and is the user's biometric information. In this example, as will be described later, it is the user's facial image. The user file data recording area 330 is an area where service usage data generated by the service provision by the service application main function 230 of the service application 200 after authentication by the user authentication application 100 has been successful can be recorded by the service data editing processing function 240. As will be described later, this area also records settlement data when it is sent to the financial institution system in conjunction with the settlement function 250.

[0046] The user file database 400 is a database that registers one or more of the user files 300 described above. The configuration of the database itself is not limited, but in this example, it is a database system built on the cloud, connected to the internet, and accessible via the internet. The scale of the user file database 400, such as the number of user files 300 registered, is not limited. It could be a small local system within a company with dozens of users, or it could be a service with tens of thousands or even hundreds of millions of users, as it also covers services using credit services, JR transportation systems, or My Number (social security number).

[0047] Next, as shown in FIG. 1, the personal authentication application 100 has a configuration including an open password code acquisition process 110, a closed password code acquisition process 120, and a matching process 130. The open password code acquisition process 110 is a function that executes a process of wirelessly communicating and acquiring user ID information from the mobile terminal 2 of the user 1 that has entered the open code input area A via the wireless communication device 111. When the matching process 130 described later also uses the input device ID information for matching, in the open password code acquisition process 110, the mobile terminal 2 of the user 1 transmits the user ID information, and the received wireless communication device 111 attaches the input device ID and transmits it to the open password code acquisition process 110. Alternatively, the wireless communication device 111 attaches the input device ID and transmits it to the mobile terminal 2 of the user 1, and the received mobile terminal 2 attaches the input device ID to the user ID information and transmits it to the open password code acquisition process 110. Here, the former will be continued for explanation.

[0048] Here, the wireless communication means is not limited, but the wireless communication device can be a WiFi Direct wireless communication device, and the wireless communication means used can be a device adopting the WiFi Direct wireless communication method. Devices adopting other wireless communication means may also be used. In addition to the WiFi Direct wireless communication method, for example, there is an Ultra Wide Band ultra-wideband wireless communication method (hereinafter abbreviated as the UWB communication method). The UWB communication method uses radio waves of a relatively high frequency and is a technology that can specify the position in units of several centimeters, which is finer than the position information by GPS. Therefore, between a smartphone adopting the UWB communication method and a UWB communication device, communication is possible only when they are close to each other within several centimeters or a dozen centimeters, so there is an advantage that crosstalk and interference with other smartphones are unlikely to occur. On the other hand, there may also be a disadvantage that the open password code cannot be transmitted while the smartphone is stored in a pocket or a bag. Therefore, here, an example using WiFi Direct wireless communication will be described.

[0049] Furthermore, it is preferable to limit the wireless communication area to some extent. For example, it is preferable to limit the communication area of ​​wireless communication equipment to a radius of 10m. However, it may be wider or narrower. The user ID information obtained is not limited, but for example, if mobile terminal 2 is smartphone 2, the user ID information is the MAC address that is uniquely set and assigned to the smartphone. The MAC address is uniquely set and assigned to smartphone 2, and this MAC address should be obtainable only from smartphone 2 held by the user at least at the time of user registration. However, if smartphone 2 is lost or stolen, an unauthorized person will be able to input the MAC address.

[0050] The closed PIN code acquisition process 120 is a function that executes a process in which user 1 acquires user biometric information via the closed PIN code input device 121 at the closed PIN code input spot B. Here, the user biometric information is not limited, but in this example it is the user's facial image. The closed PIN code input device 121 can be a camera system. Since the facial image is biometric information that only the user themselves can possess, impersonation and misrecognition are less likely. However, with current technology, facial image recognition does not yet have 100% accuracy, and misrecognition is possible. In other words, the fact remains that misrecognition is not zero even with matching processing using facial images alone.

[0051] This section describes the arrangement and coordination of the open PIN code input spot A and the closed PIN code input spot B. As shown in Figure 1, both are positioned along the flow of users entering and exiting the office building, with the closed PIN code input spot B located adjacent to the open PIN code input spot A. The system is designed so that users who enter the open PIN code input spot A will immediately enter the closed PIN code input spot B. Here, regarding the order of the arrangement of the open PIN code input spot A and the closed PIN code input spot B, the basic form is shown with the open PIN code input spot A at the beginning of the flow and the closed PIN code input spot B at the end, but the order of the arrangement can be reversed, and an arrangement where the closed PIN code input spot B is at the beginning of the flow and the open PIN code input spot A is at the end is also possible. It is preferable to limit the wireless communication area to some extent. For example, it is preferable to limit the communication area of ​​the wireless communication equipment to a radius of 10m. However, it can be wider or narrower. It should be adjusted according to the environment and purpose of the facility to which the present invention is applied. Furthermore, when a user obtains an open PIN code, which is a terminal identification number, at open PIN code input spot A via open PIN code acquisition process 110, the closed PIN code acquisition process 120 is linked to capture an image of the user's face using the camera at closed PIN code input spot B. This is referred to here as the "entry-time face image capture linkage process." Similarly, when a user exits the entrance / exit of the closed SIM communication network 200, if they obtain an open PIN code, which is a terminal identification number, via open PIN code acquisition process 110, the closed PIN code acquisition process 120 is linked to capture an image of the user's face using the camera at closed PIN code input spot B. This is referred to here as the "exit-time face image capture linkage process." This ensures that open PIN codes and closed PIN codes can be reliably obtained from users and their terminals during their movement within the closed SIM communication network 200 built inside the building, thereby ensuring reliable user authentication.

[0052] The matching process 130 is a function that performs a matching process to compare the open PIN and closed PIN set in the user file 300 with the open PIN and closed PIN entered when using the service. This matching process compares the open PIN and closed PIN held by the legitimate user, as set in the user file 300, with the open PIN and closed PIN obtained from user 1 when using the service. If the matching is successful, the service application 200 is notified that identity authentication has been achieved; if the matching is unsuccessful, the service application 200 is notified that identity authentication has not been achieved. In this example, the open PIN is the MAC address of smartphone 2, and the closed PIN is the user's facial image as biometric information. In other words, the matching condition is that both of these must be present for the matching to be successful. In other words, while misrecognition is possible with matching only the MAC address or only the facial image, with a matching condition that both are present, the possibility of misrecognition or fraudulent use in identity authentication becomes extremely low, and it can be said that the accuracy is sufficient for credit card payment security. Furthermore, it offers high convenience. Specifically, the process of acquiring user ID information wirelessly via the wireless communication device 111 can be done hands-free, and the process of acquiring a face image by the closed PIN code input device 121 through camera system capture can also be done hands-free, enabling a high level of security, including credit card payment, all hands-free.

[0053] Next, as shown in Figure 1, the service application 200 is configured to include a user file open processing function 210, a user file close processing function 220, a service application main function 230, a service data editing processing function 240, and a payment processing function 250. The user file open processing function 210 receives an open password 310, verifies its match with the open password 310 registered in the user file 300, and if authentication is successful, launches the user file 300 associated with the open password 310.

[0054] The user file closing processing function 220 receives the input of a close password 320, verifies that it matches the close password 320 registered in the user file 300, and if authentication is successful, confirms the service provision data edited and recorded in the user file 300 by the service data editing process 240, and then closes the user file 300 after normal termination.

[0055] The main service application function 230 is an application that provides services desired by the user. The main service application function 230 is not particularly limited. For example, it could be any service that the user desires, such as purchasing at a retail store, purchasing on an e-commerce site, dining at a restaurant, services at other service-providing establishments, medical services at medical facilities, transportation services at transportation facilities, services provided at government facilities, and many other services. Many other services may also be available. The service data editing processing function 240 is a process that inputs service provision data into the user file data recording area 330 of the user file 300, which is open by the user file open processing 210, and executes editing and recording processing.

[0056] The payment processing function 250 is the process of transmitting payment data for service usage to the financial institution system 500. The financial institution system 500 is not limited to this, and can be applied to a variety of payment systems, including credit card systems of credit card companies, debit payment systems of banks, and other prepaid payment systems, cryptocurrency payment systems, and service point payment systems.

[0057] The above is a description of the configuration of the user authentication application 100a, service application 200, and user file 300 shown in Figure 1. Next, we will briefly explain the data flow between the user authentication application 100a, service application 200, and user file 300. Figure 3 is a diagram that illustrates the operation and data flow of the open password acquisition process and the user file open processing function, which are activated by the input of an open password. In Figure 3, the operation and data flow from the open password acquisition process, which is activated by the input of an open password, to the user file open processing function, are shown in order. In this example, we will explain the scenario assuming that the user enters a restaurant and receives food and beverage service.

[0058] First, user 1 enters the open PIN code input area A in a hands-free state, with their smartphone 2 in their pocket or bag. The open PIN code input area A is equipped with a wireless communication device 111, and the open PIN code acquisition process 110 acquires user ID information wirelessly between the wireless communication device 111 and the smartphone 2 (step S1).

[0059] The open password acquisition process 110 passes the acquired user ID information to the matching process 130, which accesses the user file database 400 (step S2), performs a matching process with the open password (user ID information) associated with the user file 300, and identifies the user file 300 of user 1 (step S3). The matching process 130 of the user authentication application 100 notifies the user that the open password matching has been successful and identifies the user file 300 of user 1 (step S4).

[0060] The user file open processing function 210 of the service application 200 is activated (step S5), the user file 300 of the identified user 1 is opened and made editable (step S6), and the main function 230 of the service application is activated to start providing services to user 1 (step S7).

[0061] Next, Figure 4 is a diagram illustrating the service provision by the service application 200 after the user file 300 has been opened, as well as the linkage with the user file and the flow of data. The service is provided (step S8). In this case, since the service is dining at a restaurant, the usual service performed at a restaurant, such as providing food and drinks inside the restaurant, is provided. The service application usage data generated in conjunction with the service provision is written to the user file data recording area 330 (step S9). Note that the usage data may be written each time it is generated in conjunction with the service provision, or it may be written all at once when a service provision is completed. Since the user file data recording area 330 is editable, the service application usage data is written to the user file data recording area 330 of the user file 300 in conjunction with the service provision (step S10).

[0062] Next, Figure 5 is a diagram illustrating the data flow from the close PIN acquisition process upon input of the close PIN, to the user file closing process, the termination of the service application, and the settlement process to the financial institution system 500. User 1 proceeds to the close PIN input spot B in a hands-free state, and a facial image is captured by the close PIN input device 121 (camera system) equipped at the close PIN input spot B, and the facial image is acquired by the close PIN acquisition process 120 (step S12).

[0063] The closed PIN acquisition process 120 passes the acquired user 1's face image to the matching process 130, and the matching process 130 performs a matching process with the closed PIN (user face image) associated with the open user file 300, and performs user 1's identity authentication (step S12). The matching process 130 of the identity authentication application 100 notifies the user file closing process function 220 that the matching of the closed PIN has been successful (step S13).

[0064] The user file close processing function 220 passes a notification to the service application main function 230 that it has terminated service provision to user 1, stops service provision, and consequently stops writing to the user file data recording area 330 via the service data editing processing function 240 (step S14). Next, the payment function 250 of the service application 200 manages the billing information generated by the user's service provision, and writes this billing information as payment information to user 1's user file data recording area 330 (step S15). The service application 200 sends service usage payment data to the financial institution system 500 so that the payment information written to user 1's user file data recording area 330 is settled using the selected payment method (step S16). Finally, the user file close processing function 220 makes the user file data recording area 330 uneditable and then closes the user file 300 after normal termination (step S17).

[0065] The above operation and data flow assume a case where payment is completed successfully. If the matching process for the closed PIN code fails in the above flow (Step S13: Failure), it means that identity verification has failed. This could be a case where the user is the legitimate user but cannot be authenticated, or a case where someone impersonating the user receives the service. In the former case, the user will have to use another means of identity verification they possess, and the service will no longer be hands-free. In the latter case, the service will be provided by someone impersonating the user, and it is assumed that the operation in such a case will be at the discretion of the service provider. Next, if payment is not completed successfully in the above flow (Step S16: Payment cannot be executed due to reasons such as exceeding the credit limit or insufficient account balance), the user will have to use another payment method, such as cash payment, and the service will no longer be hands-free. If the user does not have enough cash, it corresponds to a case where someone ate at a restaurant without having enough cash, and it will be at the discretion of the service provider.

[0066] Next, we will discuss the improvements made to the open PIN code input area A. As explained in Example 1, this is a hands-free authentication method, and the system obtains the open PIN code wirelessly from a mobile terminal 2 such as a smartphone. If the communication area is too wide, the computer processing load will increase unnecessarily if a passerby who does not intend to use the service enters the communication area of ​​the wireless communication device 111 and obtains the open PIN code from the mobile terminal 2. Therefore, the communication area of ​​the wireless communication device 111 is restricted so that wireless communication does not occur unless user 1 intentionally passes through.

[0067] Hereinafter, it is assumed that the mobile terminal ID information is the MAC address information held by mobile terminal 2, and the wireless communication device 111 is a Wi-Fi Direct wireless communication device. The wireless communication means used is Wi-Fi Direct wireless communication. As a means of limiting the wireless communication area, one method is to equip the wireless communication device 111 with a radio wave shielding member 1111 that shields communication radio waves. Depending on how the radio wave shielding member 1111 is installed, the wireless communication device can be made into a directional wireless communication device 111a that can only transmit wireless communication in a predetermined direction and cannot transmit wireless communication in other directions.

[0068] Figure 6 is a diagram that simply shows the setup of the open PIN code input area, the configuration of the wireless communication equipment, and the wireless communication area. Figure 6(a) shows the wireless communication range of the wireless communication equipment 111 when the radio wave shielding member 1111 is not installed. This is an example of installation near the entrance of a service store. Although the distance can be controlled by adjusting the communication radio wave strength (for example, a radius of 10m), the wireless communication area becomes omnidirectional. The wireless communication area of ​​general Wi-Fi communication equipment is omnidirectional in this way. This is because Wi-Fi communication equipment is designed to be widely open to those who wish to use the Wi-Fi communication service, so omnidirectional is the basic principle. Therefore, in the example of Figure 6(a), not only those passing through the store entrance but also those passing just outside the store entrance are entering the wireless communication area.

[0069] Figure 6(b) is a simplified diagram showing the wireless communication area when the directional wireless communication device 111a is improved by equipping it with a radio wave shielding member 1111. As shown in Figure 6(b), the radio wave shielding member 1111 is equipped around the Wi-Fi wireless communication antenna of the directional wireless communication device 111a, allowing wireless communication in only some directions while shielding in other directions, resulting in a fan-shaped wireless communication area. The radio wave shielding member 111 is a material that shields Wi-Fi Direct communication radio waves, and is a directional Wi-Fi Direct wireless communication device 111a. In the example of Figure 6(b), a fan-shaped wireless communication area is set from the store entrance towards the inside of the store, and it can be seen that passersby who are only passing near the outside of the store entrance are controlled not to enter the wireless communication area. Thus, it can be seen that it is preferable for the open code input area A to be located on the movement path from the entrance of the store or facility.

[0070] Next, we will discuss countermeasures for cases where, even when the wireless communication area is restricted as shown in Figure 6(b), the open PIN acquisition process is unintentionally executed via Wi-Fi wireless communication from a mobile terminal 2 held by a passerby passing through the communication area, and the open PIN is entered. One effective countermeasure is time control. As explained in Example 1, the user authentication of the present invention requires the input of a close PIN not only when opening but also when closing. Since the passerby has acquired an open PIN without intending to enjoy the service, it is assumed that they did not actively intend to input a close PIN. Therefore, there is a configuration that includes a timer that counts the elapsed time scheduled for the service, and a log management process that invalidates the input of the open PIN after a predetermined time has elapsed after the execution of the open PIN acquisition process.

[0071] Figure 7 shows an example configuration with log management processing and time control. As shown in Figure 7, the matching process 130 includes a timer 131 and a log management process 132. When user ID information, which is the open password, is obtained from the open password acquisition process 110, the timer 131 starts counting the elapsed time, and when the log management process 132 detects that a predetermined time has elapsed, it performs error processing as a timeout. The type of error processing will depend on the operator's operational method.

[0072] Next, there is duplicate control in case the open PIN code is acquired multiple times. In other words, if a passerby passes through multiple open PIN code input areas A in succession, the open PIN code may be entered multiple times unintentionally via Wi-Fi wireless communication from the passerby's mobile terminal 2, resulting in the open PIN code acquisition process being executed multiple times. If the passerby enters the closed PIN code input spot B and does not acquire the closed PIN code, and then proceeds to enter the next open PIN code input area A, the user authentication in the closed process will be unsuccessful, and an error will be processed. The type of error processing will depend on the operator's operational method, but for example, log management process 132 will invalidate past open PIN code acquisition processes in the time series and only enable the latest open PIN code acquisition process. This is because the latest open PIN code acquisition process in the time series can be assumed to be when the passerby, as user 1, entered the open PIN code input area A seeking to enjoy the service.

[0073] Next, we will discuss the improvements related to the closed PIN input spot B. Here, we assume that the user file 300 for each user has MAC address information set as user ID information as the open PIN, and the closed PIN is set to the face image of user 1. The closed PIN input device 121 at the closed PIN input spot B may be a camera. Here, the shooting spot and shooting direction of the camera 121 are restricted. It is preferable that the settings are adjusted so that the face image cannot be entered unless user 1 intentionally holds their face up to the camera.

[0074] Figure 8 is a simple diagram showing the setup of the closed PIN code input spot B and the shooting direction of the camera, which is the closed PIN code input device 121. The example shows the service provider as a restaurant. As shown in Figure 8, the shooting direction of the camera, which is the closed PIN code input device 121, is near the path of customers heading towards the exit, but in this example, it is intentionally positioned slightly away from the exit. In other words, instead of capturing the facial images of all customers walking towards the exit, the camera only captures the facial images of those who are heading towards the register to pay and confirm the amount, and these facial images are acquired in the closed PIN code acquisition process 120. In the case of individual customers, user 1 is the person who receives the service and user 1 makes the payment, so the user and the payer are the same. However, in the case of a restaurant meal, several or more participants are expected, and they may split the bill, but often a representative pays for the group. In this case, if facial images of all participants are obtained, the process of obtaining a large number of facial images that do not require verification in the closed password acquisition process 120 and therefore do not result in a match is a waste of time. It is preferable for the representative who handles the accounting to perform the closed process as user 1.

[0075] As shown in Figure 8, the closed PIN acquisition process 120 acquires the face image of user 1 and adds intent flag information indicating that the authentication process was initiated by the user intentionally holding their face up. In the matching process 130 described in Example 1, along with the matching process of the face image acquired in the closed PIN acquisition process 120, a check is also performed to confirm that intent flag information has been added. This improvement enhances the accuracy of the closed process by checking for the addition of intent flag information indicating that the face image was entered intentionally by user 1, rather than being an unintentional capture of a face image of someone who did not intend to enter a closed PIN, i.e., someone who did not intend to enter a face image.

[0076] Next, we will discuss examples and innovations for applying the user authentication application 100 to large-scale systems that have multiple open PIN code input areas A and multiple closed PIN code input spots B. Here, as an example, we will explain its application to transportation services on large-scale train networks such as JR and other private railways. The number of users of transportation services on large-scale train networks such as JR and other private railways can be estimated to be in the millions or tens of millions, even just for commuters. If we let this number of users be N, then there are also N user registration images, making it extremely difficult for the N:N matching process 130 to perform the matching process within the short time it takes to pass through a station ticket gate. Currently, system operation and payment processing are sufficiently carried out with transportation IC cards such as Suica and ICOCA, but this is a system that works because the transportation IC card is held over the reader of the ticket gate system each time, data is exchanged wirelessly, and it is assumed that the transportation IC card holder is the correct person. In other words, conventional systems using transportation IC cards do not perform the hands-free user authentication that is the objective of this invention.

[0077] Figure 9 shows an example of application to a large-scale system with multiple open PIN code input areas A and multiple closed PIN code input spots B. For inputting the open PIN code, the configuration can be as described in Example 2, where the open PIN code is input by a wireless communication device 111 equipped in the open PIN code input area A using the Wi-Fi Direct wireless communication method. Note that at this stage of open PIN code acquisition process 110, only the condition that the person owns the smartphone 2 has been met; authentication of the person's identity has not yet been established.

[0078] Next, we will explain the improvements to the closed PIN code acquisition process 120. Multiple closed PIN code input devices 121 (cameras) at multiple closed PIN code input spots B (ticket gates) each hold individual device ID information. In other words, by using this device ID information, it is possible to identify which camera at which ticket gate acquired the facial image. In this example, we are assuming a large-scale transportation service such as JR, so it is expected that not only will there be a system where one person at a time passes through the ticket gate in a line, but also a ticket gate system with a wide width will be introduced, and the system will develop into one where multiple people pass through at once like on a sidewalk. In this case, it is preferable that the camera 121 at the closed PIN code input spot B is linked to a facial recognition system that recognizes and extracts the faces of people present in the image. Since the closed PIN code acquired by the closed PIN code acquisition process 120 is a facial image, image information from other areas is unnecessary, and it is efficient to extract and acquire only the facial images of users from image data of users walking as if on a sidewalk all at once. In recent years, there has been an increase in applications for digital cameras and smartphone cameras that perform face recognition processing to recognize and extract human faces present in images; you can simply apply such an application.

[0079] The shooting spot and shooting direction of the closed PIN code input device 121 (camera) are adjusted so that a facial image is not entered unless user 1 intentionally passes through the closed PIN code input spot. In this example, the ticket gate is large and has multiple ticket gates, but the cameras are equipped one-to-one with the ticket gates or the space above them to acquire facial images of approaching users. As explained in Example 2, there is no need to hold up one's face, and a facial image is acquired simply by moving along a fixed path of movement such as a ticket gate. However, since this confirms the intention to intentionally pass through the ticket gate, the closed PIN code acquisition process 120 adds intent flag information to indicate that it is an authentication process that the user intentionally initiated.

[0080] Figure 10 shows a configuration in which the closed PIN code acquisition process 120 is equipped with an image conversion process 122. As shown in Figure 10, the closed PIN code acquisition process 120 is equipped with an image conversion process 122, which performs image conversion processing on the original image acquired by the camera, which is the closed PIN code input device 121. The image conversion process 122 performs image conversion processing on the face image data of user 1 so that the face image data of user 1 is in the expected posture, according to the shooting direction of the camera at the closed PIN code input spot B where user 1 is scheduled to pass through. In this example, in order to capture face images of multiple users 1 walking in large numbers, if the camera 121 is positioned slightly above the ticket gate system, it is assumed that the image will show the user's face not facing directly but slightly downward. Also, if the camera 121 is positioned slightly to the side (right) of the ticket gate system, it is assumed that the image will show the user's face not facing directly but slightly to the right. It is preferable to perform image conversion processing because it is thought that the matching accuracy in the matching process 130 will improve if the angle of the face is corrected. The shooting angle of the closed PIN input device 121 (camera) is known, and the closed PIN acquisition process 120 performs image conversion processing using the image conversion process 122 to correct the shooting angle. In the matching process 130, the face image data after the image conversion process performed by the image conversion process 122 is used as the closed PIN for matching.

[0081] Next, we will describe a method for predicting the input device ID information where a closed PIN code is likely to be entered, as a way to reduce the system load of the face image matching process in the matching process 130. As shown in Figure 11, the matching process 130 is configured to include a timer 131 and a log management process 132, as well as an input device ID information prediction process 133. The input device ID information prediction process 133 predicts the device ID information of one or more closed PIN code input devices 121 at one or more closed PIN code input spots B where user 1 is expected to input user biometric information after enjoying the service (i.e., travel).

[0082] When users utilize transportation services for commuting or school, it is assumed that the ticket gates at the station where they enter (board) and the station where they exit (get off) are often fixed and repeated. The input device ID information prediction process 133 learns and stores past entry and exit data and performs prediction processing. For example, if the open password of a specific user 1 is obtained via Wi-Fi wireless communication, the user file unlocking function 210 opens the corresponding user file 300 into an editable state. Next, the input device ID information prediction process 133 predicts the specific input device ID information of the ticket gate at the exit (get off) station. As passengers using the transportation service exit through the ticket gates at various stations along the route, their facial images are acquired moment by moment by the closed PIN code acquisition process 120. The matching process 130 only needs to match the facial images acquired from the closed PIN code input device 121 (camera) at the ticket gate of the exit station, which is predicted by the input device ID information prediction process 133, with the facial images registered as closed PIN codes in the user file 300. In this way, by predicting the camera 121 at the ticket gate of the exit station that will be used to input the closed PIN code through the prediction process by the input device ID information prediction process 133, the burden of matching facial images, which would otherwise involve millions of people, is reduced.

[0083] Figure 12 illustrates the difference between face image matching processing in the conventional technology and face image matching processing in the user authentication application of the present invention. Figure 12(a) is a simplified diagram illustrating the concept of face image matching processing in the conventional technology. As can be seen in Figure 12(a), if there are N user registration face images (for example, several million people) and the number of users using the service who require matching processing is M (for example, several hundred thousand people), then in order to identify who each face image input from the camera belongs to, N × M face image matching processes would be required. In the conventional technology, in order to narrow down the number of matching processes, users were required to manually enter passwords or touch an IC card reader.

[0084] On the other hand, Figure 12(b) is a diagram that simply illustrates the concept of matching processing in the user authentication application of the present invention. As shown in Figure 12(b), even if the number of users currently using the service and requiring matching processing is M (for example, several hundred thousand) with N (for example, several million) registered user face images, since the open PIN is entered hands-free, the number of user files 300 that can be launched associated with the open PIN is considerably reduced (to M). Furthermore, because the prediction processing by the input device ID information prediction processing 133 allows for comparison processing of the user face image to be matched with the face image input from the camera 121 at the ticket gate of the predicted disembarking station, the number of comparison processing steps required is P (for example, several hundred), so it can be expected that the matching process will actually only require processing for several hundred people. In addition, since user files for which matching processing has been completed are closed one after another by the input of a closed PIN, the number of user files that remain running as users enjoying the service is reduced to a certain extent.

[0085] This invention relates to an application that runs on a computer system. In particular, it can be applied to hands-free, highly secure user authentication. The service application that provides services using the user authentication application of this invention is not limited to the content of the service and can be applied to a variety of business systems.

[0086] 100 User authentication application 110 Open PIN acquisition process 111 Wireless communication device 120 Closed PIN acquisition process 121 Closed PIN input device 122 Image conversion process 130 Matching process 200 Service application 210 User file open processing function 220 User file close processing function 230 Service application main function 240 Service data editing processing function 250 Payment function 300 User file 310 Open PIN 320 Closed PIN 330 User file data recording area 400 User file database

Claims

1. An authentication application that uses a user file, program, or storage area, which is linked to a service application that provides a service, and in which an open authentication code and a closed authentication code for user authentication are set for each user, wherein the open authentication code is user ID information held on the user's mobile terminal, and the closed authentication code is the user's biometric information, and an open authentication code input area where an open authentication code input device is installed and a closed authentication code input spot where a closed authentication code input device is installed are defined, and the authentication application provides a computer system with a hands-free open authentication code acquisition process that wirelessly acquires the user ID information from the user's mobile terminal that has entered the open authentication code input area via the open authentication code input device, and a hands-free closed authentication code acquisition process that allows the user to acquire the user's biometric information via the closed authentication code input device at the closed authentication code input spot, A hands-free user authentication application that performs user authentication by matching the open password and closed password set in the user file, the program, or the storage area with the open password and closed password entered hands-free when using the service, thereby enabling data processing for each of the service applications and the use of the service.

2. The hands-free personal authentication application according to claim 1, characterized in that the open PIN code is mobile terminal ID information assigned to the user's mobile terminal, the open PIN code input device in the open PIN code input area is a wireless communication device in a wireless communication means that the mobile terminal can respond to, the communication area of ​​the wireless communication device is restricted, and the system is configured such that the mobile terminal ID information cannot be entered via the mobile terminal unless the user intending to enjoy the service intentionally passes through it.

3. The hands-free personal authentication application according to claim 2, characterized in that the wireless communication device is equipped with a radio wave shielding member that shields communication radio waves, the wireless communication device is a directional wireless communication device that can only transmit wireless communication in a predetermined direction and cannot transmit wireless communication in other directions, and the communication area is limited to the predetermined direction and is limited to the range that the user who wishes to enjoy the service intentionally enters.

4. An authentication application that uses a program, user file, or storage area, which is linked to a service application that provides a service, and in which an open authentication code and a closed authentication code for user authentication are set for each user, wherein the open authentication code is the user's biometric information, and the closed authentication code is user ID information held on the user's mobile terminal, and an open authentication code input area where an open authentication code input device is installed and a closed authentication code input spot where a closed authentication code input device is installed are defined, and the authentication application provides a hands-free open authentication code acquisition process that causes a computer system to acquire the user's biometric information from the user who has entered the open authentication code input area via the open authentication code input device, and a hands-free closed authentication code acquisition process that obtains the user ID information wirelessly from the user's mobile terminal when the user has entered the closed authentication code input spot, A hands-free user authentication application that performs user authentication by matching the open password and closed password set in the program, the user file, or the storage area with the open password and closed password entered hands-free when using the service, thereby enabling data processing to each application file and the use of the service.

5. The hands-free personal authentication application according to claim 4, characterized in that the closed PIN code is mobile terminal ID information assigned to the user's mobile terminal, the closed PIN code input device at the closed PIN code input spot is a wireless communication device in a wireless communication means that the mobile terminal can respond to, the communication area of ​​the wireless communication device is restricted, and the settings are adjusted so that the mobile terminal ID information cannot be entered via the mobile terminal unless the user intentionally passes through it.

6. The hands-free personal authentication application according to claim 5, characterized in that the wireless communication device is equipped with a radio wave shielding member that shields communication radio waves, the wireless communication device is a directional wireless communication device that can only transmit wireless communication in a predetermined direction and cannot transmit wireless communication in other directions, and the communication area is limited to the predetermined direction and is limited to the range that the user who wishes to enjoy the service intentionally enters.

7. A hands-free personal authentication application according to any one of 1 to 6, characterized in that the device for inputting the user's biometric information is a camera, the camera's shooting spot and shooting direction are adjusted so that the face image is not input unless the user intentionally passes through it, and in the face image acquisition in the open PIN acquisition process or the closed PIN acquisition process, intent flag information indicating that the user intentionally initiated the personal authentication process is added to the face image data, and in the matching process, the application also checks whether the intent flag information has been added.

8. The hands-free personal authentication application according to claim 7, wherein the camera is linked to a face recognition system that recognizes and extracts the faces of people present in an image, and in the face image acquisition in the open PIN acquisition process or the closed PIN acquisition process, the face images of people captured in the image taken by the camera are individually extracted and treated as the open PIN or the closed PIN, respectively, and the matching process is executed.

9. The hands-free personal authentication application according to claim 7, characterized in that a closed PIN code input spot is provided adjacent to the open PIN code input spot along the user's movement path, and when the user enters, the closed PIN code acquisition process executes an entry-time face capture image synchronization process, which is triggered by the acquisition of the terminal identification number from the user terminal in the open PIN code acquisition process, to synchronize with the capture of the user's face image by the camera, and when the user leaves, the closed PIN code acquisition process executes an exit-time face capture image synchronization process, which is triggered by the acquisition of the terminal identification number from the user terminal in the open PIN code acquisition process, to synchronize with the capture of the user's face image by the camera.

10. A hands-free user authentication application according to any one of 1 to 6, characterized in that, if the user passes through multiple different open password input areas consecutively, or passes through the same open password input area multiple times consecutively, resulting in the open password acquisition process being executed multiple times consecutively, the application includes a timer for counting the elapsed service usage time, and a log management process for invalidating the input of the open password after a predetermined time has elapsed following the execution of the open password acquisition process based on the timer's count.

11. A hands-free personal authentication application according to any one of 1 to 6, characterized in that, if a person passes through multiple open PIN code input areas in succession and the open PIN code is unintentionally entered multiple times from the mobile terminal held by the person, resulting in the open PIN code acquisition process being executed multiple times, the open PIN code acquisition process includes a log management process that invalidates past open PIN code acquisitions in chronological order and makes only the most recent open PIN code acquisition valid.

12. A hands-free personal authentication application according to any one of 1 to 6, characterized in that each of the open PIN input devices and the closed PIN input device holds device ID information, and after the open PIN input, the application includes an input device ID information prediction process that predicts the device ID information of one or more of the closed PIN input devices at one or more of the closed PIN input spots where the user is expected to input the closed PIN, the device ID information of the closed PIN input device is also acquired in the closed input process, and the matching process also performs a matching process between the input device ID information predicted in the input device ID information prediction process and the input device ID information acquired in the closed PIN acquisition process.

13. A hands-free personal authentication application according to any one of claims 1 to 6, characterized in that the mobile terminal ID information is MAC address information assigned to the mobile terminal, the communication method of the wireless communication device is Wi-Fi Direct wireless communication or Ultra Wide Band wireless communication, and the communication area of ​​the wireless communication device is limited to a predetermined distance.

14. A hands-free personal authentication application according to any one of 1 to 6, characterized in that the service is subject to a charge for the use of the service, the service provider's system includes a charge information input process for inputting charge information relating to the provision of the service, the system includes a charge information input process that receives the charge information input from the service provider's system after the open PIN acquisition process and prior to the closed PIN acquisition process, and writes the charge information to the application file, and, upon successful matching through the matching process, either executes the settlement process itself based on the charge information written to the application file or requests the financial institution system to perform the settlement process.

15. The hands-free personal authentication application according to 13, characterized in that the service is a service provided in a store or facility, the open PIN code input area is located on a path leading from the entrance of the store or facility, and the closed PIN code input spot is located at a cash register or collection point near the exit of the store or facility.

16. The hands-free personal authentication application according to claim 14, wherein the service is provided at retail stores, online shopping sites, restaurants, service-providing stores, medical facilities, transportation facilities, vehicles, financial systems, and government facilities.

17. A service application that provides services in conjunction with a hands-free personal authentication application according to any one of claims 1 to 6, the service application being operated on a computer system comprising: a service data editing processing step of inputting service provision data obtained from the service application into the service application file, which is opened by inputting the open password, and performing an editing process; and a termination processing step of terminating the service-related functions either in conjunction with or independently before the termination of the service application file, after the service application file becomes operable by inputting the open password, and the service-related functions become available for use by inputting the close password.

18. A service application that enables the provision of a service with hands-free user authentication as described in 17, characterized in that the service provision data of the service application includes service usage payment data relating to the use of the service, and the service application includes a payment process for transmitting the service usage payment data to a financial institution system.

19. A user authentication method using a user file, program, or storage area that is linked to a service application providing a service, and in which an open authentication code and a closed authentication code for user authentication are set for each user, wherein the open authentication code is user ID information held on the user's mobile terminal, and the closed authentication code is the user's biometric information, and an open authentication code input area where an open authentication code input device is installed and a closed authentication code input spot where a closed authentication code input device is installed are defined, and a hands-free open authentication code acquisition process is performed to acquire the user ID information wirelessly from the user's mobile terminal that has entered the open authentication code input area via the open authentication code input device, and a hands-free closed authentication code acquisition process is performed in which the user allows the user to acquire the user's biometric information via the closed authentication code input device at the closed authentication code input spot. A hands-free authentication method for a user, which performs user authentication by matching the open password and closed password set in the user file, the program, or the storage area with the open password and closed password entered hands-free when using the service, thereby enabling data processing for each of the service applications and the use of the service.

Images