Determination system, determination method, and program

Abstract

To provide a determination system capable of preventing impersonation in executing a procedure for evaluating a cognitive function of a person and providing a service based on the evaluation or a determination as to whether the service can be provided or not.SOLUTION: A determination system executes an acquisition process, a temporary evaluation process, and a determination process. The acquisition process acquires first voice information which is voice information or a person, and line-of-sight information obtained by detecting eye motion of the person. The temporary evaluation process temporarily evaluates the cognitive function of the person on the basis of at least one of the first voice information and the line-of-sight information. The determination process performs a first identity verification process on the person to determine a procedure for providing a service to the person or determine as to whether the service can be provided or not. The first identity verification process includes processing for acquiring second voice information which is the voice information of the person, and verifying the identity on the basis of the first voice information, the second voice information, and the line-of-sight information. The determination process determines, when the first identity verification is successful, the procedure or as to whether the service can be provided, using the result of the temporary evaluation in the temporary evaluation process.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to a determination system, a determination method, and a program.

Background Art

[0002] Patent Document 1 describes a determination method for a recognition function used when providing services to a target person at a driver's license center that performs at least one of the services of issuing and renewing a driver's license. The determination method described in Patent Document 1 includes an identity confirmation process, a voice acquisition process, an estimation process, and a determination process. The identity confirmation process is a process for confirming that the target person is the actual person. The voice acquisition process is a process executed after the identity confirmation process, and causes the target person to read aloud a fixed sentence and acquires voice data related to the reading aloud. The estimation process estimates the cognitive function of the target person based on the voice data acquired in the voice acquisition process. The reflection process reflects the result of the estimation process in the procedure for providing services to the target person at the driver's license center or the determination of whether services can be provided.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the determination method described in Patent Document 1, although the identity confirmation process is performed before the voice acquisition process, it is difficult to say that it is sufficient as a countermeasure against impersonation. That is, in the determination method described in Patent Document 1, as long as the identity confirmation process for the target person is completed, another person can impersonate the target person and perform the voice acquisition process. Therefore, based on the result of the estimation process of the cognitive function of another person, the procedure for providing services to the target person or the determination of whether services can be provided is performed.

[0005] An object of the present disclosure is to provide a determination system, a determination method, and a program capable of preventing impersonation when executing a process of evaluating a person's cognitive function and determining a procedure or feasibility regarding service provision based on the evaluation.

Means for Solving the Problems

[0006] The determination system according to the present disclosure executes an acquisition process of acquiring first voice information that is the voice information of a person and gaze information obtained by detecting the movement of the person's line of sight, a preliminary evaluation process of preliminarily evaluating the person's cognitive function based on at least one of the first voice information and the gaze information, and a determination process of performing a first authentication process for the person and determining a procedure or feasibility regarding service provision for the person. The first authentication process includes a process of acquiring second voice information that is the voice information of the person and performing identity authentication based on the first voice information, the second voice information, and the gaze information. The determination process performs the determination of the procedure or feasibility using the result of the preliminary evaluation in the preliminary evaluation process when the identity authentication is successful in the first authentication process.

[0007] The determination method according to the present disclosure is such that a computer executes an acquisition process of acquiring first voice information that is the voice information of a person and gaze information obtained by detecting the movement of the person's line of sight, a preliminary evaluation process of preliminarily evaluating the person's cognitive function based on at least one of the first voice information and the gaze information, and a determination process of performing a first authentication process for the person and determining a procedure or feasibility regarding service provision for the person. The first authentication process includes a process of acquiring second voice information that is the voice information of the person and performing identity authentication based on the first voice information, the second voice information, and the gaze information. The determination process performs the determination of the procedure or feasibility using the result of the preliminary evaluation in the preliminary evaluation process when the identity authentication is successful in the first authentication process.

[0008] The program according to the present disclosure causes a computer to perform an acquisition process of acquiring first voice information, which is voice information of a person, and gaze information obtained by detecting the movement of the gaze of the person, a preliminary evaluation process of preliminarily evaluating the cognitive function of the person based on at least one of the first voice information and the gaze information, and a determination process of performing a first authentication process on the person and determining a procedure or availability regarding the provision of services to the person, wherein the first authentication process includes a process of acquiring second voice information, which is voice information of the person, and performing an authentication of the person based on the first voice information, the second voice information, and the gaze information, and the determination process performs the determination of the procedure or availability using the result of the preliminary evaluation in the preliminary evaluation process when the authentication in the first authentication process is successful, and is a program for causing the computer to execute the process.

Advantages of the Invention

[0009] According to the present disclosure, it is possible to provide a determination system, a determination method, and a program capable of preventing impersonation when executing a process of evaluating a person's cognitive function and determining a procedure or availability regarding the provision of services based on the evaluation.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Mode for Carrying Out the Invention

[0011] Hereinafter, embodiments will be described with reference to the drawings. In the embodiments, the same or equivalent elements may be denoted by the same reference numerals, and overlapping descriptions will be omitted as appropriate.

[0012] <Embodiment 1> Using FIG. 1, a configuration example of the determination system 1 will be described. FIG. 1 is a block diagram showing a configuration example of the determination system according to the present disclosure.

[0013] As shown in FIG. 1, the determination system 1 can include an acquisition processing unit 1a, a preliminary evaluation processing unit 1b, and a determination processing unit 1c.

[0014]

[0015] Since at least one of the above first voice information and gaze information is information to be temporarily evaluated, it can be referred to as evaluation target information. The evaluation target information only needs to include at least one of the first voice information and gaze information, but can also include other information. For example, the evaluation target information can include, in addition to at least one of the first voice information and gaze information, information related to the current or past illness of the person. The information related to the illness can be obtained, for example, from a hospital or the like. The information related to the illness can also be the information input by the person. The information related to the illness can also include the presence or absence of a disability of the person. Also, the evaluation method itself is not limited.

[0016] Further, the preliminary evaluation processing unit 1b can be configured to obtain a preliminary evaluation result from the evaluation target information by using a learning model that is machine-learned to input the evaluation target information and output a preliminary evaluation result. The algorithm of this learning model and the like are not limited. Also, here, an example using a learning model is given, but other AI (Artificial Intelligence) technologies can also be used for the preliminary evaluation of the cognitive function. Note that, similarly for various learning models described later, other AI technologies can be used for processing instead.

[0017] The determination processing unit 1c performs a first authentication process on the above person and executes a determination process for determining the procedure or approval / disapproval regarding the provision of services to the person. The first authentication process includes a process of obtaining second voice information that is the voice information of the person and performing authentication based on the first voice information obtained by the acquisition processing unit 1a, the second voice information, and the gaze information obtained by the acquisition processing unit 1a.

[0018] When the authentication process succeeds in the first personal authentication process, the determination process uses the result of the preliminary evaluation in the preliminary evaluation process to determine the procedure or feasibility regarding the provision of services to that person. That is, when the authentication process succeeds in the first personal authentication process, the determination process uses the result of the preliminary evaluation in the preliminary evaluation process as the evaluation of the formal cognitive function to determine the procedure or feasibility regarding the provision of services to that person. The reason why the evaluation of the cognitive function executed by the preliminary evaluation processing unit 1b is a preliminary evaluation is that it has not passed through the first personal authentication process. When the personal authentication is performed in the first personal authentication process, the preliminary evaluation becomes a formal evaluation.

[0019] The determination system 1 can be configured by a server device that functions as a determination device. In this case, the first voice information, gaze information, and other evaluation target information may be acquired, for example, from a terminal device used by that person as a user. This terminal device is an information processing device such as a smartphone, a mobile PC (Personal Computer), or an installed PC used by that person as a user. Then, the control unit (not shown) of the server device may preliminarily evaluate the cognitive function of that person based on the evaluation target information including at least one of the acquired first voice information and gaze information. Further, this server device can also be configured to transmit the preliminary evaluation result, which is the result of the preliminary evaluation made by the preliminary evaluation processing unit 1b, or the determination result by the determination processing unit 1c, or the preliminary evaluation result and the determination result, to the terminal device. This control unit can be realized, for example, by a processor such as a CPU (Central Processing Unit), a working memory, and a non-volatile storage device storing a control program. This program can be a program for causing the processor to function as the acquisition processing unit 1a, the preliminary evaluation processing unit 1b, and the determination processing unit 1c. Further, this control unit can be configured to include an IC.

[0020] Further, the determination system 1 can also be configured as a distributed system in which the functions of the above-described server device are distributed among a plurality of server devices. Each server device can include a control unit (not shown) that controls the whole thereof. Each control unit can include some functions of the acquisition processing unit 1a, the preliminary evaluation processing unit 1b, and the determination processing unit 1c. For example, each server device can be configured to execute some processes of the acquisition processing unit 1a, the preliminary evaluation processing unit 1b, and the determination processing unit 1c in cooperation with a communication unit such as a communication interface in which the control unit is separately provided. This control unit can be realized, for example, by a processor, a working memory, and a non-volatile storage device storing a control program. This program can be a program for causing the CPU to function as a part of the acquisition processing unit 1a, the preliminary evaluation processing unit 1b, and the determination processing unit 1c. Further, this control unit can be configured to include an IC.

[0021] Further, the determination system 1 can also be configured by a single terminal device used by a person as a user. Then, a control unit (not shown) of the terminal device acquires the first voice information, the gaze information, and other information to be evaluated, and preliminarily evaluates the cognitive function of the person based on the information to be evaluated including at least one of the first voice information and the gaze information. Then, the control unit (not shown) of the terminal device acquires the voice again as the second voice information, performs authentication of the person, and performs the determination process. This control unit can be realized, for example, by a processor, a working memory, and a non-volatile storage device storing a control program. This program can be a program for causing the processor to function as the acquisition processing unit 1a, the preliminary evaluation processing unit 1b, and the determination processing unit 1c. Further, this control unit can be configured to include an IC.

[0022] Further, the determination system 1 can also be constructed as a distributed system in which functions are distributed between the terminal device and the server device. For example, the determination system 1 can be composed of a terminal device and one or more server devices. The terminal device and each server device can be provided with a control unit (not shown) for controlling the whole thereof. Each control unit can have some functions of the acquisition processing unit 1a, the preliminary evaluation processing unit 1b, and the determination processing unit 1c. For example, each device can be configured to execute some processes of the acquisition processing unit 1a, the preliminary evaluation processing unit 1b, and the determination processing unit 1c in cooperation with a communication unit such as a communication interface in which its control unit is separately provided. Also, the server device that makes the final determination can be configured to transmit the determination result to the terminal device. Each control unit can be realized by, for example, a processor, a working memory, and a non-volatile storage device storing a control program. This program can be a program for causing the CPU to function as a part of the acquisition processing unit 1a, the preliminary evaluation processing unit 1b, and the determination processing unit 1c. Also, each control unit can be configured to include an IC.

[0023] Next, a processing example of the determination system 1 will be described with reference to FIG. 2. FIG. 2 is a flowchart for explaining an example of the determination method according to the present disclosure.

[0024] First, a computer acquires first voice information that is voice information of a person and gaze information obtained by detecting the movement of the person's gaze (step S1). This computer is the above-described terminal device or server device, but the device that directly acquires the voice spoken by the person and the movement of the person's gaze regarding the first voice information and gaze information is the terminal device. Next, the computer preliminarily evaluates the cognitive function of the person based on at least one of the first voice information and the gaze information (step S2). The computer that executes step S2 is the terminal device, or the terminal device and the server device, or the server device.

[0025] Next, the computer executes first-person authentication processing for the person (step S3). This first-person authentication processing includes a process of obtaining second voice information that is the voice information of the person, and performing person authentication based on the first voice information obtained in step S1, the second voice information, and the line-of-sight information obtained in step S1. Next, the computer determines whether or not person authentication has succeeded in the first-person authentication processing (step S4). If the result in step S4 is NO, the process ends. If the result in step S4 is NO, other necessary processing can also be performed. The computer that executes steps S3 and S4 can be a terminal device, or a terminal device and a server device, or a server device.

[0026] On the other hand, if the result in step S4 is YES, the computer executes a determination process for determining the procedure or feasibility regarding the provision of services to the person (step S5), and the process ends. After the processing in step S5, other necessary processing can also be performed. The computer that executes step S5 can be a terminal device, or a terminal device and a server device, or a server device. Of course, when the processing in FIG. 2 is executed by a plurality of devices, the transmission and reception of necessary information in each step will be performed between those plurality of devices.

[0027] In the present embodiment, when executing a process of evaluating a person's cognitive function and determining the procedure or feasibility regarding the provision of services based on the evaluation, the evaluation is performed using at least one of voice information and line-of-sight information, and person authentication is performed using voice information and line-of-sight information. Therefore, according to the present embodiment, impersonation can be prevented when executing the above-described determination process. That is, according to the present embodiment, after ensuring that the person is the genuine one, the cognitive function of the person can be evaluated and the procedure or feasibility regarding the provision of services can be determined.

[0028] <Embodiment 2> Regarding Embodiment 2, the differences from Embodiment 1 will be mainly described. However, in Embodiment 2, various examples and effects described in Embodiment 1 can be applied. A configuration example of the determination system 100 will be described with reference to FIG. 3. FIGS. 3 and 4 are block diagrams showing other configuration examples of the determination system according to the present disclosure.

[0029] As shown in FIGS. 3 and 4, the determination system 100 can include a terminal device 10 and a management server device (hereinafter referred to as the management server) 20. The terminal device 10 can be connected to the management server 20 via a network N. Further, the determination system 100 can include a management-side terminal device 40, and the terminal device 40 may be connectable to the management server 20 via the network N. Of course, the network connecting the terminal device 10 and the management server 20 and the network connecting the terminal device 40 and the management server 20 may be different networks.

[0030] In the acquisition process in this embodiment, although the detailed processing example will be described later, the acquisition process acquires the first voice information and the gaze information of a person during a period including the period in which the second person authentication process is performed using a certificate recording the biometric information of the person to whom the identification information is assigned.

[0031] This certificate is, for example, a driver's license, a my number card of the my number system, an insurance certificate, a residence card, etc. The residence card refers to the identity certificate of a foreigner staying in Japan.

[0032] This certificate can be equipped with a memory for recording biometric information. The memory can refer to the memory within an IC (Integrated Circuit) chip. Also, the biometric information can refer to various personal characteristics such as the face information, iris information, auricle information, behavior information, etc. of the owner of the certificate, or any combination thereof. Thus, multiple types of biometric information may be stored in the memory. Note that among the currently circulating certificates, there are also certificates in which biometric information is not stored in the memory. However, even for such certificates, if biometric information comes to be stored in the memory in the future, it can be applied as a certificate equipped with a memory in the following description. Also, the certificate may be a certificate stored in the user's mobile terminal. Taking the driver's license as an example, the driver's license may be a mobile driver's license (mDL) stored in the user's mobile terminal.

[0033] Also, the certificate may be one in which biometric information is recorded, such as being printed on its surface. For example, when the biometric information is face information, a face image, that is, a face photo, can be printed on the surface of the certificate. Also, in this case, identification information can also be printed on the surface of the certificate. As can be seen from this example, the certificate may be a certificate that does not have a memory for recording biometric information.

[0034] Also, the identification information can refer to, for example, the number of the driver's license in the case of a driver's license. The identification number can refer to the personal number in the case of a personal number card. Thus, the identification information can be an identification number or the like. The identification number can be a number unique to that person.

[0035] The terminal device 10 is an information processing device such as a smartphone, a mobile PC (Personal Computer), or a stationary PC that a person uses as a user. The terminal device 40 is an information processing device such as a smartphone, a mobile PC, or a stationary PC. The terminal device 40 can be a device used by a person on the management side as a user, or a device used by the user of the terminal device 10 as an automatic reception device.

[0036] The management server 20 is a server computer for managing a predetermined procedure. Here, the predetermined procedure refers to a procedure for updating a predetermined qualification. The predetermined qualification can be a qualification certified by a certificate recording the biometric information of a person to whom identification information is assigned. Hereinafter, an example where the predetermined qualification is a driver's license will be given. That is, in the following example, the certificate is the driver's license 30.

[0037] The driver's license 30 includes an IC chip 31. The IC chip 31 includes a memory 31a. In the memory 31a, a face image of the owner of the driver's license 30, or feature information indicating the features of the face image, etc. are stored. Hereinafter, the face image and its feature information are referred to as face information. The face information is an example of biometric information of a person. Also, as described above, the driver's license 30 may be a mobile driver's license.

[0038] First, the terminal device 10 will be described. The terminal device 10 can include a control unit 11, a storage unit 12, a communication unit 13, an operation unit 14, a display unit 15, a card reader 16, an imaging unit 17, and an audio acquisition unit 18.

[0039] The control unit 11 is a part described as the control unit of the terminal device in Embodiment 1. That is, the control unit 11 can be realized by a processor, a working memory, and a non-volatile storage device storing a control program, etc.

[0040] The storage unit 12 is, for example, a storage device using a hard disk drive, a solid state drive, or other memory. The storage unit 12 is a part that stores setting information and the like used in the terminal device 10. The storage unit 12 can also be used as a storage area for the user to store various files. The storage unit 12 can also be the storage device of the above control unit 11. When the driver's license 30 is a mobile driver's license, the storage unit 12 can store the information of the mobile driver's license.

[0041] The communication unit 13 is a part that communicates with an external device such as the management server 20 via the network N. The communication unit 13 can be composed of a wireless or wired communication interface capable of such communication.

[0042] The operation unit 14 is a part that receives operations by the user of the terminal device 10. The operation unit 14 can also be referred to as an operation reception unit. The operation unit 14 can be realized by, for example, any one or more of a physical button, a touch panel mounted on the display unit 15, a pointing device, and a keyboard.

[0043] The display unit 15 is a part for displaying a user interface (UI) image for operating the terminal device 10, and is composed of, for example, a display device such as a liquid crystal display or an organic electroluminescence display. Note that the display unit 15 can also have a configuration including a display and a drive circuit for driving the display.

[0044] The card reader 16 is a part that reads information in the memory 31a of the driver's license 30. The communication method used for such reading is not limited. The card reader 16 may be an IC card reader. The card reader 16 can read face information, but can also read identification information together. When the driver's license 30 is a mobile driver's license, the face information can also be read without providing or using the card reader 16.

[0045] The imaging unit 17 is an imaging device that captures moving images and still images. The imaging unit 17 can also be referred to as a camera. The imaging unit 17 acquires moving image data including at least the face of a person for the second personal authentication process and the detection of gaze information during a period including at least the authentication period, which is the period during which the above-described second personal authentication process is being executed. Hereinafter, the period including at least the authentication period is referred to as the acquisition period. As described above, the face information as an example of biometric information may be a face image recorded by printing on the surface of the driver's license 30. In that case, the face image as an example of biometric information can be acquired by imaging with the imaging unit 17 instead of the card reader unit 16.

[0046] Then, the control unit 11 can execute the second personal authentication process by comparing the face information read from the memory 31a by the card reader unit 16 with the face information obtained by imaging with the imaging unit 17. The face information obtained by imaging with the imaging unit 17 may be the data of the face image captured by the imaging unit 17 itself, or may be feature information obtained by extracting features from the data of the face image. This second personal authentication process determines whether the person whose face image is captured by the imaging unit 17 is the same person as the owner of the driver's license 30 by determining the identity between the person as the owner of the driver's license 30 and the person whose face image is captured by the imaging unit 17. Note that comparing can include comparing.

[0047] Alternatively, the control unit 11 may transmit the face information read from the memory 31a by the card reader unit 16 and the face information obtained by imaging with the imaging unit 17 to the management server 20 via the communication unit 13.

[0048] Alternatively, the control unit 11 may transmit at least one of the face information read from the memory 31a by the card reader unit 16 and the face information obtained by imaging with the imaging unit 17 to the management server 20 via the communication unit 13. In this case, on the management server 20 side, the second personal authentication process will be executed based on the received face information and the face information stored in advance. Note that in a configuration where only one of the face information read from the memory 31a and the face information obtained by imaging with the imaging unit 17 is transmitted to the management server 20, it is not necessary to acquire the other face information.

[0049] Hereinafter, an example will be given and described in which the second personal authentication process is executed on the management server 20 side based on the face information read from the memory 31a, the face information obtained by imaging with the imaging unit 17, and the face information stored in advance on the management server 20 side.

[0050] In addition, the control unit 11 can detect line-of-sight information indicating the movement of the line of sight from a moving image including at least the eye part obtained by imaging with the imaging unit 17, and transmit the line-of-sight information to the management server 20 via the communication unit 13. Alternatively, the control unit 11 may transmit the moving image data itself captured by the imaging unit 17 to the management server 20 via the communication unit 13 for detecting the line-of-sight information. Of course, the moving image data for detecting the line-of-sight information and the moving image data for the second personal authentication process may be the same, and hereinafter, such an example will be basically given and described.

[0051] The voice acquisition unit 18 is a part that acquires voice information indicating the voice around the terminal device 10. The acquisition of voice by the voice acquisition unit 18 can also be referred to as recording. The voice acquisition unit 18 can include a microphone. The voice acquisition unit 18 acquires voice information spoken by a person during an acquisition period including at least the authentication period during which the above-described second personal authentication process is being executed. The voice acquisition unit 18 acquires at least the voice related to the first voice information as the voice related to the voice information, but may also execute the acquisition of the voice related to the second voice information. In a configuration where the voice acquisition unit 18 does not acquire the voice related to the second voice information, the voice acquisition unit 48 provided in the terminal device 40 may acquire the voice related to the second voice information.

[0052] Note that the authentication period can be the period during which face information is obtained by imaging with the imaging unit 17, that is, the imaging period. Therefore, even when the imaging unit 17 captures a still image for comparison with the face information in the memory 31a, the imaging unit 17 may temporarily capture a moving image for obtaining face information. Alternatively, the imaging unit 17 may capture a moving image for comparison with the face information in the memory 31a. In this case, the control unit 11 may extract feature information, which is a feature of the face of the person, from the captured moving image data and transmit it to the management server 20 via the communication unit 13. Of course, the control unit 11 may directly transmit the data of the moving image captured by the imaging unit 17 to the management server 20 via the communication unit 13. Also, the acquisition period can be a period including such an authentication period and at least one of the periods before and after it. However, here, for the purpose of giving an example where the data of the moving image for detecting the line-of-sight information and the data of the moving image for the second personal authentication process are the same, the acquisition period including the authentication period refers to the period for acquiring the first voice information and the line-of-sight information.

[0053] Then, the control unit 11 transmits the first voice information acquired during the acquisition period to the management server 20 via the communication unit 13. The first voice information to be transmitted may be the voice data itself acquired by the voice acquisition unit 18, or may be feature information obtained by extracting the features of the voice data. Hereinafter, an example will be given in which the voice data itself acquired by the voice acquisition unit 18 is transmitted to the management server 20 as the first voice information for explanation.

[0054] Also, the control unit 11 may display a UI image for causing the display unit 15 to speak an answer to the question, or output a question voice for causing a speaker (not shown) to speak an answer to the question, and acquire the first voice information. Such a UI image or question voice may be configured to be output on a browser, or may be configured to be output by application software.

[0055] In addition, the control unit 11 transmits the moving image data acquired during the acquisition period via the communication unit 13. The moving image data acquired during the acquisition period is used in the second personal authentication process and the preliminary evaluation process.

[0056] In addition, the control unit 11 may also display a UI image for inputting an answer to a question on the display unit 15, and accept the answer by a user operation using the operation unit 14. Then, the control unit 11 may transmit the data of the answer input from the operation unit 14 to the management server 20 via the communication unit 13. Such a test may be configured to be performed on a browser or may be configured to be performed with application software.

[0057] Next, the terminal device 40 on the management side will be described. As shown in FIG. 4, the terminal device 40 can include a control unit 41, a storage unit 42, a communication unit 43, an operation unit 44, a display unit 45, a card reader 46, an imaging unit 47, and an audio acquisition unit 48. These components in the terminal device 40 have basically the same configuration as the components with the same names in the terminal device 10, and the description thereof will be omitted except for different uses and different control points.

[0058] The control unit 41 controls the exchange of information via the communication unit 43 with the management server 20. The control unit 41 may control the exchange of information via the communication unit 43 with the terminal device 10 as necessary. The operation unit 44 and the display unit 45 can function as a UI of the terminal device 40.

[0059] The card reader 46 can read biometric information such as face information from the driver's license 30 for personal confirmation at the time of acquisition of the second audio information or at a stage prior to the acquisition of the second audio information as part of the first personal authentication process. However, if such personal confirmation using biometric information is not adopted in the first personal authentication process, the terminal device 40 may not be provided with the card reader 46.

[0060] As part of the first personal authentication process, the imaging unit 47 captures a face image of the person who has brought the driver's license 30 for verification against the face information read from the driver's license 30 for personal verification when acquiring the second voice information or at a stage prior to the acquisition of the second voice information. The control unit 41 verifies the read face information against the captured face image. By adopting such personal verification, even when the terminal device 40 is installed as an automatic reception device not used by the management-side user, it is possible to perform personal verification of the person who has brought the driver's license 30. However, for example, a person in charge on the management side such as the user of the terminal device 40 may visually confirm the face image displayed on the display unit 45 with the face information read by the card reader unit 46 or the face photo on the surface of the driver's license 30 and the face of the person who has brought it. As in this case, when the captured face image is not used for personal verification, the terminal device 40 may not include the imaging unit 47.

[0061] The voice acquisition unit 48 acquires the voice related to the second voice information. In this case, the voice acquisition unit 18 in the terminal device 10 does not acquire the voice related to the second voice information. The control unit 41 may perform control to transmit the second voice information acquired by the voice acquisition unit 48 to the management server 20 via the communication unit 43. In this case, the management server 20 will perform the first personal authentication process. However, as an alternative example, the control unit 41 may receive the first voice information and the line-of-sight information registered in the management server 20 via the communication unit 43 and execute the first personal authentication process based on these information and the second voice information.

[0062] Next, the management server 20 will be described. The management server 20 can include a control unit 21, a storage unit 22, and a communication unit 23.

[0063] The control unit 21 is the part described as the control unit of the server device in Embodiment 1. That is, the control unit 11 can be realized by a processor, a working memory, and a non-volatile storage device storing a control program, etc.

[0064] The storage unit 22 is, for example, a storage device using a hard disk drive, a solid state drive, or other memories. The storage unit 22 is a part that stores various information necessary for the above-described predetermined procedure, for example, in a database format or the like. The storage unit 22 can also be the storage device of the above-described control unit 21.

[0065] The communication unit 23 is a part that communicates with external devices including the terminal device 10 and the terminal device 40 via the network N. The communication unit 23 can be configured by a wireless or wired communication interface capable of such communication.

[0066] The communication unit 23 receives the face information read from the memory 31a by the card reader 16, the moving image data obtained by imaging with the imaging unit 17, and the voice data as the first voice information, and passes them to the control unit 21. Further, the communication unit 23 may also receive evaluation target information other than the voice data as the first voice information and the moving image data used for detecting the line-of-sight information from the terminal device 10 or other external devices. For example, the communication unit 23 receives the result of the above-described test as part of the evaluation target information and passes it to the control unit 21. Further, the communication unit 23 may receive information regarding a disease from the terminal device 10 as information input by the person, or may receive it from a hospital server.

[0067] And the control unit 21 can include an authentication processing unit 21a, a preliminary evaluation processing unit 21b, a reception processing unit 21c, and a determination processing unit 21d.

[0068] The authentication processing unit 21a extracts face information from the moving image data obtained by imaging with the imaging unit 17, which is received via the communication unit 23. Then, the authentication processing unit 21a performs a second person authentication process by collating the first face information and the second face information received via the communication unit 23 with the third face information, which is face information stored in advance in the storage unit 22 as a database (DB) or the like. Here, the first face information is the face information read from the memory 31a by the card reader 16. The second face information is the face information extracted from the moving image data.

[0069] As described above, the second identity authentication process may be executed by comparing the first face information and the third face information, or may be executed by comparing the second face information and the third face information. Thus, the second identity authentication process can include a process of authenticating a person by comparing the biometric information of the person with the biometric information of the person previously stored in the management server 20 managed by the service-providing side. Note that the second identity authentication process may be executed by comparing the first face information and the second face information.

[0070] When the authentication processing unit 21a can confirm that the person is the same person in this second identity authentication process, that is, when it is determined that the face information to be compared is information of the same person, the authentication processing unit 21a notifies the provisional evaluation processing unit 21b to that effect, and the provisional evaluation processing unit 21b executes the provisional evaluation process. On the other hand, when the authentication processing unit 21a cannot confirm that the person is the same person in the second identity authentication process, it may notify, via the communication unit 23, that the second identity authentication process has failed, that is, the identity authentication process has failed.

[0071] The provisional evaluation processing unit 21b is an example of the acquisition processing unit 1a and the provisional evaluation processing unit 1b in FIG. 1. As an acquisition process, the provisional evaluation processing unit 21b receives, via the communication unit 23, voice data as the first voice information and moving image data for detecting gaze information acquired during a period including the period in which the second identity authentication process is performed using the driver's license 30. The provisional evaluation processing unit 21b can also receive evaluation target information other than these voice data and moving image data via the communication unit 23.

[0072] However, in the terminal device 10, the first audio information acquired by the preliminary evaluation processing unit 21b can also be obtained from another device connected to the terminal device 10 separately from the moving image data. In order to prevent spoofing of only the audio through such an acquisition route, the second personal authentication process can further use the mouth information obtained by detecting the movement of the mouth of the person. The mouth information can be extracted from the moving image data captured by the imaging unit 17, which is an example of an imaging device, of the person's mouth. Here, the movement of the mouth refers to the movement of the mouth area, that is, the imaging unit 17 can capture the mouth area. The mouth information may be extracted by the terminal device 10 and received by the authentication processing unit 21a, or may be extracted by the authentication processing unit 21a from the moving image data received from the terminal device 10. In this case, the second personal authentication process includes a process of performing personal authentication of the person based on the mouth information and the first audio information. This process is a process of collating the movement of the mouth indicated by the mouth information with the movement of the mouth for uttering the voice indicated by the first audio information to determine whether the movement of the mouth and the voice indicated by the first audio information correspond. Such a process may use a learning model. Note that the algorithm of this learning model is not limited.

[0073] In addition, the preliminary evaluation processing unit 21b extracts gaze information, which is information obtained by detecting the movement of the gaze of the person from the received moving image data. Note that the process of extracting gaze information from the moving image data can also be executed by the control unit 11 on the terminal device 10 side. In that case, the control unit 11 may transmit the extracted gaze information to the management server 20 as part of the information to be evaluated via the communication unit 13.

[0074] Then, the preliminary evaluation processing unit 21b preliminarily evaluates the cognitive function of the person based on the information to be evaluated including the first audio information and the gaze information thus obtained. Note that in this embodiment, an example in which the information to be evaluated includes both the first audio information and the gaze information is described, but as described in Embodiment 1, the information to be evaluated may include at least one of the first audio information and the gaze information.

[0075] Here, as the movement of the line of sight of a person, for example, it can be detected as the change in the line of sight of the person or the responsiveness to the change in the UI image during imaging. Therefore, the preliminary evaluation processing unit 21b can evaluate that there is a problem with the cognitive function, for example, when the eyes are swimming or when the line of sight cannot catch up with the change in the UI image. In this case, the preliminary evaluation processing unit 21b can lower the preliminary evaluation result based on the first voice information with the preliminary evaluation based on the line of sight information.

[0076] In addition, the preliminary evaluation processing unit 21b may perform a process of extracting expression information, which is information detecting the expression of a person from moving image data, as part of the information to be evaluated. Then, the preliminary evaluation processing unit 21b preliminarily evaluates the cognitive function of the person who is the imaging target of the moving image from the extracted expression information. Here, as the expression of a person, for example, it can be detected as the movement of the facial muscles including spasms or the responsiveness to the change in the UI image during imaging. Therefore, the preliminary evaluation processing unit 21b can evaluate that there is a problem with the cognitive function, for example, when the expression is tense or when the change in the expression cannot catch up with the change in the UI image. In this case, the preliminary evaluation processing unit 21b can lower the preliminary evaluation result based on the first voice information and the line of sight information with the preliminary evaluation based on the expression information.

[0077] In this way, the preliminary evaluation processing unit 21b may perform an evaluation of the cognitive function for each type of information to be evaluated and perform a comprehensive evaluation based on those evaluations.

[0078] In addition, the preliminary evaluation processing unit 21b only needs to acquire at least a part of the first voice information and the line of sight information used for the preliminary evaluation during the period when the identity authentication is performed using the above certificate. For example, if that period is period A, the first voice information and the line of sight information of the person may also be acquired in the periods before and after period A, and those information to be evaluated may be used for the preliminary evaluation processing. In that case, the preliminary evaluation processing unit 21b can determine the identity of the two persons by voiceprint determination processing by comparing the first voice information in period A with the first voice information in the periods before and after it, and perform the preliminary evaluation processing excluding the voice information of a person different from the first voice information in period A.

[0079] Further, as described for the preliminary evaluation processing unit 1b, the preliminary evaluation processing unit 21b can also be configured to obtain a preliminary evaluation result from the information to be evaluated by using a learning model that is machine-learned to input the information to be evaluated and output a preliminary evaluation result of the cognitive function. The learning model may be a model that combines learning models for each type of information to be evaluated, such as a learning model for the first audio information, a learning model for the eye line information, and a learning model for the test result. Also, the algorithm of this learning model is not limited.

[0080] As the learning model that inputs the first audio information and outputs a preliminary evaluation result of the cognitive function, for example, among the models that analyze potential brain-related diseases and emotions from the spoken words, voice rhythm, spectrum, etc., a model specialized for diseases related to the cognitive function can be used. Here, the audio information input to this learning model may be the acquired audio data itself, or information indicating the spoken words, voice rhythm, spectrum, etc. as a result of analyzing the audio data. As the learning model that inputs the eye line information and outputs a preliminary evaluation result of the cognitive function, for example, among the models that analyze potential brain-related diseases and emotions from the magnitude, direction, speed, frequency, etc. of the eye line movement, a model specialized for diseases related to the cognitive function can be used.

[0081] Also, as described above, the information to be evaluated input to the learning model includes the eye line information extracted from the moving image data, but instead, it may be the moving image data itself. In this case, the learning model will also be responsible for the process of extracting the eye line information from the moving image data.

[0082] The reception processing unit 21c receives the determination processing executed by the determination processing unit 21d. The reception processing unit 21c transmits a UI image for receiving this determination processing or information necessary for displaying the image to the terminal device 40 via the communication unit 23. The terminal device 40 may display the UI image on the display unit 45 based on the UI image received via the communication unit 43 or the information necessary for displaying the UI image and receive an operation from the operation unit 44.

[0083] The determination processing unit 21d is an example of the determination processing unit 1c in FIG. 1. The determination processing unit 21d executes a first authentication process for a person and executes a determination process for determining the procedure or admissibility regarding the provision of services to that person. The first authentication process includes a process of acquiring second voice information, which is voice information of that person, and performing authentication based on the first voice information, the second voice information, and the line-of-sight information. That is, in the determination processing unit 21d, as the first authentication process, a process of confirming whether the person who has undergone the preliminary evaluation is the same person as the person who performs the determination process for determining the procedure or admissibility is performed.

[0084] Here, the voice related to the second voice information may be acquired by a voice acquisition unit 48 such as a microphone provided in the terminal device 40. That is, the voice related to the second voice information may be acquired by a terminal device 40 different from the terminal device 10 that acquired the voice related to the first voice information.

[0085] The second voice information may be information with a shorter voice acquisition time compared to the first voice information. This is because the first voice information is used for the preliminary evaluation of the recognition function, while the second voice information only needs to be information to the extent that it can determine whether it is the same person as the first voice information. For example, the first authentication process may be a process of analyzing voiceprints and the like for both the first voice information and the second voice information and making a determination as to whether they are the same person based on the results.

[0086] In the first authentication process, for the first voice information and the second voice information, for example, feature amounts can be extracted and the feature amounts of both can be compared to perform authentication. The authentication based on the first voice information and the second voice information can also be executed, for example, using a learning model that is machine-learned to input the first voice information and the second voice information and output whether both are voices by the same person. Here, each voice information input to this learning model may be the acquired voice data itself, or may be information indicating the words spoken, the rhythm of the voice, the spectrum, etc. as a result of analyzing the data of each voice.

[0087] As described above, the first personal authentication process also includes a process of performing personal authentication based on the line-of-sight information. As the line-of-sight information, the line-of-sight information as the result extracted by the preliminary evaluation processing unit 21b may be used. The personal authentication based on the line-of-sight information can include confirmation of whether the shooting of the moving image data that is the detection source of the line-of-sight information and the recording of the audio data for the first audio information are not performed by separate devices. If these shooting and recording are considered to be performed by separate devices, there is a possibility of impersonation.

[0088] As described in the explanation of the preliminary evaluation process, as the movement of a person's line of sight, for example, it can be detected as the change of the person's line of sight or the responsiveness to the change of the UI image at the time of imaging. Therefore, for example, when the eyes are blurred, when the line of sight does not catch up with the change of the UI image, or when the movement of the line of sight is unnatural, it can be determined that there is a possibility that the person who emits the voice related to the first audio information is different from the person reflected in the moving image data, that is, there is a possibility of impersonation.

[0089] When there is such a possibility of impersonation, the determination processing unit 21d can determine that the personal authentication has failed. For the personal authentication based on the line-of-sight information, a learning model that is machine-learned to input at least the line-of-sight information and output whether impersonation is being performed may be used. This learning model may be a model that inputs the moving image data instead of the extracted line-of-sight information. As the input of this learning model, in addition to the line-of-sight information or the moving image data, one or both of the first audio information or the audio data and the UI image or the information indicating the change of the UI image can be included. The algorithm of this learning model and the like are not limited.

[0090] In addition to, or instead of, the above-described processing, the personal authentication based on the line-of-sight information may perform the following processing. That is, as the first personal authentication processing for personal authentication based on the line-of-sight information, the line-of-sight information may be extracted from the moving image data captured by the imaging unit 47 at the time of acquisition of the second voice information, and the extracted line-of-sight information may be collated with the line-of-sight information received from the terminal device 10 to perform personal authentication. The personal authentication based on the first line-of-sight information received from the terminal device 10 and the second line-of-sight information extracted from the moving image data captured by the imaging unit 47 can be executed using, for example, a learning model. This learning model can be, for example, a model that is machine-learned to input the first line-of-sight information and the second line-of-sight information and output whether or not the movements of the lines of sight are by the same person. Here, the first line-of-sight information and the second line-of-sight information input to this learning model may be the acquired moving image data itself, or may be information indicating the movement of the line of sight as a result of analyzing each moving image data.

[0091] Then, when the personal authentication is successful in the first personal authentication processing, the determination processing uses the result of the preliminary evaluation in the preliminary evaluation processing to determine the procedure or feasibility regarding the provision of services to that person. That is, when the personal authentication is successful in the first personal authentication processing, the determination processing uses the result of the preliminary evaluation in the preliminary evaluation processing as the evaluation of the formal recognition function to determine the procedure or feasibility regarding the provision of services to that person. The reason why the evaluation of the recognition function executed by the preliminary evaluation processing unit 21b is a preliminary evaluation is that the first personal authentication processing has not been performed. When the personal authentication is performed in the first personal authentication processing, the result of the preliminary evaluation executed by the preliminary evaluation processing unit 21b becomes the result of the formal evaluation. Hereinafter, the result of the formal evaluation is also simply referred to as the evaluation result.

[0092] Also, in the first personal authentication processing, it is preferable to acquire the voice related to the second voice information in front of the monitor on the side that provides the service related to the determination processing. In this case, the voice related to the second voice information is not limited to the example acquired by the voice acquisition unit 48 provided in the terminal device 40, and can also be acquired by the voice acquisition unit 18 of the terminal device 10.

[0093] By adopting voice acquisition in the presence of such a monitor, the voice related to the second voice information can be acquired while the monitor is visually observing the person. Therefore, even if the first voice information is voice acquired in a scene where the person is alone and the monitor is not present, if the first personal authentication process is successful in personal authentication, the voice related to the first voice information can be regarded as voice acquired in front of the monitor. And the result tentatively evaluated based on the first voice information and the line-of-sight information can also be regarded as the result of evaluating the recognition function in front of the monitor, that is, the result of a formal evaluation.

[0094] Also, as described for the terminal device 40, the first personal authentication process can include personal authentication using a face image. In this example, the imaging unit 47, as part of the first personal authentication process, captures a face image of the person carrying the driver's license 30 at the time of acquiring the second voice information or at a stage prior to acquiring the second voice information. Also, as shown in FIG. 4 depicting the state of communication between the driver's license 30 and the terminal device 40, the card reader 46 reads face information from the driver's license 30. Then, the determination processing unit 21d performs personal authentication by receiving the face image captured by the imaging unit 47 and the read face information via the communication unit 23 and collating the two. Alternatively, the control unit 41 collates the read face information and the captured face image.

[0095] By adopting such personal confirmation, the terminal device 40 can be installed as an automatic reception device not used by the management-side user, and personal confirmation based on the face of the person carrying the driver's license 30 can be performed even when there is no monitor. When there is a monitor, the face image is not limited to the example of being captured by the imaging unit 47 provided in the terminal device 40, and may be captured by the imaging unit 17 of the terminal device 10 and transmitted to the terminal device 40. Also, for example, a person in charge on the management side such as a user of the terminal device 40 may act as a monitor and visually confirm the face image displayed on the display unit 45 with the face information read by the card reader 46 or the face photo on the surface of the driver's license 30 and the face of the person carrying it.

[0096] Also, the first voice information used in the first personal authentication process only needs to be registered in the terminal device 10 or the management server 20 before the first personal authentication process is executed. As described above, the first voice information and the line-of-sight information can be acquired by the terminal device 10 used by a person. Then, the terminal device 10 can register the first voice information in the management server 20 managed by the service-providing side. In this case, the first personal authentication process may perform personal authentication of a person by collating the first voice information registered in the management server 20 with the second voice information. Alternatively, the terminal device 10 can register the first voice information in the storage unit 12 of the terminal device 10. In this case, the first personal authentication process may perform personal authentication of a person by connecting the terminal device 10 to the management server 20 or the terminal device 40 to read out the first voice information registered in the storage unit 12 and collating it with the second voice information. Also, the line-of-sight information acquired together with the first voice information, that is, the first line-of-sight information only needs to be registered in the terminal device 10 or the management server 20 before the first personal authentication process is executed, similar to the first voice information.

[0097] When performing the first personal authentication process by connecting the terminal device 10 and the terminal device 40, it is advisable to adopt a configuration in which the information is registered in the terminal device 10 before the first personal authentication process is executed and can be at least referenced from the terminal device 40 during the first personal authentication process. Being able to be referenced from the terminal device 40 can refer to sharing the first voice information and the first line-of-sight information between the terminal device 10 and the terminal device 40, or moving from the terminal device 10 to the terminal device 40, etc. In this case, the first personal authentication process may perform personal authentication by having the terminal device 40 reference the first voice information and collating the first voice information with the second voice information, or by transmitting it to the management server 20. Similarly, for personal authentication regarding the line-of-sight information, the terminal device 40 may perform personal authentication by referencing the first line-of-sight information or by transmitting it to the management server 20 to perform personal authentication. As described above, personal authentication can also be performed using not only the first line-of-sight information but also the second line-of-sight information. In this case as well, the first personal authentication process may perform personal authentication by having the terminal device 40 reference the first line-of-sight information and collating the first line-of-sight information with the second line-of-sight information, or by transmitting it to the management server 20.

[0098] In addition, the service for which the procedure regarding provision or the object of determination of approval or disapproval is to be made in the determination process can be a service for updating a predetermined qualification. In this case, the service can include a guidance process for guiding the procedure for updating the predetermined qualification. That is, in this case, the determination process can include a process for determining the procedure or approval or disapproval regarding the provision of such a guidance process to that person. Here, as described above, when the predetermined qualification is, for example, a driver's license 30 exemplified by a certificate, it can be exemplified by a driver's license for automobiles, which is the qualification proved by the driver's license 30.

[0099] In addition, the determination process can include, for example, as a procedure regarding the provision of a service, a first procedure for making a person take a training session and a second procedure for making the person take the training session after further evaluating the person's cognitive function, and a process for determining the procedure to be executed among a plurality of procedures including these. The training session regarding the update of the driver's license 30 can be, for example, a training session for the elderly. The above-mentioned further evaluation may be the same evaluation as that performed in the preliminary evaluation process, or may be an examination of the person's cognitive function.

[0100] In this example, the service will be provided by a procedure with fewer steps in the first procedure than in the second procedure. Considering the number of such procedures, the above-mentioned guidance process may be the following process.

[0101] That is, when the above guidance process indicates that the provisional evaluation result of the person's cognitive function, that is, the evaluation result of the person's cognitive function when the first personal authentication process is successful, indicates a problem with the cognitive function, the second procedure including the procedures necessary to update a predetermined qualification may be guided. Here, the case where it is indicated that there is a problem with the cognitive function refers to a case where there is a possibility of a problem with the cognitive function because it is only a provisional evaluation by the provisional evaluation unit 21b. When the predetermined qualification is a driver's license, the second procedure refers to, for example, a cognitive function test and an elderly person's training course. This cognitive function test is performed by the examinee filling in an examination paper or by the examinee inputting with a touch pen on a tablet equipped with software necessary for the test. If it is determined as a result of this cognitive function test that "there is a possibility of dementia", a diagnosis by a doctor will be added. On the other hand, when the above guidance process indicates that the evaluation result of the person's cognitive function shows that there is no problem with the cognitive function, the first procedure necessary to update a predetermined qualification, which has fewer procedure steps than the second procedure, may be guided. When the predetermined qualification is a driver's license, the first procedure refers to, for example, an elderly person's training course. Note that both the second procedure and the first procedure may include procedures such as receiving an updated license.

[0102] As can be seen from this example, the availability of service provision may be the availability of conducting training for the person or the necessity of further evaluating the person's cognitive function.

[0103] Also, the guidance process described above can be executed by the reception processing unit 21c. Based on the determination result in the determination process, the reception processing unit 21c may display a UI image for guidance on the display unit 45 of the terminal device 40, or cause an image for guidance to be printed by a printing device (not shown) connected to the terminal device 40, for example, via the communication unit 43. Alternatively, the reception processing unit 21c may transmit the UI image for guidance or information for displaying the UI image to the terminal device 10 via the communication unit 43 and cause it to be displayed on the display unit 15 of the terminal device 10. It can be said that printing by such a printing device, display on the display unit 45, and display on the display unit 15 are examples of output of the determination result. In this way, the terminal device 40 can be provided with an output unit that outputs the determination result.

[0104] In addition, the reception processing unit 21c may be responsible for providing a UI image to the terminal device 40 for processes such as acquisition of second voice information, acquisition of second gaze information, imaging of a face image, and reading of the driver's license 30.

[0105] Also, the determination processing unit 21d or the preliminary evaluation processing unit 21b may perform a process of deleting the acquired first voice information after the first personal authentication process. As a result, unnecessary extra information is deleted, making it easier for the user of the terminal device 10 to use the determination system 100. Also, the determination processing unit 21d or the preliminary evaluation processing unit 21b may perform a process of deleting the acquired first gaze information in the same manner as the first voice information after the first personal authentication process. As a result, unnecessary extra first gaze information is also deleted, making it even easier for the user of the terminal device 10 to use the determination system 100. Also, the determination processing unit 21d or the preliminary evaluation processing unit 21b or the control unit 41 of the terminal device 40 may perform a process of deleting the second voice information and the second gaze information after the first personal authentication process. As a result, unnecessary extra second voice information and second gaze information are also deleted, making it even easier for the user of the terminal device 10 to use the determination system 100.

[0106] Also, as described above, the biometric information of a person can include the face information of that person. In this case, at least one of the first authentication process and the second authentication process can include a process of capturing the face of the person with an imaging device to obtain face information, and performing authentication of the person based on the obtained face information. The imaging device here can be the imaging unit 47 provided in the terminal device 40 or the imaging unit 17 of the terminal device 10 for the first authentication process, and can be the imaging unit 17 of the terminal device 10 for the second authentication process.

[0107] Note that, although detailed description is omitted, the reception processing unit 21c can also be configured to transmit a UI image necessary for processing in the terminal device 10 or information necessary for displaying the image to the terminal device 10 via the communication unit 23.

[0108] Next, a processing example of the determination system 100 will be described with reference to FIGS. 5 to 9. First, an example of the preliminary evaluation process and the second authentication process will be described with reference to FIGS. 5 to 8. FIG. 5 is a flowchart for explaining an example of the preliminary evaluation process and the second authentication process included in the determination method according to the present disclosure. FIG. 6 is a diagram showing an example of an update guidance leaflet 50 for a driver's license according to the present disclosure. FIG. 7 is a diagram showing an example of a UI image according to the present disclosure. FIG. 8 is a diagram showing another example of the UI image according to the present disclosure.

[0109] Prior to the processing in the terminal device 10, an update guidance leaflet 50 for the driver's license 30 illustrated in FIG. 6 is sent to the user of the terminal device 10. Here, the description will be made on the premise that the user is an elderly person 75 years old or older with no certain violation history, or a person with a certain violation history who has passed the driving skills test by the expiration of the renewal period.

[0110] On the renewal notice leaflet 50, there is a notice text 51 regarding the reservation of the cognitive function test for driver's license renewal printed thereon. Further, on the renewal notice leaflet 50, there is also an introduction text 52 of the application software for accepting reservations and its QR (Quick Response) code (registered trademark. The same shall apply hereinafter) 53 printed thereon. Hereinafter, the application software is simply referred to as the application. The renewal notice leaflet 50 may print the procedure for using this application and the terms required for reservations made using this application.

[0111] The user who has received the renewal notice leaflet 50 uses the imaging unit 17 of the terminal device 10 to read the QR code 53, access the download source of the application, and perform the download operation. By accepting this operation, the terminal device 10 downloads the application (step S11) and installs the application in the control unit 11. Next, the user performs a startup operation to start this application from the operation unit 14. The control unit 11 accepts this startup operation and starts the application (step S12). Including this startup, the process shown in FIG. 5 can be executed based on an operation performed by the user at an arbitrary location.

[0112] When the application starts, it communicates with the management server 20. Thereby, the renewal procedure for the driver's license for motor vehicles is started. Thus, the determination system 100 may accept a request to start or resume the above-mentioned predetermined procedure by accepting the input of predetermined information such as a QR code attached to a guide document for performing a predetermined procedure such as the renewal procedure for the driver's license for motor vehicles.

[0113] The application requests the user to input the PIN code registered at the time of registration or the previous update of the driver's license 30, and accepts the input at the operation unit 14 (step S13). The application determines whether the input PIN code is correct by comparing it with the PIN code stored in the memory 31a of the card reader unit 16. If the PIN code is correct, the application reads the face information recorded in the memory 31a of the driver's license 30 by the card reader unit 16 and transmits it to the management server 20 (step S14). In step S14, the application also reads the identification information recorded in the memory 31a together with the face image and transmits it to the management server 20.

[0114] If the driver's license 30 is a mobile driver's license, in step S14, the application may use a terminal device with an imaging unit installed in a driver's license center or the like to read the face information and identification information and transmit them to the management server 20. Alternatively, if the driver's license 30 is a mobile driver's license, in step S14, a configuration may be adopted in which the application transmits the face image captured by the imaging unit 17 to the management server 20 and receives the face authentication result from the management server 20. In the case of such a configuration, the application may adopt a configuration in which the face information and identification information are read from the mobile driver's license and transmitted to the management server 20 only when a successful face authentication result is obtained. Also, when using the face image printed on the surface of the driver's license 30, the application may prompt the user to photograph the face image printed on the driver's license 30, and transmit the face image captured by the imaging unit 17 to the management server 20. In this case, the application also prompts the user to photograph, photograph, and transmit the identification information printed on the driver's license 30 together with the face image to the management server 20.

[0115] In addition, the application prompts the user to capture an image of the face using the front camera 17a, which is the imaging unit 17 or a part thereof, by displaying a shooting frame 61 as in the UI image 60 illustrated in FIG. 7. Then, the application starts acquiring a moving image with the front camera 17a and sequentially transmits the moving image data to the management server 20 (step S15).

[0116] In addition, together with the start of acquiring the moving image, the application presents a speech request sentence 62, which is a request sentence for an answer to a question, to the user as in the UI image 60, and makes a speech request as an answer request (step S16).

[0117] Here, an example is given in which, as the speech request, an answer to a question 63 is spoken instead of a set phrase. The number and type of this question 63 do not matter as long as a provisional evaluation of the recognition function is possible. The question 63 may freely include, for example, topics such as asking about the content and impressions of yesterday's lunch, and asking the user to talk about them to a certain extent. By setting such a topic that asks about the user's memory, the accuracy of the evaluation of the recognition function in the subsequent stage can also be improved. In addition, the question 63 may include a question about the driver's license, such as a question about the content described on the driver's license 30, but it does not have to be included as long as it includes questions other than those about the driver's license. This is because a question about the driver's license can be answered if the characters can be read, and it can be said that this alone is insufficient for a provisional evaluation of the recognition function.

[0118] Examples of questions other than those related to the license can include, for example, the weather in the morning and evening yesterday, recent favorite TV programs, recent travel destinations and enjoyable things, and recent unpleasant things. Also, examples of questions other than those related to the license can include questions such as, for example, please tell me what you did, such as the content of your meals and conversations with your family, from when you woke up this morning until you opened this application. Further, the application may prepare, for example, a predetermined number of questions as questions other than those related to the license, randomly display or output them as audio, and accept the user's spoken answers. By asking questions randomly, it is possible to prevent "impersonation" where someone pre-records another person's voice and passes the preliminary evaluation of the recognition function as having no problem with the recognition function. Additionally, the application may be a general-purpose AI conversation application that changes questions according to the user's answers, specialized for the evaluation of the recognition function.

[0119] In addition, the UI image 60 may include, together with the speech request sentence 62, a sentence 64 indicating that the speech content and the captured video are used for the determination of the recognition function, and a speech start button 65 for approving and starting the speech. When the speech start button 65 is selected, the acquisition of audio information by the audio acquisition unit 18 and the recording of moving image data captured by the imaging unit 17 will start. Note that when displaying the sentence 64, the acquisition of moving image data may be performed even before the speech start button 65 is selected, but it does not need to be used for detecting gaze information or facial expression information. Also, when the speech start button 65 is selected, it is preferable to display the speech end button 66 so that it can be selected.

[0120] In step S16, an example of making a speech request was given by displaying a UI image for causing the user to speak an answer to the question on the display unit 15. On the other hand, as described above, a speech request may also be made by outputting a question voice for causing the user to speak an answer to the question from a speaker (not shown) for acquiring the first audio information. This speaker is an example of the audio output unit provided in the terminal device 10. Specific examples of processing for such a speech request by voice and the user's answer to the speech request will be given.

[0121] For example, the application of the terminal device 10 can include an AI conversation application that reads out the text of a prepared question in voice using, for example, AI technology and outputs it from a speaker. In response to such a readout, the user speaks the answer content, and the voice acquisition unit 18 acquires the voice. Here, the user's spoken content as an answer to the question may be recognized by, for example, voice recognition and converted into text for recognition in such an AI conversation application. Then, for the acquired voice, the AI conversation application can automatically generate further questions and the like, enabling an automatic response. For example, when the AI conversation application cannot discriminate the user's spoken content, that is, when it cannot be heard, it may be configured to output a voice saying "Please say that again" and have the AI judge from the voice recognition text content and speak the same question again. When the AI conversation application can recognize the user's spoken content, it may automatically generate and read out a second question, a third question, etc. following the question that was the source of the spoken content. For example, generative AI such as an artificial intelligence chatbot can also generate question texts. By using such generative AI or the like, the AI conversation application may generate a new question from the flow of the previous question without having to prepare questions in advance.

[0122] With such a mechanism, the user can answer in a way that feels the same as the mechanism of interacting with a telephone operator. Also, such an AI conversation application in the terminal device 10 may be a general-purpose AI conversation application that changes questions according to the user's answer, for example, or it may be specialized for the evaluation of cognitive functions.

[0123] In addition, examples of processing as an alternative to the display of the speech request sentence 62 in the UI image are as follows. That is, the terminal device 10 may output, from the speaker, a speech request sentence such as "Since the question will be output as voice, please answer the question with the smartphone held to your ear" or "Since the question will be output as voice, please answer the question with the microphone close to your mouth". Of course, such a sentence may be displayed on the UI image.

[0124] When the user is made to answer the sentence 64 displayed on the UI image, if the terminal device 10 is a portable terminal device such as a smartphone, the user will speak while holding the terminal device 10 away from the ear and looking at the UI image. In such a situation, since the distance between the terminal device 10 and the user's mouth increases due to, for example, presbyopia, there is a concern about deterioration of the voice quality. However, as described above, by outputting the question voice from the speaker and making a speech request, there is an advantage that such a concern is eliminated.

[0125] In step S16, further, the application acquires the spoken voice data and the captured moving image data, and transmits the voice data and the moving image data to the management server 20. Here, the application may make a speech request after detecting that the second personal authentication process has been performed. Also, during the speech request or during the video shooting period, the result of the second personal authentication in the second personal authentication process may be continuously displayed on the UI image 60.

[0126] In the management server 20, the authentication processing unit 21a executes the second personal authentication process (step S17). This second personal authentication process performs personal authentication based on the first face information obtained by reading from the driver's license 30 or the like, the second face information obtained from the moving image data acquired by the front camera 17a, and the third face information stored in advance as a DB in the storage unit 22. Here, by collating at least one of the first face information and the second face information with the third face information in the DB, it is possible to determine whether the driver's license 30 is forged.

[0127] Next, the authentication processing unit 21a determines whether the result of the personal authentication process was successful, that is, whether it was OK (step S18). If the result is NO in step S18, the process ends. At this time, the authentication processing unit 21a may notify the terminal device 10 via the communication unit 23 that the personal authentication process has failed.

[0128] If the result is YES in step S18, the preliminary evaluation processing unit 21b preliminarily evaluates the cognitive function from the acquired voice data and moving image data, and registers the result in the storage unit 22 (step S19). Examples of this evaluation method are as described above. The preliminary evaluation processing unit 21b may be equipped with a function to prevent voice imitation, such as outputting the voice of someone else who has recorded in advance while acting as if speaking during video shooting. As such a prevention function, for example, as described above, a function to perform personal authentication based on the first line-of-sight information or a function to ask random questions during voice acquisition and evaluate the appropriateness of the responses may be adopted.

[0129] The reception processing unit 21c determines whether the registered preliminary evaluation result indicates that there is a problem with the cognitive function (step S20). If the result is YES in step S20, the reception processing unit 21c transmits, via the communication unit 23, a UI image for guiding the cognitive function test for display on the display unit 15 (step S21). In step S21, it may also guide the elderly training. However, the elderly training may be guided when the reservation for the cognitive function test based on the guidance for the cognitive function test is completed. After the process of step S21, the determination system 100 ends the process. After that, the user who has seen this guidance calls the phone number of the link included in the guidance to make a reservation for the cognitive function test.

[0130] If the answer in step S20 is NO, the reception processing unit 21c transmits, via the communication unit 23, a UI image for guiding the elderly training to the display unit 15 for display (step S22). In the guidance for the elderly training, for example, an interface image 70 as shown in FIG. 8 may be displayed. The UI image 70 can include a text 71 for prompting a reservation, radio buttons 72, 73 for selecting a method for guiding the elderly training, and an OK button 74 for proceeding with the guidance by the selection. After that, the user who has seen this guidance can continue to make a reservation for the elderly training in the application by selecting the radio button 72 and the OK button 74. Alternatively, the user can make a reservation for the elderly training by selecting the radio button 73 and the OK button 74 and then calling the phone number of the reservation destination. After the process of step S22, the determination system 100 ends the process.

[0131] Alternatively, instead of the processes of steps S20 to S22, for example, regardless of the result of the preliminary evaluation, a common guidance for performing either the cognitive function test and the elderly training or the elderly training may be provided, and the reservation may be accepted. In this case, the user does not know whether a cognitive function test is necessary at the time of this guidance.

[0132] At the stage when the guidance process such as the processing example in FIG. 5 ends, the user will act according to the reservation. The reservation for either the cognitive function test or the elderly training can be executed at the same facility such as the same driving license center. The user can use the terminal device 40 installed in this facility or the monitor can use the terminal device 40 on behalf of the user to accept the confirmation of the reservation and the implementation of the reserved items.

[0133] An example of the determination process executed as a continuation of the processing example in FIG. 5 will be described with reference to FIG. 9. FIG. 9 is a flowchart for explaining another example of the determination method according to the present disclosure and is a flowchart for explaining a subsequent example of the example in FIG. 5. The example of the determination process described here is executed in cooperation with the terminal device 40 with the imaging unit 47 and the voice acquisition unit 18 installed in the driving license center by the management server 20.

[0134] First, the user goes to the driver's license center and presents the driver's license 30 to the monitor who conducts the renewal reception service. The monitor checks the user's face against the face image recorded on the driver's license 30. If the result of this check indicates the same person, the monitor performs an operation to permit or reject the execution of the reservation on the terminal device 40, and the reception processing unit 21c of the management server 20 that has received the operation content performs an authentication process (step S31). Here, the reception processing unit 21c receives such an operation and determines whether the authentication has succeeded according to the content of the received operation (step S32). If the result in step S32 is YES, that is, if an operation permitting the execution of the reservation is received, it is advisable to pass the determination result to the determination processing unit 21d. On the other hand, if the reception processing unit 21c receives a NO in step S32, that is, if an operation rejecting the execution of the reservation is received, it may consider that the authentication process has failed and end the process. The above authentication process in step S31 can also be said to be part of the first authentication process.

[0135] Alternatively, in step 31, the terminal device 40 installed near the monitor captures the user's face image with the imaging unit 47, and the reception processing unit 21c of the management server 20 compares it with the face information in the DB to perform an authentication process. Alternatively, in step S31, the face image recorded on the driver's license 30 and the terminal device 40 installed near the monitor may capture the user's face image with the imaging unit 47 and read out the face image recorded on the driver's license 30. In this case, the reception processing unit 21c compares both face images with the face information in the DB of the management server 20 to perform an authentication process. In any case where the reception processing unit 21c compares with the face information in the DB of the management server 20, if they are of the same person, it may be determined that the authentication process has succeeded in step S32, and the determination result may be passed to the determination processing unit 21d. On the other hand, if they are not of the same person, it may be determined that the authentication process has failed in step S32, and the process may be ended. In any case where the reception processing unit 21c compares with the face information in the DB of the management server 20, the above authentication process in step S31 can also be said to be part of the first authentication process.

[0136] Alternatively, in step 31, the terminal device 40 installed as an unattended reception device captures a face image of the user with the imaging unit 47, and the reception processing unit 21c of the management server 20 collates it with the face information in the DB to perform an authentication process. Alternatively, in step S31, the face image recorded on the driver's license 30 and the terminal device 40 installed as an unattended reception device may capture the face image of the user with the imaging unit 47 and read out the face image recorded on the driver's license 30. Also in this case, similar to the case where the terminal device 40 is installed near the supervisor, the reception processing unit 21c may collate both face images with the face information in the DB of the management server 20 to perform an authentication process.

[0137] When the determination processing unit 21d determines YES in step S32, it acquires second voice information from the voice acquisition unit 48 provided in the terminal device 40 (step S33). Next, the determination processing unit 21d executes a first authentication process using the second voice information, the registered first voice information, and the first gaze information (step S34). In step S33, the determination processing unit 21d may acquire moving image data of the user's face from the imaging unit 47 together with the acquisition of the second voice information and extract second gaze information from the moving image data. In that case, in step S33, the determination processing unit 21d executes a first authentication process using the second voice information and the second gaze information and the registered first voice information and the first gaze information. Also, the terminal device 40 used for the acquisition of the second voice information and the second gaze information may be a device monitored by a supervisor nearby or an unattended reception device.

[0138] If the answer in step S34 is YES, the determination processing unit 21d determines to use the result of the preliminary evaluation registered in step S19 as the result of the formal evaluation (step S36). Hereinafter, the case where there is no problem with the cognitive function in the result of the preliminary evaluation will be described. In this case, the determination processing unit 21d determines to proceed with the elderly training, and returns a guidance to the terminal device 40 regarding the place and time of the elderly training, etc., and conducts the guidance (step S37). The supervisor will print this guidance or convey it orally to the user. After the process of step S37, the process will end. After the process of step S37, the user will actually be informed of the time when the renewal of the driver's license 30 is completed, etc.

[0139] On the other hand, if the answer in step S34 is NO, the determination processing unit 21d determines to proceed to the cognitive function test, and returns a guidance to the terminal device 40 regarding the place and time of the cognitive function test, etc., and conducts the guidance (step S38). Then, the supervisor who has received the test result of whether there is a problem with the cognitive function inputs the test result to the terminal device 40, and the reception processing unit 21c receives the input. The reception processing unit 21c determines whether this input indicates that there is a problem with the cognitive function (step S39), and ends the process if there is a problem. If there is a problem, that is, if the answer in step S39 is YES, the user will actually be informed that the renewal of the driver's license 30 cannot be performed. If the answer in step S39 is NO, the reception processing unit 21c or the determination processing unit 21d ends the process after performing the guidance process of the elderly training in step S37. Due to the input of "none", the supervisor will print this guidance or convey it orally to the user.

[0140] In the above processing example, the case where there is no problem with the cognitive function in the result of the preliminary evaluation has been described. However, if there is a problem, after the process of step S36, it is advisable to proceed to the process of step S38.

[0141] As described above, according to the present embodiment, in addition to the effects of Embodiment 1, by temporarily evaluating and evaluating the cognitive function using the evaluation target information including voice information and gaze information, the evaluation accuracy can be improved. Further, according to the present embodiment, the temporary evaluation and evaluation of this cognitive function can be applied in the procedure for updating a predetermined qualification.

[0142] Further, according to the present embodiment, when renewing a driver's license, by introducing a simple temporary evaluation of the cognitive function that only requires input of voice, video, etc., the number of elderly people subject to the cognitive function test can be significantly reduced. In particular, in the present embodiment, by adopting a configuration in which face information such as a driver's license 30 is used to collate with face information in the DB, forgery countermeasures for the certificate can be taken as one of the impersonation countermeasures. Further, in the present embodiment, by detecting gaze information from the video and performing a temporary evaluation of the cognitive function, not only can the evaluation accuracy be improved with respect to the temporary evaluation of the cognitive function using only voice information, but also impersonation countermeasures can be taken. Further, in the present embodiment, by adopting a configuration in which mouth information is used to collate with the first voice information, it is possible to prevent a temporary evaluation of the cognitive function by lip-syncing and take impersonation countermeasures. Further, in the present embodiment, by adopting a configuration in which the user performs procedures using the terminal device 40 as an unmanned reception device, the number of personnel required for service provision on the management side can be reduced.

[0143] Reducing the number of people subject to the cognitive function test has the following effects. First, for the elderly, there were various burdens such as the need to make a reservation for the cognitive function test, the hassle of reservation adjustment itself, inability to make a reservation on the desired date, the difficulty of going to the site itself, and the burden of the cognitive function test itself. However, according to the present embodiment, such a burden on the elderly can be reduced. Also, for police stations and driving schools, there are various burdens such as a large number of man-hours for handling inspection reservations, a large number of personnel required, and the burden of conducting the cognitive function test. In particular, since the number of elderly people is increasing year by year, such a burden is also increasing. However, according to the present embodiment, such a burden on police stations and driving schools can be reduced.

[0144] <Embodiment 3> Regarding Embodiment 3, the differences from Embodiment 2 will be mainly described. However, in Embodiment 3, the various examples and effects described in Embodiments 1 and 2 can be applied. A configuration example of the determination system 100A will be described with reference to FIG. 10. FIG. 10 is a block diagram showing another configuration example of the determination system according to the present disclosure.

[0145] As shown in FIG. 10, the determination system 100A can include a terminal device 10A and a management server 20A. The terminal device 10A can be connected to the management server 20A via a network N. Further, the determination system 100A may include a management-side terminal device 40A, and the terminal device 40A may be connectable to the management server 20A via the network N. Of course, the network connecting the terminal device 10A and the management server 20A and the network connecting the terminal device 40A and the management server 20A may be different networks.

[0146] In the determination system 100A, in the determination system 100 illustrated in FIGS. 3 and 4, the functions of the authentication processing unit 21a and the preliminary evaluation processing unit 21b of the management server 20 are transferred to the terminal device 10A. Therefore, the control unit 11 of the terminal device 10A includes an authentication processing unit 11a having the function of the authentication processing unit 21a and a preliminary evaluation processing unit 11b having the function of the preliminary evaluation processing unit 21b.

[0147] Details of the authentication processing unit 11a and the preliminary evaluation processing unit 11b will be omitted, but each of the authentication processing unit 21a and the preliminary evaluation processing unit 21b performs processing in which a part of the processing related to the transmission and reception of information during each process is removed. Further, the authentication processing unit 11a performs personal authentication as a second personal authentication process based on the first face information obtained by reading from the driver's license 30 or the like and the second face information obtained from the moving image data acquired by the front camera 17a. Alternatively, the authentication processing unit 11a accesses the third face information stored in advance as a DB in the storage unit 22, and performs personal authentication based on at least one of the first face information and the second face information and the third face information. The preliminary evaluation processing unit 11b may perform preliminary evaluation processing and register it in the storage unit 12, or may transmit the result of the preliminary evaluation to the management server 20A.

[0148] Although the processing of the management server 20A is omitted, it suffices if it can receive information such as the results of the processing performed by the terminal device 10A, as long as it can handle the change from the terminal device 10 to the terminal device 10A. Also, the processing of the terminal device 40 is basically the same as the processing of the terminal device 40 described in FIGS. 3 and 4, as long as it can handle the change from the terminal device 10 to the terminal device 10A.

[0149] According to the third embodiment, compared with the second embodiment, since the preliminary evaluation can be performed on the terminal device 10A side, the load on the management server 20A side and the load on the communication can be reduced, and the time required to obtain the result of the user's preliminary evaluation can also be shortened.

[0150] <Other Embodiments> In each embodiment, the determination system and the determination method have been described. However, the system configuration, processing procedures, etc. are not limited to those exemplified, as long as the functions of the device and the steps of the method are included. Also, although the certificates in each embodiment may have different names and biometric information stored depending on the country, each embodiment can be similarly applied in other countries. Further, each device described in each embodiment may have the following hardware configuration. FIG. 11 is a diagram showing an example of the hardware configuration of the device according to the present disclosure.

[0151] The apparatus 1000 shown in FIG. 11 can include a processor 1001, a memory 1002, and an interface (I / F) 1003. The processor 1001 may be, for example, a microprocessor, an MPU (Micro Processor Unit), or a CPU. The processor 1001 may include a plurality of processors. The memory 1002 is constituted by, for example, a combination of a volatile memory and a non-volatile memory. The functions in each apparatus described in each embodiment are realized by the processor 1001 reading and executing a program stored in the memory 1002. At this time, for example, the transmission and reception of information with other apparatuses can be performed via a communication interface as the I / F 1003. Also, the input / output for the operation of the apparatus 1000 can be performed via an input / output interface as the I / F 1003.

[0152] In the above example, the program can be stored using various types of non-transitory computer readable media and supplied to a computer. Non-transitory computer readable media include various types of tangible storage media. Examples of non-transitory computer readable media include magnetic recording media (such as flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (such as magneto-optical disks). Further, this example includes CD-ROM (Read Only Memory), CD-R, CD-R / W. Further, this example includes semiconductor memories (such as mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM (Random Access Memory)). Also, the program may be supplied to the computer by various types of transitory computer readable media. Examples of transitory computer readable media include electrical signals, optical signals, and electromagnetic waves. Transitory computer readable media can supply the program to the computer via wired communication channels such as electric wires and optical fibers, or wireless communication channels.

[0153] As described above, the present disclosure has been described with reference to the embodiments, but the present disclosure is not limited to the above-described embodiments. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Note that the present disclosure is not limited to the above-described embodiments, and can be appropriately changed without departing from the gist. And each embodiment can be combined with other embodiments as appropriate.

[0154] The figures are merely examples for explaining one or more embodiments. Each figure may be associated with one or more other embodiments, rather than being associated with only one particular embodiment. As can be understood by those skilled in the art, various features or steps described with reference to any one figure can be combined with features or steps shown in one or more other figures to create, for example, embodiments that are not explicitly illustrated or described. Not all of the features or steps shown in any one figure for explaining exemplary embodiments are necessarily essential, and some features or steps may be omitted. The order of the steps described in any figure may be changed as appropriate.

[0155] Some or all of the above embodiments may be described as follows, but are not limited thereto. (Appendix 1) An acquisition process of acquiring first voice information that is the voice information of a person and gaze information obtained by detecting the movement of the person's line of sight; A preliminary evaluation process of preliminarily evaluating the cognitive function of the person based on at least one of the first voice information and the gaze information; A determination process of performing a first authentication process for the person and determining a procedure or approval regarding the provision of services to the person; Execute, The first authentication process includes a process of acquiring second voice information that is the voice information of the person and performing authentication based on the first voice information, the second voice information, and the gaze information; When the authentication is successful in the first authentication process, the determination process uses the result of the preliminary evaluation in the preliminary evaluation process to make a determination on the procedure or approval. Determination system. (Appendix 2) The acquisition process acquires the first voice information and the gaze information during a period including a period in which a second authentication process is performed using a certificate recording the biometric information of the person to whom the identification information is assigned. The determination system according to Appendix 1. (Appendix 3) The second personal authentication process includes a process of performing personal authentication of the person by comparing the biometric information of the person with the biometric information of the person previously stored in a server device managed by the side providing the service. The determination system according to Supplementary Note 2. (Supplementary Note 4) The second personal authentication process includes a process of acquiring mouth information by imaging the mouth of the person with an imaging device and detecting the movement of the mouth of the person, and performing personal authentication of the person based on the mouth information and the first voice information. The determination system according to Supplementary Note 2 or 3. (Supplementary Note 5) The biometric information of the person includes face information of the person. At least one of the first personal authentication process and the second personal authentication process includes a process of imaging the face of the person with an imaging device to acquire the face information, and performing personal authentication of the person based on the acquired face information. The determination system according to any one of Supplementary Notes 2 to 4. (Supplementary Note 6) The first personal authentication process is to acquire the voice related to the second voice information in front of the monitor on the side providing the service. The determination system according to any one of Supplementary Notes 1 to 5. (Supplementary Note 7) The acquisition process is a process of acquiring the first voice information and the line-of-sight information with a terminal device used by the person. The terminal device registers the first voice information in a server device managed by the side providing the service. The first personal authentication process includes a process of performing personal authentication of the person by comparing the first voice information registered in the server device with the second voice information. The determination system according to any one of Supplementary Notes 1 to 6. (Supplementary Note 8) The voice related to the second voice information is acquired with another terminal device different from the terminal device that acquired the voice related to the first voice information. The determination system according to any one of Supplementary Notes 1 to 7. (Supplementary Note 9) The other terminal device includes an output unit that outputs the result of the determination process. The determination system according to appended note 8. (Appended note 10) The first personal authentication process includes a process in which the other terminal device acquires the second voice information and other gaze information obtained by detecting the movement of the gaze of the person, and a process of performing personal authentication based on the first voice information, the second voice information, the gaze information, and the other gaze information. The determination system according to appended note 8 or 9. (Appended note 11) The terminal device that acquires the voice related to the first voice information outputs, by voice, a question sentence for acquiring the voice related to the first voice information from the person from a voice output unit provided in the terminal device. The determination system according to any one of appended notes 1 to 10. (Appended note 12) The second voice information is information for which the time required for voice acquisition is shorter than that of the first voice information. The determination system according to any one of appended notes 1 to 11. (Appended note 13) The task is a task of updating a predetermined qualification. The determination system according to any one of appended notes 1 to 12. (Appended note 14) The predetermined qualification is a qualification certified by a certificate recording the biometric information of the person to whom the identification information is assigned. The determination system according to appended note 13. (Appended note 15) The determination process includes, as procedures for providing the task, a first procedure for having the person receive training and a second procedure for having the person receive training after further evaluating the cognitive function of the person, and includes a process of determining a procedure to be executed among a plurality of procedures. The determination system according to any one of appended notes 1 to 14. (Appended note 16) The availability of providing the task depends on the availability of conducting training for the person or the necessity of further evaluating the cognitive function of the person. The determination system according to any one of Supplementary Notes 1 to 15. (Supplementary Note 17) The preliminary evaluation process uses a learning model that is machine - learned to input at least one of the first voice information and the gaze information and output a preliminary evaluation result of the cognitive function, and obtains the preliminary evaluation result of the cognitive function from at least one of the first voice information and the gaze information. The determination system according to any one of Supplementary Notes 1 to 16. (Supplementary Note 18) Execute a process of deleting the first voice information after the first person authentication process. The determination system according to any one of Supplementary Notes 1 to 17. (Supplementary Note 19) A computer An acquisition process of acquiring first voice information that is voice information of a person and gaze information obtained by detecting the movement of the gaze of the person, A preliminary evaluation process of preliminarily evaluating the cognitive function of the person based on at least one of the first voice information and the gaze information, A determination process of determining a procedure or feasibility regarding the provision of services to the person, accompanied by a first person authentication process for the person, executes The first person authentication process includes a process of acquiring second voice information that is voice information of the person and performing person authentication based on the first voice information, the second voice information, and the gaze information. When the person authentication is successful in the first person authentication process, the determination process uses the result of the preliminary evaluation in the preliminary evaluation process to make a determination on the procedure or feasibility. Determination method. (Supplementary Note 20) A computer A reception process of receiving first voice information that is voice information of a person, gaze information obtained by detecting the movement of the gaze of the person, and a preliminary evaluation result that is a result of executing a preliminary evaluation process of preliminarily evaluating the cognitive function of the person based on at least one of the first voice information and the gaze information, Perform a first person authentication process on the person and a determination process of determining a procedure or feasibility regarding the provision of services to the person. Execute The first personal authentication process includes a process of acquiring second voice information which is the voice information of the person, and performing personal authentication based on the first voice information, the second voice information, and the gaze line information. When the personal authentication is successful in the first personal authentication process, the determination process uses the result of the preliminary evaluation to determine the procedure or approval / disapproval. Determination method. (Appendix 21) A computer An acquisition process of acquiring first voice information which is the voice information of a person and gaze line information obtained by detecting the movement of the gaze line of the person, A preliminary evaluation process of preliminarily evaluating the cognitive function of the person based on at least one of the first voice information and the gaze line information, For a determination process of determining a procedure or approval / disapproval regarding the provision of a service to the person involving a first personal authentication process for the person, a transmission process of transmitting the first voice information, the gaze line information, and the result of the preliminary evaluation in the preliminary evaluation process to another computer that performs the determination process, Execute The first personal authentication process includes a process of acquiring second voice information which is the voice information of the person, and performing personal authentication based on the first voice information, the second voice information, and the gaze line information. When the personal authentication is successful in the first personal authentication process, the determination process uses the result of the preliminary evaluation to determine the procedure or approval / disapproval. Determination method. (Appendix 22) On a computer An acquisition process of acquiring first voice information which is the voice information of a person and gaze line information obtained by detecting the movement of the gaze line of the person, A preliminary evaluation process of preliminarily evaluating the cognitive function of the person based on at least one of the first voice information and the gaze line information, A process including performing a first personal authentication process on the person and a determination process of determining a procedure or approval / disapproval regarding the provision of a service to the person, The first personal authentication process includes a process of acquiring second voice information that is voice information of the person, and performing personal authentication based on the first voice information, the second voice information, and the gaze information. When the personal authentication is successful in the first personal authentication process, the determination process uses the result of the preliminary evaluation in the preliminary evaluation process to determine the procedure or approval regarding the provision of services to the person. A program for executing a process. (Appendix 23) A computer A reception process of receiving the first voice information that is voice information of a person, gaze information detecting the movement of the person's gaze, and a result of a preliminary evaluation that is a result of executing a preliminary evaluation process for preliminarily evaluating the cognitive function of the person based on at least one of the first voice information and the gaze information. A determination process of performing a first personal authentication process on the person and determining a procedure or approval regarding the provision of services to the person. A process including The first personal authentication process includes a process of acquiring second voice information that is voice information of the person, and performing personal authentication based on the first voice information, the second voice information, and the gaze information. When the personal authentication is successful in the first personal authentication process, the determination process uses the result of the preliminary evaluation to determine the procedure or approval. A program for executing a process. (Appendix 24) A computer An acquisition process of acquiring the first voice information that is voice information of a person and gaze information detecting the movement of the person's gaze. A preliminary evaluation process of preliminarily evaluating the cognitive function of the person based on at least one of the first voice information and the gaze information. A transmission process of transmitting the first voice information, the gaze information, and the result of the preliminary evaluation in the preliminary evaluation process to another computer that performs the determination process for determining a procedure or approval regarding the provision of services to the person, along with the first personal authentication process on the person. A process including The first personal authentication process includes a process of obtaining second voice information which is the voice information of the person, and performing personal authentication based on the first voice information, the second voice information, and the gaze information. When the personal authentication is successful in the first personal authentication process, the determination process uses the result of the preliminary evaluation to determine the procedure or approval / disapproval. A program for executing a process. (Appendix 25) An acquisition process of obtaining first voice information which is the voice information of a person and gaze information detecting the movement of the person's gaze, A preliminary evaluation process of preliminarily evaluating the cognitive function of the person based on at least one of the first voice information and the gaze information, A determination process of performing a first personal authentication process on the person and determining a procedure or approval / disapproval regarding the provision of services to the person, is executed, The first personal authentication process includes a process of obtaining second voice information which is the voice information of the person, and performing personal authentication based on the first voice information, the second voice information, and the gaze information. When the personal authentication is successful in the first personal authentication process, the determination process uses the result of the preliminary evaluation in the preliminary evaluation process to determine the procedure or approval / disapproval. A server device. (Appendix 26) A reception process of receiving first voice information which is the voice information of a person, gaze information detecting the movement of the person's gaze, and a result of preliminary evaluation which is a result of executing a preliminary evaluation process of preliminarily evaluating the cognitive function of the person based on at least one of the first voice information and the gaze information, A determination process of performing a first personal authentication process on the person and determining a procedure or approval / disapproval regarding the provision of services to the person, is executed, The first personal authentication process includes a process of obtaining second voice information which is the voice information of the person, and performing personal authentication based on the first voice information, the second voice information, and the gaze information. When the personal authentication is successful in the first personal authentication process, the determination process uses the result of the preliminary evaluation to determine the procedure or approval / disapproval. Server device. (Appendix 27) An acquisition process for acquiring first voice information that is voice information of a person and gaze information obtained by detecting the movement of the person's line of sight, A preliminary evaluation process for preliminarily evaluating the cognitive function of the person based on at least one of the first voice information and the gaze information, For a determination process for determining a procedure or availability regarding the provision of services to the person, which involves first authentication processing for the person, the first voice information, the gaze information, and the result of the preliminary evaluation in the preliminary evaluation process are transmitted to another computer that performs the determination process. Execute, The first authentication process includes a process of acquiring second voice information that is voice information of the person and performing authentication based on the first voice information, the second voice information, and the gaze information. When the authentication is successful in the first authentication process, the determination process uses the result of the preliminary evaluation to determine the procedure or availability. Terminal device. (Appendix 28) An acquisition process for acquiring first voice information that is voice information of a person and gaze information obtained by detecting the movement of the person's line of sight, a reception process for receiving the result of the preliminary evaluation, which is the result of executing a preliminary evaluation process for preliminarily evaluating the cognitive function of the person based on at least one of the first voice information and the gaze information, a determination process for performing first authentication processing for the person and using the result of the preliminary evaluation to determine a procedure or availability regarding the provision of services to the person when the authentication is successful in the first authentication process, and a communication unit that communicates with a server device that executes these processes. A voice acquisition unit for acquiring second voice information that is voice information of the person, A transmission processing unit for transmitting the second voice information to the server device via the communication unit, A reception processing unit for receiving the result of the determination process from the server device via the communication unit, An output unit for outputting the result of the determination process, Comprising, The first personal authentication process includes a process of receiving the second voice information transmitted by the transmission processing unit and performing personal authentication based on the first voice information, the second voice information, and the line-of-sight information. Terminal device.

[0156] Some or all of the elements (e.g., configurations and functions) described in Appendices 2 to 18 that are subordinate to the determination system of Appendix 1 may be subordinate to the determination methods according to Appendices 19 to 21, the programs according to Appendices 22 to 24, the server devices according to Appendices 25 to 26, the terminal devices according to Appendix 27, and the terminal devices according to Appendix 28 in the same subordinate relationship as in Appendices 2 to 18. Some or all of the elements described in any appendix may be applied to various hardware, software, recording means for recording software, systems, and methods.

Explanation of reference numerals

[0157] 1, 100, 100A Determination system 1a Acquisition processing unit 1b, 11b, 21b Preliminary evaluation processing unit 1c, 21d Determination processing unit 10, 10A Terminal device 11, 21, 41 Control unit 11a, 21a Authentication processing unit 12, 22, 42 Storage unit 13, 23, 43 Communication unit 14, 44 Operation unit 15, 45 Display unit 16, 46 Card reader 17, 47 Imaging unit 17a Front camera 18, 48 Voice acquisition unit 20, 20A Management server 21c Reception processing unit 30 Driving license 31 IC chip 31a Memory 40 Management-side terminal device 1000 Device 1001 Processor 1002 Memory 1003 Interface N Network

Claims

1. An acquisition process for acquiring first voice information that is voice information of a person and gaze information obtained by detecting the movement of the person's line of sight, A preliminary evaluation process for preliminarily evaluating the cognitive function of the person based on at least one of the first voice information and the gaze information, A determination process for performing a first authentication process for the person and determining a procedure or availability regarding the provision of services to the person, is executed, The first authentication process includes a process of acquiring second voice information that is voice information of the person and performing person authentication based on the first voice information, the second voice information, and the gaze information, When the person authentication is successful in the first authentication process, the determination process uses the result of the preliminary evaluation in the preliminary evaluation process to perform the determination of the procedure or availability. Determination system.

2. The acquisition process acquires the first voice information and the gaze information during a period including a period in which a second authentication process is performed using a certificate recording the biometric information of the person to whom the identification information is assigned. The determination system according to Claim 1.

3. The second authentication process includes a process of performing person authentication for the person by comparing the biometric information of the person with the biometric information of the person pre-stored in a server device managed by the service-providing side. The determination system according to Claim 2.

4. The second authentication process includes a process of imaging the person's mouth with an imaging device to obtain mouth information detecting the movement of the person's mouth and performing person authentication for the person based on the mouth information and the first voice information. The determination system according to Claim 2 or 3.

5. The biometric information of the person includes the face information of the person, At least one of the first authentication process and the second authentication process includes a process of imaging the person's face with an imaging device to obtain the face information and performing person authentication for the person based on the obtained face information. The determination system according to Claim 2 or 3.

6. The first authentication process acquires the voice related to the second voice information in front of a monitor on the service-providing side. The determination system according to Claim 1 or 2.

7. The acquisition process is a process of acquiring the first voice information and the gaze information with a terminal device used by the person, The terminal device registers the first voice information in a server device managed by the service-providing side. The first personal authentication process includes a process of performing personal authentication of the person by collating the first voice information registered in the server device with the second voice information. The determination system according to claim 1 or 2.

8. The voice related to the second voice information is acquired by another terminal device different from the terminal device that acquired the voice related to the first voice information. The determination system according to claim 1 or 2.

9. A computer performs an acquisition process of acquiring first voice information that is voice information of a person and gaze information obtained by detecting the movement of the person's line of sight, a preliminary evaluation process of preliminarily evaluating the cognitive function of the person based on at least one of the first voice information and the gaze information, performs a first personal authentication process on the person, and a determination process of determining a procedure or feasibility regarding the provision of services to the person, and executes the first personal authentication process includes a process of acquiring second voice information that is the voice information of the person, and performing personal authentication based on the first voice information, the second voice information, and the gaze information, the determination process uses the result of the preliminary evaluation in the preliminary evaluation process to perform the determination of the procedure or feasibility when the personal authentication is successful in the first personal authentication process. Determination method.

10. On a computer an acquisition process of acquiring first voice information that is voice information of a person and gaze information obtained by detecting the movement of the person's line of sight, a preliminary evaluation process of preliminarily evaluating the cognitive function of the person based on at least one of the first voice information and the gaze information, performing a first personal authentication process on the person, and a determination process of determining a procedure or feasibility regarding the provision of services to the person, is a process including the first personal authentication process includes a process of acquiring second voice information that is the voice information of the person, and performing personal authentication based on the first voice information, the second voice information, and the gaze information, the determination process uses the result of the preliminary evaluation in the preliminary evaluation process to perform the determination of the procedure or feasibility when the personal authentication is successful in the first personal authentication process. A program for executing the process.

Images