Cognitive function determination system, cognitive function determination method, and program
The cognitive function determination system addresses the issue of impersonation by using biometric authentication and voice data acquisition during the authentication period, ensuring that the cognitive function assessment is based on the actual person's voice, thus preventing impersonation and enhancing reliability.
Patent Information
- Application Number
- JP2023189458
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-11-06
- Publication Date
- 2025-05-19
AI Technical Summary
Existing cognitive function determination methods are insufficient in preventing impersonation, as identity verification does not guarantee that the voice data used to estimate cognitive function belongs to the actual person.
A cognitive function determination system that utilizes a certificate recording biometric information to authenticate the person during a specific period, acquires voice information during this authentication, and evaluates the cognitive function based on the voice information to ensure that the voice data belongs to the authenticated person.
The system effectively prevents impersonation by ensuring that the cognitive function determination is based on the voice of the authenticated person, thereby enhancing the reliability of the cognitive function assessment.
Smart Images

Figure 2025077344000001_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to a cognitive function determination system, a cognitive function determination method, and a program.
Background Art
[0002] Patent Document 1 describes a method for determining a cognitive function used in providing services to a target person at a driver's license center that performs at least one of the services of issuing and renewing a driver's license. The determination method described in Patent Document 1 includes an identity verification process, a voice acquisition process, an estimation process, and a determination process. The identity verification process is a process for verifying that the target person is the actual person. The voice acquisition process is a process executed after the identity verification process, and causes the target person to read aloud a fixed sentence and acquires voice data related to the reading aloud. The estimation process estimates the cognitive function of the target person based on the voice data acquired in the voice acquisition process. The reflection process reflects the result of the estimation process in the procedure for providing services to the target person at the driver's license center or the determination of whether the service can be provided.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] However, in the determination method described in Patent Document 1, although the identity verification process is performed before the voice acquisition process, it is difficult to say that it is sufficient as a countermeasure against impersonation. That is, in the determination method described in Patent Document 1, once the identity verification process for the target person is completed, another person can impersonate the target person and perform the voice acquisition process. Therefore, based on the result of the estimation process of the cognitive function of another person, the procedure for providing services to the target person or the determination of whether the service can be provided is performed.
[0005] An object of the present disclosure is to provide a cognitive function determination system, a cognitive function determination method, and a program capable of preventing impersonation when executing a process of determining a cognitive function of a person using the voice of the person.
Means for Solving the Problems
[0006] The cognitive function determination system according to the present disclosure uses a certificate recording biometric information of a person to whom identification information is assigned, and in a period including a period in which an authentication process for the person is being performed, an acquisition process for acquiring voice information of the person, and an evaluation process for evaluating the cognitive function of the person based on the voice information.
[0007] The cognitive function determination method according to the present disclosure is a method in which a computer acquires voice information of a person using a certificate recording biometric information of a person to whom identification information is assigned, and in a period including a period in which an authentication process for the person is being performed, and evaluates the cognitive function of the person based on the voice information.
[0008] The program according to the present disclosure is a program for causing a computer to execute an acquisition process for acquiring voice information of a person using a certificate recording biometric information of a person to whom identification information is assigned, and in a period including a period in which an authentication process for the person is being performed, and an evaluation process for evaluating the cognitive function of the person based on the voice information.
Effects of the Invention
[0009] According to the present disclosure, it is possible to provide a cognitive function determination system, a cognitive function determination method, and a program capable of preventing impersonation when executing a process of determining a cognitive function of a person using the voice of the person.
Brief Description of the Drawings
[0010]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Mode for Carrying Out the Invention
[0011] Hereinafter, embodiments will be described with reference to the drawings. In the embodiments, the same or equivalent elements may be denoted by the same reference numerals, and redundant descriptions will be omitted as appropriate.
[0012] <Embodiment 1> Using FIG. 1, a configuration example of the cognitive function determination system 1 will be described. FIG. 1 is a block diagram showing a configuration example of a cognitive function determination system according to the present disclosure.
[0013] As shown in FIG. 1, the cognitive function determination system 1 can include an acquisition processing unit 1a and an evaluation processing unit 1b.
[0014] The acquisition processing unit 1a performs an acquisition process of acquiring voice information of a person during a period including a period in which an authentication process for the person is being performed, using a certificate in which biometric information of the person to whom the identification information is assigned is recorded. This certificate is, for example, a driver's license, a my number card under the my number system, an insurance certificate, or the like.
[0015] This certificate can be equipped with a memory for recording biometric information. The memory can refer to the memory within an IC (Integrated Circuit) chip. Also, the biometric information can refer to various personal characteristics such as the face information, iris information, auricle information, and behavior information of the owner of the certificate, or any combination thereof. Thus, multiple types of biometric information may be stored in the memory. Note that among the currently circulating certificates, there are also certificates in which biometric information is not stored in the memory. However, even for such certificates, if biometric information is stored in the memory in the future, it can be applied as a certificate with a memory in the following description. Also, the certificate may be a certificate stored in the user's mobile terminal. Taking the driver's license as an example, the driver's license may be a mobile driver's license (mDL) stored in the user's mobile terminal.
[0016] Also, the certificate may be one in which biometric information is recorded, such as being printed on its surface. For example, when the biometric information is face information, a face image, that is, a face photo, can be printed on the surface of the certificate. Also, in this case, identification information can also be printed on the surface of the certificate. As can be seen from this example, the certificate may be a certificate that does not have a memory for recording biometric information.
[0017] Also, the identification information can refer to, for example, the driver's license number in the case of a driver's license. The identification number can refer to the my number in the case of a my number card. Thus, the identification information can be an identification number or the like. The identification number can be a number unique to that person.
[0018] The evaluation processing unit 1b performs evaluation processing for evaluating the cognitive function of the person based on the voice information. Since the voice information is information to be evaluated, it can be referred to as evaluation target information. The evaluation target information only needs to include at least the voice information, but can also include other information. For example, the evaluation target information can include, in addition to the voice information, information related to the current or past illness of the person. Information related to illness can be obtained, for example, from a hospital or the like. Information related to illness can also be information input by the person. Information related to illness can also include the presence or absence of a disability of the person. Also, the evaluation method itself is not limited. Further, the evaluation processing unit 1b can be configured to obtain an evaluation result from the evaluation target information by using a learning model that is machine-learned to input the evaluation target information and output an evaluation result.
[0019] Also, the acquisition processing unit 1a only needs to acquire at least a part of the voice information used for the evaluation processing during the period when the identity authentication is being performed using the certificate. For example, if that period is period A, voice information of the person can also be acquired in the periods before and after period A, and these voice information can be used for the evaluation processing. In that case, the evaluation processing unit 1b can determine the identity of the two persons by comparing the voice information of period A with the voice information of the periods before and after it through voiceprint determination processing, and perform the evaluation processing excluding the voice information of a person different from the voice information of period A.
[0020] The cognitive function determination system 1 can be configured, for example, as a single server device (cognitive function determination device). In this case, the voice information may be acquired from a terminal device, which is an information processing device such as a smartphone, a mobile PC (Personal Computar), or an installed PC that the person uses as a user. Then, a control unit (not shown) of the server device may evaluate the cognitive function of the person based on the evaluation target information including at least the acquired voice information. Further, this server device can also be configured to transmit the evaluation result, which is the result of the evaluation process performed by the evaluation processing unit 1b, to the terminal device. This control unit can be realized, for example, by a processor such as a CPU (Central Processing Unit), a working memory, and a non-volatile storage device storing a control program. This program can be a program for causing the processor to function as the acquisition processing unit 1a and the evaluation processing unit 1b. Further, this control unit can be configured to include an IC.
[0021] Further, the cognitive function determination system 1 can also be constructed as a distributed system in which the functions of the above-described server device are distributed among a plurality of server devices. Each server device can be provided with a control unit (not shown) that controls the whole. Each control unit can have some of the functions of the acquisition processing unit 1a and the evaluation processing unit 1b. For example, each server device can be configured to execute some of the processes of the acquisition processing unit 1a and the evaluation processing unit 1b in cooperation with a communication unit such as a communication interface provided separately by its control unit. This control unit can be realized, for example, by a processor, a working memory, and a non-volatile storage device storing a control program. This program can be a program for causing the CPU to function as a part of the acquisition processing unit 1a and the evaluation processing unit 1b. Further, this control unit can be configured to include an IC.
[0022] Further, the cognitive function determination system 1 can also be configured by a user's terminal device alone. Then, a control unit (not shown) of the terminal device may acquire evaluation target information including at least voice information, and evaluate the cognitive function of the person based on the evaluation target information. This control unit can be realized by, for example, a processor, a working memory, and a non-volatile storage device storing a control program. This program can be a program for causing the processor to function as the acquisition processing unit 1a and the evaluation processing unit 1b. Further, this control unit can be configured to include an IC.
[0023] Further, the cognitive function determination system 1 can also be constructed as a distributed system in which functions are distributed between a terminal device and a server device. For example, the cognitive function determination system 1 can be configured by a terminal device and one or more server devices. The terminal device and each server device can include a control unit (not shown) for controlling the whole. Each control unit can have some functions of the acquisition processing unit 1a and the evaluation processing unit 1b. For example, each device can be configured to execute some processes of the acquisition processing unit 1a and the evaluation processing unit 1b in cooperation with a communication unit such as a communication interface provided separately by its control unit. Further, the server device that performs the final evaluation can also be configured to transmit the evaluation result to the terminal device. This control unit can be realized by, for example, a processor, a working memory, and a non-volatile storage device storing a control program. This program can be a program for causing the CPU to function as a part of the acquisition processing unit 1a and the evaluation processing unit 1b. Further, this control unit can be configured to include an IC.
[0024] Next, a processing example of the cognitive function determination system 1 will be described with reference to FIG. 2. FIG. 2 is a flowchart for explaining an example of the cognitive function determination method according to the present disclosure.
[0025] First, while the computer is performing the authentication process using a certificate that records the biometric information of a person to whom identification information has been assigned, the computer acquires the voice information of the person during a period including the period of performing the authentication process (step S1). This computer is the terminal device or the server device described above, and the device that directly acquires the voice spoken by the person is the terminal device. Next, the computer evaluates the cognitive function of the person based on the evaluation target information including at least the voice information (step S2), and ends the process.
[0026] According to the present embodiment, when executing the process of determining the cognitive function of a person using the voice of the person, it is possible to prevent impersonation. That is, according to the present embodiment, it is possible to determine the cognitive function of the person after ensuring that it is the voice of the person himself / herself.
[0027] <Embodiment 2> Regarding Embodiment 2, the differences from Embodiment 1 will be mainly described. However, in Embodiment 2, the various examples and effects described in Embodiment 1 can be applied. Using FIG. 3, a configuration example of the cognitive function determination system 100 will be described. FIG. 3 is a block diagram showing another configuration example of the cognitive function determination system according to the present disclosure.
[0028] As shown in FIG. 3, the cognitive function determination system 100 can include a terminal device 10 and a management server device (hereinafter, management server) 20. The terminal device 10 can be connected to the management server 20 via a network N.
[0029] The terminal device 10 is an information processing device such as a smartphone, a mobile PC (Personal Computar), or an installed PC used by a person as a user.
[0030] The management server 20 is a server computer for managing a predetermined procedure. Here, the predetermined procedure refers to a procedure for updating a predetermined qualification. Hereinafter, an example where the predetermined qualification is a driver's license will be given. That is, in the following example, the certificate is the driver's license 30.
[0031] The driver's license 30 is provided with an IC chip 31. The IC chip 31 is provided with a memory 31a. In the memory 31a, a face image of the owner of the driver's license 30, or feature information indicating features of the face image, etc. are stored. Hereinafter, the face image and its feature information are referred to as face information. The face information is an example of biometric information of a person. Also, as described above, the driver's license 30 may be a mobile driver's license.
[0032] First, the terminal device 10 will be described. The terminal device 10 can include a control unit 11, a storage unit 12, a communication unit 13, an operation unit 14, a display unit 15, a card reader 16, an imaging unit 17, and an audio acquisition unit 18.
[0033] The control unit 11 is the part described as the control unit of the terminal device in Embodiment 1. That is, the control unit 11 can be realized by a processor, a working memory, and a non-volatile storage device storing a control program, etc.
[0034] The storage unit 12 is, for example, a storage device using a hard disk drive, a solid state drive, or other memories. The storage unit 12 is a part that stores setting information and the like used in the terminal device 10. The storage unit 12 can also be used as a storage area for the user to store various files. The storage unit 12 can also be the storage device of the above control unit 11. When the driver's license 30 is a mobile driver's license, the storage unit 12 can store the information of the mobile driver's license.
[0035] The communication unit 13 is a part that communicates with an external device such as the management server 20 via the network N. The communication unit 13 can be configured by a wireless or wired communication interface capable of such communication.
[0036] The operation unit 14 is a part that receives operations by the user of the terminal device 10. The operation unit 14 can also be referred to as an operation reception unit. The operation unit 14 can be realized by, for example, any one or a plurality of physical buttons, a touch panel mounted on the display unit 15, a pointing device, and a keyboard.
[0037] The display unit 15 is a part for displaying a user interface image for operating the terminal device 10, and is constituted by, for example, a display device such as a liquid crystal display or an organic electroluminescence display. Note that the display unit 15 can also have a configuration including a display and a drive circuit for driving the display.
[0038] The card reading unit 16 is a part for reading the information in the memory 31a of the driver's license 30. The communication method used for such reading is not limited. The card reading unit 16 may be an IC card reader. The card reading unit 16 can read face information, and can also read identification information together. When the driver's license 30 is a mobile driver's license, the face information can be read using a terminal device with an imaging unit installed in a driver's license center or the like without providing or using the card reading unit 16.
[0039] The imaging unit 17 is an imaging device for imaging still images and moving images. The imaging unit 17 can also be referred to as a camera. As described above, the face information as an example of biometric information may be a face image recorded by printing on the surface of the driver's license 30. In that case, the face image as an example of biometric information can be acquired by imaging with the imaging unit 17 instead of the card reading unit 16.
[0040] Then, the control unit 11 can compare the face information read from the memory 31a by the card reader 16 with the face information obtained by imaging with the imaging unit 17 and execute an authentication process. The face information obtained by imaging with the imaging unit 17 may be the face image data itself captured by the imaging unit 17, or may be feature information obtained by extracting features from the face image data. This authentication process determines whether the person whose face image is captured by the imaging unit 17 is the same person as the owner of the driver's license 30 by determining the identity between the person as the owner of the driver's license 30 and the person whose face image is captured by the imaging unit 17.
[0041] Alternatively, the control unit 11 may transmit the face information read from the memory 31a by the card reader 16 and the face information obtained by imaging with the imaging unit 17 to the management server 20 via the communication unit 13. In this case, the authentication process will be executed on the management server 20 side. Hereinafter, an example in which the authentication process is executed on the management server 20 side will be given for explanation.
[0042] The voice acquisition unit 18 is a part that acquires voice information indicating the voice around the terminal device 10. The voice acquisition unit 18 can include a microphone. The voice acquisition unit 18 acquires voice information uttered by a person during a period including at least the authentication period, which is the period during which the above-described authentication process is being executed. Hereinafter, the period including at least the authentication period is referred to as the acquisition period.
[0043] The authentication period can be the period during which face information obtained by imaging with the imaging unit 17 is compared with the face information read from the memory 31a by the card reader unit 16, that is, the imaging period. Therefore, even when the imaging unit 17 captures a still image for comparison with the face information in the memory 31a, the imaging unit 17 may temporarily capture a moving image. Alternatively, the imaging unit 17 may capture a moving image for comparison with the face information in the memory 31a. In this case, the control unit 11 may extract feature information, which is a feature of the face of the person, from the captured moving image and transmit it to the management server 20 via the communication unit 13. Of course, the control unit 11 may directly transmit the data of the moving image captured by the imaging unit 17 to the management server 20 via the communication unit 13. Also, the acquisition period can be a period including such an authentication period and at least one of the period before and the period after it.
[0044] Then, the control unit 11 transmits the voice information acquired during the acquisition period to the management server 20 via the communication unit 13. The transmitted voice information may be the voice data itself acquired by the voice acquisition unit 18, or may be feature information obtained by extracting the features of the voice data. Hereinafter, an example will be given in which the voice data itself acquired by the voice acquisition unit 18 is transmitted to the management server 20 as the voice information for explanation.
[0045] Also, an example is given in which the control unit 11 transmits the moving image acquired during the acquisition period via the communication unit 13. The moving image acquired during the acquisition period has been described on the premise that it is used in the personal authentication process. However, this moving image can also be used for the evaluation process of the cognitive function. This point is the processing of the management server 20 and will be described later.
[0046] In addition, the control unit 11 of the terminal device 10 may display a user interface image for inputting an answer to a question on the display unit 15 and receive the answer by a user operation using the operation unit 14. Then, the control unit 11 may transmit the answer data input from the operation unit 14 to the management server 20 via the communication unit 13. Such a test may be configured to be performed on a browser or may be configured to be performed with application software.
[0047] Next, the management server 20 will be described. The management server 20 can include a control unit 21, a storage unit 22, and a communication unit 23.
[0048] The control unit 21 is the part described as the control unit of the server device in Embodiment 1. That is, the control unit 11 can be realized by a processor, a working memory, and a non-volatile storage device storing a control program, etc.
[0049] The storage unit 22 is, for example, a storage device using a hard disk drive, a solid state drive, or other memory. The storage unit 22 is a part that stores various information necessary for the above-described predetermined procedure, for example, in a database format or the like. The storage unit 22 can also be the storage device of the above-described control unit 21.
[0050] The communication unit 23 is a part that communicates with external devices including the terminal device 10 via the network N. The communication unit 23 can be configured by a wireless or wired communication interface capable of such communication.
[0051] The communication unit 23 receives the face information read from the memory 31a by the card reader unit 16 and the face information obtained by imaging with the imaging unit 17, and passes them to the control unit 21. Also, the communication unit 23 receives the voice information acquired during the above-described period and passes it to the control unit 21. Further, the communication unit 23 may also receive evaluation target information other than the voice information from the terminal device 10 or other external devices. For example, the communication unit 23 receives the result of the above-described test as part of the evaluation target information and passes it to the control unit 21. Also, the communication unit 23 may receive information regarding a disease from the terminal device 10 as information input by the person, or may receive it from a hospital server.
[0052] And the control unit 21 can include an authentication processing unit 21a, an evaluation processing unit 21b, and a reception processing unit 21c.
[0053] The authentication processing unit 21a executes an identity authentication process by comparing the face information read from the memory 31a by the card reader unit 16 and the face information obtained by imaging with the imaging unit 17, which are received via the communication unit 23. When it can be confirmed that the person is the same person in this identity authentication process, that is, when it is determined that both pieces of face information are information of the same person, the control unit 21 notifies the evaluation processing unit 21b to that effect, and the evaluation processing unit 21b executes an evaluation process. On the other hand, when it cannot be confirmed that the person is the same person in the above identity authentication process, the control unit 21 may notify, via the communication unit 23, that the identity authentication process has failed.
[0054] The evaluation processing unit 21b is a part corresponding to the evaluation processing unit 1b in FIG. 1. The evaluation processing unit 21b receives voice information from the communication unit 23. The evaluation processing unit 21b can also receive evaluation target information other than the voice information via the communication unit 23. Then, the evaluation processing unit 21b performs an evaluation process for evaluating the cognitive function of the person based on the evaluation target information including at least the voice information.
[0055] Also, the evaluation processing unit 21b may perform a process of deleting the voice information acquired in the acquisition process after the evaluation process. This makes it easier for the user of the terminal device 10 to use the cognitive function determination system 100.
[0056] In addition, the evaluation processing unit 21b may receive, from the communication unit 23, the data of the moving image as the face information acquired during the acquisition period. This is because the data of the moving image acquired during the acquisition period can be used not only for the personal authentication process but also for the evaluation process of the cognitive function.
[0057] Then, the evaluation processing unit 21b receives, as part of the evaluation target information, the data of the moving image, and performs a process of extracting the gaze information, which is the information detecting the movement of the person's gaze from the data. Further, the evaluation processing unit 21b evaluates the cognitive function of the person who is the imaging target of the moving image from the extracted gaze information. Here, as the movement of the person's gaze, for example, it can be detected as the change of the person's line of sight or the responsiveness to the change of the user interface image at the time of imaging. Therefore, the evaluation processing unit 21b can evaluate that there is a problem with the cognitive function, for example, when the eyes are blurry or the gaze does not catch up with the change of the user interface image. In this case, the evaluation processing unit 21b can lower the evaluation result based on the voice information by the evaluation based on the gaze information.
[0058] In addition, the evaluation processing unit 21b receives, as part of the evaluation target information, the data of the moving image, and performs a process of extracting the expression information, which is the information detecting the expression of the person from the data. Further, the evaluation processing unit 21b evaluates the cognitive function of the person who is the imaging target of the moving image from the extracted expression information. Here, as the expression of the person, for example, it can be detected as the movement of the facial muscles including spasms or the responsiveness to the change of the user interface image at the time of imaging. Therefore, the evaluation processing unit 21b can evaluate that there is a problem with the cognitive function, for example, when the expression is strained or the change of the expression does not catch up with the change of the user interface image. In this case, the evaluation processing unit 21b can lower the evaluation result based on the voice information by the evaluation based on the expression information.
[0059] In this way, the evaluation processing unit 21b may perform the evaluation of the recognition function for each type of evaluation target information, and perform a comprehensive evaluation based on those evaluations. Note that the process of extracting the eye line information from the moving image data can also be executed by the control unit 11 on the terminal device 10 side. In that case, the control unit 11 may transmit the extracted eye line information to the management server 20 as part of the evaluation target information via the communication unit 13.
[0060] Also, as described for the evaluation processing unit 1b, the evaluation processing unit 21b can be configured to obtain an evaluation result from the evaluation target information using a learning model that has been machine-learned to input the evaluation target information and output an evaluation result of the recognition function. The learning model may be a model that combines learning models for each type of evaluation target information, such as a learning model for voice information, a learning model for eye line information, and a learning model for test results. Also, the algorithm of the learning model or the like is not limited. Here, an example using a learning model is given, but other AI (Artificial Intelligence) technologies may be used for the evaluation of the recognition function.
[0061] As a learning model that inputs voice information and outputs an evaluation result of the recognition function, for example, among the models that analyze potential brain-related diseases and emotions from the words spoken, the rhythm of the voice, the spectrum, etc., a model specialized for diseases related to the recognition function can be used. Here, the voice information input to this learning model may be the acquired voice data itself, or information indicating the words spoken, the rhythm of the voice, the spectrum, etc. as a result of analyzing the voice data.
[0062] Also, as described above, the evaluation target information input to the learning model can include the eye line information extracted from the moving image data, but instead, the moving image data itself may be used. In this case, the learning model is also responsible for the process of extracting the eye line information from the moving image data.
[0063] The reception processing unit 21c executes guidance processing for guiding a procedure to update a predetermined qualification based on the evaluation result in the evaluation processing. Here, as described above, when the predetermined qualification is the driver's license 30 exemplified in the certificate, it can be exemplified by the automobile driving license which is the qualification certified by the driver's license 30.
[0064] As this guidance processing, the reception processing unit 21c transmits, via the communication unit 23, a user interface image for guidance or information necessary for displaying the image to the terminal device 10. As a result, in the terminal device 10, the control unit 11 can receive the user interface image or the necessary information via the communication unit 13 and display the user interface image on the display unit 15.
[0065] In this way, the reception processing unit 21c guides the procedure necessary for performing a predetermined update based on the evaluation result of the person recognition function.
[0066] Further, when the evaluation result in the evaluation processing indicates that there is a problem with the recognition function, the above guidance processing may guide a first procedure necessary for updating a predetermined qualification. The case where it is indicated that there is a problem with the recognition function is merely an evaluation by the evaluation processing unit 21b, and refers to a case where there may be a problem with the recognition function. When the predetermined qualification is an automobile driving license, the first procedure refers to a cognitive function test and an elderly person training session. This cognitive function test is performed by the examinee filling out an examination paper or inputting with a touch pen on a tablet equipped with software necessary for the examination. If it is determined as "there may be a risk of dementia" as a result of this cognitive function test, a diagnosis by a doctor will be added.
[0067] On the other hand, when the evaluation result in the evaluation processing indicates that there is no problem with the recognition function, the above guidance processing guides a second procedure with fewer steps than the first procedure necessary for updating a predetermined qualification. When the predetermined qualification is an automobile driving license, the second procedure refers to an elderly person training session.
[0068] Next, a processing example of the cognitive function determination system 100 will be described with reference to FIGS. 4 to 7. FIG. 4 is a flowchart for explaining another example of the cognitive function determination method according to the present disclosure. FIG. 5 is a diagram showing an example of a renewal notice leaflet for a driver's license according to the present disclosure. FIG. 6 is a diagram showing an example of a user interface image according to the present disclosure. FIG. 7 is a diagram showing another example of the user interface image according to the present disclosure.
[0069] Prior to the processing in the terminal device 10, a renewal notice leaflet 50 of the driver's license 30 exemplified in FIG. 5 is sent to the user of the terminal device 10. Here, the explanation will be made on the premise that the user is an elderly person 75 years old or older without a certain violation history, or a person with a certain violation history who has passed the driving skills test before the expiration of the renewal period.
[0070] The renewal notice leaflet 50 prints a notice sentence 51 regarding the reservation of the cognitive function test for driver's license renewal. Further, the renewal notice leaflet 50 also prints an introduction sentence 52 of the application software for accepting the reservation and its QR (Quick Response) code (registered trademark. The same applies hereinafter) 53. Hereinafter, the application software is simply referred to as an application. The renewal notice leaflet 50 may print the procedure for using this application and the terms necessary for the reservation using this application.
[0071] The user who has received the renewal notice leaflet 50 reads the QR code 53 with the imaging unit 17 of the terminal device 10, accesses the download source of the application, and performs a download operation. By receiving this operation, the terminal device 10 downloads the application (step S11) and installs the application in the control unit 11. Next, the user performs a start operation to start this application from the operation unit 14. The control unit 11 receives this start operation and starts the application (step S12).
[0072] The application communicates with the management server 20 when it is launched. Thereby, the renewal procedure for the driver's license is started. In this way, the information processing system 100 may receive a request to start or resume the above-described predetermined procedure by accepting the input of predetermined information such as a QR code attached to a guidance document for performing a predetermined procedure such as the renewal procedure for the driver's license.
[0073] The application requests the user to input the PIN code registered at the time of registration of the driver's license 30 or at the time of the previous renewal, and accepts the input at the operation unit 14 (step S13). The application determines whether the input PIN code is correct by comparing it with the PIN code stored in the memory 31a of the card reader 16. If the PIN code is correct, the application reads the face information recorded in the memory 31a of the driver's license 30 by the card reader 16 and transmits it to the management server 20 (step S14). In step S14, the application also reads the identification information recorded in the memory 31a together with the face image and transmits it to the management server 20.
[0074] In the case where the driver's license 30 is a mobile driver's license, in step S14, the application may read the face information and the identification information using a terminal device with an imaging unit installed at the driver's license center or the like and transmit it to the management server 20. Also, in the case of using the face image printed on the surface of the driver's license 30, the application may prompt the user to photograph the face image printed on the driver's license 30, and transmit the face image captured by the imaging unit 17 to the management server 20. In this case, the application also prompts the user to photograph the identification information printed on the driver's license 30 together with the face image, captures the image, and transmits it to the management server 20.
[0075] In addition, the application prompts the user to take a picture of their face with the imaging unit 17 or the front camera 17a, which is a part of it, by displaying a shooting frame 61 as in the user interface image 60 illustrated in FIG. 6. Then, the application starts acquiring a moving image with the front camera 17a and sequentially transmits the moving image data to the management server 20 (step S15).
[0076] In addition, along with the start of the acquisition of the moving image, the application presents a speech request sentence 62 to the user as in the user interface image 60 to make a speech request, acquires the spoken voice, and transmits it to the management server 20 as voice information (step S16). Here, the application may make a speech request after detecting that the personal authentication has been performed. Also, during the speech request or the video shooting period, the result of the personal authentication may be continuously displayed on the user interface image 60.
[0077] Here, an example of making the user speak a set phrase 63 as a speech request is given. However, the speech request may be freely made, for example, by setting a certain topic such as "Please talk about the content and feelings of yesterday's lunch", and making the user speak. By setting such a topic that asks about the user's memory, the accuracy of the evaluation of the cognitive function in the later stage can also be improved. Also, the user interface image 60 may include, together with the speech request sentence 62, a sentence 64 indicating that the speech content will be used for the determination of the cognitive function, and a speech start button 65 for approving it and starting the speech. When the speech start button 65 is selected, the acquisition of voice information by the voice acquisition unit 18 will start. Also, when the speech start button 65 is selected, it is advisable to display the speech end button 66 so that it can be selected.
[0078] In the management server 20, the authentication processing unit 21a executes an identity authentication process based on the face information obtained by reading from the driver's license 30 or the like and the data of the moving image acquired by the front camera 17a (step S17). Next, the authentication processing unit 21a determines whether the result of the identity authentication process is successful, that is, whether it is OK (step S18). If the result in step S18 is NO, the process ends. At this time, the authentication processing unit 21a may notify the terminal device 10 via the communication unit 23 that the identity authentication process has failed.
[0079] If the result in step S18 is YES, the evaluation processing unit 21b evaluates the cognitive function from the acquired voice and moving image (step S19). The example of this evaluation method is as described above. The evaluation processing unit 21b may be equipped with a function to prevent voice impersonation, such as outputting the voice recorded in advance by others while acting as if speaking during video shooting. As such a prevention function, for example, a function of asking random questions during voice acquisition and evaluating the appropriateness of the responses thereto may be adopted.
[0080] The reception processing unit 21c obtains the evaluation result from the evaluation processing unit 21b and determines whether there is a problem with the cognitive function (step S20). If the result in step S20 is YES, the reception processing unit 21c transmits, via the communication unit 23, a user interface image for guiding the cognitive function test for display on the display unit 15 (step S21). In step S21, an elderly person training may also be guided. However, the elderly person training may be guided when the reservation for the cognitive function test based on the guidance for the cognitive function test is completed. After the process of step S21, the cognitive function determination system 100 ends the process. Thereafter, the user who sees this guidance calls the phone number of the link included in the guidance to make a reservation for the cognitive function test.
[0081] If the answer in step S20 is NO, the reception processing unit 21c transmits, via the communication unit 23, a user interface image for guiding the elderly training to the display unit 15 for display (step S22). In the elderly training guidance, for example, an interface image 70 as shown in FIG. 7 may be displayed. The user interface image 70 can include a sentence 71 prompting a reservation, radio buttons 72, 73 for selecting a method of guiding the elderly training, and an OK button 74 for proceeding with the guidance based on the selection. After that, the user who has seen this guidance can continue to make a reservation for the elderly training in the application by selecting the radio button 72 and the OK button 74. Alternatively, the user can make a reservation for the elderly training by selecting the radio button 73 and the OK button 74 and then calling the phone number of the reservation destination. After the process of step S22, the cognitive function determination system 100 ends the process.
[0082] As described above, according to the present embodiment, in addition to the effects of the first embodiment, by evaluating the cognitive function using evaluation target information other than voice information such as line-of-sight information, the determination accuracy can be improved. Further, according to the present embodiment, this evaluation of the cognitive function can be applied in a procedure for updating a predetermined qualification.
[0083] Also, according to the present embodiment, when renewing a driver's license, by introducing a simple evaluation of the cognitive function that only requires input of voice or the like, the number of targets for the cognitive function test can be significantly reduced from all elderly people.
[0084] Reducing the targets of cognitive function tests has the following effects. First, for the elderly, there were various burdens such as the need to make reservations for cognitive function tests, the hassle of reservation adjustment itself, inability to make reservations on the desired date, the difficulty of traveling to the local area itself, and the burden of the cognitive function test itself. However, according to this embodiment, such burdens on the elderly can be reduced. Also, for police stations and training schools, there were various burdens such as a large amount of man-hours for handling test reservations, a significant need for personnel, and the burden of conducting cognitive function tests. Especially since the number of elderly people is increasing year by year, such burdens are also on an increasing trend. However, according to this embodiment, such burdens on police stations and training schools can be reduced.
[0085] <Other Embodiments> In each embodiment, the cognitive function determination system and the cognitive function determination method have been described. However, the system configuration, processing procedures, etc. are not limited to those illustrated, as long as the functions of the device and the steps of the method are included. Also, the certificates in each embodiment may have different names and biometric information stored depending on the country, but each embodiment can be similarly applied in other countries. Further, each device described in each embodiment may have the following hardware configuration. FIG. 8 is a diagram showing an example of the hardware configuration of the device according to the present disclosure.
[0086] The device 1000 shown in FIG. 8 can include a processor 1001, a memory 1002, and an interface (I / F) 1003. The processor 1001 may be, for example, a microprocessor, an MPU (Micro Processor Unit), or a CPU. The processor 1001 may include a plurality of processors. The memory 1002 is configured by, for example, a combination of a volatile memory and a non-volatile memory. The functions in each device described in each embodiment are realized by the processor 1001 reading and executing the program stored in the memory 1002. At this time, for example, the transmission and reception of information with other devices can be performed via the communication interface as the I / F 1003. Also, the input and output for operating the device 1000 can be performed via the input / output interface as the I / F 1003.
[0087] In the above example, the program can be stored using various types of non-transitory computer readable media and supplied to a computer. Non-transitory computer readable media include various types of tangible storage media. Examples of non-transitory computer readable media include magnetic recording media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (e.g., magneto-optical disks). Further, this example includes CD-ROM (Read Only Memory), CD-R, CD-R / W. Further, this example includes semiconductor memories (e.g., mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM (Random Access Memory)). Also, the program may be supplied to the computer by various types of transitory computer readable media. Examples of transitory computer readable media include electrical signals, optical signals, and electromagnetic waves. Transitory computer readable media can supply the program to the computer via wired communication paths such as electric wires and optical fibers, or wireless communication paths.
[0088] As described above, the present disclosure has been described with reference to the embodiments, but the present disclosure is not limited to the above-described embodiments. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Note that the present disclosure is not limited to the above-described embodiments, and can be appropriately changed without departing from the gist. And each embodiment can be combined with other embodiments as appropriate.
[0089] The figures are merely examples for explaining one or more embodiments. Each figure may be associated with not only one specific embodiment but also one or more other embodiments. As can be understood by those skilled in the art, various features or steps described with reference to any one figure can be combined with features or steps shown in one or more other figures to create, for example, embodiments that are not explicitly illustrated or described. Not all of the features or steps shown in any one figure for explaining exemplary embodiments are necessarily essential, and some features or steps may be omitted. The order of the steps described in any figure may be changed as appropriate.
[0090] Some or all of the above embodiments may be described as follows, but are not limited thereto. (Appendix 1) An acquisition process of acquiring a person's voice information during a period including a period in which an authentication process for the person is performed using a certificate recording the person's biometric information assigned with identification information, and An evaluation process of evaluating the person's cognitive function based on the voice information, and A cognitive function determination system that executes the above. (Appendix 2) The evaluation process evaluates the person's cognitive function based on the voice information and eye line information detecting the movement of the person's eye line. The cognitive function determination system according to Appendix 1. (Appendix 3) An instruction process is executed to provide guidance on a procedure for updating a predetermined qualification based on the evaluation result in the evaluation process. The cognitive function determination system according to Appendix 1 or 2. (Appendix 4) The predetermined qualification is the qualification certified by the certificate. The cognitive function determination system according to Appendix 3. (Appendix 5) When the guidance process indicates that there is a problem with the cognitive function based on the evaluation result in the evaluation process, it guides the first procedure necessary to update the predetermined qualification. When the evaluation result in the evaluation process indicates that there is no problem with the cognitive function, it guides the second procedure that has fewer steps than the first procedure necessary to update the predetermined qualification. The cognitive function determination system according to Appendix 3 or 4. (Appendix 6) The personal authentication process is a process of performing personal authentication by comparing the face information as the biometric information recorded in the memory provided in the certificate with the face image captured by the imaging device or the face information obtained from the face image. The cognitive function determination system according to any one of Appendices 1 to 5. (Appendix 7) The evaluation process uses a learning model that is machine-learned to input at least the voice information and output the evaluation result of the cognitive function, and obtains the evaluation result of the cognitive function from at least the voice information. The cognitive function determination system according to any one of Appendices 1 to 6. (Appendix 8) Perform a process of deleting the voice information obtained in the acquisition process after the evaluation process. The cognitive function determination system according to any one of Appendices 1 to 7. (Appendix 9) The computer Acquires the voice information of a person during a period including the period when the personal authentication process is being performed using a certificate recording the biometric information of the person to whom the identification information is assigned. Evaluates the cognitive function of the person based on the voice information. Cognitive function determination method. (Appendix 10) To the computer An acquisition process of acquiring the voice information of a person during a period including the period when the personal authentication process is being performed using a certificate recording the biometric information of the person to whom the identification information is assigned, An evaluation process of evaluating the cognitive function of the person based on the voice information, A program for causing execution. (Appendix 11) An acquisition process for acquiring voice information of a person during a period including a period in which an authentication process is performed using a certificate recording biometric information of a person to whom identification information is assigned, An evaluation process for evaluating the cognitive function of the person based on the voice information, A server device that executes the above.
[0091] Part or all of the elements (for example, configuration and function) described in Appendices 2 to 8 that are subordinate to the cognitive function determination system of Appendix 1 may also be subordinate to the cognitive function determination method according to Appendix 9, the program according to Appendix 10, and the server device according to Appendix 11 in the same subordinate relationship as Appendices 2 to 8. Part or all of the elements described in any appendix may be applied to various hardware, software, recording means for recording software, systems, and methods.
Explanation of Signs
[0092] 1, 100 Cognitive function determination system 1a Acquisition processing unit 1b, 21b Evaluation processing unit 10 Terminal device 11, 21 Control unit 12, 22 Storage unit 13, 23 Communication unit 14 Operation unit 15 Display unit 16 Card reader 17 Imaging unit 17a Front camera 18 Voice acquisition unit 21a Authentication processing unit 21c Reception processing unit 30 Driving license 31 IC chip 31a Memory 1000 Device 1001 Processor 1002 Memory 1003 Interface N Network
Claims
1. an acquisition process for acquiring voice information of a person to whom identification information is assigned, during a period including a period during which identity authentication processing is being performed, using a certificate that records biometric information of the person; an evaluation process for evaluating a cognitive function of the person based on the voice information; A cognitive function assessment system that performs the following:
2. The evaluation process evaluates the cognitive function of the person based on the voice information and gaze information obtained by detecting a gaze movement of the person. The cognitive function assessment system according to claim 1 .
3. Executing a guidance process for providing guidance on a procedure for updating a predetermined qualification based on the evaluation result in the evaluation process. The cognitive function assessment system according to claim 1 or 2.
4. the predetermined entitlement being the entitlement attested to in the certificate; The cognitive function assessment system according to claim 3.
5. The guidance process, when an evaluation result in the evaluation process indicates that there is a problem with the cognitive function, guides the user to a first procedure necessary to renew the specified qualification, and, when an evaluation result in the evaluation process indicates that there is no problem with the cognitive function, guides the user to a second procedure which is necessary to renew the specified qualification and which has fewer steps than the first procedure. The cognitive function assessment system according to claim 3.
6. The identity authentication process is a process of performing identity authentication by comparing face information as the biometric information recorded in a memory provided in the certificate with a face image captured by an imaging device or face information acquired from the face image. The cognitive function assessment system according to claim 1 or 2.
7. The evaluation process includes inputting at least the speech information, and obtaining an evaluation result of the cognitive function from at least the speech information using a learning model that has been machine-learned to output an evaluation result of the cognitive function. The cognitive function assessment system according to claim 1 or 2.
8. performing a process of deleting the voice information acquired in the acquisition process after the evaluation process; The cognitive function assessment system according to claim 1 or 2.
9. The computer Acquiring voice information of a person to whom identification information has been assigned, during a period including a period during which identity authentication processing is being performed, using a certificate that records biometric information of the person; assessing a cognitive function of the person based on the audio information; Method for determining cognitive function.
10. On the computer, an acquisition process for acquiring voice information of a person to whom identification information is assigned, during a period including a period during which identity authentication processing is being performed, using a certificate that records biometric information of the person; an evaluation process for evaluating a cognitive function of the person based on the voice information; A program for executing the above.
Citation Information
Patent Citations
Determination method for cognitive function, program, and determination system for cognitive function
WO2021024987A1