Authentication device, program, and authentication method

Abstract

To provide an authentication device equipped with an authentication moving image acquisition part for acquiring an authentication moving image capturing a person for authentication and an authentication part for authenticating a person on the basis of the movement of a muscle of the face of the person specified by analyzing the authentication moving image.SOLUTION: An authentication part may authenticate a person using a neural network for outputting a feature amount vector with an input of a moving image including the person as a subject. The authentication part may estimate a motor neuron of the face of the person on the basis of the movement of a muscle of the face of the person specified by analyzing an authentication moving image, and authenticate the person by the estimated motor neuron. An authentication device includes an authentication moving image acquisition part for acquiring an authentication moving image capturing a walking person for authentication, and the authentication part for authenticating a person on the basis of the movement of a muscle of the body of a person specified by analyzing the authentication moving image.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an authentication device, a program, and an authentication method. [Background technology]

[0002] Patent Document 1 describes a technique for acquiring a face image of a user and authenticating the user using information related to feature points contained in the face image. [Prior art document] [Patent documents] [Patent Document 1] JP 2021-170205 A Summary of the Invention [Means for solving the problem]

[0003] According to an embodiment of the present invention, there is provided an authentication device. The authentication device may include an authentication video acquisition unit that acquires an authentication video of a person for authentication. The authentication device may include an authentication unit that authenticates the person based on the movement of the facial muscles of the person identified by analyzing the authentication video.

[0004] The authentication unit may authenticate the person using machine learning. The authentication unit may authenticate the person using a neural network that receives a video including a person as a subject and outputs a feature vector. The authentication unit may authenticate the person using deep learning. The authentication unit may authenticate the person using a deep neural network. The authentication unit may authenticate the person using a deep neural network that handles time series. The authentication unit may authenticate the person using a recurrent neural network. The authentication unit may authenticate the person using a long short-term memory (LSTM). The authentication device may further include a registration video acquisition unit that acquires a registration video captured of a person for registration; a registration estimation unit that estimates the facial motor neurons of the person based on the facial muscle movements of the person identified by analyzing the registration video; and a registration data storage unit that stores registration data for a plurality of people including the motor neurons estimated by the registration estimation unit and personal identification information capable of identifying the person, and the authentication unit may estimate the facial motor neurons of the person based on the facial muscle movements of the person identified by analyzing the authentication video acquired by the authentication video acquisition unit, and authenticate the person by comparing the estimated motor neurons with the motor neurons of the plurality of registration data stored in the registration data storage unit. The authentication device may further include an expression data acquisition unit that acquires expression data corresponding to each of the plurality of parameters by inputting a plurality of parameters to a simulator that generates expression data indicative of the person's facial movements by simulating the movement of the person's facial muscles in accordance with input parameters related to motor neurons, and a training data storage unit that stores training data including the expression data acquired by the expression data acquisition unit and the parameters corresponding to the expression data, and the registration estimation unit may estimate the facial motor neurons of the person based on the plurality of training data stored in the training data storage unit.The registration estimation unit may estimate the facial motor neurons of the person by identifying the parameters of training data among the plurality of training data, the parameters of which correspond to the facial muscle movement of the person identified by analyzing the registration video. The authentication unit may estimate the facial motor neurons of the person based on the plurality of training data stored in the training data storage unit.

[0005] The enrollment data storage unit may store the plurality of enrollment data by grouping them according to the features of the person's facial parts, and the authentication unit may identify a group corresponding to the features of the person's facial parts identified by analyzing the authentication video acquired by the authentication video acquisition unit, and authenticate the person by comparing the motor neurons of the plurality of enrollment data belonging to the identified group stored in the enrollment data storage unit with the motor neurons of the person's face estimated based on the movement of the person's facial muscles identified by analyzing the authentication video. The enrollment data storage unit may store the plurality of enrollment data by grouping them according to the features of the person's facial fat, and the authentication unit may identify a group corresponding to the features of the person's facial fat identified by analyzing the authentication video acquired by the authentication video acquisition unit, and authenticate the person by comparing the motor neurons of the plurality of enrollment data corresponding to the identified group stored in the enrollment data storage unit with the motor neurons of the person's face estimated based on the movement of the person's facial muscles identified by analyzing the authentication video. The enrollment data storage unit may store the plurality of enrollment data by grouping according to the gender of the person, and the authentication unit may identify a group corresponding to the gender of the person identified by analyzing the authentication video acquired by the authentication video acquisition unit, and authenticate the person by comparing the motor neurons of the plurality of enrollment data corresponding to the identified group stored in the enrollment data storage unit with the facial motor neurons of the person estimated based on the facial muscle movement of the person identified by analyzing the authentication video. The enrollment data storage unit may store the plurality of enrollment data by grouping according to the age of the person, and the authentication unit may identify a group corresponding to the age of the person identified by analyzing the authentication video acquired by the authentication video acquisition unit, and authenticate the person by comparing the motor neurons of the plurality of enrollment data corresponding to the identified group stored in the enrollment data storage unit with the facial motor neurons of the person estimated based on the facial muscle movement of the person identified by analyzing the authentication video.The authentication device may further include an instruction information output unit that outputs instruction information instructing the person to perform a predetermined action, and the registration video acquisition unit may acquire the registration video that captures the face of the person after the instruction information output unit outputs the instruction information, and the authentication video acquisition unit may acquire the authentication video that captures the face of the person after the instruction information output unit outputs the instruction information.

[0006] The authentication video acquisition unit may acquire the authentication video capturing the person walking, and the authentication unit may authenticate the person based on the muscle movements of the person's body and facial muscles identified by analyzing the authentication video. The registration estimation unit may estimate the motor neurons of the person's body based on the muscle movements of the person's body identified by analyzing the registration video, the registration data storage unit may store the registration data including the facial motor neurons and bodily motor neurons of the person estimated by the registration estimation unit and personal identification information capable of identifying the person, and the authentication unit may estimate the facial motor neurons and bodily motor neurons of the person based on the facial muscle movements and bodily muscle movements of the person identified by analyzing the authentication video acquired by the authentication video acquisition unit, and authenticate the person by comparing the estimated facial motor neurons and bodily motor neurons with the facial motor neurons and bodily motor neurons of multiple registration data stored in the registration data storage unit. The authentication unit may identify multiple enrollment data corresponding to the estimated motor neurons of the person's body from the multiple enrollment data stored in the enrollment data storage unit, and authenticate the person by comparing the estimated facial motor neurons of the person with the facial motor neurons of the identified multiple enrollment data.

[0007] The authentication device may further include a registration video acquisition unit that acquires a registration video of the person for registration, a motion data generation unit that generates motion data indicating the motion of the person's facial muscles by analyzing the registration video, and a registration data storage unit that stores registration data for a plurality of people, the motion data generated by the motion data generation unit and personal identification information that can identify the person, and the authentication unit may authenticate the person by comparing the motion data indicating the motion of the person's facial muscles generated by analyzing the authentication video acquired by the authentication video acquisition unit with the motion data of the plurality of registration data stored in the registration data storage unit. The authentication device may further include an instruction information output unit that outputs instruction information instructing the person to perform a predetermined action, and the registration video acquisition unit may acquire the registration video of the person after the instruction information output unit outputs the instruction information, and the authentication video acquisition unit may acquire the authentication video of the person after the instruction information output unit outputs the instruction information.

[0008] According to an embodiment of the present invention, there is provided an authentication device. The authentication device may include an authentication video acquisition unit that acquires an authentication video of a person walking for authentication. The authentication device may include an authentication unit that authenticates the person based on muscle movements of the person's body identified by analyzing the authentication video.

[0009] The authentication device may further include a registration video acquisition unit that acquires a registration video captured of a person walking for registration purposes, a registration estimation unit that estimates the motor neurons of the person's body based on the muscle movements of the person's body identified by analyzing the registration video, and a registration data storage unit that stores registration data for a plurality of people including the motor neurons estimated by the registration estimation unit and personal identification information capable of identifying the person, and the authentication unit may authenticate the person by estimating the motor neurons of the person's body based on the muscle movements of the person's body identified by analyzing the authentication video acquired by the authentication video acquisition unit, and comparing the estimated motor neurons with the motor neurons of the plurality of registration data stored in the registration data storage unit.

[0010] According to one embodiment of the present invention, there is provided a program for causing a computer to function as a host machine authentication device.

[0011] According to one embodiment of the present invention, a computer implemented authentication method is provided. The authentication method may include an authentication video acquisition step of acquiring an authentication video of a person for authentication. The authentication method may include an authentication step of authenticating the person based on facial muscle movements of the person identified by analyzing the authentication video.

[0012] According to one embodiment of the present invention, there is provided an authentication method executed by a computer. The authentication method may include an authentication video acquisition step of acquiring an authentication video of a walking person for authentication. The authentication method may include an authentication step of authenticating the person based on muscle movements of the body of the person identified by analyzing the authentication video.

[0013] The above summary of the invention does not list all of the necessary features of the present invention. Also, subcombinations of these features may also be inventions. [Brief description of the drawings]

[0014] [Figure 1] An example of a system 10 is shown diagrammatically. [Diagram 2] 3 shows an example of a feature amount 310. [Diagram 3] 3 shows an example of a feature amount 320. [Figure 4] 3 illustrates a schematic diagram of an example authentication network 330. [Diagram 5] 2 illustrates an example of a functional configuration of the authentication device 100. [Figure 6] 2 shows an example of a processing flow by the authentication device 100. [Figure 7] 2 shows an example of a processing flow by the authentication device 100. [Figure 8] 2 shows an example of a processing flow by the authentication device 100. [Figure 9] An example of a system 10 is shown diagrammatically. [Figure 10] 1 shows an example of a hardware configuration of a computer 1200 that functions as the authentication device 100. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] Identifying an individual through facial recognition or biometric authentication is important for security. However, it is difficult to fully deal with fake images created by 3D printers and photographs using methods that take 2D and 3D shape features. In addition, biometric authentication requires special devices, takes time to measure, and has not yet completely solved problems such as removing makeup (facial veins) and fingerprints (some people cannot remove them, fakes are possible). The authentication device 100 according to this embodiment uses features tracked from the movement of facial muscles during face authentication, for example. Motor neurons are required to move muscles. The number of motor neurons is greatest at birth, and as a person learns how to move the muscles, the number decreases and the muscles are optimized. As a result, the way muscles are moved differs from person to person due to optimization based on genetic information and environment at birth. Even if two people have similar genes and facial features, like twins, they move their muscles differently. In addition, the authentication device 100 according to this embodiment can extract features based on the way a person walks when approaching a camera, further improving accuracy. Just like facial expressions, the way people walk also has its own characteristics due to the different number of motor neurons and connectors each person has.

[0016] The present invention will be described below through embodiments of the invention, but the following embodiments do not limit the scope of the invention according to the claims. Furthermore, not all of the combinations of features described in the embodiments are necessarily essential to the solution of the invention.

[0017] 1 illustrates an example of a system 10. The system 10 includes an authentication device 100 and a camera 200.

[0018] The authentication device 100 and the camera 200 may communicate with each other via a network 20. The network 20 may include the Internet. The network 20 may include a Local Area Network (LAN).

[0019] The network 20 may include a mobile communication network. The mobile communication network may be compliant with any of the following communication methods: 3G (3rd Generation) communication method, LTE (Long Term Evolution) communication method, 5G (5th Generation) communication method, and 6G (6th Generation) communication method and later.

[0020] The authentication device 100 may be connected to the network 20 by wire. The authentication device 100 may be connected to the network 20 wirelessly. The authentication device 100 may be connected to the network 20 via a wireless base station. The authentication device 100 may be connected to the network 20 via a Wi-Fi (registered trademark) access point.

[0021] The camera 200 may be connected to the network 20 by wire. The camera 200 may be connected to the network 20 wirelessly. The camera 200 may be connected to the network 20 via a wireless base station. The camera 200 may be connected to the network 20 via a Wi-Fi access point.

[0022] The authentication device 100 and the camera 200 may be directly connected to each other. Also, the authentication device 100 may have the camera 200 built-in.

[0023] The authentication device 100 receives an image captured by the camera 200 from the camera 200. The authentication device 100 may receive an image captured by the camera 200 of the person 30 from the camera 200. The authentication device 100 may receive a video captured by the camera 200 of the person 30 from the camera 200.

[0024] The camera 200 is installed at any location where authentication of the person 30 is required. When the authentication device 100 has the camera 200 built in, the authentication device 100 may be set at any location where authentication of the person 30 is required.

[0025] The camera 200 may include a depth sensor. The authentication device 100 may receive, from the camera 200, a captured image including depth information detected by the depth sensor of the camera 200.

[0026] The authentication device 100 may receive, from the camera 200, a registration video captured by the camera 200 of the person 30 for registration. Capturing an image for registration may mean notifying the person 30 that an image will be captured for registration and capturing an image of the person 30 by the camera 200. Capturing an image for registration may mean capturing an image of the person 30 by the camera 200 with the camera 200 set to a registration mode. Capturing an image for registration may mean capturing an image of the person 30 by the camera 200 with the authentication device 100 set to a registration mode.

[0027] The authentication device 100 may authenticate the person 30 based on the movement of the facial muscles of the person 30. For example, the authentication device 100 stores enrollment data including the movement feature of the facial muscles of the person 30 acquired by analyzing the enrollment video of the person 30 and personal identification information capable of identifying the person 30. The authentication device 100 stores enrollment data for a plurality of people 30.

[0028] The authentication device 100 may receive, from the camera 200, an authentication video in which the camera 200 captures the person 30 for authentication. Capturing an image for authentication may mean capturing an image of the person 30 by the camera 200 in a scene in which the person 30 is to be authenticated. Capturing an image for authentication may mean notifying the person 30 that an image will be captured for authentication and capturing an image of the person 30 by the camera 200. Capturing an image for authentication may mean capturing an image of the person 30 by the camera 200 with the camera 200 set to an authentication mode. Capturing an image for authentication may mean capturing an image of the person 30 by the camera 200 with the authentication device 100 set to an authentication mode.

[0029] The authentication device 100 may authenticate the person 30 by comparing the feature amounts of the movement of the facial muscles of the person 30 identified by analyzing the authentication video with the feature amounts of a plurality of enrollment data.

[0030] The authentication device 100 may authenticate the person 30 based on the muscle movements of the person 30 while walking. For example, the authentication device 100 stores enrollment data including muscle movement features of the person 30 acquired by analyzing the enrollment video of the person 30 and personal identification information capable of identifying the person 30. The authentication device 100 stores enrollment data for a plurality of people 30. The authentication device 100 may authenticate the person 30 by comparing the muscle movement features of the person 30 identified by analyzing the authentication video with the features of the plurality of enrollment data.

[0031] 2 illustrates an example of the feature amount 310. The authentication device 100 analyzes a video of the person 30 to acquire the feature amount 310. The authentication device 100 acquires feature points of the face of the person 30 using a 2D image or depth information in the video. The authentication device 100 generates, for example, a 3D mesh of the face of the person 30.

[0032] The authentication device 100 may hold vertex coordinates (3D or 2D) of a 3D mesh, and may track the vertex coordinates that move with changes in facial expression as a feature of the movement of the facial muscles of the person 30. The coordinates may be in the Euler coordinate system or the Quaternion coordinate system, but are in the Local coordinate system. As illustrated in the feature 310 of FIG. 2, the vertex coordinates may hold the Local coordinate system, or, as illustrated in the feature 320 of FIG. 3, only the difference value at time t=0 may be held.

[0033] Similarly, the authentication device 100 acquires feature points of the body of the person 30 using 2D images or depth information in the video. The authentication device 100 generates, for example, a 3D mesh of the body of the person 30. The authentication device 100 then holds vertex coordinates (3D or 2D) of the 3D mesh, and may track the vertex coordinates that move as the person 30 moves his or her body, such as by walking, as feature amounts of muscle movement of the body of the person 30.

[0034] 4 shows an example of the authentication network 330. The authentication network 330 may be an example of a neural network that receives a video including a person as a subject and outputs a feature vector. Here, an example of the authentication network 330 is shown in which authentication is performed using the facial features and facial muscle movements of the person 30.

[0035] The authentication device 100 analyzes the authentication video to extract facial features of the person 30 and generate a facial feature vector. The authentication device 100 analyzes the authentication video to extract the facial trajectory of the person 30, i.e., the movement of the facial muscles of the person 30, and generate a facial trajectory vector. The authentication device 100 then aggregates the facial feature vector and the facial trajectory vector and outputs the result. If authentication is successful, the authentication device 100 outputs personal identification information of the person 30.

[0036] 5 shows an example of a schematic functional configuration of authentication device 100. Authentication device 100 includes a training data storage unit 102, a facial expression data acquisition unit 104, a body data acquisition unit 106, registration video acquisition units 110 and 120, a registration data storage unit 128, an authentication video acquisition unit 130, an authentication unit 132, and an instruction information output unit 140. Note that it is not essential that authentication device 100 includes all of these units.

[0037] The training data storage unit 102 stores training data of facial movements. The facial movements may be facial expression movements. The training data may include a moving image of a moving face. The training data may include a feature of the movement of facial muscles when the facial movements are made in the moving image. The training data storage unit 102 stores a plurality of training data. The training data storage unit 102 stores a large amount of training data. The training data storage unit 102 may store training data received from an external source or registered from an external source.

[0038] The facial expression data acquisition unit 104 acquires facial expression data indicating facial movement of the person 30. The facial expression data acquisition unit 104 may acquire facial expression data corresponding to each of the multiple parameters by inputting multiple parameters to a simulator that generates facial expression data indicating the facial movement of the person by simulating the movement of the person's facial muscles according to input parameters related to motor neurons. The motor neurons are sometimes called motor neurons. The training data storage unit 102 stores training data including the facial expression data acquired by the facial expression data acquisition unit 104 and parameters corresponding to the facial expression data.

[0039] A motor neuron is connected to the muscle, and a signal is sent by firing of the motor neuron, and the muscle moves by contracting. For example, the simulator connects the motor neuron to the facial muscles, and uses the Hodgkin-Huxley model (AL Hodgkin, A. A quantitative description of membrane current and its application to conduction and excitation in nerve, from the physiological laboratory. University of Cambridge, pp. 500-544, 1952.) to calculate the firing of the signal. In addition, a Hill-type model is used as a muscle contraction model. This makes it possible to simulate the movement of the muscles in detail, and it is possible to virtually extract feature points based on the movement of each muscle and use them as training data. The facial expression data acquisition unit 104 can generate a wide variety of training data using parameters such as the signal strength, the number of motor neurons, the firing rate and synchronization of each neuron, the connector of the motor neuron, and the Min and Max of the Hill-type model.

[0040] The simulator may also automatically generate face shapes using photorealistic or morphing techniques, which will generate a variety of combinations of face movements and face shapes, allowing for the automatic generation of sufficient data for training.

[0041] The authentication device 100 may use any existing simulator as long as it is capable of generating facial expression data. Data extracted from a 3D sensor or video is noisy. Also, acquiring a large amount of training data from an individual or many people requires a lot of effort. In contrast, the facial expression data acquisition unit 104 can acquire a large amount of facial expression data with a rich variety by using a simulator.

[0042] The facial expression data acquisition unit 104 may acquire facial expression data corresponding to each of the multiple parameters by inputting the multiple parameters to a simulator that generates facial expression data indicating the facial movement of a person by simulating the movement of the muscles in the person's face in accordance with input of parameters other than motor neurons.

[0043] The physical data acquiring unit 106 acquires motion data indicating the motion of the body of the person 30. The physical data acquiring unit 106 may acquire physical data corresponding to each of the multiple parameters by inputting multiple parameters to a simulator that generates physical data indicating the motion of the body of the person by simulating the motion of muscles of the body of the person according to input parameters related to motor neurons. The training data storage unit 102 stores training data including the physical data acquired by the physical data acquiring unit 106 and parameters corresponding to the physical data.

[0044] The simulator, for example, connects motor neurons to the muscles of the body, and uses the Hodgkin-Huxley model to calculate the firing of signals. In addition, a Hill-type model is used as a muscle contraction model. The body data acquisition unit 106 can generate training data with a rich variety of parameters, such as signal strength, the number of motor neurons, the firing rate of each neuron, synchronization, the motor neuron connector, and the Min and Max of the Hill-type model. The simulator may also automatically generate the shape of the body using photo real or morphing techniques. This allows variations to be generated in the combination of facial movements and facial shapes, so that sufficient data for training can be automatically generated. The authentication device 100 may use any existing simulator as long as it is capable of generating movement data.

[0045] The registration video acquisition unit 110 acquires a registration video obtained by capturing an image of the person 30 for registration. The registration video acquisition unit 110 may receive, from the camera 200, a registration video captured by the camera 200. The registration video acquisition unit 110 may receive, from the camera 200, a registration video obtained by capturing an image of the person 30 performing a predetermined action. Examples of the predetermined action include an action of changing from a neutral expression to a smile, an action of uttering predetermined words such as "a, i, u, e, o," etc., but is not limited to these, and any action may be used.

[0046] The registration processing unit 120 executes the registration process using the registration moving image acquired by the registration moving image acquisition unit 110. The registration processing unit 120 includes a feature data generation unit 122, a registration estimation unit 124, and a motion data generation unit 126.

[0047] The feature data generating unit 122 generates feature data indicating the facial features of the person 30 by analyzing the registration video. The feature data may include features of the face shape of the person 30. The feature data may include features of the eye shape of the person 30. The feature data may include features of the nose shape of the person 30. The feature data may include features of the mouth shape of the person 30. The feature data may include relationships between the facial features of the person 30. Examples of the relationships between the features include the distance between the eyes, the positional relationship between the eyes and the nose, the positional relationship between the eyes and the mouth, the positional relationship between the nose and the mouth, and the positions of the eyes, nose, and mouth on the face. The feature data may include features of fat on the face of the person 30. Examples of the fat features include the position of fat and the thickness of fat. The feature data may include features of wrinkles on the face of the person 30.

[0048] The feature data generating unit 122 may generate feature data indicating the gender of the person 30 by analyzing the registration moving image. The feature data generating unit 122 may generate feature data indicating the age of the person 30 by analyzing the registration moving image.

[0049] The registration estimation unit 124 estimates the facial motor neurons of the person 30 based on the movement of the facial muscles of the person 30 identified by analyzing the registration video. The registration estimation unit 124 may estimate the facial motor neurons of the person 30 based on a plurality of training data stored in the training data storage unit 102. For example, the registration estimation unit 124 may estimate the facial motor neurons of the person 30 by identifying parameters of training data, among the plurality of training data, whose facial expression data corresponds to the movement of the facial muscles of the person 30 identified by analyzing the registration video.

[0050] The motion data generating unit 126 generates motion data indicating the movement of the facial muscles of the person 30 by analyzing the registration video. The motion data generating unit 126 may generate motion data indicating the movement of the facial muscles of the person 30 based on a plurality of training data stored in the training data storage unit 102. The motion data generating unit 126 may generate motion data indicating the movement of the facial muscles of the person 30 by identifying parameters of training data among the plurality of training data, the parameters of which correspond to the movement of the facial muscles of the person 30 identified by analyzing the registration video, in which the facial expression data corresponds to the movement of the facial muscles of the person 30.

[0051] The enrollment data storage unit 128 stores enrollment data including the facial motor neurons of the person 30 estimated by the enrollment estimation unit 124 and personal identification information of the person 30. The enrollment data storage unit 128 may store enrollment data including the facial motor neurons of the person 30 estimated by the enrollment estimation unit 124, feature data generated by the feature data generation unit 122, and personal identification information of the person 30. The enrollment data storage unit 128 may store enrollment data including the motion data generated by the motion data generation unit 126 and personal identification information of the person 30. The enrollment data storage unit 128 stores enrollment data for a plurality of people 30.

[0052] The authentication video acquisition unit 130 acquires an authentication video obtained by capturing an image of the person 30 for authentication. The authentication video acquisition unit 130 may receive, from the camera 200, an authentication video captured by the camera 200. The authentication video acquisition unit 130 may receive, from the camera 200, an authentication video obtained by capturing an image of the person 30 performing a predetermined action. The action may be the same as the action when the registration video acquisition unit 110 captures an image of the person 30 performing the predetermined action.

[0053] The authentication unit 132 authenticates the person 30 based on the movement of the facial muscles of the person 30 identified by analyzing the authentication video acquired by the authentication video acquisition unit 130. The authentication unit 132 may authenticate the person 30 using machine learning. The authentication unit 132 may authenticate the person 30 using a neural network that receives as input a video including a person as a subject and outputs a feature vector. The authentication unit 132 may use deep learning. The authentication unit 132 may use a deep neural network. The authentication unit 132 may use a deep neural network that handles time series. The authentication unit 132 uses, for example, a recurrent neural network. The authentication unit 132 uses, for example, an LSTM. For example, the authentication unit 132 estimates the facial motor neurons of the person 30 based on the movement of the facial muscles of the person 30 identified by analyzing the authentication video acquired by the authentication video acquisition unit 130, and authenticates the person 30 by comparing the estimated motor neurons with the motor neurons of multiple registration data stored in the registration data storage unit 128.

[0054] The authentication unit 132 may estimate the facial motor neurons of the person 30 based on a plurality of training data stored in the training data storage unit 102. For example, the authentication unit 132 may estimate the facial motor neurons of the person 30 by identifying parameters of training data among the plurality of training data, the training data corresponding to the movement of the facial muscles of the person 30 identified by analyzing the video for authentication.

[0055] For example, when there is enrollment data including a motor neuron whose degree of coincidence with the estimated motor neuron is higher than a predetermined threshold, the authentication unit 132 determines that the authentication is successful, and when there is no such data, the authentication unit 132 determines that the authentication is unsuccessful. When the authentication is successful, the authentication unit 132 may output personal identification information of the enrollment data including the motor neuron corresponding to the estimated motor neuron.

[0056] The enrollment data storage unit 128 may store a plurality of enrollment data by grouping the features of the facial parts of the person 30. The authentication unit 132 may identify a group corresponding to the features of the facial parts of the person 30 identified by analyzing the authentication video, and authenticate the person 30 by comparing the motor neurons of the plurality of enrollment data belonging to the identified group stored in the enrollment data storage unit 128 with the facial motor neurons of the person 30 estimated based on the movement of the facial muscles of the person 30 identified by analyzing the authentication video. For example, when the person 30 to be authenticated has a round face, the authentication unit 132 narrows down the enrollment data to a plurality of enrollment data belonging to a round face group and performs authentication. For example, when the person 30 to be authenticated has a relatively large nose, the authentication unit 132 narrows down the enrollment data to a plurality of enrollment data belonging to a group with relatively large noses and performs authentication. For example, when the person 30 to be authenticated has relatively narrow eyes, the authentication unit 132 narrows down the enrollment data to a plurality of enrollment data belonging to a group with relatively narrow eyes and performs authentication. This can contribute to reducing the processing load on the authentication device 100 and improving authentication accuracy.

[0057] The enrollment data storage unit 128 may store a plurality of enrollment data by grouping the fat features of the face of the person 30. The authentication unit 132 may identify a group corresponding to the fat features of the face of the person 30 identified by analyzing the authentication video, and authenticate the person 30 by comparing the motor neurons of the plurality of enrollment data belonging to the identified group stored in the enrollment data storage unit 128 with the facial motor neurons of the person 30 estimated based on the movement of the facial muscles of the person 30 identified by analyzing the authentication video. This may contribute to reducing the processing load of the authentication device 100 and improving the authentication accuracy.

[0058] The enrollment data storage unit 128 may store a plurality of enrollment data, grouped according to the gender of the person 30. The authentication unit 132 may identify a group corresponding to the gender of the person 30 identified by analyzing the authentication video, and authenticate the person 30 by comparing the motor neurons of the plurality of enrollment data belonging to the identified group stored in the enrollment data storage unit 128 with the facial motor neurons of the person 30 estimated based on the movement of the facial muscles of the person 30 identified by analyzing the authentication video. This may contribute to reducing the processing load of the authentication device 100 and improving the authentication accuracy.

[0059] The enrollment data storage unit 128 may store a plurality of enrollment data, grouped according to the age of the person 30. The authentication unit 132 may identify a group corresponding to the age of the person 30 identified by analyzing the authentication video, and authenticate the person 30 by comparing the motor neurons of the plurality of enrollment data belonging to the identified group stored in the enrollment data storage unit 128 with the facial motor neurons of the person 30 estimated based on the movement of the facial muscles of the person 30 identified by analyzing the authentication video. This may contribute to reducing the processing load of the authentication device 100 and improving the authentication accuracy.

[0060] The authentication unit 132 may authenticate the person 30 by comparing data indicating the movement of the facial muscles of the person 30 generated by analyzing the authentication video acquired by the authentication video acquisition unit 130 with movement data of multiple enrollment data stored in the enrollment data storage unit 128.

[0061] The instruction information output unit 140 outputs instruction information instructing the person 30 to perform a predetermined action. The registration video acquisition unit 110 may acquire a registration video obtained by capturing an image of the person 30 after the instruction information output unit 140 outputs the instruction information. The authentication video acquisition unit 130 may acquire an authentication video obtained by capturing an image of the person 30 after the instruction information output unit 140 outputs the instruction information.

[0062] For example, when registering person 30, instruction information output unit 140 displays and outputs instruction information on a display arranged near camera 200, and outputs instruction information by voice from a speaker arranged near camera 200. For example, when authenticating person 30, instruction information output unit 140 displays and outputs instruction information similar to that at the time of registration on a display arranged near camera 200, and outputs instruction information similar to that at the time of registration by voice from a speaker arranged near camera 200. This makes it possible to prompt person 30 to perform the same action at the time of authentication as that at the time of registration, which can contribute to improving authentication accuracy.

[0063] The registration video acquisition unit 110 may acquire a registration video capturing an image of a walking person 30. For example, the registration video acquisition unit 110 receives from the camera 200 a registration video capturing an image of the person 30 approaching the camera 200 at the time of registration.

[0064] The feature data generating unit 122 may generate feature data indicating features of the body type of the person 30 by analyzing the registration video. The feature data may include features of the shape of the arms of the person 30. The feature data may include features of the shape of the legs of the person 30. The feature data may include relationships between parts of the body of the person 30.

[0065] The registration estimation unit 124 may estimate the motor neurons of the body of the person 30 based on the muscle movements of the body of the person 30 identified by analyzing the registration video. The registration estimation unit 124 may estimate the motor neurons of the body of the person 30 based on a plurality of training data stored in the training data storage unit 102. For example, the registration estimation unit 124 may estimate the motor neurons of the body of the person 30 by identifying parameters of training data, among the plurality of training data, whose physical data corresponds to the muscle movements of the body of the person 30 identified by analyzing the registration video.

[0066] The motion data generating unit 126 generates motion data indicating the movement of the muscles of the body of the person 30 by analyzing the registration video. The motion data generating unit 126 may generate motion data indicating the movement of the muscles of the body of the person 30 based on a plurality of training data stored in the training data storage unit 102. The motion data generating unit 126 may generate motion data indicating the movement of the muscles of the body of the person 30 by identifying parameters of training data, among the plurality of training data, that correspond to the movement of the muscles of the body of the person 30 identified by analyzing the registration video.

[0067] The enrollment data storage unit 128 may store enrollment data including the facial motor neurons and body motor neurons of the person 30 estimated by the enrollment estimation unit 124 , and the personal identification information of the person 30 .

[0068] The authentication video acquisition unit 130 may acquire an authentication video capturing an image of a walking person 30. For example, the authentication video acquisition unit 130 receives from the camera 200 an authentication video capturing an image of the person 30 approaching the camera 200 during authentication.

[0069] The authentication unit 132 may authenticate the person 30 based on the muscle movements of the body of the person 30 identified by analyzing the authentication video and the muscle movements of the face of the person 30. For example, the authentication unit 132 estimates the facial motor neurons and the body motor neurons of the person 30 based on the muscle movements of the face of the person 30 identified by analyzing the authentication video and the muscle movements of the body of the person 30, and authenticates the person 30 by comparing the estimated facial motor neurons and the body motor neurons with the facial motor neurons and the body motor neurons of the multiple enrollment data stored in the enrollment data storage unit. For example, the authentication unit 132 identifies multiple enrollment data corresponding to the estimated body motor neurons of the person 30 from the multiple enrollment data stored in the enrollment data storage unit 128, and authenticates the person 30 by comparing the estimated facial motor neurons of the person 30 with the facial motor neurons of the identified multiple enrollment data. As a result, for example, the analysis results of the authentication video captured when person 30 approaches camera 200 can narrow down the registration data to be subject to authentication based on facial muscle movements, which can contribute to reducing the processing load on authentication device 100 and improving authentication accuracy.

[0070] The authentication device 100 may authenticate the person 30 based on the muscle movements of the body of the person 30, rather than on the muscle movements of the face of the person 30. In this case, the authentication video acquisition unit 130 acquires, for authentication purposes, an authentication video captured of the person 30 walking, and the authentication unit 132 authenticates the person 30 based on the muscle movements of the body of the person 30 identified by analyzing the authentication video.

[0071] The authentication unit 132 may estimate motor neurons in the body of person 30 based on the muscle movements of the body of person 30 identified by analyzing the authentication video acquired by the authentication video acquisition unit 130, and authenticate person 30 by comparing the estimated motor neurons with the motor neurons of multiple registration data stored in the registration data storage unit 128.

[0072] The authentication unit 132 may estimate the motor neurons of the body of the person 30 based on the plurality of training data stored in the training data storage unit 102. For example, the authentication unit 132 may estimate the motor neurons of the body of the person 30 by identifying parameters of training data among the plurality of training data, the training data corresponding to the muscle movements of the body of the person 30 identified by analyzing the authentication video.

[0073] The enrollment data storage unit 128 may store a plurality of enrollment data by grouping the features of the body parts of the person 30. The authentication unit 132 may identify a group corresponding to the features of the body parts of the person 30 identified by analyzing the authentication video, and authenticate the person 30 by comparing the motor neurons of the plurality of enrollment data belonging to the identified group stored in the enrollment data storage unit 128 with the motor neurons of the body of the person 30 estimated based on the muscle movements of the body of the person 30 identified by analyzing the authentication video.

[0074] The authentication unit 132 may analyze the authentication video to identify a group corresponding to the gender of the person 30 identified, and authenticate the person 30 by comparing the motor neurons of the multiple registration data belonging to the identified group stored in the registration data storage unit 128 with the motor neurons of the body of the person 30 estimated based on the muscle movements of the body of the person 30 identified by analyzing the authentication video. The authentication unit 132 may analyze the authentication video to identify a group corresponding to the age of the person 30 identified, and authenticate the person 30 by comparing the motor neurons of the multiple registration data belonging to the identified group stored in the registration data storage unit 128 with the motor neurons of the body of the person 30 estimated based on the muscle movements of the body of the person 30 identified by analyzing the authentication video.

[0075] 6 shows an example of a processing flow of the authentication device 100. Here, an example of a processing flow is shown for authenticating the person 30 based on the movement of the muscles in the face of the person 30 and determining whether or not to accept the person 30.

[0076] In step (sometimes abbreviated to S) 102, authentication video acquisition unit 130 acquires authentication video of person 30 for authentication purposes. In S104, authentication unit 132 analyzes the authentication video to extract characteristics of person 30 and identify a group that matches the characteristics of person 30. In S106, authentication unit 132 narrows down the multiple enrollment data stored in enrollment data storage unit 128 to those belonging to the group identified in S104.

[0077] In S108, the authentication unit 132 estimates the facial motor neurons of the person 30 based on the movement of the facial muscles of the person 30 identified by analyzing the authentication video acquired by the authentication video acquisition unit 130 in S102. In S110, the authentication unit 132 authenticates the person 30 by comparing the motor neurons estimated in S108 with the motor neurons of the multiple registered data narrowed down in S106.

[0078] If the authentication is successful (YES in S112), proceed to S114, and if the authentication is not successful, proceed to S116. In S114, the authentication unit 132 outputs an authentication result that accepts the person 30. In S116, the authentication unit 132 outputs an authentication result that rejects the acceptance of the person 30. Then, the processing ends. Note that, although the case where the enrollment data is narrowed down in S104 and S106 has been described here, narrowing down the enrollment data is not necessary.

[0079] 7 shows an example of a processing flow of the authentication device 100. Here, an example of a processing flow is shown for authenticating the person 30 based on the facial muscle movements and the body muscle movements of the person 30, and determining whether or not to accept the person 30.

[0080] In S202, the authentication video acquisition unit 130 acquires an authentication video of the person 30 for authentication. In S204, the authentication unit 132 estimates the motor neurons of the body of the person 30 based on the muscle movements of the body of the person 30 identified by analyzing the authentication video. In S206, the authentication unit 132 narrows down the enrollment data by identifying multiple enrollment data corresponding to the motor neurons of the body of the person 30 estimated in S204 from the multiple enrollment data stored in the enrollment data storage unit 128.

[0081] In S208, the authentication unit 132 estimates the facial motor neurons of the person 30 based on the movement of the facial muscles of the person 30 identified by analyzing the authentication video acquired by the authentication video acquisition unit 130 in S202. In S210, the authentication unit 132 authenticates the person 30 by comparing the motor neurons estimated in S208 with the motor neurons of the multiple registered data narrowed down in S206.

[0082] If the authentication is successful (YES in S212), proceed to S214, and if the authentication is not successful, proceed to S216. In S214, the authentication unit 132 outputs an authentication result that accepts the person 30. In S216, the authentication unit 132 outputs an authentication result that rejects the acceptance of the person 30. Then, the process ends.

[0083] 8 shows an example of a processing flow of the authentication device 100. Here, an example of a processing flow is shown for authenticating the person 30 based on muscle movements of the body of the person 30 and determining whether or not to accept the person 30.

[0084] In S302, the authentication video acquisition unit 130 acquires an authentication video of the person 30 for authentication. In S304, the authentication unit 132 analyzes the authentication video to extract characteristics of the person 30 and identify a group that matches the characteristics of the person 30. In S306, the authentication unit 132 narrows down the multiple enrollment data stored in the enrollment data storage unit 128 to the multiple enrollment data that belong to the group identified in S304.

[0085] In S308, the authentication unit 132 estimates motor neurons of the body of the person 30 based on the muscle movements of the body of the person 30 identified by analyzing the authentication video acquired by the authentication video acquisition unit 130 in S102. In S310, the authentication unit 132 authenticates the person 30 by comparing the motor neurons estimated in S308 with the motor neurons of the multiple registered data narrowed down in S306.

[0086] If the authentication is successful (YES in S312), proceed to S314; if the authentication is not successful, proceed to S316. In S314, the authentication unit 132 outputs an authentication result that accepts the person 30. In S316, the authentication unit 132 outputs an authentication result that rejects the acceptance of the person 30. Then, the processing ends. Note that, although the case where the enrollment data is narrowed down in S304 and S306 has been described here, narrowing down the enrollment data is not necessary.

[0087] Fig. 9 illustrates an example of the system 10. In the system 10 illustrated in Fig. 9, distributed authentication processing in a mobile communication network is realized. The authentication devices 100 may be distributed and deployed in a MEC (Multi-access Edge Computing). The authentication devices 100 arranged in the MEC may perform authentication on a video captured by a camera 200 within an area corresponding to the MEC.

[0088] The system 10 may include an authentication device 100 arranged in each of the multiple MECs and an authentication device 100 connected to the network 20. In the example shown in Fig. 9, the authentication device 100 arranged in the MEC may be called a distributed authentication device, and the authentication device 100 connected to the network 20 may be called a management authentication device.

[0089] The management authentication device manages data used for authentication, such as registration data, and provides the data to the distributed authentication device as needed. The distributed authentication device executes authentication using the data acquired from the management authentication device.

[0090] The management authentication device may use information on the GC 26 that detected the radio waves. In the system 10, the data is cached in the location (GC 26) that is closest to the DC that caught the radio waves in the mobile communication network. That is, when using (authentication), the data is temporarily cached in the location (GC 26) that is closest.

[0091] When radio waves are received in the mobile communication network, the management authentication device may extract data corresponding to the owner of the user terminal that emitted the radio waves from the registered data storage unit 128 and transmit the data to the GC 26 that is closest to the DC that received the radio waves. If the cached data is not used, it may be cleared after a predetermined time has elapsed.

[0092] According to the system 10, since the location information managed in the mobile communication network is used, the area to which the data should be transmitted can be specified without using a GPS or the like.

[0093] The management authentication device may transmit data to which searchable encryption has been applied to the GC 26. Searchable encryption is encryption that allows data to be searched while it remains encrypted. In the case where data is decrypted every time data is searched in the distributed authentication device, the risk of leakage is high. If decrypted data exists in the distributed authentication device, even if only temporarily, it will be possible to know what is being searched for when data is leaked. In particular, when an image of a person 30 is used, the possibility of the image of the person 30 being leaked cannot be denied. If registration is not performed smoothly due to such concerns, there is a risk of causing problems in the operation of the authentication system. In response to this, the management authentication device transmits data to which searchable encryption has been applied to the GC 26, so that authentication processing can be performed without decryption, and even if data is leaked, it is possible to make it unknown what is being searched for, thereby reducing the risk of leakage.

[0094] The management authentication device does not need to have an authentication function. That is, the management authentication device does not need to have the authentication video acquisition unit 130 and the authentication unit 132.

[0095] The distributed authentication device does not need to have a registration function. That is, the distributed authentication device does not need to have the training data storage unit 102, the facial expression data acquisition unit 104, the body data acquisition unit 106, the registration video acquisition unit 110, and the registration processing unit 120.

[0096] 10 is a schematic diagram showing an example of a hardware configuration of a computer 1200 functioning as the authentication device 100. A program installed on the computer 1200 can cause the computer 1200 to function as one or more "parts" of the device according to the present embodiment, or cause the computer 1200 to execute operations or one or more "parts" associated with the device according to the present embodiment, and / or cause the computer 1200 to execute a process or steps of the process according to the present embodiment. Such a program can be executed by the CPU 1212 to cause the computer 1200 to execute specific operations associated with some or all of the blocks of the flowcharts and block diagrams described herein.

[0097] The computer 1200 according to this embodiment includes a CPU 1212, a RAM 1214, and a graphics controller 1216, which are connected to each other by a host controller 1210. The computer 1200 also includes input / output units such as a communication interface 1222, a storage device 1224, a DVD drive, and an IC card drive, which are connected to the host controller 1210 via an input / output controller 1220. The DVD drive may be a DVD-ROM drive, a DVD-RAM drive, etc. The storage device 1224 may be a hard disk drive, a solid state drive, etc. The computer 1200 also includes a legacy input / output unit such as a ROM 1230 and a keyboard, which are connected to the input / output controller 1220 via an input / output chip 1240.

[0098] The CPU 1212 operates according to a program stored in the ROM 1230 and the RAM 1214, thereby controlling each unit. The graphic controller 1216 acquires image data generated by the CPU 1212 into a frame buffer or the like provided in the RAM 1214 or into itself, and causes the image data to be displayed on the display device 1218.

[0099] The communication interface 1222 communicates with other electronic devices via a network. The storage device 1224 stores programs and data used by the CPU 1212 in the computer 1200. The DVD drive reads programs or data from a DVD-ROM or the like and provides them to the storage device 1224. The IC card drive reads programs and data from an IC card and / or writes programs and data to an IC card.

[0100] The ROM 1230 stores therein a boot program or the like that is executed by the computer 1200 upon activation, and / or a program that depends on the hardware of the computer 1200. The input / output chip 1240 may also connect various input / output units to the input / output controller 1220 via a USB port, a parallel port, a serial port, a keyboard port, a mouse port, and the like.

[0101] The programs are provided by a computer-readable storage medium such as a DVD-ROM or an IC card. The programs are read from the computer-readable storage medium, installed in the storage device 1224, the RAM 1214, or the ROM 1230, which are also examples of computer-readable storage media, and executed by the CPU 1212. Information processing described in these programs is read by the computer 1200, and brings about cooperation between the programs and the various types of hardware resources described above. An apparatus or method may be constructed by implementing operations or processing of information according to the use of the computer 1200.

[0102] For example, when communication is performed between the computer 1200 and an external device, the CPU 1212 may execute a communication program loaded in the RAM 1214 and instruct the communication interface 1222 to perform communication processing based on the processing described in the communication program. Under the control of the CPU 1212, the communication interface 1222 reads transmission data stored in a transmission buffer area provided in the RAM 1214, the storage device 1224, a DVD-ROM, or a recording medium such as an IC card, and transmits the read transmission data to the network, or writes reception data received from the network to a reception buffer area or the like provided on the recording medium.

[0103] Furthermore, the CPU 1212 may cause all or a necessary portion of a file or database stored in an external recording medium such as the storage device 1224, a DVD drive (DVD-ROM), an IC card, etc. to be read into the RAM 1214, and perform various types of processing on the data on the RAM 1214. The CPU 1212 may then write back the processed data to the external recording medium.

[0104] Various types of information, such as various types of programs, data, tables, and databases, may be stored in the recording medium and undergo information processing. The CPU 1212 may perform various types of processing on the data read from the RAM 1214, including various types of operations, information processing, conditional judgment, conditional branching, unconditional branching, information search / replacement, etc., as described throughout this disclosure and specified by the instruction sequence of the program, and write back the results to the RAM 1214. The CPU 1212 may also search for information in a file, database, etc. in the recording medium. For example, when a plurality of entries each having an attribute value of a first attribute associated with an attribute value of a second attribute are stored in the recording medium, the CPU 1212 may search for an entry whose attribute value of the first attribute matches a specified condition from among the plurality of entries, read the attribute value of the second attribute stored in the entry, and thereby obtain the attribute value of the second attribute associated with the first attribute that satisfies a predetermined condition.

[0105] The above-described programs or software modules may be stored in a computer-readable storage medium on the computer 1200 or in the vicinity of the computer 1200. In addition, a recording medium such as a hard disk or a RAM provided in a server system connected to a dedicated communication network or the Internet can be used as a computer-readable storage medium, thereby providing the programs to the computer 1200 via the network.

[0106] The blocks in the flowcharts and block diagrams in the present embodiment may represent stages of a process in which an operation is performed or "parts" of an apparatus responsible for performing the operation. Particular stages and "parts" may be implemented by dedicated circuitry, programmable circuitry provided with computer-readable instructions stored on a computer-readable storage medium, and / or a processor provided with computer-readable instructions stored on a computer-readable storage medium. The dedicated circuitry may include digital and / or analog hardware circuits, and may include integrated circuits (ICs) and / or discrete circuits. The programmable circuitry may include reconfigurable hardware circuits, such as, for example, field programmable gate arrays (FPGAs), programmable logic arrays (PLAs), and the like, including AND, OR, XOR, NAND, NOR, and other logical operations, flip-flops, registers, and memory elements.

[0107] A computer-readable storage medium may include any tangible device capable of storing instructions that are executed by a suitable device, such that a computer-readable storage medium having instructions stored thereon comprises an article of manufacture that includes instructions that can be executed to create means for performing the operations specified in the flowcharts or block diagrams. Examples of computer-readable storage media may include electronic storage media, magnetic storage media, optical storage media, electromagnetic storage media, semiconductor storage media, and the like. More specific examples of computer-readable storage media may include floppy disks, diskettes, hard disks, random access memories (RAMs), read-only memories (ROMs), erasable programmable read-only memories (EPROMs or flash memories), electrically erasable programmable read-only memories (EEPROMs), static random access memories (SRAMs), compact disk read-only memories (CD-ROMs), digital versatile disks (DVDs), Blu-ray disks, memory sticks, integrated circuit cards, and the like.

[0108] The computer readable instructions may include either assembler instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or source or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk®, JAVA®, C++, etc., and conventional procedural programming languages ​​such as the “C” programming language or similar programming languages.

[0109] Computer readable instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, or to a programmable circuit, either locally or over a local area network (LAN), a wide area network (WAN), such as the Internet, etc., to cause the processor of the general purpose computer, special purpose computer, or other programmable data processing apparatus, or to a programmable circuit, to execute the computer readable instructions to generate means for performing the operations specified in the flowcharts or block diagrams. Examples of processors include computer processors, processing units, microprocessors, digital signal processors, controllers, microcontrollers, etc.

[0110] Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. It is clear to those skilled in the art that various modifications and improvements can be made to the above embodiments. It is clear from the description of the claims that such modifications and improvements can also be included in the technical scope of the present invention.

[0111] It should be noted that the order of execution of each process, such as operations, procedures, steps, and stages, in the devices, systems, programs, and methods shown in the claims, specifications, and drawings is not specifically stated as "before" or "prior to," and that the process may be performed in any order unless the output of a previous process is used in a later process. Even if the operational flow in the claims, specifications, and drawings is described using "first," "next," etc. for convenience, it does not mean that the process must be performed in this order.

[0112] Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. It is clear to those skilled in the art that various modifications and improvements can be made to the above embodiments. It is clear from the description of the claims that such modifications and improvements can also be included in the technical scope of the present invention.

[0113] It should be noted that the order of execution of each process, such as operations, procedures, steps, and stages, in the devices, systems, programs, and methods shown in the claims, specifications, and drawings is not specifically stated as "before" or "prior to," and that the process may be performed in any order unless the output of a previous process is used in a later process. Even if the operational flow in the claims, specifications, and drawings is described using "first," "next," etc. for convenience, it does not mean that the process must be performed in this order. [Explanation of symbols]

[0114] 10 system, 20 network, 26 GC, 30 person, 100 authentication device, 102 training data storage unit, 104 facial expression data acquisition unit, 106 body data acquisition unit, 110 registration video acquisition unit, 120 registration processing unit, 122 feature data generation unit, 124 registration estimation unit, 126 movement data generation unit, 128 registration data storage unit, 130 authentication video acquisition unit, 132 authentication unit, 140 instruction information output unit, 200 camera, 310 feature amount, 320 feature amount, 330 authentication network, 1200 computer, 1210 host controller, 1212 CPU, 1214 RAM, 1216 graphics controller, 1218 display device, 1220 input / output controller, 1222 communication interface, 1224 storage device, 1230 ROM, 1240 input / output chip

Claims

1. an authentication video acquisition unit that acquires an authentication video of a person for authentication; an authentication unit that estimates facial motor neurons of the person based on the movement of the facial muscles of the person identified by analyzing the authentication video, and authenticates the person using the estimated motor neurons; An authentication device comprising:

2. an enrollment data storage unit for storing enrollment data for a plurality of persons, the enrollment data including facial motor neurons of the persons and personal identification information for identifying the persons; Further equipped with The authentication device according to claim 1 , wherein the authentication unit authenticates the person by comparing the estimated motor neurons with a plurality of motor neurons of the enrollment data stored in the enrollment data storage unit.

3. a registration video acquisition unit that acquires a registration video of a person for registration; a registration estimation unit that estimates the facial motor neurons of the person based on the movement of the facial muscles of the person identified by analyzing the registration video; Further equipped with The authentication device according to claim 2 , wherein the enrollment data storage unit stores the enrollment data for the plurality of persons, the enrollment data including the motor neurons estimated by the enrollment estimation unit and personal identification information capable of identifying the persons.

4. an expression data acquisition unit that acquires expression data corresponding to each of a plurality of parameters by inputting a plurality of parameters to a simulator that generates expression data showing a movement of a person's facial expression by simulating the movement of the muscles in the person's face in accordance with input of parameters related to motor neurons; a training data storage unit that stores training data including the facial expression data acquired by the facial expression data acquisition unit and parameters corresponding to the facial expression data; Further equipped with The authentication device according to claim 3 , wherein the enrollment estimation unit estimates the facial motor neurons of the person based on a plurality of the training data stored in the training data storage unit.

5. The authentication device of claim 4, wherein the registration estimation unit estimates the facial motor neurons of the person by identifying the parameters of training data among the multiple training data, the parameters of which correspond to the facial muscle movements of the person identified by analyzing the registration video, among the multiple training data.

6. The authentication device according to claim 4 , wherein the authentication unit estimates motor neurons in the face of the person based on a plurality of the training data stored in the training data storage unit.

7. the registration data storage unit stores the plurality of registration data by grouping the plurality of registration data according to the characteristics of the facial parts of a person; An authentication device as described in any one of claims 3 to 6, wherein the authentication unit identifies a group corresponding to the characteristics of the facial parts of the person identified by analyzing the authentication video acquired by the authentication video acquisition unit, and authenticates the person by comparing the motor neurons of multiple registration data belonging to the identified group stored in the registration data storage unit with the facial motor neurons of the person estimated based on the movement of the facial muscles of the person identified by analyzing the authentication video.

8. the registration data storage unit stores the plurality of registration data by grouping the plurality of registration data according to facial fat characteristics of a person; An authentication device as described in any one of claims 3 to 6, wherein the authentication unit identifies a group corresponding to the facial fat distribution characteristics of the person identified by analyzing the authentication video acquired by the authentication video acquisition unit, and authenticates the person by comparing motor neurons of multiple registration data corresponding to the identified group stored in the registration data storage unit with the facial motor neurons of the person estimated based on the movement of the facial muscles of the person identified by analyzing the authentication video.

9. the registration data storage unit stores the plurality of registration data by grouping the persons according to their gender; An authentication device as described in any one of claims 3 to 6, wherein the authentication unit analyzes the authentication video acquired by the authentication video acquisition unit to identify a group corresponding to the gender of the identified person, and authenticates the person by comparing motor neurons of multiple registration data corresponding to the identified group stored in the registration data storage unit with the facial motor neurons of the person estimated based on the movement of the facial muscles of the person identified by analyzing the authentication video.

10. the registration data storage unit stores the plurality of registration data by grouping the persons according to their ages; An authentication device as described in any one of claims 3 to 6, wherein the authentication unit analyzes the authentication video acquired by the authentication video acquisition unit to identify a group corresponding to the age of the identified person, and authenticates the person by comparing motor neurons of multiple registration data corresponding to the identified group stored in the registration data storage unit with the facial motor neurons of the person estimated based on the movement of the facial muscles of the person identified by analyzing the authentication video.

11. an instruction information output unit that outputs instruction information for instructing the person to perform a predetermined action; Further equipped with the registration video acquisition unit acquires the registration video capturing an image of a face of the person after the instruction information output unit outputs the instruction information; The authentication device according to claim 3 , wherein the authentication video acquisition unit acquires the authentication video capturing an image of the face of the person after the instruction information output unit outputs the instruction information.

12. the authentication video acquisition unit acquires the authentication video capturing an image of the person walking; The authentication device according to claim 3 , wherein the authentication unit authenticates the person based on the muscle movements of the person's body and the muscle movements of the person's face identified by analyzing the authentication video.

13. the registration estimation unit estimates motor neurons of the person's body based on muscle movements of the person's body identified by analyzing the registration video; the enrollment data storage unit stores the enrollment data including the face motor neurons and the body motor neurons of the person estimated by the enrollment estimation unit, and personal identification information capable of identifying the person; The authentication unit estimates the facial motor neurons and body motor neurons of the person based on the facial muscle movements and body muscle movements of the person identified by analyzing the authentication video acquired by the authentication video acquisition unit, and authenticates the person by comparing the estimated facial motor neurons and body motor neurons with the facial motor neurons and body motor neurons of multiple registration data stored in the registration data storage unit.

14. The authentication unit identifies a plurality of enrollment data corresponding to the estimated body motor neurons of the person from the plurality of enrollment data stored in the enrollment data storage unit, and authenticates the person by comparing the estimated facial motor neurons of the person with the facial motor neurons of the identified plurality of enrollment data.

15. an authentication video acquisition unit that acquires an authentication video of a person walking for authentication; an authentication unit that estimates motor neurons of the person's body based on muscle movements of the person identified by analyzing the authentication video, and authenticates the person using the estimated motor neurons; An authentication device comprising:

16. a registration data storage unit for storing registration data for a plurality of persons, the registration data including motor neurons of the body of the person and personal identification information capable of identifying the person; Further equipped with The authentication device according to claim 15 , wherein the authentication unit authenticates the person by comparing the estimated motor neurons with motor neurons of a plurality of the enrollment data stored in the enrollment data storage unit.

17. a registration video acquisition unit that acquires a registration video of a person walking for registration; a registration estimation unit that estimates motor neurons of the person's body based on muscle movements of the person's body identified by analyzing the registration video; Further equipped with The authentication device according to claim 16 , wherein the enrollment data storage unit stores the enrollment data for the plurality of persons, the enrollment data including the motor neurons estimated by the enrollment estimation unit and personal identification information capable of identifying the persons.

18. A program for causing a computer to function as the authentication device according to any one of claims 1 to 17.

19. 1. A computer implemented authentication method comprising: An authentication video acquisition stage for acquiring an authentication video of a person for authentication; an authentication step of estimating facial motor neurons of a person based on the movement of the facial muscles of the person identified by analyzing the authentication video, and authenticating the person using the estimated motor neurons; An authentication method comprising:

20. 1. A computer implemented authentication method comprising: An authentication video acquisition stage for acquiring an authentication video of a walking person for authentication; an authentication step of estimating motor neurons of the person's body based on muscle movements of the person identified by analyzing the authentication video, and authenticating the person using the estimated motor neurons; An authentication method comprising:

Images