Vehicle-mounted facial image matching device, facial image matching system, facial image matching method, and facial image matching program

Abstract

To provide an on-vehicle face image collation apparatus, a face image collation method, and a face image collation program that collate a face image in a wide range.SOLUTION: In a face image collation system including a drive recorder, a server apparatus, and a command terminal apparatus, an on-vehicle face image collation apparatus 30 of the drive recorder 1 includes an imaging unit 21, a management unit 32c as an object information acquisition unit, a face image detection unit 32a, and a face image collation unit 32b. The imaging unit 21 photographs a video. The management unit 32c acquires object face image information relating to a face image of a collation object. The face image detection unit 32a detects a face image from the video photographed by the imaging unit 21. The face image collation unit 32b collates the face image detected by the face image detection unit 32a with the object face image information acquired by the management unit 32c. When the collation results do not match a predetermined number of times, the management unit 32c transmits a face image information request that externally requests the object face image information relating to a new face image formed by shaping the face image to be collated.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to an in-vehicle facial image matching device, a facial image matching system, and a facial image matching method. The present invention relates to a matching method and a face image matching program. [Background technology]

[0002] In recent years, surveillance cameras have been installed inside and outside stores, etc., and the images captured by these cameras have become Systems have been developed that record continuously and monitor conditions at the site being monitored.

[0003] For example, in Patent Document 1, multiple cameras are installed from the entrance to the exit of a surveillance area. This face image tracking system is a system for tracking a face image by using a plurality of cameras installed in the camera. The facial image is sent from the computer to the camera, and the facial image is extracted from the images captured by each camera. When a face is matched by face recognition, each camera outputs the face image, camera number, and The face image is then sent to the computer along with the time of the photograph. The computer then chronologically decodes the received face images. Display on a display device. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2007-158421 A Summary of the Invention [Problem to be solved by the invention]

[0005] The conventional face image tracking system described in Patent Document 1 is set up from the entrance to the exit of the surveillance area. The system tracks facial images using multiple cameras placed in the vicinity of the camera, but the tracking range is fixed. In addition, when tracking the facial images of a specific person, If a person's appearance changes due to plastic surgery, the facial recognition will be performed using the facial images extracted by each camera. It will no longer be possible to compare the data.

[0006] The present invention has been made in view of the above circumstances, and its object is to provide a wide range of In-vehicle facial image matching device capable of matching facial images by The present invention aims to provide a method and a program for matching face images. [Means for solving the problem]

[0007] The vehicle-mounted facial image matching device according to one embodiment of the present invention includes an imaging unit that captures an image and a facial image of a target to be matched. a target information acquisition unit for acquiring target face image information relating to the image captured by the imaging unit; a face image detection unit that detects a face image from a video; and a face image detected by the face image detection unit. a face image matching unit that matches the target face image information acquired by the target information acquisition unit; The target information acquisition unit acquires a target face information relating to a new face image obtained by shaping the face image to be matched. The method is characterized in that image information is further acquired.

[0008] Another aspect of the present invention is a face image matching system. and a server for transmitting the target face image information to the vehicle-mounted face image matching device. and a server device.

[0009] Another aspect of the present invention is a face image matching method. and a target information acquisition step for acquiring target face image information related to a face image to be matched. a face image detection step for detecting a face image from the image captured by the imaging step; a face image detected by the face image detection step and the target information acquisition step and a face image matching step of matching the target face image information obtained by The image information acquisition step acquires target face image information regarding a new face image obtained by shaping the face image to be matched. The present invention is characterized in that it further acquires information regarding the Effect of the Invention

[0010] According to the present invention, face images can be collated over a wide range. [Brief description of the drawings]

[0011] [Figure 1] 2 is a schematic diagram for explaining a communication connection in the face image matching system according to the embodiment. FIG. [Diagram 2] 1 is a block diagram showing a configuration of a drive recorder including an in-vehicle face image matching device. [Diagram 3] FIG. 2 is a block diagram showing a configuration of a server device. [Figure 4] FIG. 2 is a block diagram showing a configuration of a command terminal device. [Diagram 5] 10 is a flowchart showing a procedure of a face image matching process in the drive recorder. [Figure 6] FIG. 11 is a sequence diagram of the face image matching system when matching is achieved. [Figure 7] FIG. 11 is a sequence diagram of the face image matching system when matching does not result in a match. [Figure 8] 11 is a flowchart showing a procedure for virtual shaping processing of a face image in the virtual shaping system. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] The present invention will be described below based on a preferred embodiment with reference to FIGS. The same or equivalent components and parts shown on the front page will be given the same reference numerals, and In addition, the drawings may be omitted for the purpose of explaining the embodiments. Some of the components are omitted in the illustration. (Embodiment) FIG. 1 is a diagram illustrating a communication connection in a face image matching system 100 according to an embodiment. The facial image matching system 100 includes an in-vehicle facial image matching device 3 mounted on a vehicle 6. The drive recorder 1 includes a drive recorder 2 including a drive recorder 3, a server device 7, and a command terminal device 8. The live recorder 1 captures images of the outside of the vehicle, such as the front of the vehicle 6, continuously over time, and records the images. The drive recorder 1 stores the captured video in a storage medium, but the capacity of the storage medium is limited. Therefore, after saving multiple video files for a certain period of time, it is recommended to start over from the old video files. The old footage is overwritten in sequence to record new footage.

[0013] The drive recorder 1 communicates with a server device 7 via a communication network 9. The device 7 stores target face image information related to a face image to be matched in the drive recorder 1. The information is distributed to a plurality of vehicles 6, and furthermore, target face image information regarding a new shaped face image is generated. The command terminal device 8 is, for example, a personal computer. It communicates with the server device 7 via the communication network 9 .

[0014] The command terminal device 8 transmits target face image information to the server device 7 and controls the start and end of tracking. After that, the server device 7 manages the distribution of the new target face image after the retouching. The present invention provides an input environment for an operator to generate target face image information related to a desired face image. In the embodiment, the drive recorder 1 has a function of capturing an image of the outside of the vehicle 6. The vehicle-mounted face image matching device 30 is configured as a part of the drive recorder 1, but It may also be configured as a separate device without a recording function.

[0015] FIG. 2 is a block diagram showing the configuration of a drive recorder 1 including an in-vehicle face image matching device 30. The drive recorder 1 includes a recorder control unit 10, a video recording unit 20, an imaging unit 21, and a vehicle The driving recorder 1 includes an imaging unit that captures images of the outside of the vehicle 6. The image processing unit 31 basically includes an image pickup unit 21 and an image processing unit 31 that processes the image captured by the image pickup unit 21. do.

[0016] The recorder control unit 10 is configured by, for example, a CPU (Central Processing Unit) etc. The recorder control unit 10 controls the image capture unit 21 to operate according to the computer program. The recorder control unit 10 instructs the camera 10 to record an image of the outside of the vehicle, such as the front of the vehicle. The processing unit 31 is instructed to perform frame processing on the captured image and record it in the image recording unit 20. The video recording unit 20 may record video using a removable medium such as an SD card or a USB memory. , a hard disk, etc., and records the image input from the image processing unit 31. Reference numeral 1 denotes a camera having a detector such as a CCD, and takes an image of the outside of a vehicle 6 .

[0017] The vehicle-mounted face image matching device 30 includes a video processing unit 31, a matching processing unit 32, a storage unit 33, and a communication The image processing unit 31 converts the image captured by the imaging unit 21 into a frame. The data is then subjected to processing such as data compression and output to the video recording unit 20 and the matching processing unit 32.

[0018] The storage unit 33 is a RAM (Random Access Memory), a flash memory, a hard disk, The collation processing unit 32 is configured by a data storage device such as a memory device. It stores computer programs and a recognition dictionary for recognizing face images from captured images. The communication unit 34 is connected to a communication network 9 such as the Internet via, for example, WiFi (registered trademark). ) or the like, and transmits and receives data and the like to and from the server device 7.

[0019] The matching processing unit 32 includes a face image detection unit 32a, a face image matching unit 32b, and a management unit 32c. The collation processing unit 32 is configured by, for example, a CPU and executes a computer program. However, even if it is configured with the same CPU as the recorder control unit 10, The face image detection unit 32a detects a face image by determining whether or not there is a face image in the video. If a face image is present, that portion is cut out and output to face image matching section 32b.

[0020] The face image detection unit 32a attempts to recognize a face image from the video using a dictionary for recognizing face images, etc. For example, a dictionary for recognizing face images includes face shape data, etc., and the face image detection unit 32 a extracts shape patterns appearing in the image and uses them to identify face images based on the data contained in the face image recognition dictionary. The face image detection unit 32a detects a face image by comparing the face image with the face image data. Using the well-known image recognition processing techniques that have been developed, it is possible to detect face images from video. Cut.

[0021] The face image matching unit 32b compares the face image cut out from the video by the face image detection unit 32a with the The facial image comparison unit 32b compares the facial image information acquired by the facial image comparison unit 32c with the target facial image information acquired by the facial image comparison unit 32b. Images may be compared, or feature points contained in face images may be compared. When comparing feature points, the face image detection unit 32a extracts a face image from a video. Detect feature points of the face image. The feature points of the face image include, for example, the size and position of each part of the face, The facial image matching unit 32b detects the facial image by matching. If it is determined that the face image input from the management unit 32a matches the target face image, the face image is sent to the management unit 32c. A matching result is output, and the matching face image is temporarily stored in the storage unit 33.

[0022] The management unit 32c receives a transmission signal from the server device 7 via the communication unit 34 and In addition, the management unit 32c acquires target face image information that is a matched face image within a predetermined time. If the face image is not obtained, the server device 7 is requested to transmit new target face image information via the communication unit 34. The management unit 32c transmits a face image information request. In addition, the management unit 32c receives a match from the face image matching unit 32b. When the matching result is input, the matching face image, the matching time, and The verification match information including the location information and the like is transmitted to the server device 7 via the communication unit 34. The management unit 32c corresponds to the target information acquisition unit in the present invention.

[0023] FIG. 3 is a block diagram showing the configuration of the server device 7. The server device 7 is a virtual shaping system. The server device 7 includes a command system 71, a management unit 72, a storage unit 73, and a communication unit 74. Based on the target face image information transmitted from the driver terminal device 8, the driver The virtual shaping system 71 starts cooperation by establishing a communication connection with the live recorder 1. A start command is received from a command terminal device 8 via a communication network 9 .

[0024] The storage unit 73 is a data storage device such as a RAM, a flash memory, or a hard disk storage device. The management unit 72 is configured with a computer program to be executed and a target face image. Image information, information transmitted from the drive recorder 1, and data used in the virtual shaping system 71 The communication unit 74 stores the information such as the number of users and the like by wireless communication such as WiFi (registered trademark) or wired communication. It is communicatively connected to the communication network 9.

[0025] The virtual cosmetic surgery system 71 performs virtual cosmetic surgery on the face image to be compared input from the management unit 72. The virtual shaping system 71 generates a new face image and feature points of the face image that have been shaped to the desired shape. For example, the regions of each part of a face image, such as the hairstyle, cheeks, chin, eyebrows, eyes, nose, and mouth, are extracted, and then A process for shaping a face image by transforming an area on the image, and a process for shaping the face image after the shaping The virtual shaping system 71 also executes a process of generating feature points of the command terminal device. 8 receives the transformation processing input of the face image input by the operator via the communication network 9. The virtual cosmetic surgery system 71 uses a known facial image processing system in the technical field of image editing, etc. Image shaping or transformation techniques can be used.

[0026] The management unit 72 is configured with, for example, a CPU and executes the following operations according to a computer program. The management unit 72 receives a transmission signal from the command terminal device 8 via the communication unit 74. Then, target face image information to be matched is acquired, and the target face image information is transmitted via the communication network 9. to the drive recorder 1. The management unit 72 also transmits the The face image information request and the matching information are transmitted to the command terminal device 8. 72, when a new face image is generated by shaping the face image to be matched, The target face image information including the face image is transmitted to the drive recorder 1 via the communication unit 74.

[0027] FIG. 4 is a block diagram showing the configuration of the command terminal device 8. The command terminal device 8 includes: The device includes a display unit 81, an operation input unit 82, a communication unit 83, a storage unit 84, and a processing unit 85. The display unit 81 is, for example, a liquid crystal monitor, and displays characters and symbols necessary for the operator to operate the device. The operation input unit 82 is, for example, a keyboard or a touch panel. and accepts input from the operator.

[0028] The communication unit 83 is a communication network that is connected to the communication device 100 via wireless communication such as WiFi (registered trademark) or wired communication. The storage unit 84 is connected to the network 9 for communication. The processing unit 85 is configured with a data storage device such as a The program, the face image to be compared, and the data transmitted from the drive recorder 1 and the server device 7 It stores information, data used when inputting virtual shaping operations, etc.

[0029] The processing unit 85 is configured with, for example, a CPU and executes the following steps according to a computer program. The processing unit 85 accepts a face image of a specific person as a target for matching, and The target face image information including the designation information to be described later is transmitted to the server device 7. The display unit 85 displays information on the drive recorder 1 being subjected to the verification process on the display unit 81. The information, such as the quantity, the current location, whether or not verification is in progress, etc., is displayed on the display unit 81, and the operator The data will be made aware of the matching status, etc.

[0030] When a face image information request is sent from the drive recorder 1, the processing unit 85 7, the virtual cosmetic surgery system 71 is started, and a processing screen for cosmetic surgery of the face image is displayed. The information input by the operator is displayed on the display unit 81, and the information input by the operator is received by the operation input unit 82. The unit 85 transmits information input by the operator regarding the shaping process to the server device 7 via the communication unit 83. The processing unit 85 transmits the verification match information transmitted by the drive recorder 1 to the communication unit 83. The processing unit 85 receives the target face image information included in the matching information via the The facial image, the verification date and time, the location information, etc. are stored in the memory unit 84 and displayed on the display unit 81. To make.

[0031] Next, the operation of the face image matching system will be described. 10 is a flowchart showing a procedure of face image matching processing in the drive recorder 1. The management unit 32c of the management unit 32 transfers target face image information including a face image of a specific person from the server device 7. The management unit 32c acquires the image data from the recorder control unit 10 and stores the image data in the storage unit 33 (S1). and causes the imaging unit 21 to capture an image of the outside of the vehicle (S2).

[0032] The face image detection unit 32a acquires the image from the image processing unit 31 for a certain period of time (S3), and The system attempts to detect and extract a face image using the command, and determines whether or not a face image is present (S4). The terminal device 8 detects the target face image information for a certain period of time during which the face image detection unit 32a acquires an image. It is also possible to include designation information for a predetermined number of times to be compared.

[0033] If it is determined in step S4 that there is no face image in the video ( If no face image is detected in the video in step S4, the process returns to step S3 and the process is repeated. If it is determined that the face image is to be detected (S4: YES), the face image matching unit 32b switches to the face image detection unit 32a. The extracted face image is compared with the target face image information (S5), and it is determined whether or not it matches the target face image. It is determined whether or not the

[0034] In step S6, if it is determined that the face image matches the face image to be compared (S6: YES Then, the management unit 32c transmits the verification match information to the server device 7 (S7), and the process ends. In step S6, if it is determined that the face image does not match the face image to be compared (S6: NO), It is determined whether the number of comparisons reaches the above-mentioned predetermined number (S8). If it is determined that the number of comparisons has not reached the predetermined number (S8: NO), the process returns to step S3. The process is repeated.

[0035] In step S8, if it is determined that the number of comparisons has reached a predetermined number (S8: YES ), the management unit 32c transmits a face image information request to the server device 7 (S9). obtains target face image information including the new face image that has been shaped from the server device 7, and stores the information in the storage unit 3 The command terminal device 8 stores the command in the command log file 8 (S10), and the process returns to step S5 to repeat the process. In step S8, the number of times of matching is determined to be one. In step S10, the process proceeds to step S9 unconditionally, and new face images to be compared are driven one after another. The recorder 1 may acquire the information.

[0036] The command to end this flow inputted through the operation input unit 82 of the command terminal device 8 is When the recorder 1 receives the signal, the flow of the face image matching process shown in FIG. 5 may be ended. stomach.

[0037] The vehicle-mounted face image matching device 30 receives a face image to be matched inputted to the command terminal device 8. and comparing the face image detected from the video captured by the imaging unit 21 with the face image to be compared. The vehicle-mounted face image matching device 30 is mounted on the vehicle 6 and is used for a wide range of purposes while the vehicle 6 is traveling. In addition, the vehicle 6 equipped with the vehicle-mounted face image matching device 30 can perform face image matching in a wide range. By increasing the number of, it is possible to match target face images with a wider range and higher density. .

[0038] The face image matching system 100 uses a server device 7 to store target face image information in a drive recorder. By transmitting the image to the vehicle 1, the vehicle-mounted face image matching devices 30 mounted on the multiple vehicles 6 simultaneously perform targeting. The facial image matching system 100 is equipped with an in-vehicle facial image matching device 30. If no matching face image is found for the face image to be matched, a new face image with retouching is created. By sending a new face image, matching is possible even if the target person has had cosmetic surgery. The matching system 100 matches a face image by a predetermined number of matches in the vehicle-mounted face image matching device 30. If the face image does not match, a new face image is sent to ensure that the face image being matched is correct. The system can be made to execute a predetermined number of comparisons.

[0039] FIG. 6 is a sequence diagram of the face image matching system 100 when a match is found by matching. In the command terminal device 8, an operator inputs a face image to be matched (S 21), and inputs the feature points of the face image (S22). Generate target face image information including the face image, feature points and designated information, and transmit it to the server device 7. The server device 7 stores the target face image information (S24). The signal is then transmitted to recorder 1 (S25).

[0040] The drive recorder 1 stores the target face image information (S26), captures the image outside the vehicle (S2 7), detects a face image and extracts that part (S28). The drive recorder 1 , the cut-out face image matches the target face image information transmitted from the command terminal device 8. If the result of the comparison shows a match, the drive recorder 1 The verification match information including the image, verification date and time, location information, etc. is generated (S30) and transmitted to the server device 7. The server device 7 stores the collation match information (S32) and executes the command. The command terminal device 8 transmits the face information included in the verification match information to the command terminal device 8 (S33). The image, the verification date and time, the location information, etc. are displayed on the display unit 81, and a verification operation is performed (S34). The person to be matched is identified through the process (S35).

[0041] FIG. 7 shows a sequence in the face image matching system 100 when matching fails. Steps S21 to S29 are the same as the sequence shown in FIG. Only step S29 is shown, and the description and explanation are omitted for the sake of brevity. The scanner 1 checks whether the cut-out face image matches the target face image information (S29). If not, a face image information request is generated (S41) and transmitted to the server device 7 (S42 The server device 7 stores the face image information request (S43) and The command terminal device 8 transmits the command to the virtual shaping system in the server device 7 (S44). The program is started and the formatting information is input (S45). The virtual shaping system 71 in the server device 7 is activated.

[0042] The command terminal device 8 transmits the shaping information to the server device 7 (S46). generates a new face image that has been shaped (S47), and stores the target face image information including the new face image. The face image information including the new face image is transmitted to the drive recorder 1 (S48). The drive recorder 1 performs steps S49 to S52 in the same manner as shown in FIG. The process is carried out in the same manner as in steps S26 to S29.

[0043] After that, the facial image cut out by the drive recorder 1 matches the target facial image information. In this case, the processes from step S30 to step S35 shown in FIG. In addition, when the face image cut out in the drive recorder 1 does not match the target face image information Then, the process starting from step S41 shown in FIG. 7 is repeated.

[0044] FIG. 8 is a flow chart showing the procedure of virtual shaping processing of a face image in the virtual shaping system 71. The input and designation for the shaping process in the virtual shaping system 71 are performed through the command terminal. The virtual shaping system 71 is a system for shaping the face of a person to be verified. A face image before virtual cosmetic surgery is input (S61). At this time, not only one face image but multiple face images may be input. After the face image is input, the virtual cosmetic surgery system 71 For example, the size and shape of the eyes, moles, hairstyle, etc. of the face image to be matched are A feature point that serves as a parameter to be specified is designated (S62).

[0045] Next, in the virtual plastic surgery system 71, the part to be plastic-surgery is designated (S63), and the new plastic-surgery face is generated. An image is generated (S64). In the specification of the shaping part, each part of the face is subjected to the specified shaping. In addition, it may be possible to specify shaping that takes into account aging over time. The flowchart shown in FIG. 1 illustrates an example of a virtual shaping process, and is based on known methods for face images. A virtual shaping technique can be used.

[0046] The face image matching system 100 performs the following operations based on the transmission of target face image information from the command terminal device 8. Based on the information, the server device 7 transmits target face image information to the drive recorder 1 to perform face image matching. By executing the process, the command terminal device 8 centrally manages a series of collation processes.

[0047] Since the face image matching process is managed by the command terminal device 8, On the coder 1 side, the matching process is automatically executed without the user being aware of the operating state. For example, the face image matching process, which is highly confidential, can be performed without displaying it on the drive recorder 1 side. It can be executed.

[0048] Next, the vehicle-mounted face image matching device 30, the face image matching system 100, and the face The features of the image matching method and the face image matching program will be described.

[0049] The vehicle-mounted face image matching device 30 according to the embodiment includes an image capturing unit 21, a management unit serving as a target information acquisition unit, and The imaging unit 21 includes, for example, a face image detecting unit 32a, a face image verifying unit 32b, and a face image verifying unit 32c. For example, the image management unit 32c is installed in the vehicle 6 and captures an image of the outside of the vehicle. The face image detection unit 32a obtains target face image information. The face image matching unit 32b detects a face image from the face detected by the face image detection unit 32a. The image is compared with the target face image information acquired by the management unit 32c. The image matching device 30 can match face images over a wide range while the vehicle 6 is traveling.

[0050] The management unit 32c also stores target face image information on a new face image obtained by shaping the face image to be matched. This allows the vehicle-mounted face image matching device 30 to determine whether the target person has had cosmetic surgery. , matching is possible even when no matching image is found.

[0051] In addition, the management unit 32c is configured to detect whether the face image matching unit 32b has a mismatch after a predetermined number of tries. Then, a face image information request is sent to the external server device 7 to request a new face image. The vehicle-mounted face image matching device 30 performs matching a predetermined number of times on the face image to be matched. It is possible to do so.

[0052] The facial image matching system 100 includes the above-mentioned vehicle-mounted facial image matching device 30 and a vehicle-mounted facial image matching device 30. The facial image matching system includes a server device 7 that transmits the facial image to the facial image matching device 30. The system 100 uses the vehicle-mounted face image matching devices 30 mounted on multiple vehicles 6 to simultaneously identify target persons. A match can be made.

[0053] The face image matching method includes an imaging step, a target information acquisition step, a face image detection step, and The method includes a face image matching step. The imaging step is, for example, capturing an image of the outside of the vehicle. The information acquisition step acquires target face image information related to the face image to be matched. The face image matching step detects a face image from the image captured by the imaging step. The face image detected by the face image detection step and the target information acquired by the target information acquisition step are The target information acquisition step includes shaping the face image to be matched and comparing it with the target face image information. According to this face image matching method, target face image information regarding the new face image is further obtained. In this way, facial image matching can be performed over a wide area while the vehicle 6 is traveling. According to this method, matching is possible even if the target person has had plastic surgery and no matching image can be found. It becomes possible.

[0054] The face image matching program includes an imaging step, a target information acquisition step, and a face image detection step. The image capturing step is performed by, for example, capturing an image of the outside of a vehicle. The target information acquisition step acquires target face image information related to the face image to be matched. The face image detection step obtains a face image from the video captured by the imaging step. The face image matching step is a step of detecting the face image detected by the face image detection step and comparing the face image with the target information. The target face image information acquired by the information acquisition step is compared with the target face image information acquired by the information acquisition step. Further, target face image information regarding a new face image obtained by shaping the face image to be matched is obtained. According to the facial image matching program, facial images can be matched over a wide area by driving the vehicle 6. In addition, this facial image matching program can detect if the target person has had cosmetic surgery and matched. This makes it possible to perform matching even when a matching image cannot be found.

[0055] The above describes the embodiments of the present invention. It is understood that various modifications and variations are possible within the scope of the invention, and that such modifications and variations are within the scope of the invention. It will be understood by those skilled in the art that such modifications and variations are within the scope of the present invention. The descriptions and drawings herein should be treated as illustrative rather than restrictive. [Explanation of symbols]

[0056] 21 imaging unit, 30 in-vehicle face image matching device, 32a face image detection unit, 32b face image matching unit, 32c management unit (target information acquisition unit), 6 vehicle, 7 server device, 100 facial image matching system.

Claims

1. a face image matching unit for matching a predetermined face image with target face image information relating to a face image to be matched; a target information acquisition unit that transmits a face image information request for requesting target face image information on a new face image obtained by shaping the face image to be matched to an external source when the matching result does not match a predetermined number of times; Equipped with The target information acquisition unit of the face image matching device further acquires target face image information about a new face image obtained by shaping the face image of the matching target.

2. a face image matching step of matching a predetermined face image with target face image information related to a face image to be matched; a target information acquisition step of transmitting a face image information request for requesting target face image information relating to a new face image obtained by shaping the face image to be compared to an external source when the matching result does not match a predetermined number of times; Including, The face image matching method further includes acquiring target face image information about a new face image obtained by shaping the face image of the matching target in the target information acquiring step.

3. a face image matching step of matching a predetermined face image with target face image information related to a face image to be matched; a target information acquisition step of transmitting a face image information request for requesting target face image information relating to a new face image obtained by shaping the face image to be compared to an external source when the matching result does not match a predetermined number of times; Run the following on your computer: The face image matching program further includes a step of acquiring target face image information about a new face image obtained by shaping the face image to be matched.

Images