Age estimation system and age estimation method

Abstract

To provide an age estimation system and an age estimation method with high efficiency and high reliability.SOLUTION: An age estimation system 500 consists of a customer terminal 100, a service company terminal 200, and a server 300. The customer terminal 100 photographs a picture of an identification document 115 and a picture of the face of a customer 110. The server 300 extracts the picture of the face on a certificate and the date of birth from the picture of the identification document 115, determines if the picture of the identification document 115 and the picture of the face of the customer 110 show the same person, when determining that the pictures show the same person, estimates the age of the customer 110 from the picture of the face of the customer 110, compares the estimated age of the customer 110 with the age calculated from the date of birth, and when the difference between the ages is less than a predetermined value, estimates the age calculated from the date of birth as the age of the customer 110.SELECTED DRAWING: Figure 5

Description

Technical Field

[0001] The present invention relates to an age estimation system and an age estimation method performed using a photo of an identity document and a customer's face photo.

Background Art

[0002] Conventionally, research and development have been conducted on systems and methods for estimating age using face authentication and the like. For example, Patent Document 1 (Japanese Patent Application Laid-Open No. 2009-230751) discloses an age estimation device for improving the convenience of a user who uses age estimation results.

[0003] In the age estimation device described in Patent Document 1, means for detecting a face from an image, means for estimating the age of the detected face, means for calculating an allowable range representing an error of the estimated age, and the estimated age and the allowable range are Output in the form of X±Y (X: estimated age [years], ±Y: allowable range [years]) And output means for outputting in this form.

[0004] Also, Patent Document 2 (Japanese Patent Application Laid-Open No. 2015-153377) discloses a product sales data processing device and a program capable of determining an accurate age group of a customer.

[0005] The product sales data processing device described in Patent Document 2 includes a customer display unit that displays information to a customer, a key for declaring the execution of processing for calculating the total amount or change amount related to a product transaction and displaying the total amount or change amount on the customer display unit, customer imaging means for causing an imaging unit provided at a position for imaging a face image of the customer substantially facing the customer display unit to image when the customer display unit displays the total amount or change amount, age group determination means for comparing a face image extracted from an image captured by the imaging unit with face image data showing characteristics by age group stored in advance and determining the age group of the customer, and association means for associating the determined age group with product information of the product traded according to the operation of the key.

[0006] Patent Document 3 (Reprint No. 2016 / 199397) discloses a sales support method and a sales support system that can reduce the effort required to deal with age misrepresentation in the sale of age-restricted products.

[0007] The sales support method described in Patent Document 3 is a sales support method for supporting the sale of age-restricted products, wherein input information indicating whether a customer is above or below a predetermined age, obtained by the customer inputting into an input device, is acquired from the input device, age estimation information indicating the customer's age estimated using biometric information obtained by observing the customer, and if the input information indicates that the customer is above the predetermined age, a determination is made based on the age estimation information as to whether the customer is above the predetermined age, and the determination result is notified.

[0008] Furthermore, Patent Document 4 (Japanese Patent Publication No. 2010-079877) discloses an age authentication system that allows even those without special equipment to easily transmit image data of a driver's license or the like to a server in a way that protects personal information, and to obtain an electronic money ID with age verification.

[0009] The age authentication system described in Patent Document 4 is an age authentication system comprising a server and a plurality of terminal devices installed in a public space and connected to the server via a network, wherein each terminal device includes a scanner for capturing image data of a user's identification document, means for performing a concealment process on at least a portion of the captured image data of the identification document other than the date of birth, and means for transmitting the concealed image data to the server, and the server is characterized by including means for reading the date of birth from the image data of the user's identification document transmitted from each terminal device, means for determining whether the user meets a predetermined age condition based on the date of birth, means for storing a unique age authentication ID (=age authentication electronic money ID) in an age authentication ID storage means in association with the user's attribute information if the predetermined age condition is met, and means for transmitting the age authentication ID or a reference number associated therewith to the terminal device. [Prior art documents] [Patent Documents]

[0010] [Patent Document 1] Japanese Patent Publication No. 2009-230751 [Patent Document 2] Japanese Patent Publication No. 2015-153377 [Patent Document 3] Re-tabled publication 2016 / 199397 [Patent Document 4] Japanese Patent Publication No. 2010-079877 [Overview of the Initiative] [Problems that the invention aims to solve]

[0011] In recent years, it has become increasingly important to estimate an applicant's age online in situations where age verification is required, such as purchasing alcohol and tobacco at self-checkout counters in unmanned stores, selling age-restricted products like alcohol or tobacco online, and registering for online dating services.

[0012] The age estimation device described in Patent Document 1 obtains the age-specific distribution (for example, 20s, 30s, 40s, 50s) of features extracted from a large number of sample face images, and then applies the features of the face image detected from the input image to the age-specific distribution to determine the age of the input image. However, in this case, especially for those aged 20 and over, the acceptable range for estimated age tends to widen, making accurate age estimation difficult.

[0013] In the product sales data processing device described in Patent Document 2, the age group determination means stores attribute data (data representing the characteristics of parts such as a person's eyes, nose, mouth, ears, and chin, and / or facial deformation characteristics such as smiling, serious, eyes closed, and eyes open) for each gender and age group from teenagers (male) to those 70 years and older (female), and determines the age group of the customer by comparing the captured face image with the pre-stored face image data that shows the characteristics of each age group. However, even in this case, the accuracy of the age estimation is not sufficient.

[0014] In the sales support method described in Patent Document 3, when selling age-restricted products, the customer is asked to input their age, and if the input age is above a predetermined age, it is determined whether the customer is above the predetermined age based on age estimation information that indicates the customer's age estimated using biometric information. Patent Document 3 does not disclose a method for estimating a customer's age. However, the age entered by the customer may not be correct, and the age estimation information obtained using biometric data is not necessarily accurate, so the reliability of age estimation cannot be said to be sufficient.

[0015] The age authentication system described in Patent Document 4 reads the date of birth from the image data of the user's identification document and estimates the person's age from the date of birth on the identification document. In this case as well, when reading identification documents using multiple network-connected terminal devices, there are risks such as whether the identification document belongs to the person concerned and whether the identification document is forged.

[0016] The object of the present invention is to provide a highly efficient and reliable age estimation system and method based on a photograph of an identity verification document and a photograph of the customer's face entered from a customer terminal. [Means for solving the problem]

[0017] (1) The age estimation system, which follows a single phase, is an age estimation system consisting of a customer terminal, a service company terminal, and a server. The customer terminal includes a display / operation unit that displays operating instructions on the screen and a shooting unit that takes photos of identification documents and the customer's face. The service company terminal includes a registration unit that receives age estimation results from the server and registers the age estimation results. The server includes an extraction unit that extracts the face photograph from the identification document and extracts personal information including name and date of birth through character recognition processing, and a unit that determines whether the customer's face photograph and the face photograph on the document are of the same person. The system includes a facial photo recognition unit that determines whether the facial photo is of the same person, and an age estimation / comparison unit that, if the facial photo recognition unit determines that the facial photo is of the same person, estimates the customer's age from the facial photo and compares the estimated customer age with the age calculated from the date of birth. The age estimation / comparison unit estimates the age calculated from the date of birth as the customer's age if the age difference is less than a predetermined value. The system also determines that the facial photo recognition unit does not determine that the customer's facial photo and the facial photo on the ticket are of the same person, and that the age estimation / comparison unit determines that the age difference is greater than or equal to a predetermined value, in which case the customer's age cannot be estimated.

[0018] A one-step age estimation system is an age estimation system that determines age using a photograph from an identification document and a photograph of the customer's face. While age estimation systems widely employ methods that use customers' facial photographs to determine their age, this method is not sufficiently accurate. On the other hand, in face-to-face age estimation, it is possible to determine age by having the customer present identification documents such as a driver's license. However, when determining the age of a customer in a non-face-to-face setting, such as in online shopping, if the age is determined from the date of birth printed on the photo of the submitted identification document, there is a possibility that someone else's identification document has been submitted, or that the identification document has been forged. In the age estimation system of the present invention, a photo of the identity document and a photo of the customer's face are compared to confirm that the customer is the person of the identity document, the age of the customer is estimated from the photo of the customer's face, and the estimated age of the customer is compared with the age calculated from the date of birth to confirm the validity of the age calculated from the date of birth, thereby eliminating the risk of forgery of identity documents and enhancing the reliability of age estimation. The predetermined value of the age difference is, for example, 3 years.

[0019] (2) The age estimation system according to the second invention is an age estimation system according to an aspect, in which the display / operation unit prompts the customer to input application information including the date of birth, and the server further includes an application information matching determination unit. The application information matching determination unit determines whether the date of birth self-reported by the customer matches the date of birth extracted from the identity document. If they do not match, the age of the customer may be considered unestimable.

[0020] In this case, false self-reporting of the date of birth can be eliminated.

[0021] (3) The age estimation system according to the third invention is an age estimation system according to an aspect or the second invention. When the photographing unit takes a photo of the customer's face, after taking a photo facing the front, it instructs the customer to turn the face in one or more of the left, right, up, and down directions, and takes a photo or video of the customer's face in the state of turning the face in that direction. The face photo determination unit determines that the sent face photo or video is not a photo of the customer's own face if the orientation of the face in the face photo does not match the specified orientation, or if there are suspicious movements in the video, and the age of the customer may be considered unestimable.

[0022] In age estimation via a network, there is a possibility that the photo of the customer's face taken by the photographing unit is not a photo of the customer's own face but a photo of another person's face. To eliminate such a possibility, it is desirable to determine whether the taken photo is a photo of a real person's face. The age estimation system according to the third invention can reliably determine whether a photograph or video is of a real person's face by examining whether the orientation of the face in the photograph matches the specified criteria, or whether there are any suspicious movements in the video, in response to a print photograph attack in which a photograph of another person obtained illegally is taken to impersonate someone, or a video playback attack in which a video of another person's appearance is played during registration to impersonate someone. Furthermore, this instruction is not limited to once, and multiple still images and videos may be taken. As a result, real-time performance can be ensured. Furthermore, this method can be implemented even when the customer's device is a typical smartphone, making it particularly effective for age estimation using smartphones.

[0023] (4) The age estimation system according to the fourth invention, in one aspect or the age estimation system according to the second invention, further comprises a light-emitting device that emits a specific wavelength of color, which emits light from the light-emitting device to capture a photograph of the customer's face and transmit it to a server, and a face photograph determination unit further calculates the difference between the component data of the color emitted by the light-emitting device and the component data of the color not emitted by the light-emitting device in the customer's face photograph when the light-emitting device is emitted, for the customer's face and background portions, and if the ratio or difference of the magnitude of the difference is less than or equal to a predetermined value, it may be determined that the transmitted face photograph is not a photograph of the customer's face itself, and the customer's age cannot be estimated.

[0024] In the case of age estimation using a native app that utilizes a customer terminal equipped with a light-emitting device that emits a specific wavelength of color, it is desirable to use the age estimation system according to the fourth invention as a method for determining whether a photograph taken is a photograph of a real person's face. In the case of a photograph of a real person's face, the color components emitted by the light-emitting device have high brightness in the face area (close to the device) due to reflection from the face, and low brightness in the background area (outside the face). In contrast, the color components that the light-emitting device does not emit have little difference between the face area and the background area. Therefore, the difference between the color component data of the color component that the light-emitting device emits and the color component data of the color component that the light-emitting device does not emit is greater in the face area than in the background area. On the other hand, in the case of photographs that do not depict the faces of real people, the light from the light-emitting device is reflected from the background, so the difference between the color components that the device emits and the color components that it does not emit is small between the face and the background. Therefore, the difference between the color component data of the device that emits light and the color component data of the device that does not emit light is small between the face and the background. Based on the above, by comparing the magnitude of the difference between the component data of the color emitted by the light-emitting device and the component data of the color not emitted by the light-emitting device, specifically the difference in the human face area and the difference in the background area, if the ratio or difference in the magnitude of the difference is greater than or equal to a predetermined value, it can be determined that the image data is image data of a real person's face.

[0025] (5) The age estimation method, which follows other phases, comprises a shooting step in which the customer terminal displays operating instructions to the customer and takes a photograph of the customer's identification document and a photograph of the customer's face; an extraction step in which the server extracts the face photograph from the photograph of the identification document and extracts personal information including the name and date of birth through character recognition processing; a face photograph determination step in which the server determines whether the customer's face photograph and the face photograph on the ticket are of the same person; an age estimation comparison step in which, if it is determined in the face photograph determination step that they are of the same person, the server estimates the customer's age from the customer's face photograph and compares the estimated customer age with the age calculated from the date of birth; and a registration step in which the service company terminal receives the age estimation result from the server and registers the age estimation result. In the age estimation comparison step, if the age difference is less than a predetermined value, the age calculated from the date of birth is estimated as the customer's age. In the face photograph determination step, if it is determined that the customer's face photograph and the face photograph on the ticket are not of the same person, and in the age estimation comparison step, if the age difference is greater than or equal to a predetermined value, the customer's age cannot be estimated.

[0026] The other-phase age estimation method is an invention of an age estimation method corresponding to the one-phase age estimation system, which compares the photograph on the identification document with the customer's facial photograph to confirm that the customer is the person on the identification document, estimates the customer's age from the customer's facial photograph, compares the estimated customer's age with the age calculated from the date of birth, and confirms the validity of the age calculated from the date of birth, thereby eliminating the risk of forgery of identification documents and increasing the reliability of age estimation. [Brief explanation of the drawing]

[0027] [Figure 1] This is a schematic diagram showing the configuration of the age estimation system. [Figure 2] This is a schematic diagram showing an example of a customer terminal configuration. [Figure 3] This is a schematic diagram showing an example of the configuration of a service provider's terminal. [Figure 4] This is a schematic diagram showing an example of a server configuration. [Figure 5]This is a schematic flowchart illustrating an example of an age estimation method. [Modes for carrying out the invention]

[0028] Embodiments of the present invention will be described below with reference to the drawings. In the following description, identical parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed descriptions of them will not be repeated.

[0029] [Embodiment] This embodiment is an age estimation system 500 and an age estimation method comprising a customer terminal 100, a service company terminal 200, and a server 300.

[0030] (Configuration of the age estimation system 500 of this embodiment) Figure 1 is a schematic diagram showing an example of the configuration of the age estimation system 500 according to this embodiment, Figure 2 is a schematic diagram showing an example of the configuration of the customer terminal 100, Figure 3 is a schematic diagram showing an example of the configuration of the service company terminal 200, and Figure 4 is a schematic diagram showing an example of the configuration of the server 300.

[0031] As shown in Figure 1, the age estimation system 500 is connected via a communication network 400, with a customer terminal 100, a service company terminal 200, and a server 300. The customer terminal 100 is operated by the customer 110 and is used to take photos of the identification document 115 and the customer 110's face. The service company terminal 200 is managed by the service company, but since it does not usually require operator intervention, the server 300 can also perform the functions of the service company terminal 200. Server 300 is typically managed by the company operating the age estimation system 500 and is used for processes such as determining the identity of the facial photograph on the identification document 115 and the facial photograph of the customer 110, and for automatically masking sensitive information on the identification document 115.

[0032] As shown in Figure 2, the customer terminal 100 includes a camera 120 for taking photos of the identity verification document 115 and the customer 110's face, a display / operation unit 150 for displaying operation details on the screen, operating the camera 120 to take photos, and monitoring the taken photos, a communication unit 170 for transmitting application information such as date of birth to the service company terminal 200 and transmitting the identity verification document 115 and the customer 110's face to the server 300, and a control unit 180. The control unit 180 is typically composed of a CPU, memory, hard disk, etc. The communication unit 170 may be a mobile phone communication, wireless LAN, or wired LAN. The customer terminal 100 may be a device owned by the customer, such as a smartphone or laptop computer, or it may be an age estimation terminal installed in an unmanned store, for example. When taking a photograph of customer 110's face, it is desirable to display a frame around the face on the display / operation unit 150 and guide the customer 110 so that their face fits perfectly within that frame.

[0033] In network-based identity authentication, there is a possibility that the facial photograph of customer 110 taken by the camera unit 120 may not be a photograph of customer 110's face itself, but rather a photograph of another person's face. To address such cases, it is desirable to determine whether the photograph taken is a photograph of a real person's face. In this embodiment, in order to counter a print photo attack in which a photograph of another person obtained illegally is taken to impersonate someone, or a video playback attack in which a video of another person's appearance is played during registration to impersonate someone, the customer 110 may be instructed to turn in one or more directions from left, right, up, or down, and a photograph or video of the customer 110 turning their head in that direction may be taken. This method makes it possible to determine whether the photograph or video sent is an impersonation. For example, during identity verification, random numbers or the like may be shown to customer 110, and within a certain time, customer 110 may be asked to take a photograph of their face and / or identification documents together with a piece of paper on which the numbers or the like are written, and the photograph may be sent immediately. Alternatively, during identity verification, a random pose may be shown to customer 110, and within a certain time, customer 110 may be asked to take a photograph of their face in that pose and the photograph may be sent immediately. Furthermore, a semi-transparent 3D AR system may be used where an animated face slowly gives instructions, and the actual customer's face 110 moves in accordance with the animated face, capturing a video or multiple still images. As a result, real-time functionality and biometric detection can be achieved by randomizing the movement of the animated face. Suspicious behavior may also be detected automatically by a machine. Furthermore, this method can be implemented even if the customer terminal 100 is a typical smartphone, making it particularly effective for user authentication using a smartphone. However, taking photos or videos by directing the customer 110 during the shooting process is optional and not required.

[0034] Furthermore, as a countermeasure against impersonation and forgery, the imaging unit 120 may be equipped with a light-emitting device 130 that emits light of one or more colors of a specific wavelength, and a photograph of the customer's face 110 may be taken when the light-emitting device 130 is emitting light. In this case, a photograph of the customer's face 110 taken when the light-emitting device 130 is emitting light is taken and sent to the server 300, and the difference between the component data of the color emitted by the light-emitting device 130 and the component data of the color not emitted by the light-emitting device 130 is calculated for the face and background portions of the customer 110. By comparing the magnitude of the difference in the face portion of the customer 110 with the magnitude of the difference in the background portion, it is possible to determine whether the photograph is a photograph of a real person.

[0035] This is based on the following principle: In the case of a photograph of a real person's face, the color components emitted by the light-emitting device 130 have high brightness in the face area (close to the light-emitting device 130) due to reflection from the face, and low brightness in the background area (outside the face). In contrast, the color components that the light-emitting device 130 does not emit have little difference between the face area and the background area. Therefore, the difference between the color component data of the color components emitted by the light-emitting device 130 and the color component data of the color components that the light-emitting device 130 does not emit is greater in the face area than in the background area.

[0036] On the other hand, in the case of photographs that do not depict the faces of real people, the light from the light-emitting device 130 is reflected from the background, so the difference between the color components emitted by the light-emitting device 130 and the color components that the light-emitting device 130 does not emit is small between the face and the background. Therefore, the difference between the color component data emitted by the light-emitting device 130 and the color component data that the light-emitting device 130 does not emit is small between the face and the background. Based on the above, by comparing the magnitude of the difference between the component data of the color emitted by the light-emitting device 130 and the component data of the color not emitted by the light-emitting device 130, specifically the difference for the human face and the difference for the background, if the ratio or difference in the magnitude of the difference is greater than or equal to a predetermined value, it can be determined that the image data is image data of a real person's face. However, taking a photograph using a light-emitting device 130 that emits light of one or more colors of a specific wavelength is optional, and if this method is not used to determine whether or not it is an impersonation, the light-emitting device 130 may be omitted.

[0037] Next, as shown in Figure 3, the service company terminal 200 includes a display / operation unit 220, a registration unit 230, a communication unit 270, and a control unit 280. However, since the service company terminal 200 usually does not require judgment or operation by an operator, the display / operation unit 220 may be omitted. Also, the functions of the service company terminal 200 can be provided by the server 300.

[0038] As shown in Figure 4, the server 300 includes an extraction unit 310 that extracts personal information including the facial photograph on the document 115, name, and date of birth; an application information matching determination unit 320 that determines whether the application information and the extracted information match; a facial photograph determination unit 350 that determines whether the facial photograph on the document 115 and the facial photograph of the customer 110 are of the same person; an age estimation / comparison unit 360 that estimates the age of the customer 110 using the facial photograph of the customer 110 and compares it with the age calculated from the date of birth of the customer 110; a communication unit 370; and a control unit 380. The extraction unit 310 determines the position of the facial photograph from the photograph of the identity verification document 115 by identifying the type of identity verification document 115 (for example, whether it is a My Number Card or a driver's license) and using methods such as pattern recognition, and extracts the facial photograph from the document. The extraction unit 310 also extracts the identity verification document code and personal information such as name and date of birth by subjecting the photograph of the identity verification document 115 to character recognition processing such as OCR.

[0039] The application information matching determination unit 320 compares the personal information such as the date of birth stated in the application information with the date of birth and other information on the identity verification document 115 extracted by the extraction unit 310. If they match, the unit proceeds to the process of determining whether the facial photograph on the ticket and the facial photograph of the customer are identical. The facial photo determination unit 350 uses AI (artificial intelligence) to measure an approximation score to determine whether the facial photo on the identity verification document 115 and the facial photo of the customer 110 are the same face. If the approximation score is above a predetermined value, it determines that the facial photo on the identity verification document 115 and the facial photo of the customer 110 are the faces of the same person, and proceeds to the customer facial photo age estimation process. On the other hand, if the approximation score is below a predetermined value, it is determined that it is not clear whether the facial photograph on the identification document 115 and the facial photograph of the customer 110 are of the same person, and the service company terminal 200 is sent a result indicating that age estimation is not possible.

[0040] Furthermore, when taking a photograph of customer 110's face, if the display / operation unit 150 specifies the direction of the face and takes several photographs, or if the direction of the face is specified and a video including facial movements is taken, the face photo determination unit 350 will determine that the photograph of customer 110 taken by the shooting unit 120 is not a photograph of the real customer 110 if the direction of the face in the sent photograph is not as instructed, or if there are suspicious movements in the facial movements, and will notify the service company terminal 200 that age estimation is not possible.

[0041] Furthermore, if the camera unit 120 of the customer terminal 100 is equipped with a light-emitting device 130 that emits a specific wavelength of color, and a photograph of the customer 110's face is taken when the light-emitting device 130 is emitting light, the face photograph determination unit 350 calculates the difference between the component data of the color emitted by the light-emitting device 130 and the component data of the color that the light-emitting device 130 does not emit light for both the face and background portions of the customer 110, and compares the magnitude of the difference for the face portion of the customer 110 with the magnitude of the difference for the background portion. If the difference or ratio of the magnitude of the difference is less than or equal to a predetermined value, the camera unit 350 determines that the photograph of the customer 110 taken by the camera unit 120 is not a photograph of the real customer 110, and notifies the service company terminal 200 that age estimation is not possible.

[0042] The age estimation / comparison unit 360 uses AI to estimate the customer's age from the customer's facial photograph, and then compares the estimated age with the age calculated from the date of birth on the identity verification document 115. If the difference between the two ages is less than a predetermined value, the unit communicates the age calculated from the date of birth as the estimated age to the service company terminal 200. On the other hand, if the age difference is greater than or equal to the predetermined value, the unit considers that the identity verification document 115 is forged, and communicates to the service company terminal 200 that age estimation is not possible. In this case, it is also possible to estimate customer 110's age from the facial photograph on identification document 115, but it is usually preferable to estimate customer 110's age from the customer's facial photograph because it is the most recent photograph and has a higher resolution.

[0043] (Flowchart of the age estimation method of this embodiment) Figure 5 shows a flowchart of the age estimation method according to this embodiment. The operation of each step will be explained below in accordance with the flowchart in Figure 5. Customer 110 applies to the service company for age estimation using customer terminal 100 (Step S1), and customer terminal 100 sends application information such as date of birth to service company terminal 200 (Step S2). This application information is also sent to server 300 and registered (Step S3). Service company terminal 200 replies to customer terminal 100 with instructions on how to perform age estimation (Step S4).

[0044] Customer 110 uses the camera unit 120 of the customer terminal 100 to take a photograph of their identification document 115 and a photograph of their face (steps S5, S6). When taking a photograph of customer 110's face, it is desirable to display a frame for the face on the display / operation unit 150 and guide customer 110 so that their face fits exactly within that frame. In this case, as a countermeasure against so-called impersonation and forgery, where a photograph of another person's face is taken instead of the customer 110's own face, the display / operation unit 150 may be used to specify the direction of the face and take several photographs, or to specify the direction of the face and take a video including facial movements. Alternatively, if the shooting unit 120 is equipped with a light-emitting device 130 that emits light of one or more colors of a specific wavelength, a photograph of the customer 110's face may be taken when the light-emitting device 130 is emitting light. The customer terminal 100 sends a photo of the identity verification document 115 and a photo of the customer's face to the server 300 (step S7).

[0045] If the customer 110's facial photographs include multiple facial photographs or videos with specified facial orientations, the server 300 verifies that the facial orientation in each photograph is as specified, or that there are no suspicious facial movements. Furthermore, if the customer 110's facial photographs include a photograph of the face when the light-emitting device 130, which emits light of a specific wavelength, is emitting light, the server 300 calculates the difference between the color component data of the light-emitting device 130 that is emitted and the color component data of the light-emitting device 130 that is not emitted for both the face and background portions of the customer 110's facial photograph, and compares the magnitude of the difference for the face portion of the customer 110 with the magnitude of the difference for the background portion (step S8). Furthermore, if the orientation of the face in the facial photograph is not as specified, if there are suspicious movements in the facial movements in the video, or if the difference or ratio between the difference in the face portion of the customer 110's facial photograph and the difference in the background portion is less than or equal to a predetermined value, the server 300 determines that the facial photograph of customer 110 that was sent is not a photograph of the real customer 110 and notifies the service company terminal 200 that age estimation is not possible (steps S9, S19). Note that these reality determination processes (S8, S9) are optional and may not be performed.

[0046] Server 300 extracts the facial photograph from the photo of the submitted identity verification document 115, and also extracts personal information such as the identity verification document code, name, and date of birth through optical character recognition (OCR) processing (step S10). Next, the server 300 determines whether the date of birth extracted from the identity verification document 115 is the same as the date of birth in the application information self-declared by the person (step S11). If the two dates of birth are not the same, it notifies the service company terminal 200 that age estimation is not possible (steps S12, S19). Note that this birth date matching process is optional, and if the birth date matching process is not performed, steps S11 and S12 may be omitted. Also, at the start of the application (step S1), customer 110 does not need to enter their birth date. Next, the server 300 uses AI to measure an approximation score to determine whether the facial photograph on the identity verification document 115 and the facial photograph of the customer 110 are the same face (step S13). Then, if the approximation score is above a predetermined value, it is determined that the facial photograph on the identification document 115 and the facial photograph of customer 110 are the same person, and the process proceeds to the customer facial photograph age estimation process. On the other hand, if the approximation score is less than a predetermined value, it is determined that it is not clear whether the facial photograph on the identification document 115 and the facial photograph of the customer 110 are of the same person, and the age estimation is not possible, and this is communicated to the service company terminal 200 (steps S14, S19).

[0047] Server 300 uses AI to estimate the age of customer 110 from the customer's facial photograph (step S15). Next, server 300 compares the age calculated from the date of birth extracted from the identity verification document 115 with the age estimated from the customer's facial photograph (step S16). Then, if the age difference between the age calculated from the extracted date of birth and the age estimated from the customer's facial photograph is less than a predetermined value, the age calculated from the date of birth is communicated to the service company terminal 200 as the age estimation result (steps S17, S18). On the other hand, if the age difference is greater than or equal to the predetermined value, it is considered that, for example, the identity verification document 115 has been forged, and the service company terminal 200 is notified that the age cannot be estimated (steps S17, S19). The predetermined value for the age difference is, for example, 3 years. Finally, the service provider terminal 200 registers the estimated age (step S20).

[0048] In this embodiment, the age estimation method estimates the customer's age from the date of birth on the identity verification document sent via the network. In this case, (1) If a customer who has sent a photo of their identification document is not the same person as the person listed on the document, (2) The documents used for identity verification have been forged. (3) There is a risk that the facial photograph sent may not be the customer's own, According to this embodiment, the risk can be eliminated for (1) by the process of determining that the facial photograph on the ticket is the same as the facial photograph of the customer (step S13), for (2) by the process of determining that the age on the ticket is the same as the age in the facial photograph of the customer (step S16), and for (3) by the process of determining that the customer's facial photograph is real (step S8). Therefore, the age estimation method of this embodiment enables highly reliable and accurate age estimation to be performed efficiently through a network.

[0049] In this embodiment, the customer terminal 100 corresponds to the "customer terminal," the service company terminal 200 corresponds to the "service company terminal," the server 300 corresponds to the "server," the age estimation system 500 corresponds to the "age estimation system," the display / operation unit 150 corresponds to the "display / operation unit," the shooting unit 120 corresponds to the "shooting unit," the registration unit 230 corresponds to the "registration unit," the extraction unit 310 corresponds to the "extraction unit," the application information matching determination unit 320 corresponds to the "application information matching determination unit," the face photo determination unit 350 corresponds to the "face photo determination unit," the age estimation / comparison unit 360 corresponds to the "age estimation / comparison unit," and the light-emitting device 130 corresponds to the "light-emitting device."

[0050] While the above describes a preferred embodiment of the present invention, the invention is not limited thereto. It will be understood that various other embodiments can be made without departing from the spirit and scope of the invention. Furthermore, although the operation and effects of the configuration of the present invention are described in this embodiment, these operations and effects are examples and do not limit the invention. [Explanation of Symbols]

[0051] 100 customer terminals 120 Photography Department 130 Light-emitting device 150 Display / operation section 200 service company terminals 230 Registration Department 300 servers 310 Extraction part 320 Application Information Matching Determination Unit 350 Facial Photo Recognition Unit 360 Age Estimation / Comparison Section 500 Age Estimation System

Claims

1. An age estimation system consisting of a customer terminal, a service company terminal, and a server, The customer terminal comprises a display / operation unit that displays operating instructions on the screen, and a shooting unit that takes photographs of identification documents and the customer's face. The service company terminal is equipped with a registration unit that receives age estimation results from the server and registers the age estimation results. The server includes an extraction unit that extracts a facial photograph from the photo of the identification document and extracts personal information including the name and date of birth through character recognition processing, A facial photograph determination unit that determines whether the facial photograph of the customer and the facial photograph on the ticket are of the same person, The facial photograph determination unit determines that the photographs belong to the same person, and the unit includes an age estimation / comparison unit that estimates the customer's age from the customer's facial photograph and compares the estimated age of the customer with the age calculated from the date of birth. If the age estimation / comparison unit determines that the age difference is less than a predetermined value, it estimates the customer's age based on the date of birth. If the facial photograph determination unit determines that the customer's facial photograph and the facial photograph on the ticket are not of the same person, and if the age estimation / comparison unit determines that the age difference is greater than or equal to a predetermined value, it determines that the customer's age cannot be estimated. The imaging unit further comprises a light-emitting device that emits a specific wavelength of color, and emits light from the light-emitting device to capture the customer's facial photograph and transmit it to the server. The face photograph determination unit further calculates the difference between the color component data of the color emitted by the light-emitting device and the color component data of the color not emitted by the light-emitting device in the face photograph of the customer when the light-emitting device is lit, for the face portion and the background portion of the customer, and if the ratio or difference of the magnitude of the difference is less than or equal to a predetermined value, it determines that the transmitted face photograph is not a photograph of the customer's face itself, and the age of the customer cannot be estimated.

2. The display / operation unit prompts the customer to enter application information, including their date of birth. The server further comprises an application information matching determination unit, which determines whether the date of birth declared by the customer matches the date of birth extracted from the identity verification document, and if they do not match, the age of the customer cannot be estimated, as described in claim 1.

3. When the camera unit takes a photograph of the customer's face, after taking a photograph of the customer facing forward, it instructs the customer to turn in one or more directions from left, right, up, or down, and takes a photograph or video of the customer's face as they turn their head in that direction. The age estimation system according to claim 1 or 2, wherein the face photo determination unit determines that the received face photo or video is not a photograph of the customer's face itself if the orientation of the face in the face photo is not as specified, or if there is suspicious movement in the video, and makes it impossible to estimate the customer's age.

4. The customer terminal displays operating instructions to the customer, and includes a shooting step of taking a photograph of the customer's identification document and a photograph of the customer's face. The server performs an extraction process in which it extracts a facial photograph from the aforementioned identification document and extracts personal information, including the name and date of birth, through character recognition processing. The server performs a facial photograph determination step to determine whether the customer's facial photograph and the facial photograph on the ticket are of the same person, If the facial photograph recognition step determines that the photographs belong to the same person, the server estimates the customer's age from the customer's facial photograph and compares the estimated age of the customer with the age calculated from the date of birth in an age estimation comparison step. The service company terminal receives the age estimation result from the server and registers the age estimation result, and the service company terminal includes a registration step, In the age estimation comparison step, if the age difference is less than a predetermined value, the age calculated from the date of birth is estimated as the customer's age; if the facial photograph determination step determines that the customer's facial photograph and the facial photograph on the ticket are not of the same person, and if the age difference in the age estimation comparison step is greater than or equal to a predetermined value, the customer's age cannot be estimated. The aforementioned shooting step further comprises a light emission step that emits a specific wavelength of color, and the light emission step is activated to capture the customer's facial photograph and transmit it to the server. The face photograph determination step further calculates the difference between the color component data of the light-emitting device and the color component data of the light-emitting device that is not emitted in the face photograph of the customer at the time of light emission in the light emission step, for the face portion and the background portion of the customer, and if the ratio or difference of the magnitude of the difference is less than or equal to a predetermined value, it is determined that the transmitted face photograph is not a photograph of the customer's face itself, and the age of the customer cannot be estimated.

Images