Information processing apparatus, information processing method, and program

Abstract

To reduce a burden in correcting a deficiency in a face image of an applicant attached to various application forms in electronic application.SOLUTION: An information processing apparatus acquires input information from an applicant terminal used by an applicant and executes predetermined information processing. The information processing apparatus comprises a control unit. The control unit executes an image determination step of inputting a face image of the applicant included in the input information to a learned model machine-learned on the basis of training data corresponding to a plurality of persons, and determining if the input face image satisfies one or more image determination requirements determined in advance as application acceptance requirements.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing method, and a program. [Background technology]

[0002] There are various known electronic application systems that use the Internet to perform various procedures online. For example, Patent Document 1 proposes a method and system for accepting applications for media containing facial images that reduces the load on the server and allows efficient processing on a mobile terminal.

[0003] Various technologies have also been proposed for checking whether there are any defects in the application information received by such electronic application systems. For example, Patent Document 2 proposes a program, computer, and information processing method that can improve convenience by outputting information on the type of defect if there is a defect in the received supporting document data. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2016-81141 [Patent Document 2] Patent No. 7336801 Summary of the Invention [Problem to be solved by the invention]

[0005] When candidates apply for various exams, such as entrance exams, certification exams, and qualification exams, that use electronic application systems, they must access the system from their own devices, enter the necessary information, and attach a photograph of themselves. When educational institutions, companies, organizations, etc. administering exams encounter problems with the photographs attached to the application information received through the electronic application system, they typically request the candidate to resend the photograph via email or other means. These problems include, for example, a small face, a cropped portion of the head, wearing a mask, an object or pattern in the background, a gap between the photograph and the border, hair covering the eyes, being out of focus, a white face due to flash, a dark face due to backlighting or insufficient lighting, and a paper photograph. This creates a burden for educational institutions, companies, organizations, etc. to address these problems in candidate photographs at the application stage.

[0006] The present invention aims to reduce the burden of dealing with defects in the facial images of applicants attached to various application forms in electronic applications. [Means for solving the problem]

[0007] [1] An information processing device that acquires input information from an applicant terminal used by an applicant and executes predetermined information processing, the information processing device includes a control unit, The control unit an image determination step of inputting a facial image of the applicant included in the input information into a trained model that has been machine-learned based on training data for multiple people, and determining whether the input facial image satisfies one or more image determination requirements that are predetermined as application acceptance requirements; 1. An information processing device comprising: [Effects of the Invention]

[0008] According to this invention, if there is a defect in the facial image of an applicant attached to various application forms in an electronic application, the burden of dealing with the defect can be reduced. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram illustrating an example of the overall configuration of a system including an information processing apparatus according to an embodiment of the present invention. [Figure 2] 1 is a diagram illustrating a software configuration as an example of the configuration of an information processing apparatus according to an embodiment of the present invention. [Figure 3] FIG. 10 is a diagram illustrating an example of a facial image determination requirement in this embodiment. [Figure 4] 1 is a flowchart showing an example of information processing according to the present embodiment. [Figure 5] 10 is a flowchart showing another example of information processing according to the present embodiment. [Figure 6] A diagram showing an example of input items displayed on the display screen of the applicant terminal. [Figure 7] A diagram showing an example of input items displayed on the display screen of the applicant terminal, following Figure 6. [Figure 8] FIG. 7 shows an example of operation items for a facial image displayed on the display screen of the applicant terminal. [Figure 9] FIG. 10 is a diagram showing an example of an application acceptance confirmation screen displayed on the display screen of the applicant terminal. [Figure 10] FIG. 10 is a diagram showing an example of application confirmation information displayed on the display screen of the applicant terminal. DETAILED DESCRIPTION OF THE INVENTION

[0010] An example of an embodiment of the present invention will be described below with reference to the accompanying drawings. An information processing system, which is one aspect of this embodiment, is configured with one or more computers and is used when an applicant applies for various tests such as entrance exams, certification exams, and qualification exams administered by educational institutions, companies, or organizations (hereinafter referred to as "administrators" in this embodiment).

[0011] In one embodiment, the administrator manages application information from applicants and provides services such as issuing examination tickets to applicants in an electronic application system.

[0012] Such an electronic application system is a system that is constructed and managed using one or more computers by an operator who provides the electronic application service of this embodiment to applicants.

[0013] In one embodiment, an electronic application system can be constructed in such a manner that an operator system constructed by an operator on a communication network is communicatively connected to an external system constructed on a communication network by a cloud service provider that provides cloud computing services, and to an applicant terminal used by the applicant.

[0014] In the form shown in Figure 1, the electronic application system 1 is configured such that an information processing device 3 managed by an operator is communicatively connected to an operator terminal 4 used by the operator, an external system 5 managed by a cloud service provider, and an applicant terminal 2 used by an applicant via a communication network 6 including an Internet communication network and a wireless communication network defined by wireless communication standards.

[0015] Hereinafter, this embodiment includes a computer program for causing a computer to function as the electronic application system 1 described in this embodiment.

[0016] [Applicant's device] The applicant terminal 2 is a terminal such as a personal computer, smartphone, or tablet used by an applicant who uses the electronic application system 1 to apply for various exams such as entrance exams, certification exams, and qualification exams.

[0017] Although not shown in the figure, the applicant terminal 2 is equipped with a central processing unit composed of a CPU or the like that processes and performs calculations on various data, a main storage device such as a main memory that stores various data, an auxiliary storage device such as an internal storage, input devices such as a keyboard, mouse, and touch panel, an output device such as a display, a communication I / F (Interface) that communicates with the information processing device 3, a camera that is an imaging device, and a web browser for using the electronic application service provided by the operator.

[0018] [Information processing device] The information processing device 3 is configured with one or more computers. In this embodiment, the information processing device 3 is configured with a server and a database (hereinafter, in this specification and drawings, the database will be referred to as "DB") managed by an administrator.

[0019] The server is equipped with a central processing unit configured with a CPU or the like to process and perform calculations on various data, a main storage device such as a main memory to store various data, an auxiliary storage device such as an internal storage, and a communication I / F (Interface) to communicate with the applicant terminal 2, the operator terminal 4, and the external system 5. The server may be configured with one or more devices, or may be a server realized on the cloud.

[0020] As shown in FIG. 2, the information processing device 3 includes a control unit 7 and a storage unit 8 as software components.

[0021] The control unit 7 causes the information processing device 3 to function as an application management means 9, a first determination means 10, and a second determination means 11.

[0022] When the information processing device 3 is made to function as the application management means 9, the control unit 7 executes screen display and screen transition steps such as displaying the top screen of the electronic application service, input screens for various information, and displaying output screens in response to access from the applicant terminal 2 and operation of the applicant's terminal 2 by the applicant.

[0023] For example, the control unit 7 executes various screen display steps, such as a selection screen for the type of test corresponding to the schedule as shown in FIG. 6, a screen for inputting information such as the applicant's name as shown in FIG. 7, a screen for editing the applicant's facial image data as shown in FIG. 8, a screen for confirming application acceptance as shown in FIG. 9, and a screen for outputting application confirmation information as shown in FIG. 10.

[0024] When information processing device 3 is made to function as first determination means 10, control unit 7 executes a format confirmation step of confirming whether the applicant's facial image information sent from applicant terminal 2 meets predetermined format requirements.

[0025] For example, the control unit 7 executes a format confirmation step to check whether the facial image information of the applicant has been created in a predetermined file format and file size.

[0026] When the information processing device 3 is made to function as the second judgment means 11, the control unit 7 executes an image judgment step to judge whether the facial image related to the applicant's facial image information satisfies one or more image judgment requirements that are predetermined as application acceptance requirements.

[0027] In this embodiment, the control unit 7 inputs a facial image related to the applicant's facial image information into a trained model that has been machine-learned based on training data for multiple people, and executes an image judgment step in which it is determined whether the input facial image satisfies one or more image judgment requirements that have been predetermined as application acceptance requirements, as shown in Figure 3.

[0028] The trained model is a model that has learned the relationship between an image of a person, the image quality, the image shooting conditions, the attributes of the elements that make up the face, and the layout of the face in the entire image.

[0029] The image quality may be exemplified by parameters such as whether the image is a color image or a monochrome image, whether there is a margin, and the like.

[0030] Examples of image capturing conditions include various parameters such as image resolution, brightness, and degree of blur.

[0031] Examples of attributes of elements that make up a face include parameters such as identification of eyes, ears, nose, and mouth, identification of facial expressions, and identification of other elements such as a mask, hat, and sunglasses.

[0032] Examples of the layout of faces in the entire image include parameters such as the ratio of the size of the faces to the image display area, the orientation of the faces, and the number of faces.

[0033] Such a trained model may be stored in an auxiliary storage device such as an internal storage device, or may be provided from the external system 5 through API collaboration between the external system 5 and the information processing device 3.

[0034] The selection of the image judgment requirements, the judgment criteria, and the thresholds are set according to the administrator's wishes and stored in an auxiliary storage device such as an internal storage, etc. Therefore, the image judgment requirements are flexible for each administrator.

[0035] The facial image related to the applicant's facial image information is input into the trained model and subjected to image analysis to determine whether it meets the image judgment requirements shown in Figure 3.

[0036] Regardless of the result of the judgment, the control unit 7 executes a screen display step of displaying a selection screen on the applicant terminal 2 for whether or not to register a facial image. This is to enable acceptance of the application even if it is judged that the applicant's facial image does not satisfy the image judgment requirements. If it is selected not to register a facial image, the control unit 7 causes the applicant terminal 2 to display again the editing screen for the applicant's facial image data.

[0037] The control unit 7 may also execute a determination result transmission step of transmitting the determination result to the applicant terminal 2.

[0038] In this case, if it is determined that the applicant's facial image meets the above image determination requirements, the control unit 7 sends the result to the applicant terminal 2 and displays a selection screen for whether or not to register the facial image.

[0039] On the other hand, if it is determined that the applicant's facial image does not satisfy the image determination requirements, the control unit 7 transmits the result to the applicant terminal 2 and causes the editing screen for the applicant's facial image data to be displayed again.

[0040] The storage unit 8 constructs a DB in which predetermined information is stored. In this embodiment, application information in which applicant information is linked to an application type ID that identifies the type of application is stored in the application DB 12. In addition, the applicant information is configured by linking personal information such as name and address, facial image information, facial image judgment result information, etc. to an applicant ID assigned to each applicant.

[0041] [Operator terminal] The operator terminal 4 is a terminal such as a personal computer, smartphone, tablet, etc. used by an operator to manage application information from applicants who have applied for various exams such as entrance exams, certification exams, and qualification exams using the electronic application system 1.

[0042] Although not shown in the figure, the operator terminal 4 is equipped with a central processing unit composed of a CPU or the like that processes and performs calculations on various types of data, a main storage device such as a main memory that stores various types of data, an auxiliary storage device such as an internal storage, input devices such as a keyboard, mouse, and touch panel, an output device such as a display, a communication I / F (Interface) that communicates with the information processing device 3 and the external system 5, and a web browser for managing application information.

[0043] [External System] The external system 5 is a cloud computing system constructed by the cloud service provider using one or more computers (cloud service provider terminals such as personal computers, smartphones, tablets, etc.) and servers.

[0044] Although not shown, the computers and servers that make up the external system 5 are equipped with a central processing unit composed of a CPU or the like that processes and performs calculations on various types of data, a main storage device such as a main memory that stores various types of data, an auxiliary storage device such as internal storage, input devices such as a keyboard, mouse, and touch panel, output devices such as a display, and a communication I / F (Interface) that communicates with the information processing device 3 and the operator terminal 4.

[0045] In addition, the server constituting the external system 5 has a memory unit that stores the above-mentioned trained model, and the above-mentioned trained model can be called up in the information processing device 3 through API integration with the information processing device 3.

[0046] [Information processing flow according to this embodiment] The processing flow of the electronic application system 1 of this embodiment will be described below with reference to FIGS. 3 to 10, taking an exam as an example.

[0047] (S101) The examinee (applicant) operates the applicant terminal 2 to access the information processing device 3 and selects application for the exam on the exam application service page displayed on the screen. The control unit 7 of the information processing device 3 causes the information processing device 3 to function as application management means 9, and causes an application form selection screen corresponding to the schedule as shown in Figure 6 to be displayed on the applicant terminal 2. The examinee selects the desired option.

[0048] (S102) The control unit 7 of the information processing device 3 causes the information processing device 3 to function as the application management means 9, and causes an input screen for personal information such as the examinee's name, as shown in Figure 7, to be displayed on the applicant terminal 2. The examinee enters the necessary information in the input fields.

[0049] (S103) The control unit 7 of the information processing device 3 causes the information processing device 3 to function as the application management means 9, and causes an editing screen for the examinee's facial image data as shown in FIG. 8 to be displayed on the applicant terminal 2. The examinee calls up an image of himself / herself that is stored in the applicant terminal 2 or that he / she has taken by activating the built-in camera, and performs editing operations such as trimming. After the editing operations are completed, the examinee's facial image information is uploaded to the information processing device 3.

[0050] (S104) The control unit 7 of the information processing device 3 causes the information processing device 3 to function as the first judgment means 10, and executes a format confirmation step to check whether the examinee's facial image information has been created in a predetermined file format and file size.

[0051] (S105) Next, the control unit 7 of the information processing device 3 causes the information processing device 3 to function as the second judgment means 11, and executes an image judgment step to judge whether the facial image related to the facial image information of the examinee satisfies one or more image judgment requirements that are predetermined as application acceptance requirements. In this processing flow, the control unit 7 calls up the above-mentioned trained model from the memory unit of the external system 5 through API collaboration between the information processing device 3 and the external system 5, inputs a facial image related to the examinee's facial image information into the trained model, performs image analysis, and determines whether the facial image satisfies the image judgment requirements pre-set in the information processing device 3 as shown in Figure 3.

[0052] (S106) Regardless of whether the examinee's facial image is judged to satisfy or not satisfy the above image judgment requirements, the control unit 7 causes the information processing device 3 to function as an application management means 9, and displays a selection screen on the applicant terminal 2 prompting the applicant to decide whether or not to register the facial image. If the examinee chooses not to register, the control unit 7 causes the edit screen for the examinee's facial image data to be displayed again on the applicant terminal 2. The examinee again edits his or her facial image on the edit screen and uploads it to the information processing device 3.

[0053] (S107) If the examinee selects registration, the storage unit 8 of the information processing device 3 stores application information in which examinee information is linked to an application type ID that identifies the type of examination, based on the information input up to that point, in the application DB 12. The examinee information includes an examinee ID assigned to each examinee, linked to personal information such as name and address, facial image information, and facial image judgment result information.

[0054] (S108) The control unit 7 of the information processing device 3 may cause the information processing device 3 to function as the application management means 9, and may cause a payment screen that provides guidance on a predetermined examination fee payment method to be displayed on the applicant terminal 2. The examinee selects a payment method and pays the examination fee. Once the processing of S107 or payment of the examination fee is completed, the application acceptance number issuance screen will be displayed as shown in Figure 9. If you select to output the application confirmation information (print documents to be submitted) on this screen, an application confirmation slip will be displayed as shown in Figure 10 and can be printed.

[0055] (S201) During the application acceptance period, the administrator operates the administrator terminal 4 to access the information processing device 3, and inputs predetermined conditions on the examination application management page displayed on the screen to inquire about application information.

[0056] (S202) The control unit 7 of the information processing device 3 causes the information processing device 3 to function as an application management means 9, searches the application DB 12 for application information related to the input conditions, and executes a query step of responding with the search results to the operator terminal 4.

[0057] (S203) The search results are displayed on the screen of the administrator terminal 4, allowing the administrator to confirm the application information. In this case, the judgment results of the above-mentioned judgment process are displayed for the facial image of the examinee attached to the application information, so the administrator can easily confirm whether the facial image meets the requirements or not.

[0058] As described above, according to this embodiment, AI-based facial image analysis technology is incorporated into the existing electronic application service, and the applicant's facial image is judged in advance as to whether it meets or does not meet the image assessment requirements, thereby reducing the burden on the administrator, such as checking for any defects in the facial image attached to the application documents. [Explanation of symbols]

[0059] 1. Electronic Application System 6. Communication Networks

Claims

1. An information processing device that acquires input information from an applicant terminal used by an applicant and executes predetermined information processing, the information processing device includes a control unit, The control unit an image determination step of inputting a facial image of the applicant included in the input information into a trained model that has been machine-learned based on training data for multiple people, and determining whether the input facial image satisfies one or more image determination requirements that are predetermined as application acceptance requirements; 1. An information processing device comprising:

2. The trained model is a model that has learned the relationship between a person's face image and at least one of the image quality of the face image, the shooting conditions, the attributes of the elements that make up the face, and the layout of the face in the entire image.

2. The information processing apparatus according to claim 1, wherein:

3. The information processing device includes: Further, a storage unit that stores the trained model 3. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.

4. The control unit calls the trained model through API cooperation with an external server including a storage unit in which the trained model is stored, and executes the image determination step.

3. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.

5. An information processing system comprising an information processing device and an external server communicably connected to the information processing device, the information processing system acquiring input information from an applicant terminal used by an applicant and executing predetermined information processing, the information processing device includes a control unit, The control unit an image determination step of inputting a facial image of the applicant contained in the input information into a trained model that has been machine-learned based on training data for multiple people, and determining whether the input facial image satisfies one or more image determination requirements that are predetermined as application acceptance requirements; The external server includes a storage unit in which the trained model is stored, The control unit calls the trained model through API cooperation with the external server and executes the image determination step. An information processing system comprising:

6. an image determination step in which a facial image of the applicant contained in input information obtained from the applicant terminal used by the applicant is input into a trained model that has been machine-learned based on training data for multiple individuals, and the input facial image is determined to satisfy one or more image determination requirements that are predetermined as application acceptance requirements; A program that causes a computer to function as a control means for executing the following:

Images