Selection support system, server, remote interview method, and program

By using CG model anonymization technology in remote interviews to hide the appearance and voice of job seekers, it solves the problem that it is difficult to eliminate employer preconceptions in the existing technology, and achieves fairness and reliability of the recruitment process.

JP7673417B2Active Publication Date: 2025-05-09DAI NIPPON PRINTING CO LTD
View PDF 10 Cites 0 Cited by

Patent Information

Application Number
JP2021016480
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-02-04
Publication Date
2025-05-09
Estimated Expiration
2041-02-04

AI Technical Summary

Technical Problem

The prior art has difficulty eliminating the preconceptions of job seekers’ gender and appearance in remote interviews, resulting in unfair recruitment processes.

Method used

By connecting cameras and authentication devices to the server and leveraging CG model anonymization technology, hiding the look and voice of the job seeker, making it impossible for employers to identify gender and appearance during remote interviews.

Benefits of technology

Achieve a fair assessment of job seekers in remote interviews, reducing the impact of gender and appearance on recruitment results, and ensuring the reliability of the recruitment process through identity verification.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007673417000001
    Figure 0007673417000001
  • Figure 0007673417000002
    Figure 0007673417000002
  • Figure 0007673417000003
    Figure 0007673417000003
Patent Text Reader

Abstract

To provide a selection support system and the like for realizing fair and highly reliable selection by clearing a prejudice such as sex and looks of an applicant.SOLUTION: A selection support system 1 is configured such that a photographing device 2, a server 3, an employer terminal 4 and an applicant terminal 5 are communicably connected with each other via a network 6. The server 3 performs processing of mediating a remote interview performed between the photographing device 2 and the employer terminal 4. The server 3 receives a face image and information of an identification document of a user transmitted from the photographing device 2 and executes identification. In the remote interview, the server 3 performs anonymization processing by converting the video and voice of the applicant input from the photographing device 2 into the video and voice of a 3DCG model and the like and transmits the video and voice to the employer terminal 4 by making the looks and sex of the applicant unrecognizable.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a selection support system, a photography device, a server, a remote interview method, and a program, and more particularly to selection using a photography device. [Background technology]

[0002] Online remote conferences are becoming more common. In a remote conference, users in different locations hold a conference by transmitting and receiving image data and audio data between terminals equipped with cameras and microphones. In such remote conferences, there is a concern that a user may participate in the conference by impersonating a legitimate user, for example by replacing an image. For example, Patent Document 1 discloses a communication system that can authenticate users in an online remote conference after the conference has started.

[0003] However, it has become an issue that people with distinctive appearances due to congenital illnesses and sexual minorities have difficulty in job selection. For example, a typical resume has a section for attaching a photograph, and attaching a photograph is mandatory. Meanwhile, in some overseas regions, employment discrimination based on race, skin color, religion, sex, nationality, physical disability, age, genetic information, etc. is prohibited. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2015-049602 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, many companies conduct interviews to assess a candidate's suitability for the job, abilities, personality, and talents.

[0006] The present invention has been made in consideration of the above-mentioned problems, and its purpose is to provide a selection support system etc. that removes preconceptions, such as the gender or appearance of an applicant, and realizes fair and reliable selection. [Means for solving the problem]

[0007] The first invention for solving the above-mentioned problems is, ID photos can be taken A selection support system in which a stationary photographing device, a server, and a terminal are connected via a network, the photographing device comprising: Using a camera for taking ID photos An imaging means for imaging a user; Using the camera The user's identity verification document image and a personal identification information acquisition means for acquiring an image of the user photographed by the photographing means and an image of the personal identification document acquired by the personal identification information acquisition means. image a transmission means for transmitting the image of the user taken by the photographing device and the identity of the user's identification document acquired by the photographing device to the server, and a remote interview means for inputting and outputting video and audio via the server in order to conduct a remote interview between the terminal and the server, image a receiving means for receiving the image from the photographing device; An image of the user and an image of the user's identification document a remote interview means for performing processing for conducting a remote interview between the photographing device and the terminal; and anonymization means for anonymizing the user in a video image received from the photographing device during the remote interview and transmitting the video image to the terminal, The server manages the image of the user and the image of the identification document secretly from the terminal. This is a selection support system characterized by the above.

[0008] According to the selection support system of the first invention, in a remote interview conducted between a photography device and a terminal, the server transmits the image of the photography device to the terminal while anonymizing the user. This makes it possible to transmit the image to the employer's terminal without revealing the appearance or gender of the applicant (user), realizing a fair selection process that is not influenced by gender or appearance. In addition, by performing identity verification using information on the identification document acquired by the photography device and an image of the user, reliability can be ensured even in a remote interview where the appearance, etc., is anonymized.

[0009] In the first invention, it is preferable that the anonymization means represents the user using a CG model. By using a CG model, it becomes possible to freely reproduce the facial expressions and movements of the user by performing, for example, face tracking or motion capture.

[0010] The identity verification means performs identity verification processing of the user during the remote interview. Also, the identity verification means performs identity verification processing of the user before the remote interview. Thus, by performing identity verification before or during the remote interview, sufficient reliability can be ensured even in a remote interview in which appearance, etc. are anonymized.

[0011] The anonymization means may further anonymize the user's voice received from the photographing device and transmit the anonymized voice to the terminal. This makes it possible to conduct a remote interview with the user's voice anonymized.

[0012] The server further comprises a recruitment information registration means for accepting registration of recruitment information from recruits; The above and an application information registration means for accepting registration of applicant information and employment decision information from a user, and the identity verification means records the result of the identity verification of the user in association with the applicant information registered by the user. This makes it possible to apply the present invention to a selection support system having a server that manages employment information and applicant information.

[0013] It is preferable that the server further comprises an information management means for storing the applicant information and the employment decision information separately and for managing the applicant information confidentially from the terminal of the employer. This makes it possible to realize a fair selection process since the applicant's personal information, etc. cannot be viewed from the terminal of the employer.

[0014] The server preferably includes an information presentation means for presenting the employment judgment information so that it can be viewed on the terminal of the employer. This allows the employment judgment information registered by the applicant to be viewed on the terminal of the employer, making it possible to smoothly carry out online selection.

[0015] The server further includes a screening information registration means for receiving the screening result from the terminal of the recruit and storing the result in association with the employment judgment information. This allows the recruit to register the screening result online from the terminal. User It is preferable that the terminal further comprises a communication means for transmitting a message according to the examination result to the terminal.

[0016] The server is provided with a code transmission means for issuing an applicant code which is an identification code for identifying a user who has registered the applicant information and transmitting the applicant code to the user, the photographing device is further provided with a code input means for receiving input of the applicant code, and the transmission means transmits an image of the user and an image of the identification document to the image The applicant then transmits the applicant code to the server together with the applicant code input by the code input means. The applicant then has the photographing device read the applicant code transmitted from the server, and the photographing device then transmits the applicant code to the server. image By sending the email, the applicant's information and identity verification documents registered in advance on the server will be image It is possible to link the two.

[0017] It is preferable that the server further comprises an interview information registration means for accepting registration of interview information including the date and time of the remote interview, thereby enabling employers and applicants to easily adjust schedules for remote interviews.

[0020] No. 2 The invention is ID photos can be taken A server in which a stationary photographing device and a terminal are connected via a network, Using a camera for taking ID photos A photographed image of the user and the photographing device Using the camera The identity verification documents of the user obtained image a receiving means for receiving the image from the photographing device; An image of the user and an image of the user's identification document a remote interview means for performing processing for conducting a remote interview between the photographing device and the terminal; and anonymization means for anonymizing the user in a video image received from the photographing device during the remote interview and transmitting the video image to the terminal, The image of the user and the image of the identification document are managed secretly from the terminal. The server is characterized by:

[0021] No. 2 According to this invention, a server in the selection support system of the first invention can be realized.

[0022] No. 3 The invention is ID photos can be taken A remote interview method in a selection support system in which a stationary photographing device, a server, and a terminal are connected via a network, comprising: Using a camera for taking ID photos the photographing device photographing a user; Using the camera The photographing device photographs the user's identification document. image and acquiring an image of the user taken by the photographing device and an image of the identification document. image a step of transmitting the image of the user taken by the photographing device and the identification document of the user acquired by the photographing device to the server; image from the photography device; and An image of the user and an image of the user's identification documenta step of inputting and outputting video and audio via the server in order to conduct a remote interview between the photographing device and the terminal; and a step of anonymizing the user and transmitting the video input by the photographing device during the remote interview to the terminal. fruit, The server manages the image of the user and the image of the identification document secretly from the terminal. This is a remote interview method characterized by the above.

[0023] No. 3 According to the remote interview method of the present invention, in a remote interview conducted between a photographing device and a terminal, a server anonymizes the image of the user of the photographing device and transmits it to the terminal. This makes it possible to transmit the image to the terminal of the hiring party without revealing the appearance or gender of the applicant (user), realizing a fair selection process that is not influenced by gender or appearance. In addition, by performing identity verification using information on the identification document acquired by the photographing device and an image of the user, reliability can be ensured even in a remote interview where appearance, etc. are anonymized.

[0026] No. 4 The invention is ID photos can be taken A stationary photographing device and a computer connected to a terminal via a network, the photographing device Using a camera for taking ID photos A photographed image of the user and the photographing device Using the camera The identity verification documents of the user obtained image a receiving means for receiving the signal from the photographing device; An image of the user and an image of the user's identification document a remote interview means for performing processing for conducting a remote interview between the photographing device and the terminal; and an anonymization means for anonymizing the user in the video received from the photographing device during the remote interview and transmitting the video to the terminal. a program for managing an image of the user and an image of the identification document secretly from the terminal; It is.

[0027] No. 4 According to the present invention, a computer can be used as a server of the selection support system of the first invention, or 2It is possible to make the device function as a server of the present invention. Effect of the Invention

[0028] The present invention can provide a selection support system that can eliminate preconceived notions about an applicant's gender or appearance and achieve fair and reliable selection. [Brief description of the drawings]

[0029] [Figure 1] A block diagram showing the system configuration of a selection support system 1 according to a first embodiment of the present invention. [Diagram 2] FIG. 2 is a block diagram showing an example of the appearance of the photographing device 2. [Diagram 3] A block diagram showing the hardware configuration of the photographing device 2. [Figure 4] Figure showing an example of the hardware configuration of Server 3 [Diagram 5] FIG. 2 shows an example of the hardware configuration of a computer terminal used as the recruit terminal 4 and the applicant terminal 5. [Figure 6] A block diagram showing the functional configuration of the photographing device 2. [Figure 7] Block diagram showing the functional configuration of server 3 [Figure 8] FIG. 3 shows the data structure of the recruit registration information folder 331. [Figure 9] A diagram showing the data structure of the applicant information folder 332. [Figure 10] FIG. 2 shows the data structure of the hiring decision information folder 333. [Figure 11] A block diagram showing the functional configuration of the adopter terminal 4. [Figure 12] A block diagram showing the functional configuration of the applicant terminal 5. [Figure 13] Flowchart showing the flow of recruitment information registration process [Figure 14] A diagram showing an example of a recruitment information input form 51 [Figure 15] A diagram showing an example of ES (entry sheet) input form 61 [Figure 16]Flowchart showing the flow of application information registration processing [Figure 17] FIG. 13 is a diagram showing an example of a provision information setting screen 71. [Figure 18] Flowchart showing the flow of screening information registration processing [Figure 19] Flowchart showing the flow of identity verification information registration processing [Figure 20] A diagram explaining identity verification processing [Figure 21] Flowchart showing the flow of identity verification processing [Figure 22] Flowchart showing the interview date and time registration process [Figure 23] Flowchart showing the remote interview process [Figure 24] Flowchart showing the flow of anonymization processing [Diagram 25] FIG. 11 is a block diagram showing the functional configuration of a photographing device 2A according to a second embodiment; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0030] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings.

[0031] [First embodiment] FIG. 1 is a diagram showing a system configuration of a selection support system 1 according to a first embodiment of the present invention.

[0032] As shown in FIG. 1, the selection support system 1 is configured by a photography device 2, a server 3, a recruit terminal 4, and an applicant terminal 5, which are communicatively connected via a network 6. The network 6 is a LAN (Local Area Network). This includes a wide area network (WAN) that connects over a wider area, or a public communication line such as the Internet.

[0033] The photographing device 2 is a stationary photographing device installed at stations, stores, on the street, in schools, etc. The photographing device 2 has a function of photographing a user, generating an ID photo from the image according to the purpose and printing it, printing an image received from an applicant terminal 5 such as a user's smartphone, or downloading and printing an image previously uploaded by the user to an image server (not shown). In the present invention, the photographing device 2 has an identity verification function for verifying the identity of the user, and a remote interview function for conducting a remote interview with an applicant terminal 4 using the selection support system 1. The user can select and use one of the ID photo function, image print function, identity verification function, remote interview function, and other functions. The identity verification function and remote interview function will be described in detail later.

[0034] The photographing device 2 may have any shape and is not limited to a box type as shown in Fig. 2, but may also be an open type or stand type photographing device 2. The photographing device 2 is equipped with a camera 23, a monitor 28, a microphone 26, a speaker 27, etc. for conducting a remote interview. The camera 23 and monitor 28 for photographing can be used as the camera 23 and monitor 28 for a remote interview.

[0035] The server 3 is a computer that performs processing while transmitting and receiving information between the recruit terminal 4, the applicant terminal 5, and the photography device 2 in the selection support system 1, and manages information registered by the recruit and information registered by the applicant, mediates communication between the recruit and the applicant, and mediates processing for the recruit and the applicant to conduct remote interviews. Details of these processes will be described later. Note that although the server 3 shown in FIG. 1 is shown as one computer, the server 3 may be configured using multiple computers. For example, the server 3 may be configured separately for each function and include a web server, a database server, a mail server, a file server, etc.

[0036] The employed person terminal 4 is a computer terminal used by the employed person in the selection support system 1, and is a computer that can be connected to the server 3 via the network 6. The employed person terminal 4 can be a notebook PC, a desktop PC, a smartphone, a tablet, etc. The employed person terminal 4 is equipped with a camera 506, a monitor (display unit 504), a microphone 507, a speaker 508, etc. for conducting a remote interview. The employed person terminal 4 is also equipped with a web browser, and accesses a website for employed persons provided by the server 3 to view and register predetermined information. Alternatively, the employed person terminal 4 may be equipped with a dedicated application program, and predetermined information may be transmitted and received between the employed person terminal 4 and the server 3 in accordance with the application program, and information may be viewed and registered.

[0037] The applicant terminal 5 is a computer terminal used by an applicant in the selection support system 1, and is a computer that can communicate with the server 3 via the network 6. The applicant terminal 5 may be a notebook PC, desktop PC, smartphone, tablet, etc. The applicant terminal 5 is also equipped with a web browser, and accesses the applicant website provided by the server 3 to view and register predetermined information. Alternatively, the applicant terminal 5 may be equipped with a dedicated application program (selection support app 511) for using the selection support system 1, and predetermined information may be sent and received between the applicant terminal 5 and the server 3 in accordance with the selection support app 511, allowing the information to be viewed and registered.

[0038] Next, the configuration of each device will be described. Fig. 2 is a diagram showing the external configuration of the photographing device 2, and Fig. 3 is a block diagram showing the internal configuration of the photographing device 2. The photographing device 2 shown in the example of Fig. 2 is a box type with an open side, and a curtain 30 separates the outside from the inside (photography room). An operation panel 21, a coin mechanism 22, a camera 23, a lighting unit 24, a microphone 26, a speaker 27, a monitor 28, a code reader 35, etc. are provided on the front panel of the photography room. A control device 10 and a printer 25 are also stored inside the housing of the photographing device 2, and printed materials printed by the printer 25 are discharged from a printed material outlet 251 provided on the outer wall panel of the photographing device 2.

[0039] As shown in Fig. 3, the camera 23, the lighting unit 24, the operation panel 21, the microphone 26, the speaker 27, the monitor 28, the coin mechanism 22, the code reader 35, and the printer 25 are connected to the control device 10 inside the housing, and their operation is controlled by the control device 10. However, this is not limiting, and various other configurations may be used as appropriate.

[0040] The control device 10 is a computer equipped with a control unit 101, a ROM (Read Only Memory) 104, a RAM (Random Access Memory) 105, a storage unit 106, a communication unit 107, an I / O (Input / Output) control 102, an I / F (Interface) 103, etc. The control device 10 is connected to an operation panel 21, a speaker 27, a microphone 26, a monitor 28, etc. via the I / O control 102. The control device 10 is also connected to a coin mechanism 22, a printer 25, a code reader 35, etc. via the I / F 103.

[0041] The control unit 101 of the control device 10 is a CPU (Central Processing Unit) and centrally controls each unit of the photography device 2. The control unit 101 loads programs stored in the storage unit 106, ROM 104, etc. into a work area on the RAM 105 and executes them. The ROM 104 is a non-volatile memory and permanently stores programs such as a boot program and BIOS, data, etc. The RAM 105 is a volatile memory and temporarily stores programs and data loaded from the storage unit 106, ROM 104, etc., and also includes a work area used by the control unit 101 to perform various processes.

[0042] The storage unit 106 is a hard disk drive, a solid state drive, a flash memory, or the like, and stores programs executed by the control unit 101 during processing described below, data necessary for executing the programs, an OS, etc. These programs and data are read and executed by the control unit 101 as necessary.

[0043] The communication unit 107 has a communication control device, a communication port, etc., and is a communication interface that mediates communication via the network 6. The photographing device 2 is connected to the server 3, etc. via the network 6 to transmit and receive various data. The communication unit 107 may also be equipped with short-range wireless communication such as wireless LAN (Wi-Fi), Bluetooth (registered trademark), or an infrared communication unit, as a communication interface that mediates communication with an applicant terminal 5 such as a user's smartphone.

[0044] The I / O control 102 is an interface for inputting and outputting various types of information to and from the operation panel 21, the monitor 28, the microphone 26, the speaker 27, and the like.

[0045] The operation panel 21 is composed of a touch panel display and various buttons, etc., and displays various screens related to user operations and selections, and inputs input signals to the control unit 101 according to touch operations and button operations on the screen.

[0046] The microphone 26 picks up the voice and inputs it to the control unit 101 . The speaker 27 outputs the sound input from the control unit 101. For example, the sound of operation guidance is output from the speaker 27. When a remote interview is performed, the speaker 27 outputs the voice of the other party transmitted from the server 3. Note that a headset equipped with the microphone 26 and the speaker 27, or headphones / earphones may be provided.

[0047] The monitor 28 is composed of a display device such as an LCD panel and a logic circuit (such as a video adapter) for executing display processing in cooperation with the display device, and displays display data input under the control of the control unit 101 on the display device.

[0048] The I / F 103 is an interface for connecting peripheral devices such as the coin mechanism 22, the printer 25, the code reader 35, etc., and for inputting and outputting various types of information. The coin mechanism 22 includes an input port for coins and bills, a change return port, a receipt outlet, a receipt printer, etc., and performs deposit and change processing.

[0049] The code reader 35 reads codes such as bar codes and QR codes (registered trademark), and inputs them to the control unit 101 .

[0050] The printer 25 is a device that prints images and the like on a predetermined sheet of paper. Printed material printed by the printer 25 is discharged from a print outlet 251. There is no particular restriction on the type of printer 25 and the number of printers to be installed.

[0051] The illumination unit 24 is a surface light source located in front of the subject, and emits light. The illumination unit 24 is connected to a light source (strobe), and the timing and amount of light emitted by the light source are controlled according to a control signal input from the control unit 101. The camera 23 is a digital camera that takes an image of the user, and is configured with an image pickup element such as a CCD (Charge Coupled Device), a CMOS (Complementary Metal Oxide Semiconductor), etc. The camera 23 inputs the captured image (including a moving image and a still image) to the control unit 101.

[0052] Fig. 4 is a block diagram showing a hardware configuration of the server 3. As shown in Fig. 4, the server 3 can be realized by a computer configured by connecting a control unit 301, a storage unit 302, and a communication unit 303 via a bus 309 or the like. However, the present invention is not limited to this, and various configurations can be used as appropriate.

[0053] The control unit 301 is composed of a CPU, a ROM, a RAM, etc. The CPU calls up a program stored in the storage unit 302, the ROM, a recording medium, etc., into a work memory area on the RAM and executes it, drives and controls each device connected via the bus 309, and realizes the processing performed by the server 3.

[0054] The storage unit 302 is a hard disk drive, a solid state drive, a flash memory, or the like, and stores programs executed by the control unit 301 in the processes described below, data necessary for executing the programs, an OS, etc. These programs and data are read out as necessary by the control unit 301 and transferred to the RAM, and are then read out by the CPU and executed as various means. Details of the processes executed by the server 3 will be described later.

[0055] The communication unit 303 has a communication control device, a communication port, etc., and is a communication interface that mediates communication between the server 3 and the network 6. The communication unit 303 communicates with the photography device 2, the hired person terminal 4, the applicant terminal 5, and other computers via the network 6. The bus 309 is a path that mediates the exchange of control signals, data signals, etc. between each unit.

[0056] Fig. 5 is a block diagram showing the hardware configuration of a computer terminal used as the employed person terminal 4 and the applicant terminal 5. As shown in Fig. 5, the employed person terminal 4 and the applicant terminal 5 are configured by connecting, for example, a control unit 501, a memory unit 502, a communication unit 503, etc. via a bus 509. However, this is not limited to this, and various configurations can be used as appropriate. For example, the camera 506, the microphone 507, the speaker 508, the display unit 504, the input unit 505, etc. may be external. The control unit 501, the memory unit 502, and the communication unit 503 are substantially similar to the control unit 301, the memory unit 302, and the communication unit 303 described above.

[0057] The display unit 504 is composed of a display device such as a liquid crystal panel, and a logic circuit (such as a video adapter) for executing display processing in cooperation with the display device, and displays display data input under the control of the control unit 501 on the display device. Note that the display unit 504 may be a touch panel display in which an input device such as a touch panel is integrally provided on the display screen.

[0058] The input unit 505 includes, for example, an input device such as a touch panel, a keyboard, a pointing device such as a mouse, a numeric keypad, etc., and inputs input data to the control unit 501.

[0059] The camera 506 is a video camera using an imaging element such as a CCD image sensor or a CMOS image sensor, and inputs the captured image to the control unit 501 . The microphone 507 picks up voice and inputs it to the control unit 501 . The speaker 508 outputs the sound input from the control unit 501. Note that the microphone 507 and the speaker 508 may be a headset or headphones / earphones as shown in FIG.

[0060] Next, the functional configuration of each device in the selection support system 1 will be described. Fig. 6 is a block diagram showing the functional configuration of the photographing device 2. As shown in Fig. 6, the photographing device 2 has a photographing unit 201, a personal identification information acquisition unit 202, a personal identification information transmission unit 203, a code input unit 204, and a remote interview processing unit 205, etc. The remote interview processing unit 205 has a video / audio input / output unit 206, a remote interview control unit 207, etc. Each of these units is realized by the control unit 101 of the control device 10 of the photographing device 2 performing processing.

[0061] The photographing unit 201 controls the camera 23, the lighting unit 24, etc. to perform photographing processing and obtains still or moving images of the user.

[0062] The personal identification information acquisition unit 202 executes a process for acquiring a face image of a user and information on the personal identification document of the user. Personal identification documents are identification cards used for personal identification by government agencies, financial institutions, mobile phone carriers, etc., and include, for example, a driver's license, a My Number card, a residence card, a special permanent resident card, etc.

[0063] The personal identification information acquisition unit 202, for example, captures a facial image of the user using the camera 23. The personal identification information acquisition unit 202 also captures still images of the front and back of the user's personal identification document to obtain a card face image. The personal identification information acquisition unit 202 may also capture a moving image of the user moving the personal identification document using the camera 23 to obtain information on the thickness of the personal identification document.

[0064] The personal identification information transmitting unit 203 transmits the image of the personal identification document acquired by the personal identification information acquiring unit 202 and the face image of the user captured by the photographing unit 201 to the server 3. The server 3 performs personal identification processing using the image of the personal identification document and the face image of the user.

[0065] The code input unit 204 accepts input (reading) of various codes issued by the server 3. For example, in the selection support system 1, an applicant code is issued to a user (hereinafter referred to as an applicant) who applies for recruitment information. The applicant code is identification information that identifies the applicant, and includes numerical information or text information. The applicant code is converted into a QR code or a barcode and notified to the applicant terminal 5.

[0066] An applicant accesses the server 3 from the applicant terminal 5, registers predetermined information (personal information such as name, date of birth, etc.), and obtains an applicant code issued by the server 3. The server 3 links the information registered from the applicant terminal 5 (personal information such as name, date of birth, etc.) with the applicant code and stores it in a predetermined folder (applicant information folder 332) in the storage unit 302. When an applicant uses the photographing device 2 for identity verification or a remote interview, the applicant holds the applicant code (QR code) over the code reader 35 to have it read, and enters the value of the applicant code.

[0067] The identity verification information sending unit 203 of the photographing device 2 transmits the image of the identity verification document and the image of the applicant acquired by the identity verification information acquiring unit 202 to the server 3 together with the applicant code input by the code input unit 204. The server 3 (identification unit 312) compares the acquired image of the identity verification document and the image of the applicant with pre-registered information (personal information such as name, date of birth, etc.) to verify the identity of the applicant.

[0068] The remote interview processing unit 205 performs processing for conducting a remote interview between the photographing device 2 and the hired candidate terminal 4. Video / audio input / output unit 206 superimposes the video input from camera 23 and the audio input from microphone 26, compresses and encodes the superimposed data, and transmits it to server 3. It also decodes the superimposed data of video and audio received from server 3 and separates it into video data and audio data. The audio data is output from speaker 27, and the video data is input to monitor 28 and displayed in synchronization with the audio.

[0069] In order to carry out remote interview processing, the remote interview control unit 207 controls communication with the server 3, connection with the other party, starting and stopping the remote interview, and inputting and outputting video and audio. If the identity verification process during the remote interview fails, the remote interview control unit 207 interrupts the remote interview.

[0070] The video and audio of the applicant inputted into the photographing device 2 are anonymized by the server 3 and transmitted to the terminal of the person being interviewed (the hired person terminal 4). That is, the processing is performed so that the applicant's appearance and voice cannot be recognized by the other person. In the anonymization processing, for example, the appearance of the applicant is expressed using a CG model, or the voice is changed. In order to perform the anonymization processing, the remote interview control unit 207 of the photographing device 2 accepts the selection of the character and the selection of the voice, and performs pre-processing such as setting up face tracking and motion capture. The anonymization processing will be described later.

[0071] Fig. 7 is a block diagram showing the functional configuration of the server 3. As shown in Fig. 7, the server 3 has an identity verification information receiving unit 311, an identity verification unit 312, a code transmitting unit 313, a remote interview processing unit 314, a recruitment information registration unit 316, an application information registration unit 317, an information management unit 318, an information presenting unit 319, a screening information registration unit 320, a contact unit 321, an interview information registration unit 322, a memory unit 302, and the like. The remote interview processing unit 314 has an anonymization unit 315. The memory unit 302 is provided with an employed person registration information folder 331, an applicant information folder 332, an employment decision information folder 333, and the like.

[0072] The personal identification information receiving unit 311 receives from the photographing device 2 the image of the applicant photographed by the photographing device 2 and the image of the applicant's personal identification document acquired by the photographing device 2 . The identity verification unit 312 verifies the identity of the user using the image of the applicant and the image of the identity verification document received by the identity verification information receiving unit 311 .

[0073] The code sending unit 313 sends the applicant code issued when the applicant's personal information (such as name and date of birth) was registered from the applicant terminal 5 to the applicant terminal 5. The code sending unit 313 sends the applicant code to the applicant terminal 5, for example, together with a notice of the screening results.

[0074] The remote interview processing unit 314 performs processing for conducting a remote interview between the photographing device 2 and the employed person terminal 4. The remote interview processing unit 314 performs identity verification processing of the user (applicant) of the photographing device 2 before conducting a remote interview. The remote interview processing unit 314 also performs authentication processing at the time of login to the employed person terminal 4. If the authentication is successful, the applicant is allowed to enter a virtual interview room and the interview begins. The communication unit 303 also transmits the video data and audio data received from the photographing device 2 and the employed person terminal 4 to the other party's photographing device 2 and employed person terminal 4. At this time, the remote interview processing unit 314 anonymizes the applicant using the anonymization unit 315 for the video data and audio data input from the photographing device 2 and transmits the anonymized data to the other party's employed person terminal 4.

[0075] The anonymization unit 315 decodes the compressed and encoded data of the video and audio data received from the photography device 2, and separates and extracts the video data and the audio data. For the video data, for example, a 3DCG model is used to express the person (applicant) included in the video. The anonymization unit 315 recognizes the user's facial expression and movement by face tracking or motion capture, and generates video data so that the 3DCG model has the same facial expression and movement as the user. For the audio data, the anonymization unit 315 changes the sound quality of the user or converts it into a predetermined sound. The anonymized video data and audio data are superimposed and compressed and encoded, and transmitted to the employed person terminal 4 via the communication unit 303. The anonymization unit 315 may anonymize both the video and audio, or may anonymize only one of them. In this embodiment, an example in which both the video and audio are anonymized will be described.

[0076] The recruitment information registration unit 316 accepts the registration of recruitment information from the employed person terminal 4. For example, the server 3 opens a website for employed persons to register the recruitment information, and accepts the input of recruitment information from the employed person terminal 4 via this website. The recruitment information includes recruitment requirements 331a and ES question information 331b, which will be described later. The recruitment information registration unit 316 stores the information registered from the employed person terminal 4 in an employed person registration information folder 331 in the storage unit 302.

[0077] 8 shows the data configuration of the recruit registration information folder 331. The recruit registration information folder 331 stores recruitment requirements 331a, ES (entry sheet) question information 331b, company information 331c, recruiter information 331d, interview information 331e, company_recruiter information 331f, company_ES question information 331g, etc.

[0078] The recruitment requirements 331a include information on the company code, registration date and time, update date and time, and content. The company code is identification information for identifying the company (recruiter), and is issued by the information management unit 318 of the server 3 when the recruiter terminal 4 creates an account in the selection support system 1. The registration date and time and update date and time are information on the date and time when the recruiter terminal 4 registered and updated the content of the recruitment requirements 331a, respectively, and are assigned by the information management unit 318 of the server 3. The content of the recruitment requirements 331a includes, for example, employment conditions such as application qualifications, recruitment qualifications, and work location, working conditions such as salary, and other special notes.

[0079] The ES (entry sheet) question information 331b includes information such as the ES question code, the content of the question (question 1, question 2, question 3, ..., special notes), registration date and time, update date and time, etc. The ES question code is identification information for identifying the ES question information 331b, and is issued by the information management unit 318 of the server 3 when the employed person terminal 4 registers the ES question information 331b. The registration date and time and update date and time are information on the date and time when the employed person terminal 4 registered and updated the ES question information 331b, respectively, and are assigned by the information management unit 318 of the server 3.

[0080] The company information 331c includes information such as a company code, a company name, an address, etc. The company information 331c is information registered by a recruiter or the like when the recruiter terminal 4 creates an account in the selection support system 1. The recruiter information 331d includes information such as a recruiter code, affiliation, name, login PW (password), registration date and time, and login date and time. The recruiter information 331d is registered by a recruiter at a company (employer). The recruiter code and registration date and time are assigned by the information management unit 318 of the server 3 when the recruiter information 331d is registered. The login date and time is recorded as the date and time when the recruiter logged in to the selection support system 1.

[0081] The interview information 331e includes information such as an interview code, a company code, date, time, location, and person in charge. The interview code is information that identifies each interview, and is assigned by the information management unit 318 of the server 3 when the hired employee terminal 4 registers the interview information 331e. The date, time, location, and person in charge are information on the date, time, location, and interviewer of the interview, respectively, and are registered by the hired employee terminal 4.

[0082] The company_recruiter information 331f includes information on the company code, recruiter code, authority, registration date and time, and update date and time. The authority information is registered by the recruiter terminal 4, and the registration date and time and update date and time are generated by the information management unit 318 of the server 3. The company_ES question information 331g includes information such as the company code, the ES question code, the hiring category, the hiring year, the registration date and time, and the update date and time. The company_ES question information 331g is registered by the recruiter terminal 4. The hiring category and hiring year information are registered by the recruiter terminal 4, and the registration date and time and the update date and time are generated by the information management unit 318 of the server 3.

[0083] Returning to the explanation of Figure 7. The application information registration unit 317 accepts the registration of personal information of applicants (hereinafter referred to as applicant information 332a) and the registration of employment decision information (ES response information 333a). The server 3 accepts the input of applicant information 332a and employment decision information (ES response information 333a) from the applicant terminal 5, for example, via an applicant website that can be viewed by applicants. The application information registration unit 317 stores the applicant information 332a input by the applicant terminal 5 in the applicant information folder 332 of the storage unit 302. In addition, it stores the ES response information 333a input by the applicant terminal 5 in the employment decision information folder 333 of the storage unit 302.

[0084] In the present invention, the server 3 manages the information stored in the applicant information folder 332 in a confidential manner so that it cannot be viewed from the employed person terminal 4. The employed person terminal 4 can view only the information stored in the employment decision information folder 333 out of the information registered by the applicant.

[0085] As shown in FIG. 9, applicant information folder 332 stores applicant information 332a, personal identification information 332b, and the like. The applicant information 332a includes an applicant code, name, date of birth, gender, address, email address, career history, identity verification flag, etc. The applicant code is identification information for identifying the applicant, and is assigned by the information management unit 318 of the server 3 when the applicant terminal 5 registers the applicant information 332a. The name, date of birth, gender, address, email address, and career history are information entered by the applicant. The identity verification flag is set to "0" if identity verification by the server 3 has not been processed or authentication has failed, or if identity verification information 332b has not been registered, and is set to "1" if identity verification processing is performed by the server 3 and authentication is successful.

[0086] The identity verification information 332b includes an applicant code, an identity verification document (image), a facial image, an identity verification flag, etc. The identity verification document and facial image are information transmitted from the photographing device 2, and are stored in association with the applicant code. The identity verification flag is set to "0" if identity verification by the server 3 has not been processed or authentication has failed, or if the identity verification information 332b has not been registered, and is set to "1" if identity verification processing is performed by the server 3 and authentication is successful.

[0087] 10, the employment decision information folder 333 stores ES response information 333a registered from the applicant terminal 5. The employment decision information folder 333 also stores screening progress information 333b indicating the progress and results of the screening, interview information 333c which is information regarding the interview, and the like.

[0088] The ES response information 333a includes information on the applicant code, ES question code, answer 1, answer 2, answer 3, notes, registration date and time, and update date and time. The applicant code is the applicant code of the applicant who answered, and the ES question code is information indicating which ES question the answer is for. The information on answer 1, answer 2, answer 3, and notes is information input from the applicant terminal 5. The registration date and time and update date and time are generated by the information management unit 318 of the server 3.

[0089] The screening progress information 333b is information indicating the recruit, the applicant, the implementation status and the result of the screening, and includes information such as the company code, the applicant code, the hiring year, the screening flag, the ES response flag, the hiring category, the registration date and time, and the update date and time. The screening flag is information indicating the screening stage and the screening result, and is assigned values ​​such as "0" if not screened, "1" if the ES screening is passed, "2" if the first interview is passed, "3" if the second interview is passed, "4" if the applicant is passed, and "5" if the applicant is not passed. The screening flag is registered and updated by the information management unit 318 according to the input of the implementation status and the result of the screening from the recruiter terminal 4. The ES response flag is set to "1" when the applicant registers ES response information 333a in response to the ES question information 331b presented by the recruiter, that is, when an application is made in response to the recruitment information. When the ES response information 333a is not registered, it is set to "0". The hiring year and hiring category are information registered from the recruiter terminal 4. The registration date and time and the update date and time are stored and updated by the information management unit 318 of the server 3.

[0090] The interview information 333c is information relating to an interview conducted between a recruit and an applicant, and includes an interview code, which is information identifying the interview, an applicant code indicating the applicant, as well as information such as an interview flag, interview level, and interview date and time. The interview flag indicates the status of the interview, and for example, "0" is stored if the interview has not been conducted, and "1" is stored if the interview has been conducted. The interview level is information indicating the stage of the interview, such as first interview, second interview, etc. The interview flag, interview level, and interview date and time are stored based on information entered from the recruit terminal 4.

[0091] Returning to the explanation of Fig. 7, the information management unit 318 of the server 3 manages the information registered in the server 3. For example, when the information management unit 318 receives recruitment information (recruitment requirements 331a, ES question information 331b, company information 331c, recruiter information 331d, interview information 331e, company_recruiter information 331f, company_ES question information 331g, etc.) from the recruiter terminal 4, it stores it in the recruiter registration information folder 331 and assigns code information and information such as the registration date and time and the update date and time.

[0092] Furthermore, when applicant information 332a is registered from the applicant terminal 5, the information management unit 318 stores it in the applicant information folder 332, assigns an applicant code, and assigns information such as the registration date and time and the update date and time, etc. Furthermore, identity verification is performed by the identity verification unit 312 of the server 3, and if authentication is successful, the identity verification flag (initially "0") is set to "1".

[0093] Furthermore, when the information management unit 318 receives the applicant's identity verification information 332b (image of the identity verification document and face image) from the photographing device 2, it links it to the applicant code and stores it in the applicant information folder 332. Identity verification is carried out by the identity verification unit 312 of the server 3, and if the authentication is successful, the identity verification flag (initial state is "0") is set to "1." The information management unit 318 manages the applicant information 332a and identity verification information 332b in secret so that they cannot be referenced from the employer terminal 4.

[0094] Furthermore, when the information management unit 318 receives ES response information 333a from the applicant terminal 5, it links it with the applicant code and stores it in the employment decision information folder 333. At this time, the information management unit 318 sets the ES response flag (initially "0") in the screening progress information 333b to "1." The information management unit 318 provides the applicant's ES response information 333a so that it can be referenced on the employer terminal 4.

[0095] Furthermore, when the information management unit 318 receives information on the implementation status and results of the screening from the employed person terminal 4, it sets the screening flag (initial state is "0") of the screening progress information 333b of the corresponding applicant to a value corresponding to the implementation status and results of the screening. It also updates and stores information such as the registration date and time and the update date and time of the screening progress information 333b. Furthermore, when the interview date and time are registered from the applicant terminal 5 or the employed person terminal 4, the information management unit 318 generates interview information 333c and stores it in the employment judgment information folder 333. Furthermore, when information on the implementation status and interview level of the interview is sent from the employed person terminal 4, it updates the interview flag and updates the interview level information.

[0096] The information presentation unit 319 presents the information stored in the employment determination information folder 333 so that it can be viewed on the employed person terminal 4. For example, the information presentation unit 319 presents ES answer information 333a to ES question information 331b registered by the employed person so that it can be viewed on the employed person website.

[0097] The screening information registration unit 320 accepts input of the screening status and results from the recruit's terminal 4. For example, the screening information registration unit 320 provides an input form for inputting the screening status and results on a recruit's website. The information management unit 318 updates and records the screening progress information 333b based on the input screening status and results.

[0098] The communication unit 321 sends a message to the applicant terminal 5 according to the implementation status and results of the screening. Specifically, for example, when the ES screening is passed, a message to that effect is sent along with a QR code indicating the applicant code to the applicant terminal 5. If the applicant passes or fails, a message to that effect is sent to the applicant terminal 5. The form of communication may be, for example, sending an email to a registered email address or using the notification function of the selection support app 511.

[0099] The interview information registration unit 322 accepts registration of information regarding remote interviews from the employed person terminal 4 and the applicant terminal 5. For example, the interview information registration unit 322 accepts registration of candidate dates for remote interviews, whether the interview has been conducted or not, the level of the interview, etc. from the employed person terminal 4 on the employed person website. In addition, from the applicant terminal 5, registration of a desired date and time from among the candidate dates for remote interviews on the applicant website.

[0100] 11 is a block diagram showing the functional configuration of the hired employee terminal 4. As shown in FIG. 11, the hired employee terminal 4 includes a selection processing unit 401 and a remote interview processing unit 406.

[0101] The selection processing unit 401 is a functional unit for performing selection processing using the selection support system 1, and is realized by the control unit 501 of the employed person terminal 4 performing processing while transmitting and receiving information to and from the server 3. The selection processing unit 401 has functional units such as a recruitment information input unit 402, a screening information input unit 403, an application information viewing unit 404, a contact receiving unit 405, etc.

[0102] The recruitment information input unit 402 performs a process for registering the recruitment information in the server 3. Specifically, the employer terminal 4 accesses the employer's website in the server 3 and inputs the recruitment information in accordance with a predetermined input form. As described above, the recruitment information includes the recruitment requirements 331a, ES (entry sheet) question information 331b, company information 331c, recruiter information 331d, interview information 331e, company_recruiter information 331f, company_ES question information 331g, etc.

[0103] The screening information input unit 403 performs processing for registering screening information (such as the implementation status and results of the screening) in the server 3. Specifically, the employed person terminal 4 accesses the website for employed people on the server 3 and inputs the screening information (such as the implementation status and results of the screening) according to a predetermined input form.

[0104] The application information viewing unit 404 performs processing to view the contents of the application submitted by the applicant. Specifically, the employed person terminal 4 accesses the employed person's website on the server 3 and views the application information. In the selection support system 1 of the present invention, the application information disclosed to the employed person terminal 4 is limited to the employment decision information in FIG.

[0105] The contact receiving unit 405 receives contact from the server 3. For example, when an applicant registers ES response information 333a in response to the recruitment information (ES question information 331b) registered by the recruit, or when an interview date and time is registered from the applicant terminal 5, the contact receiving unit 405 receives a contact (email or notification) containing the content from the server 3.

[0106] The remote interview processing unit 406 is a functional unit for conducting remote interviews using the selection support system 1, and is realized by the control unit 501 of the employed person terminal 4 performing processing while transmitting and receiving information to and from the server 3. The remote interview processing unit 406 has a video / audio input / output unit 407 and a remote interview control unit 408.

[0107] The video / audio input / output unit 407 superimposes the video input from the camera 506 of the adopter terminal 4 and the audio input from the microphone 507, compresses and encodes the superimposed data, and transmits it to the server 3. It also decodes the superimposed data of audio and video received from the server 3, and separates it into audio data and video data. The audio data is output from the speaker 508, and the video data is input to the display unit 504 and displayed in synchronization with the audio.

[0108] The remote interview control unit 408 controls communication with the server 3 and controls the input and output of video and audio in order to perform remote interview processing. Video and audio of the user (applicant) of the photographing device 2, who is the person being interviewed, is anonymized by the server 3 and transmitted to the hired person terminal 4.

[0109] Fig. 12 is a block diagram showing the functional configuration of the applicant terminal 5. As shown in Fig. 12, the applicant terminal 5 is equipped with a selection support application 511, and a control unit 501 executes processing in accordance with the selection support application 511 to perform various processes while transmitting and receiving information to and from the server 3. The selection support application 511 has functional units such as a recruitment information viewing unit 512, an application information input unit 513, an applicant code receiving unit 514, an interview date and time input unit 515, a contact receiving unit 516, etc.

[0110] The employment information viewing unit 512 acquires multiple pieces of employment information registered in the server 3 and displays them for viewing. For example, the applicant terminal 5 accesses the applicant's website on the server 3 and acquires the employment information page. It is assumed that the employment information page contains employment information for each company.

[0111] The application information input unit 513 performs processing for registering the application information on the server 3. Specifically, the applicant terminal 5 accesses the applicant's website on the server 3 and inputs the application information according to a predetermined input form. As described above, the application information includes applicant information 332a, which is the applicant's personal information, and ES response information 333a.

[0112] The applicant code receiving unit 514 receives the applicant code transmitted from the server 3. The applicant code is transmitted from the server 3 when the applicant passes the ES screening. The applicant code is transmitted from the server 3 in the form of, for example, numerical information, character information, a QR code, a barcode, or the like. The applicant code is used when registering the personal identification information 332b in the photograph taking device 2 and when conducting a remote interview.

[0113] The interview date and time input unit 515 performs processing for registering the desired interview date and time in the server 3. Specifically, the applicant terminal 5 accesses the applicant's website on the server 3 and inputs the desired interview date and time according to a specific input form. The contact receiving unit 516 receives contact from the server 3. For example, contact such as the result of the screening, contact regarding the implementation of identity verification, and registration of interview date and time is sent from the server 3. The form of contact includes email, notification of the selection support application 511, and the like.

[0114] Next, a description will be given of the flow of the process executed by the selection support system 1. First, the recruitment information registration process will be described with reference to Fig. 13. The recruitment information registration process is a process carried out between the server 3 and the employed person terminal 4. First, the employed person terminal 4 accesses the server 3 of the selection support system 1 via a website or the like and requests the creation of a new account (step S101). The server 3 creates an account for the employed person terminal 4 (step S102). In step S102, the server 3 creates a company code and stores it in the employed person registration information folder 331 as company information 331c. Then, the server 3 transmits the URL of a website (registration site) for registering the recruitment information to the employed person terminal 4 (step S103). The employed person terminal 4 receives the URL of the registration site (step S104), accesses the registration site (step S105), and inputs information such as the company information 331c, the hiring manager information 331d, and the recruitment information (recruitment requirements 331a, ES question information 331b) (step S106).

[0115] In step S106, it is desirable for the server 3 to provide a predetermined input form on the registration site. Fig. 14 shows an example of a recruitment requirements input form 51 for registering the recruitment requirements 331a, and Fig. 15 shows an example of an ES (entry sheet) input form 61 for registering the ES question information 331b and the ES answer information 333a.

[0116] The recruitment requirements input form 51 shown in FIG. 14 is provided with a condition input field 52 for inputting conditions such as application qualifications, recruitment qualifications, work location, number of hires, starting salary, etc., a special notes input field 53 for inputting special notes such as the URL of recruitment information on a company's website, a send button 55 which is operated to send the input information, and a cancel button 56 which is operated to return to the original screen.

[0117] 15 is provided with a question and answer input field 62 for inputting questions and answers, a special notes input field 63 for inputting special notes, a send button 65 operated when sending input information, a cancel button 66 operated when returning to the previous screen, etc. When registering ES question information 331b on the employed applicant terminal 4, the content of the question (question) is input in the question and answer input field 62 of the ES input form 61. The number of questions (questions) in the question and answer input field 62 is arbitrary. Furthermore, when entering ES response information 333a on the applicant terminal 5, the question and answer input field 62 is displayed with the content of the question (question) reflected.

[0118] When the recruitment information (recruitment requirements 331a, ES question information 331b, etc.) is input from the recruit terminal 4 and transmitted to the server 3 (step S107 in FIG. 13), the server 3 receives the input information (step S108). The server 3 stores the information received in step S108 in the recruit registration information folder 331 (step S109).

[0119] Next, the application information registration process will be described with reference to Fig. 16. The application information registration process is a process carried out between the server 3 and the applicant terminal 5. When the selection support application 511 is launched on the applicant terminal 5, the applicant terminal 5 accesses a website for applicants provided by the server 3 (step S201). When the applicant terminal 5 selects a recruitment information page on the applicant website, the applicant terminal 5 requests the server 3 to view the recruitment information (step S202). In response to the request, the server 3 transmits a list of registered recruitment information and the recruitment requirements 331a, etc. to the applicant terminal 5 (step S203). In steps S202 to S203, for example, search conditions may be accepted from the applicant terminal 5, and the server 3 may provide recruitment information that matches the conditions.

[0120] When applying for a recruitment information item, the applicant designates the recruitment information item (recruitment requirements 331a) for which the applicant wishes to apply from the recruitment information page and presses the Entry (Apply) button (step S204). The server 3 then transmits the URL of the applicant's registration site to the applicant terminal 5 (step S205). Upon receiving the URL of the applicant's registration site (step S206), the applicant terminal 5 accesses the registration site (step S207) and first inputs the applicant's personal information (applicant information 332a) (step S208). In step S208, it is preferable that the server 3 (registration site) is provided with a predetermined input form. The applicant inputs personal information and career information such as name, date of birth, sex, address, email address, and career history from the applicant terminal 5 according to the input form, and transmits the information to the server 3 (step S208).

[0121] The server 3 receives the personal information and career information transmitted from the applicant terminal 5 (step S209), issues an applicant code, and stores it in the applicant information folder 332 as applicant information 332a (step S210). At this stage, the identity verification flag of the applicant information 332a is set to "0" (=unconfirmed). After storing the applicant information 332a in the applicant information folder 332, the server 3 generates screening progress information 333b and stores it in the employment decision information folder 333 (step S211). At this stage, the screening flag of the screening progress information 333b is set to "0" (=unscreened), and the ES response flag is set to "0" (=unanswered).

[0122] The applicant registration site may accept the setting of the range of information to be provided to the employer. For example, in step S208, the applicant terminal 5 acquires and displays a provided information setting screen 71 shown in FIG. 17 from the applicant website, and sets information not to be provided to the employer and information to be provided to the employer. The provided information setting screen 71 is provided with an input field 72 for inputting information not to be provided to the employer, an input field 73 for inputting information to be provided to the employer, a special notes input field 74 for inputting special notes, a send button 75 operated when transmitting the input information, a cancel button 76 operated when returning to the original screen, and the like. In the initial setting, personal information such as name, date of birth, sex, address, email address, and career history, and face image are set as information not to be provided.

[0123] Next, the applicant obtains the ES input form 61 from the applicant registration site and inputs answers to the ES questions according to the input form. The ES input form 61 reflects the ES question information 331b that is linked to the recruitment information specified in step S204 and stored. The applicant terminal 5 transmits the ES response information 333a entered in the ES input form 61 to the server 3 (step S212). When the server 3 receives the ES response information 333a transmitted from the applicant terminal 5 (step S213), it stores it in the employment decision information folder 333 (step S214). In addition, the server 3 sets the ES response flag in the screening progress information 333b to "1" (=answered) (step S215).

[0124] Next, the screening information registration process will be described with reference to Fig. 18. The screening information registration process is a process carried out between the server 3 and the employed person terminal 4. The recruiter accesses the recruit's website of the selection support system 1 from the recruit's terminal 4 and inputs login information such as a login password (step S301). The server 3 performs authentication processing based on the login information, and if authentication is successful, sends a menu screen to the recruit's terminal 4 (step S302). The recruit's terminal 4 receives the menu screen from the server 3 and displays it (step S303).

[0125] The menu screen of the recruiter's website has links to various menus such as the recruitment information registration site (the above-mentioned registration site), an application information confirmation menu, a remote interview menu, etc. When the application information confirmation menu is selected (step S304), the server 3 reads out and transmits the recruitment decision information (ES response information 333a) applied for the recruitment information by the recruiter (step S305). The recruiter's terminal 4 receives and displays the recruitment decision information (ES response information 333a) (step S306).

[0126] The recruiter refers to the employment decision information (ES response information 333a) and performs ES (entry sheet) screening. Then, the recruiter inputs the results of the ES screening (step S307). The recruiter website displays an input form for the screening results and accepts the input of the screening results. For example, the display screen of the employment decision information (ES response information 333a) by each applicant displayed in step S306 has an input field for the screening results, and if either pass or fail is input in this input field, the screening results are linked to the applicant code and transmitted to the server 3. If the ES screening is passed (successful), the screen transitions to an input form for inputting interview information 331e (date and time, place, person in charge, etc.), and the input of the interview information 331e is accepted (step S308). The recruiter terminal 4 transmits the input screening results and interview information 331e linked to the applicant code (step S309).

[0127] When the server 3 receives the screening result and the interview information 331e (step S310), it updates and records the screening flag of the screening progress information 333b to "1" (=ES passed) (step S311). In addition, it registers the input interview information 331e in the employed person registration information folder 331 (step S312).

[0128] The server 3 notifies the applicant terminal 5 of the screening result. If the applicant passes the ES, the applicant code is transmitted together with the screening result, and the applicant is notified to carry out identity verification at the photographing device 2 (step S313). If the applicant fails, a notice to that effect is sent.

[0129] When the applicant terminal 5 receives the screening results and the applicant code, the applicant goes to the photographing device 2 and carries out the personal identification information registration process. The personal identification information registration process will be described with reference to FIG.

[0130] When a user (applicant) enters the photography room, the photography device 2 displays a top screen on the operation panel 21 (step S401). The top screen has buttons for selecting various services, such as a photo ID service, an image print service, an identity verification service, and a remote interview service. When the identity verification menu is selected by the user (step S402), the process proceeds to identity verification menu processing.

[0131] Instead of selecting a service (menu) on the top screen, a QR code may be held over the code reader 35. The code (QR code, barcode, or numerical or textual information, etc.) is an applicant code issued by the server 3, which the applicant has received in advance from the server 3 on his / her own terminal (applicant terminal 5).

[0132] The applicant displays an applicant code (QR code) on the applicant terminal 5 (step S403) and holds the QR code over the code reader 35 of the photographing device 2, which reads the QR code (step S404). Note that in the process of step S404, instead of reading the QR code, input of the code value may be accepted. Once reading of the QR code / input of the code value is completed, the photographing device 2 uses the camera 23 to photograph the identification document and the user (steps S405 and S406).

[0133] FIG. 20 is a diagram showing how the identification document is photographed and the user is photographed. The photographing device 2 performs the photographing process while displaying the photographing guide screens 81 to 85 as shown in FIG. 20 on the operation panel 21 or the monitor 28. First, as shown in FIG. 20(a), a frame line is displayed on the photographing guide screen 81, and a message is displayed to include the front side of the identification document within the frame line. When the shutter button is pressed, the front side of the identification document is photographed as a still image. Next, as shown in FIG. 20(b), a video recording button is displayed on the photographing guide screen 82, and an instruction message is displayed to move the identification document for several seconds after the button is pressed. When the video recording button is pressed, the identification document is photographed as a video. Next, as shown in FIG. 20(c), a frame line is displayed on the photographing guide screen 83, and a message is displayed to include the back side of the identification document within the frame line. When the shutter button is pressed, the back side of the identification document is photographed as a still image.

[0134] Next, the photographing device 2 takes a facial image of the user (applicant). As shown in FIG. 20(d), the photographing device 2 displays a frame line for the face and body on the photographing guide screen 84, and displays a message to fit the face within the frame. When the shutter button is pressed with the face positioned within the frame, a still image of the face is taken. Next, as shown in FIG. 20(e), an instruction message is displayed to tilt the face in accordance with the movement of the frame while facing forward. The photographing device 2 takes a video of this process. Note that the photographing procedure in FIG. 20 is one example, and photographing may be performed using other procedures.

[0135] Once the photographing is completed, the photographing device 2 transmits images of the identification document (still images of the front and back, and a moving video) and a facial image (a still image and a video capturing the movement) together with the applicant code to the server 3 (step S407).

[0136] The server 3 receives the image of the identification document, the face image, and the applicant code from the photographing device 2 (step S408). Then, the server 3 performs an identity verification process based on the received information (step S409). The identity verification process is performed, for example, according to the procedure shown in FIG. 21.

[0137] As shown in FIG. 21, in the identity verification process, the control unit 301 of the server 3 obtains an image of the received identity verification document and obtains the applicant information 332a from the applicant information folder 332 (step S501). The control unit 301 of the server 3 judges whether there is any inconsistency in the information written on the front side of the identity verification document from the image of the front side (step S502). For example, it judges whether the name, date of birth, and address written on the front side match the applicant information 332a. The control unit 301 of the server 3 also obtains thickness information of the identity verification document from a video of the identity verification document being moved, and judges whether the identity verification document has an appropriate thickness (step S503). The control unit 301 of the server 3 also judges whether there is any inconsistency in the information written on the back side from the image of the back side of the identity verification document (step S504). For example, if the name, date of birth, address, etc. are written on the back side, it judges whether the written contents match the applicant information 332a. Next, the control unit 301 compares the captured face image with the photo image on the identification document and judges whether the people match (step S505). Furthermore, the control unit 301 checks whether the captured face image shows the person actually moving (step S506). The control unit 301 of the server 3 judges whether the identification document is correct and belongs to the person based on the judgment results of steps S502 to S506. Then, the control unit 301 outputs the authentication result (step S507).

[0138] If the identity verification process is successful, the server 3 stores the image of the identity verification document, the face image, and the applicant code received in step S408 as identity verification information 332b in the applicant information folder 332 (step S410 in FIG. 19). The identity verification flag is set to "1" (identity verified). If the identity verification process is unsuccessful, an error screen is displayed and the process ends.

[0139] Next, the process of registering interview dates and times from applicants will be described with reference to FIG. As shown in step S313 of FIG. 18, the server 3 sends a notice to applicants who have passed the ES screening.

[0140] The applicant terminal 5 receives a notification of the screening result from the server 3 (step S601). If the applicant passes the ES screening and registration of the interview date and time is required, the URL of the registration site for the interview date and time is notified from the server 3. The applicant accesses the notified registration site from the applicant terminal 5 and submits a response regarding the interview date and time (or interview code) (step S602).

[0141] When the server 3 receives the interview date and time (or interview code) from the applicant terminal 5 (step S603), it generates interview information 333c that stores the applicant code, interview date and time, the corresponding interview code, etc., and stores it in the employment judgment information folder 333 (step S604). At this stage, the interview flag is set to "0" (= not conducted).

[0142] If the recruiter wishes to check the interview schedule, he / she accesses the recruiter's website from the recruiter's terminal 4 and selects the interview schedule confirmation menu (step S605). The server 3 reads out the interview information 333c stored in the recruitment decision information folder 333 and transmits it to the recruiter's terminal 4 (step S606). The recruiter's terminal 4 displays the received interview information 333c (step S607).

[0143] Furthermore, if the recruiter wishes to check other employment decision information (ES response information 333a and screening progress information 333b), he or she accesses the recruiter's website from the recruiter's terminal 4 and sends a request to check the employment decision information (step S608). The server 3 reads out the ES response information 333a and screening progress information 333b stored in the employment decision information folder 333 and sends them to the recruiter's terminal 4 (step S609). The recruiter's terminal 4 displays the received employment decision information (ES response information 333a and screening progress information 333b) (step S610).

[0144] Next, the remote interview process carried out between the employed person terminal 4 and the photographing device 2 will be described with reference to FIG. On the interview day, the recruiter accesses the recruiter's website of the selection support system 1 from the recruiter's terminal 4 and enters login information (step S701). The server 3 performs authentication processing based on the login information (step S702), and if the authentication is successful, sends a menu screen to the recruiter's terminal 4. The recruiter's terminal 4 receives the menu screen from the server 3 and displays it (step S703). When the remote interview menu is selected on the menu screen (step S704) and the interview code for the interview to be conducted is specified (step S705), the recruiter's terminal 4 sends a request to start the corresponding remote interview to the server 3 and waits for the start of the remote interview processing (step S706).

[0145] On the other hand, on the day of the interview, the applicant goes to the photographing device 2 and selects the remote interview menu from the top screen of the photographing device 2 (step S707) (step S708). The photographing device 2 first reads the applicant code (QR code) displayed on the applicant terminal 5 to verify the identity of the applicant (step S709) and transmits it to the server 3 (step S710). When the server 3 receives the applicant code from the photographing device 2 (step S711), it performs authentication processing (identity verification processing) based on the received applicant code (step S712). In the authentication processing (identity verification processing) of step S712, the server 3 refers to the identity verification flag of the applicant information 332a and the identity verification information 332b stored in association with the applicant code, and determines whether it is "1" (=identity verification completed). If the identity verification flag is "1", the identity has been verified and authentication is successful. If the identity verification flag is "0", the identity verification has not been performed and authentication is unsuccessful. The server 3 transmits the result of the authentication process to the applicant terminal 5 (step S713). If the result of authentication failure is received (step S714; No), the photographing device 2 displays an error screen (step S715) and then returns to the top screen. If the result of authentication success is received (step S714; Yes), the photographing device 2 transmits a request to start a remote interview to the server 3 and waits for the start of the remote interview process (step S716).

[0146] When the server 3 receives the request to start the remote interview from the employed person terminal 4 and the applicant terminal 5, it starts the remote interview process between the employed person terminal 4 and the applicant terminal 5 (step S717).

[0147] During the remote interview, the video and audio data input from the photographing device 2 is compressed and encoded and transmitted to the server 3 (step S718). When the server 3 receives the video and audio data input from the photographing device 2, it performs identity verification processing based on the received video data (step S719). That is, the server 3 decodes the video and audio data received from the photographing device 2 to extract the video and audio data. Then, it performs identity verification processing based on the image of the applicant included in the video data.

[0148] In the identity verification process in step S719, for example, as in steps S505 and S506 of the identity verification process in FIG. 21, the server 3 compares the applicant's face included in the video data with the image of the photo on the identity verification document to determine whether the people match. The server 3 also checks the inclination of the face from the video data to verify whether the image shows the applicant actually moving. If the authentication fails in the identity verification process in step S719 (step S720; Yes), the server 3 transmits an instruction to interrupt the remote interview to the photographing device 2. The photographing device 2 interrupts the remote interview process (step S721) and returns to step S718. If the authentication succeeds in the identity verification process in step S719 (step S720; No), the server 3 executes anonymization processing of the video data and audio data received from the photographing device 2 (step S722).

[0149] Here, the anonymization process will be described with reference to FIG. 24. The server 3 selects an arbitrary character from among the characters generated by the 3DCG model stored in advance in the storage unit 302, and selects an arbitrary voice (step S801). Here, it is desirable to select a neutral character and voice so that the applicant's gender and appearance are not known. When the server 3 acquires the video data and voice data of the applicant from the photography device 2 (step S802), it acquires predetermined feature points of the applicant's face and body contained in the video data (step S803), sets the corresponding feature points of the CG model (step S804), and moves the feature points of the CG model according to the movement of the feature points in the video. In this way, the facial expression, hand movement, posture, etc. are changed (step S805). Note that markers may be attached to predetermined parts of the applicant to make it easier to track the feature points. Also, the input voice is changed to the sound quality of the selected voice (step S806). The server 3 superimposes the generated video data and voice data, compresses and encodes them, and outputs them (step S807).

[0150] The server 3 transmits the video and audio of the applicant, which have been rendered as a CG model through the anonymization process described above, to the hired candidate terminal 4. Upon receiving the superimposed data of the video and audio of the applicant, which have been rendered as a CG model through the anonymization process, the hired candidate terminal 4 decodes the data and separates it into audio data and video data. The hired candidate terminal 4 outputs the audio data from the speaker 508 and inputs the video data to the display unit 504, where it is displayed in synchronization with the audio (step S723).

[0151] Meanwhile, the video and audio data input at the hired candidate terminal 4 is transmitted to the server 3 (step S724), and then transmitted from the server 3 to the photographing device 2 where the remote interview is being conducted. Upon receiving the video and audio data from the server 3, the photographing device 2 decodes and separates it into audio data and video data. The audio data is output from the speaker 27, and the video data is input to the monitor 28 and displayed in synchronization with the audio (step S725). In this manner, the remote interview is conducted.

[0152] After the remote interview is completed, the recruiter registers the interview results (screening results) from the recruiter terminal 4. To register the screening results, similar to the screening information registration process in FIG. 18, the recruiter logs into the recruiter's website from the recruiter terminal 4, obtains the screening results input form from the menu screen, and enters the screening results (applicant code, pass / fail, hiring year, hiring category, etc.). When the server 3 receives the screening results, it updates the screening flag in the screening progress information 333b to a value according to the result. For example, if the applicant passes the first interview, "2" is assigned, and if the applicant fails, "5" is assigned. The server 3 notifies the applicant terminal 5 of the screening results.

[0153] As described above, the server 3 of the selection support system 1 of this embodiment performs a process of mediating a remote interview conducted between the photographing device 2 and the employed person terminal 4. The server 3 receives the information on the user's identification document and the face image of the applicant transmitted from the photographing device 2, and performs an identity verification process. In addition, in the remote interview, the server 3 performs anonymization process by converting the video of the applicant input from the photographing device 2 into a video such as a 3DCG model or converting the audio. This makes it possible to transmit the applicant's appearance and gender to the employed person terminal 4 without revealing it, and realizes a fair selection that is not influenced by gender or appearance. In addition, by performing identity verification of the applicant using the photographing device 2, reliability can be ensured even in a remote interview where the applicant's appearance is hidden.

[0154] [Second embodiment] Next, a second embodiment of the present invention will be described. Fig. 25 is a block diagram showing the functional configuration of a photographing device 2A according to the second embodiment. The photographing device 2A of the second embodiment has an anonymization unit 208 as shown in Fig. 25.

[0155] That is, the remote interview processing unit 205 of the photographing device 2A anonymizes the video data input from the camera 23 and microphone 26 of the photographing device 2A using the anonymization unit 208 and transmits the anonymized data to the server 3. In addition to the video, the anonymization unit 208 may also anonymize the audio data and transmit the anonymized data to the server 3.

[0156] The anonymization process according to the second embodiment will be described. The remote interview control unit 207 of the photographing device 2 accepts character selection and voice selection, and performs pre-processing such as setting face tracking and motion capture.

[0157] The anonymization unit 208 performs an anonymization process on the video input from the camera 23. Specifically, for example, the user is represented using a 3DCG model. The anonymization unit 208 recognizes the facial expressions and movements of the user, and generates video data so that the 3DCG model has the same facial expressions and movements as the user. In addition, the anonymization unit 208 changes the sound quality of the user for the voice data input from the microphone 26, or converts it into a predetermined model voice.

[0158] The video / audio input / output unit 206 superimposes the video and audio anonymized by the anonymization unit 208, compresses and encodes the data, and transmits the superimposed data to the server 3. The server 3 transmits the anonymized video and audio data transmitted from the photographing device 2A to the other party's hired person terminal 4. The video / audio input / output unit 206 decodes the video and audio data of the hired person terminal 4 received from the server 3, and separates the data into video and audio. The audio is output from the speaker 27, and the video is input to the monitor 28 and displayed in synchronization with the audio.

[0159] In the photographing device 2A of the second embodiment, the remote interview control unit 207 performs identity verification processing of the user during the remote interview. The remote interview control unit 207 compares the face of the applicant included in the video before anonymization processing input from the camera 23 with the image of the photo of the identification document, and determines whether the people match. The image of the photo of the identification document is an image acquired by the identity verification information acquisition unit 202 (an image of the identification document taken by the camera 23 at the time of the remote interview or in advance). In addition, the remote interview control unit 207 checks the inclination of the face from the video before anonymization processing, and checks whether the image shows the person actually moving. If the authentication fails due to the identity verification processing, the remote interview is interrupted and the identity verification processing is repeated. If the authentication is successful, the anonymization unit 208 anonymizes the video and audio and transmits them to the server 3.

[0160] In this way, in the second embodiment, the photography device 2A anonymizes the video and audio during the remote interview and transmits them to the server 3. This makes it possible to conduct a remote interview while concealing the appearance and voice of the applicant.

[0161] In the above-mentioned embodiments, a one-to-one interview between the photographing device 2 and the hired candidate terminal 4 has been described, but there may be multiple photographing devices 2 and multiple hired candidate terminals 4. This makes the present invention applicable to one-to-multiple interviews. In such cases, it is desirable to represent the users of the photographing device 2 with different characters in the anonymization process. Furthermore, the present invention is not limited to interviews, and can also be applied to online meetings and the like.

[0162] Although the preferred embodiments of the selection support system and the like according to the present invention have been described above with reference to the attached drawings, the present invention is not limited to these examples. It is clear that a person skilled in the art can come up with various modified or revised examples within the scope of the technical ideas disclosed in this application, and it is understood that these also naturally belong to the technical scope of the present invention. [Explanation of symbols]

[0163] 1. Selection support system 2.Photographic equipment 3. Server 4. Employee terminal 5. Applicant terminal 10....Control device 23………………Camera 26………………Mike 27………………Speaker 28………………Monitor 35………………Code reader 51………………Application information entry form 61………………ES input form 201………………Photography department 202... Personal Identification Information Acquisition Department 203... Personal identification information transmission unit 204………………Code input section 205...Remote interview processing section 206....Video / audio input / output section 207...Remote interview control section 208………………Anonymization Department 311………………Identification information receiving unit 312………………Identification Department 313………………Code transmission unit 314...Remote interview processing section 315…………Anonymization Department 316………………Recruitment Information Registration Department 317………………Application Information Registration Department 318………………Information Management Department 319………………Information presentation department 320………………Examination Information Registration Department 321………………Limited Contact Department 322………………Interview Information Registration Department 331.....Recruitment registration information folder 332………………Applicant information folder 333.....Recruitment decision information folder

Claims

1. A selection support system in which a stationary photographing device capable of taking ID photographs, a server, and a terminal are connected via a network, The photographing device is A photographing means for photographing a user using a camera for taking ID photographs; an identity verification information acquisition means for acquiring an image of the identity verification document of the user using the camera; a transmission means for transmitting to the server an image of the user photographed by the photographing means and an image of the identification document acquired by the identification information acquisition means; A remote interview means for inputting and outputting video and audio via the server in order to conduct a remote interview between the terminal and the remote interview means; Equipped with The server, a receiving means for receiving from the photographing device an image of the user photographed by the photographing device and an image of the user's identification document acquired by the photographing device; an identity verification means for verifying the identity of the user by using the image of the user and an image of the user's identification document received by the receiving means; a remote interview means for performing processing for conducting a remote interview between the photographing device and the terminal; an anonymization means for anonymizing the user in the video image received from the photographing device during the remote interview and transmitting the video image to the terminal; Equipped with The server manages the image of the user and the image of the identification document secretly from the terminal. A selection support system comprising:

2. 2. The selection support system according to claim 1, wherein the anonymization means represents the user using a CG model.

3. 3. The selection support system according to claim 1, wherein the identity verification means performs identity verification processing of the user during the remote interview.

4. 4. The selection support system according to claim 1, wherein the identity verification means performs identity verification processing of the user before the remote interview is conducted.

5. 5. The selection support system according to claim 1, wherein the anonymization means further anonymizes the user in the voice received from the photographing device and transmits the voice to the terminal.

6. The server, A recruitment information registration means for accepting registration of recruitment information from recruits; an application information registration means for accepting registration of applicant information and employment judgment information from the user, 6. The selection support system according to claim 1, wherein said identity verification means records the result of the identity verification of said user in association with applicant information registered by said user.

7. The selection support system according to claim 6, characterized in that the server further comprises an information management means for storing the applicant information and the employment decision information separately and for managing the applicant information in secret from the terminal of the employed person.

8. The server, 8. The selection support system according to claim 6, further comprising information presenting means for presenting the employment decision information so that it can be viewed on a terminal of the employed person.

9. The server, The selection support system according to any one of claims 6 to 8, further comprising a screening information registration means for accepting input of screening results from the terminal of the employed person and storing the results in association with the employment judgment information.

10. The server, 10. The selection support system according to claim 9, further comprising a communication unit for transmitting a message according to the screening result to the terminal of the user.

11. the server includes a code transmission means for issuing an applicant code which is an identification code for identifying a user who has registered the applicant information and transmitting the applicant code to the user; The photographing device is further comprising a code input means for receiving an input of the applicant code, The transmission means transmits an image of the user and an image of the personal identification document to the server together with the applicant code input by the code input means.

11. The selection support system according to claim 6,

12. 12. The selection support system according to claim 1, wherein the server further comprises an interview information registration means for accepting registration of interview information including a date and time of the remote interview.

13. A server in which a stationary photographing device capable of taking ID photographs and a terminal are connected via a network, a receiving means for receiving from the photographing device an image of the user taken by a camera for taking an ID photo of the photographing device and an image of the user's identification document acquired by the camera of the photographing device; an identity verification means for verifying the identity of the user by using the image of the user and an image of the user's identification document received by the receiving means; a remote interview means for performing processing for conducting a remote interview between the photographing device and the terminal; an anonymization means for anonymizing the user in the video image received from the photographing device during the remote interview and transmitting the video image to the terminal; Equipped with The image of the user and the image of the identification document are managed secretly from the terminal. A server comprising:

14. A remote interview method in a selection support system in which a stationary photographing device capable of taking ID photographs, a server, and a terminal are connected via a network, comprising: The photographing device photographs a user using a camera for taking ID photographs; said photographing device capturing an image of said user's identification document using said camera; transmitting an image of the user and an image of the identification document taken by the photographing device to the server; receiving, by the server, from the photographing device, an image of the user taken by the photographing device and an image of the user's identification document acquired by the photographing device; performing identity verification of the user using the image of the user and the image of the user's identification document received by the server; A step of inputting and outputting video and audio via the server between the photographing device and the terminal in order to conduct a remote interview; a step of anonymizing the user and transmitting the image captured by the photographing device during the remote interview to the terminal; Including, The server manages the image of the user and the image of the identification document secretly from the terminal. A remote interview method characterized by:

15. A stationary photographing device capable of taking ID photographs, a terminal, and a computer connected via a network, a receiving means for receiving from the photographing device an image of the user taken by a camera for taking an ID photo of the photographing device and an image of the user's identification document acquired by the camera of the photographing device; an identity verification means for verifying the identity of the user by using the image of the user and the image of the user's identification document received by the receiving means; a remote interview means for performing processing for conducting a remote interview between the photographing device and the terminal; an anonymization means for anonymizing the user in the video image received from the photographing device during the remote interview and transmitting the video image to the terminal; A program for causing the device to function as a The image of the user and the image of the identification document are managed secretly from the terminal. A program characterized by:

Citation Information

Patent Citations

  • Employment supporting system

    JP2002157454A

  • Photographed image distribution system, image management device, photographed image distribution program, and photographed image distribution method

    JP2003143363A

  • Interactive interview system

    JP2005056360A

  • Communication terminal, information processing device, communication system, and program

    JP2015049602A

  • Authenticity determination system, method and program for identity confirmation document

    JP2019003421A