Program, server and method for supporting online interviews

Abstract

To provide a technology that reduces the burden on interviewers in online interviews. [Solution] An interview support server 10 that supports online interviews using a main image from a camera 75 that captures an interviewee 2 acquires a sub-image from a camera 35 used by the interviewee 2, and enables a video call between a main terminal 20 used by the interviewee 2 and a terminal 40 used by an interviewer 3 based on the sub-image.

Description

[Technical Field]

[0001] The present disclosure relates to a program, a server, and a method for supporting online interviews. [Background technology]

[0002] Conventionally, interviews are conducted to evaluate personality, abilities, or thoughts that cannot be judged through documents and written tests. Japanese Patent Application Laid-Open No. 2002-73914 discloses a human resources intermediary device that conducts online interviews between a hiring company and a job seeker via a hiring company client and a job seeker client installed on the hiring company's side. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2002-73914 Summary of the Invention [Problem to be solved by the invention]

[0004] In online interviews, there is a possibility that interviewees may engage in misconduct. Therefore, interviewers must take steps to prevent misconduct by interviewees at the start of the interview. Such steps include, for example, determining whether the environment is conducive to misconduct or encouraging interviewees to create such an environment. As a result, the burden on interviewers is heavy.

[0005] An object of the present disclosure is to provide technology that reduces the burden on interviewers in online interviews. [Means for solving the problem]

[0006] According to one aspect of the present disclosure, a program for supporting an online interview using a first image from a first camera capturing an interviewee causes a computer to acquire a second image from a second camera handled by the interviewee, and enable a video call between a first terminal handled by the interviewee and a second terminal handled by an interviewer based on the second image.

[0007] According to another aspect of the present disclosure, a server supporting an online interview using a first image from a first camera capturing an interviewee acquires a second image from a second camera handled by the interviewee, and enables a video call between a first terminal handled by the interviewee and a second terminal handled by an interviewer based on the second image.

[0008] According to yet another aspect of the present disclosure, a method for supporting an online interview using a first image from a first camera capturing an interviewee includes: a server acquiring a second image from a second camera handled by the interviewee; and the server enabling a video call between a first terminal handled by the interviewee and a second terminal handled by an interviewer based on the second image. [Effects of the Invention]

[0009] The technology disclosed herein reduces the burden on interviewers during online interviews. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a diagram schematically illustrating an overall configuration of a system according to an embodiment. [Figure 2] FIG. 2 is a diagram illustrating an example of a hardware configuration of each device in the system according to the embodiment. [Figure 3] FIG. 2 is a diagram illustrating an example of a management database. [Figure 4] 10 is a flowchart showing the flow of online interview management processing. [Figure 5] FIG. 10 is a sequence diagram showing the flow of the first stage of the online interview execution support process. [Figure 6] FIG. 10 is a sequence diagram showing the flow of the middle stage of the online interview execution support process. [Figure 7] FIG. 10 is a sequence diagram showing the flow of the latter stage of the online interview execution support process. [Figure 8] FIG. 6 is a diagram showing an example of a screen displayed on the main terminal in step S28 shown in FIG. 5. [Figure 9] FIG. 7 is a diagram showing an example of a screen displayed on the main terminal in step S37 shown in FIG. 6. [Figure 10] FIG. 7 is a diagram showing an example of a screen displayed on the sub-terminal in step S39 shown in FIG. 6. [Figure 11] FIG. 8 is a diagram showing an example of a web screen displayed in step S46 shown in FIG. 7. [Figure 12] FIG. 8 is a diagram showing an example of a screen displayed on each terminal that has entered the virtual conference room in step S50 shown in FIG. 7. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In the drawings, the same or corresponding parts are designated by the same reference numerals, and the description thereof will not be repeated. The embodiments and modifications described below may be selectively combined as appropriate.

[0012] (Overall system configuration) FIG. 1 is a diagram schematically illustrating the overall configuration of a system according to an embodiment. The system 1 shown in FIG. 1 is used for online interviews between an interviewee 2 and an interviewer 3. For example, online interviews are conducted for various types of tests, such as entrance exams, regular exams, certification exams, qualification exams, employment exams, promotion exams, and aptitude tests. Alternatively, online interviews may be conducted for purposes such as counseling, interviews, interviews, and various types of interviews. Various types of interviews include, for example, personnel interviews.

[0013] As shown in Figure 1, system 1 comprises an interview support server 10, a main terminal 20, a sub-terminal 30, terminals 40 and 60, and an online conference server 50. The interview support server 10, the main terminal 20, the sub-terminal 30, the terminals 40 and 60, and the online conference server 50 can be connected to a communication network using wired or wireless communication.

[0014] Each of the interview support server 10 and the online conference server 50 may be configured with one or more computers. Each of the interview support server 10 and the online conference server 50 may include a virtual machine or a container built in a cloud environment, or at least a partial configuration of these.

[0015] The main terminal 20 and terminals 40 and 60 are, for example, desktop computers, laptops, tablets, etc. The secondary terminal 30 is, for example, a smartphone, tablet, etc. The secondary terminal 30 is installed in a holder 5. The main terminal 20 and secondary terminal 30 are operated by the interviewee 2. The main terminal 20 has a camera 75 that captures the interviewee 2 operating the main terminal 20. The secondary terminal 30 has a camera 35. The terminal 40 is operated by the interviewer 3. The terminal 60 is operated by an administrative staff member 4 of the organization conducting the online interview. The administrative staff member 4 is responsible for arranging and managing the online interview. The main terminal 20 is an example of a "first terminal" in the present disclosure. The terminal 40 is an example of a "second terminal" in the present disclosure. The secondary terminal 30 is an example of a "third terminal" in the present disclosure. The camera 75 of the main terminal 20 is an example of a "first camera" in the present disclosure. The camera 35 of the sub-terminal 30 is an example of the "second camera" of the present disclosure.

[0016] The online conference server 50 provides an online conference (web conference) service. Examples of online conference services include Zoom (registered trademark), Teams (registered trademark), and Google Meet (registered trademark). The online conference service sets up a virtual conference room on a network and exchanges information (including audio, video, and materials) between multiple terminals that have entered the virtual conference room.

[0017] The interview support server 10 supports each pre-registered online interview in response to instructions from the terminal 60. In the example shown in FIG. 1, a secretariat staff member 4 operates the terminal 60 to register an online interview between an interviewee 2 and an interviewer 3 in the interview support server 10. As a result, the interview support server 10 supports the online interview using video from a camera 75 capturing the interviewee 2 (hereinafter also referred to as "main video"). The main video is an example of the "first video" of the present disclosure.

[0018] Specifically, the interview support server 10 acquires video from the camera 35 used by the interviewee 2 before the start of the online interview (hereinafter also referred to as "sub-video before the start of the interview"). Based on the sub-video before the start of the interview, the interview support server 10 enables a video call between the main terminal 20 used by the interviewee 2 and the terminal 40 used by the interviewer 3. For example, as described below, the interview support server 10 guides the main terminal 20 to enter a virtual conference room that the terminal 40 has already entered or is scheduled to enter, based on the fact that a predetermined range is included in the sub-video before the start of the interview. Alternatively, the interview support server 10 may guide the main terminal 20 to enter a virtual conference room based on the fact that the sub-video is received. Note that the sub-video before the start of the interview is an example of the "second video" in the present disclosure. This allows the main terminal 20 and the terminal 40 to conduct a video call via the virtual conference room.

[0019] The camera 35 of the sub-terminal 30 is operated by the interviewee 2. Therefore, the sub-image captured by the camera 35 may include the interviewee 2's surroundings or the interviewee 2 viewed from a different perspective than the main image. Generally, it is difficult for the interviewee 2 to commit fraud without appearing in both images (the main image and the sub-image) captured from two perspectives. Therefore, when the interview support server 10 acquires the sub-image, it gives the interviewee 2 the impression that the environment is difficult to commit fraud. Therefore, by having the interview support server 10 enable a video call between the main terminal 20 and the terminal 40 based on the sub-image before the start of the interview, the interviewer 3 can start the online interview in an environment that makes it difficult to commit fraud. In other words, the interviewer 3 does not need to perform any work to prevent the interviewee 2 from committing fraud at the start of the online interview. This reduces the burden on the interviewer 3 during the online interview.

[0020] Furthermore, enabling a video call between the main terminal 20 and the terminal 40 is based on the sub-video, not the main video of the camera 75 of the main terminal 20. In other words, enabling a video call between the main terminal 20 and the terminal 40 does not require checking the main video or checking the connection with the camera 75 that captures the main video. The main video is frequently checked by the interviewer 3 during an online interview. Therefore, if there is a problem with the main video or if the camera 75 that captures the main video is not connected, the interviewer 3 can easily warn the interviewee 2. Upon receiving the warning, the interviewee 2 can easily resolve the problem with the main video or the connection problem with the camera 75 by operating the main terminal 20 used for the online interview. On the other hand, if there is a problem with the sub-video or if the camera 75 that captures the sub-video is not connected, it usually takes a considerable amount of time to resolve the problem. Therefore, if an online interview begins with such a problem, the interviewer 3 must instruct the interviewee 2 on how to resolve the problem. This may increase the burden on the interviewer 3. Therefore, by enabling a video call between the main terminal 20 and the terminal 40 based on the sub-video, the burden on the interviewer 3 is reduced.

[0021] (Hardware configuration) FIG. 2 is a diagram illustrating an example of the hardware configuration of each device in the system according to the embodiment. As illustrated in FIG. 2, the main terminal 20 and the terminals 40 and 60 each have the hardware configuration of a general-purpose computer. That is, the main terminal 20 and the terminals 40 and 60 each include a processor 71, a memory 72, a storage 73, a communication module 74, a camera 75, a display 76, a speaker 77, a microphone 78, and an input device 79. These components are connected to each other via an internal bus for data communication. The communication module 74 communicates with external devices (including at least the interview support server 10 and the online conference server 50) according to a known communication protocol. The camera 75 may be an external camera. The input device 79 includes, for example, a keyboard, a mouse, a touch panel, etc. The display 76 of the main terminal 20 is an example of a "first display" in the present disclosure.

[0022] The processor 71 loads various programs stored in the storage 73 into the memory 72 and executes them. The storage 73 also stores a web browser 731.

[0023] The sub-terminal 30 includes a processor 31, a memory 32, a storage 33, a communication module 34, a camera 35, a display 36, and an input device 39. These components are connected to each other via an internal bus so that data can be communicated between them. The input device 39 includes, for example, a touch panel. The display 36 is an example of a "second display" in the present disclosure.

[0024] The processor 31 loads various programs stored in the storage 33 into the memory 32 and executes them. A web browser 331 and a code reader application 332 are stored in the storage 33. The code reader application 332 is an application for reading codes included in images captured by the camera 35. The communication module 34 communicates with external devices according to communication protocols including, for example, Wi-Fi (registered trademark), 4G / LTE, 5G, and the like.

[0025] The interview support server 10 includes a processor 11, a memory 12, a storage 13, and a communication module 14. These components are connected to each other via an internal bus so that they can communicate data with each other. The communication module 14 communicates with external devices (including at least the main terminal 20, the sub-terminal 30, the terminals 40 and 60, and the online conference server 50) via a network.

[0026] The processor 11 deploys various programs stored in the storage 13 into the memory 12 and executes them. The storage 13 stores a support program 131. The support program 131 includes a set of instructions that define various functions provided by the interview support server 10. The functions defined by the support program 131 include a management function that manages information about each online interview, a collaboration support function that supports collaboration between terminals when conducting an online interview, and a monitoring function that provides video recorded during an online interview.

[0027] Furthermore, the storage 13 stores a management database (DB) 132 used to execute the support program 131 .

[0028] Fig. 3 is a diagram showing an example of the management database. The management database 132 shown in Fig. 3 has a table format and includes a record 132a for each online interview. The record 132a includes fields 132b to 132i.

[0029] A number identifying the online interview is written in field 132b, and a scheduled date and time of the online interview is written in field 132c.

[0030] Field 132d describes information identifying the interviewee (e.g., name, ID, and email address). Field 132e describes the interview URL (Uniform Resource Locator) and passcode issued to the interviewee. The interview URL is an access code (corresponding to the "first access code" in this disclosure) for accessing an information resource (corresponding to the "first resource" in this disclosure) within the interview support server 10 that identifies the corresponding online interview. The information resource that identifies the online interview includes, for example, record 132a. The interview URL is an example of the "first URL" in this disclosure.

[0031] Field 132f describes information identifying the interviewer (e.g., name, ID, and email address). Field 132g describes the conference URL to be notified to the interviewer. The conference URL is an access code to a virtual conference room provided by online conference server 50. The virtual conference room is an example of a "second resource" in the present disclosure. The conference URL, which is an access code to the virtual conference room, is an example of a "second access code" and a "second URL" in the present disclosure.

[0032] Field 132h describes the progress of the online interview (for example, the access date and time and the marker recognition date and time, which will be described later). Field 132i describes the path to the recording file showing the video recorded during the online interview.

[0033] Returning to FIG. 2, the online conference server 50 includes a processor 51, a memory 52, a storage 53, and a communication module 54. These components are connected to each other via an internal bus so that they can communicate data with each other. The communication module 54 communicates with external devices (including at least the main terminal 20, the sub-terminal 30, the terminals 40 and 60, and the interview support server 10) via a network.

[0034] The processor 51 loads various programs stored in the storage 53 into the memory 52 and executes them. An online conference program 531 for providing an online conference service is stored in the storage 53. The online conference program 531 includes a group of instructions for providing a virtual conference room used for an online conference.

[0035] Furthermore, storage 53 stores online conference bot 532, which extends the functionality of the online conference service. Online conference bot 532 is a program for participating in a virtual conference room and performing various tasks. For example, a task includes streaming a specified video in the virtual conference room. When the online conference service is Zoom, ZoomBot is used as online conference bot 532.

[0036] The processors 11, 31, 51, and 71 are configured, for example, by a central processing unit (CPU) or a graphics processing unit (GPU). The memories 12, 32, 52, and 72 are configured, for example, by volatile storage devices such as dynamic random access memory (DRAM) or static random access memory (SRAM). The storages 13, 33, 53, and 73 are configured, for example, by nonvolatile storage devices such as solid state drives (SSDs) and hard disk drives (HDDs).

[0037] (System processing flow) The processing flow of the system 1 shown in FIG. 1 will be described with reference to FIGS. 4 to 12. The processing of the system 1 includes a management process that is mainly targeted at the secretariat staff 4, and an online interview execution support process that is mainly targeted at the interviewee 2 and the interviewer 3. The management process corresponds to the management function and monitoring function defined by the support program 131. The management process may also target the interviewer 3. The online interview execution support process corresponds to the collaboration support function defined by the support program 131.

[0038] (Online interview management process) 4 is a flowchart showing the flow of the online interview management process. The flow shown in FIG.

[0039] In step S1, the processor 11 of the interview support server 10 outputs an administrator login screen in response to a request to view the administrator screen from the terminal 60. The view request from the terminal 60 is created using the web browser 731. Therefore, the interview support server 10 operates as a web server and outputs the administrator login screen as a web screen. The secretariat staff 4 enters login information (e.g., ID and password) into the administrator login screen displayed on the display 76 of the terminal 60.

[0040] In step S2, processor 11 compares the login information entered on the administrator login screen with pre-registered authentication information and determines whether authentication is successful. If authentication is unsuccessful (NO in step S2), the process returns to step S1. If authentication is successful (YES in step S2), the process proceeds to step S3.

[0041] In step S3, processor 11 outputs a dashboard containing multiple menus for the administrator as a new web screen. The multiple menus include "URL Management," "New Registration," and "Recording Management." Secretariat employee 4 selects a desired menu from the dashboard displayed on terminal 60.

[0042] In step S4, processor 11 determines which menu item has been selected. If "URL Management" has been selected, processor 11 proceeds to step S5. If "New Registration" has been selected, processor 11 proceeds to step S6. If "Recording Management" has been selected, processor 11 proceeds to step S13.

[0043] In step S5, processor 11 outputs a URL management screen as a new web screen. The URL management screen includes "URL List" and "Progress Management" as viewing items. Processor 11 transitions the web screen depending on the selected item. For example, if "URL List" is selected, processor 11 generates a web screen including a list of information (including interview URLs and conference URLs) recorded in fields 132b to 132g of management database 132, and outputs it to terminal 60. Also, if "Progress Management" is selected, processor 11 generates a web screen showing the progress recorded in field 132h of management database 132, and outputs it to terminal 60. In this way, processor 11 transitions the web screen in response to a request from terminal 60. After step S5, the management process ends.

[0044] In step S6, processor 11 outputs a new registration screen as a new web screen and accepts various information specifying the online interview to be registered. The various information includes the scheduled date and time of the online interview, information identifying the interviewee (name, ID, and email address), and information identifying the interviewer (name, ID, and email address).

[0045] In step S7, in response to receiving the various information, processor 11 adds a new record 132a to management database 132. Processor 11 writes a unique number in field 132b of the new record 132a. Furthermore, processor 11 writes the scheduled date and time, information identifying the interviewee, and information identifying the interviewer received in step S7 into fields 132c, 132d, and 132f, respectively, of the new record 132a.

[0046] In step S8, processor 11 issues an interview URL to the interviewee of the online interview to be registered. The interview URL is, for example, an access code to the new record 132a added in step S7. Processor 11 may also issue a unique passcode to be used for authentication when accessing the interview URL.

[0047] In step S9, processor 11 accepts the conference URL notified to the interviewer. Specifically, processor 11 outputs a web screen for inputting the conference URL to terminal 60. The secretariat staff 4 may input the conference URL for the online interview to be registered, which was received in advance from online conference server 50, into the web screen. Alternatively, processor 11 may acquire the conference URL from online conference server 50 using API (Application Programming Interface) integration with an online conference service application (not shown). Specifically, processor 11 provides online conference server 50 with a conference URL issuance request to which the various information (scheduled date and time and information on participants (interviewee 2 and interviewer 3)) accepted in step S6 is added. In response to the issuance request, online conference server 50 issues a conference URL for entering the virtual conference room to be provided at the scheduled date and time. Processor 11 acquires the issued conference URL. This eliminates the need for the secretariat staff 4 to acquire the conference URL in advance.

[0048] In step S10, processor 11 associates the interview URL issued in step S8 with the conference URL accepted in step S9 and saves them. Specifically, processor 11 writes the interview URL and conference URL into fields 132e and 132g, respectively, of new record 132a added in step S7. If a passcode was also issued in step S8, processor 11 also writes the passcode into field 132e.

[0049] In step S11, processor 11 sends an email containing the interview URL issued in step S8 to the interviewee's email address. This notifies the interviewee of the interview URL. If a passcode was issued in step S8, the passcode is also sent along with the interview URL.

[0050] In step S12, processor 11 sends an email containing the conference URL received in step S9 to the interviewer's email address. This notifies the interviewer of the conference URL. After step S12, processor 11 completes the new registration and ends the process.

[0051] In step S13, processor 11 outputs a recording management screen as a new web screen. The recording management screen includes "Playback" and "AI (Artificial Intelligence) Analysis" as viewing items. Processor 11 transitions the web screen depending on the selected item. For example, processor 11 references field 132i of management database 132 to read the specified recording file. When "Playback" is selected, processor 11 generates a web screen including a playback window for the recording file and outputs it to terminal 60. When "AI Analysis" is selected, processor 11 applies a predetermined AI analysis algorithm to the recording file. Processor 11 generates a web screen showing the application result of the AI ​​analysis algorithm and outputs it to terminal 60. The AI ​​analysis algorithm is constructed, for example, using machine-learned artificial intelligence to determine whether or not foul play is suspected in the video.

[0052] (Online interview execution support processing) Figure 5 is a sequence diagram showing the first stage of the online interview execution support processing flow. Figure 6 is a sequence diagram showing the middle stage of the online interview execution support processing flow. Figure 7 is a sequence diagram showing the latter stage of the online interview execution support processing flow. Figures 5 to 7 show the execution support processing for an online interview between an interviewee 2 and an interviewer 3.

[0053] In step S20, the terminal 40 of the interviewer 3 receives an email including the conference URL from the interview support server 10. In step S21, the main terminal 20 of the interviewee 2 receives an email including the interview URL from the interview support server 10. Steps S20 and S21 correspond to steps S12 and S11, respectively, shown in Figure 4. In step S21, the main terminal 20 may receive an email including the interview URL and a passcode.

[0054] After steps S20 and S21, steps S22 to S50 are carried out as the scheduled date and time of the online interview approaches. Note that steps S22 and S23 may be carried out before steps S24 to S49, in parallel with steps S24 to S49, or after steps S24 to S49.

[0055] In step S22, processor 71 of terminal 40 accepts a request to access the conference URL. Specifically, interviewer 3 clicks on the conference URL written in the email. Processor 71 of terminal 40 accepts the click on the conference URL as a request to access the conference URL.

[0056] In step S23, the processor 71 of the terminal 40 calls the web browser 731 and accesses the conference URL. As described above, the conference URL is an access code to the virtual conference room in the online conference server 50. Therefore, the terminal 40 enters the virtual conference room indicated by the conference URL.

[0057] In step S24, processor 71 of main terminal 20 accepts a request to access the interview URL. Specifically, interviewee 2 clicks on the interview URL written in the email. Processor 71 of main terminal 20 accepts the click on the interview URL as a request to access the interview URL.

[0058] In step S25, the processor 71 of the main terminal 20 calls the web browser 731 and accesses the interview URL. As described above, the interview URL is an access code to the corresponding record 132a in the management database 132 in the interview support server 10. Therefore, the main terminal 20 accesses the interview support server 10. Note that in step S21, if a passcode has been received along with the interview URL, the processor 71 of the main terminal 20 displays a screen on the display 76 prompting the user to enter the passcode, and transmits the passcode entered into the input device 79 to the interview support server 10.

[0059] In step S26, the processor 11 of the interview support server 10 generates a session ID and a two-dimensional code associated with the session ID. The session ID is associated with the accessing main terminal 20 and the accessed record 132a. The two-dimensional code is an access code to the associated session ID (corresponding to the "third resource" in this disclosure) and is an example of the "third access code" in this disclosure. Note that if a passcode has been sent in step S25, step S26 is performed in response to successful authentication using the passcode.

[0060] Furthermore, in step S26, the processor 11 writes the access date and time into the field 132h of the accessed record 132a in the management database 132.

[0061] In step S27, the processor 11 transmits the generated two-dimensional code to the main terminal 20. Specifically, the processor 11 outputs to the main terminal 20 a web screen including the two-dimensional code.

[0062] In step S28, the processor 71 of the main terminal 20 causes the display 76 to display a web screen including the two-dimensional code.

[0063] Fig. 8 is a diagram showing an example of a screen displayed on the main terminal in step S28 shown in Fig. 5. As shown in Fig. 8, a web screen 80 includes a two-dimensional code 81 and a message 82 prompting the user to read the two-dimensional code 81 using the sub-terminal 30. The interviewee 2 checks the web screen 80 and operates the sub-terminal 30 in accordance with the message 82. Specifically, the interviewee 2 inputs an instruction to start the code reader application 332 into the sub-terminal 30.

[0064] 5, in step S29, the processor 31 of the sub-terminal 30 starts the code reader application 332 in accordance with the input. When the code reader application 332 starts, the interviewee 2 adjusts the position and posture of the sub-terminal 30 so that the two-dimensional code 81 displayed on the main terminal 20 is included in the field of view of the camera 35.

[0065] In step S30, the processor 31 reads the two-dimensional code 81 displayed on the main terminal 20 in accordance with the code reader application 332.

[0066] In step S31, processor 31 launches web browser 331 based on the read two-dimensional code 81 and uses web browser 331 to access the session ID held by interview support server 10. In other words, processor 11 of interview support server 10 receives access to the session ID from sub-terminal 30 by camera 35 reading two-dimensional code 81.

[0067] As shown in FIG. 6, in step S32, the processor 11 of the interview support server 10 registers the sub-terminal 30 in association with a session ID.

[0068] In step S33, processor 11 generates multiple web screens prompting the user to prepare for the interview and sequentially outputs the multiple web screens to the sub-terminal 30 associated with the session ID. In step S34, processor 31 of sub-terminal 30 accepts operations on the multiple web screens distributed from interview support server 10.

[0069] Specifically, the processor 11 generates a first web screen including information identifying the interviewee 2 (e.g., name) written in field 132d of record 132a of the online interview corresponding to the session ID. The first web screen prompts the user to input a confirmation result of the appropriateness of the information. The sub-terminal 30 accepts input of a response on the first web screen indicating that the information identifying the interviewee is appropriate.

[0070] In response to receiving a response that the information identifying the interviewee 2 is appropriate, the processor 11 generates a second web screen requesting permission to use the camera 35. The sub-terminal 30 accepts input of permission to use the camera 35 on the second web screen.

[0071] In response to input of permission to use the camera 35, the processor 11 generates a third web screen that prompts the user to place the sub-terminal 30 in the holder 5 (see FIG. 1). The sub-terminal 30 accepts input on the third web screen that the sub-terminal 30 is ready.

[0072] In step S35, in response to receiving the input indicating that preparation is complete, the processor 31 of the sub-terminal 30 notifies the interview support server 10 that preparation of the sub-terminal 30 is complete.

[0073] In step S36, the processor 11 of the interview support server 10 generates a web screen including one or more markers and transmits the generated web screen to the main terminal 20. In step S37, the processor 71 of the main terminal 20 displays the web screen received in step S36 on the display 76.

[0074] FIG. 9 is a diagram showing an example of a screen displayed on the main terminal in step S37 shown in FIG. 6. As shown in FIG. 9, the web screen 80A includes one or more markers 83 and a message 84. In the example shown in FIG. 9, the one or more markers 83 include markers 83a to 83d. The markers 83a to 83d are arranged at the four corners of the web screen 80A, respectively. The markers 83a to 83d are composed of images that are different from one another. The number of markers 83 is not limited to four, and may be one to three, or five or more. The four markers 83 are an example of an "image" in the present disclosure. The message 84 urges the interviewee 2 to follow the shooting guide displayed on the display 36 of the sub-terminal 30.

[0075] The processor 11 of the interview support server 10 may vary the pattern of one or more markers 83 for each session ID. For example, the processor 11 may vary at least one of the number of one or more markers 83, the type of image constituting each marker 83, and the arrangement of each marker 83 on the web screen 80A for each session ID. In this case, the processor 11 records the session ID in association with pattern information representing the number of one or more markers 83, the type of image, and the arrangement.

[0076] Returning to Figure 6, in step S38, the processor 11 of the interview support server 10 sends an instruction to display a shooting guide that instructs shooting of a first predetermined range to the sub-terminal 30. Step S38 is performed following step S36 or in parallel with step S36.

[0077] In step S39, the processor 31 of the sub-terminal 30 activates the camera 35 in response to the input of permission to use the camera 35 received in step S34, and displays on the display 36 the photography guide received in step S37.

[0078] Fig. 10 is a diagram showing an example of a screen displayed on the sub-terminal in step S39 shown in Fig. 6. As shown in Fig. 10, a screen 90 includes areas 91 and 92 and a button 93.

[0079] An area 91 displays a shooting guide instructing the user to shoot within a first predetermined range. The first predetermined range includes, for example, the markers 83a to 83d displayed on the display 76 of the main terminal 20. In this case, the shooting guide instructs the user to set up the sub-terminal 30 so that the four markers 83 displayed on the display 76 of the main terminal 20 are within the field of view of the camera 35. Furthermore, the shooting guide instructs the user to tap a button 93 after the setup is complete. An area 92 displays a sub-image captured by the camera 35.

[0080] Note that, by displaying the shooting guide in area 91, the web screen 80A displayed on the display 76 of the main terminal 20 does not need to include the shooting guide. This increases the space available for arranging one or more markers 83 on the web screen 80A. As a result, the degree of freedom in the size and arrangement of the one or more markers 83 on the web screen 80A increases.

[0081] The interviewee 2 follows the shooting guide displayed in area 91 and adjusts the position and posture of the sub-terminal 30 so that the markers 83a to 83d displayed on the display 76 of the main terminal 20 are displayed within area 92. The interviewee 2 taps button 93 after confirming that the markers 83a to 83d are included within area 92.

[0082] Returning to Figure 6, in step S40, in response to button 93 being tapped, processor 31 of sub-terminal 30 starts transmitting the sub-video captured by camera 35 to interview support server 10. Then, in step S41, processor 31 continues transmitting the sub-video captured by camera 35 to interview support server 10.

[0083] As shown in Figure 7, processor 11 of interview support server 10 performs steps S42 to S45 to enable a video call between main terminal 20 used by interviewee 2 and terminal 40 used by interviewer 3 based on the sub-image. That is, in step S42, processor 11 of interview support server 10 performs an identification process for marker 83 in the sub-image of camera 35. Specifically, processor 11 recognizes marker 83 from the sub-image using known image recognition technology.

[0084] In step S43, the processor 11 determines whether the sub-image of the camera 35 includes a first predetermined range (including, for example, the markers 83a to 83d).

[0085] As described above, if the pattern of one or more markers 83 differs for each session ID, the processor 11 calls up pattern information corresponding to the session ID associated with the sub-terminal 30 that is the sender of the sub-video. The processor 11 compares the number, image type, and arrangement of one or more markers 83 identified from the sub-video with the pattern information, and if they match (or if the similarity is equal to or greater than a reference value), it determines that the sub-video includes the first predetermined range.

[0086] If the pattern of one or more markers 83 is fixed, a possible fraudulent act would be to install the camera 35 of the sub-terminal 30 so as to capture an image of a dummy terminal (a terminal different from the main terminal 20) that displays that pattern. However, as described above, by varying the pattern of one or more markers 83 for each session ID, such fraudulent act can be prevented.

[0087] If the first predetermined range is not included in the sub video (NO in step S43), the process returns to step S42, whereby steps S42 and S43 are repeated until the first predetermined range is included in the sub video.

[0088] If the sub-video includes the first predetermined range (YES in step S43), the process proceeds to step S44. In step S44, the processor 11 reads the conference URL written in field 132g of the record 132a corresponding to the session ID associated with the sub-terminal 30 that is the sender of the sub-video. Furthermore, the processor 11 writes the date and time at which the answer in step S43 was YES (referred to as the "marker recognition date and time") in field 132h of the record 132a.

[0089] In step S45, the processor 11 outputs a web screen to the main terminal 20 corresponding to the session ID associated with the sub-terminal 30 that is the sender of the sub-video, prompting the main terminal 20 to switch the access destination. Specifically, the processor 11 outputs a web screen for switching the access destination of the main terminal 20 to the virtual conference room indicated by the conference URL, in order to enable a video call between the main terminal 20 and the terminal 40. In this way, the processor 11 causes the main terminal 20 that has accessed the interview URL to display information about the conference URL.

[0090] In step S46, the processor 71 of the main terminal 20 displays on the display 76 a web screen that prompts the user to switch the access destination, and accepts the request to access the conference URL.

[0091] Fig. 11 is a diagram showing an example of a web screen displayed in step S46 shown in Fig. 7. As shown in Fig. 11, web screen 80B includes a button 85 for accessing the conference URL. Interviewee 2 clicks button 85 to start the online interview.

[0092] Returning to FIG. 7, in step S47, in response to the clicking of button 85, processor 71 of main terminal 20 accesses the virtual conference room according to the conference URL and causes main terminal 20 to enter the virtual conference room. In this way, main terminal 20 enters the virtual conference room provided by online conference server 50 without going through interview support server 10, and provides the main video captured by camera 75 to the virtual conference room. This enables a video call between main terminal 20 and terminal 40.

[0093] Following step S45, the processor 11 of the interview support server 10 performs step S48. In step S48, the processor 11 transfers the sub-video received from the sub-terminal 30 to the online conference server 50. The processor 11 adds the conference URL read in step S44 to the sub-video.

[0094] Furthermore, the processor 11 starts recording the sub-video received from the sub-terminal 30 and creates a recording file. The created recording file is stored in the storage 13 or an external storage. The processor 11 writes a path to the recording file in the field 132i of the record 132a in the management database 132 that corresponds to the session ID associated with the sub-terminal 30. As a result, after the online interview, the secretariat staff 4 can check the state of the online interview by playing back the recording file.

[0095] In step S49, when the processor 51 of the online conference server 50 receives the sub-video from the interview support server 10, it calls the online conference bot 532. The processor 51 causes the online conference bot 532 to participate in the virtual conference room specified by the conference URL added to the sub-video. The online conference bot 532 provides the sub-video from the sub-terminal 30 to the virtual conference room.

[0096] In this way, by performing steps S22 and S47, the terminal 40 and the main terminal 20 enter the virtual conference room. This initiates a video call between the interviewee 2 and the interviewer 3. As described above, an interview URL, not a conference URL, is sent to the interviewee 2. By performing steps S24 to S43, the interview support server 10 notifies the conference URL for entering the virtual conference room only to the interviewee 2 whose camera 35's sub-image is ready. As a result, only the interviewee 2 whose sub-image is ready can participate in the virtual conference room. On the other hand, a conference URL, not an interview URL, is sent to the interviewer 3. In other words, different URLs are notified to the interviewee 2 and the interviewer 3. Therefore, the interviewer 3 can easily participate in the virtual conference room simply by performing the operation accepted in step S22. A publicly known service, such as Zoom (registered trademark), is used as the online conference service used in the online interview. Therefore, the interviewer 3 can easily conduct the online interview using a familiar online conference service. It should be noted that a reference form is also possible in which an interview URL, rather than a conference URL, is sent to the interviewer 3. However, in the reference form, the interviewer 3 must access the interview URL and then the conference URL, which takes time and effort before the online interview can begin. In contrast, in this embodiment, the time and effort required by the interviewer 3 before the online interview can begin is reduced.

[0097] Furthermore, by performing step S49, the online conference bot 532 enters the virtual conference room and provides the virtual conference room with the sub-image from the camera 35 of the sub-terminal 30. In other words, the sub-terminal 30 can enter the virtual conference room via the online conference bot 532.

[0098] In the subsequent step S50, the interviewee 2 and the interviewer 3 conduct an online interview in the virtual conference room by operating the main terminal 20 and the terminal 40, respectively. A web screen representing the virtual conference room is displayed on the display 76 of each of the main terminal 20 and the terminal 40.

[0099] 12 is a diagram showing an example of a screen displayed on each terminal that has entered the virtual conference room in step S50 shown in FIG. 7. As shown in FIG. 12, the web screen 80C includes areas 86, 87, and 88 that respectively correspond to the terminal 40, the main terminal 20, and the online conference bot 532 that have entered the virtual conference room. Area 86 displays the video (including the interviewer 3) from the camera 75 of the terminal 40. Area 87 displays the main video (including the interviewee 2) from the camera 75 of the main terminal 20. Area 88 displays the sub-video (including the display of the main terminal 20) from the camera 35 of the sub-terminal 30.

[0100] By checking web screen 80C, interviewee 2 can see that he or she and his or her surroundings are being filmed from two perspectives. This allows interviewee 2 to realize that the environment is one in which cheating is difficult. Furthermore, interviewer 3 can conduct the online interview while using the images in both areas 87 and 88 to confirm that no cheating is being committed.

[0101] (Variation) (Variation 1) From step S48 onward shown in FIG. 7, the processor 11 of the interview support server 10 may apply an AI analysis algorithm to the sub-video received in real time from the sub-terminal 30 to determine whether or not misconduct is suspected. If misconduct is suspected, the processor 11 adds a message to the sub-video to call attention to the suspected misconduct. As a result, if misconduct is suspected, the message to call attention to the suspected misconduct is displayed in area 88 shown in FIG. 12. As a result, the interviewer 3 can draw attention to the misconduct at an appropriate time during the online interview.

[0102] (Variation 2) In the above description, in step S45, the processor 11 of the interview support server 10 outputs a web screen to the main terminal 20 prompting the interviewee 2 to access the conference URL. As a result, the main terminal 20, in response to receiving a request to access the conference URL from the interviewee 2, enters the virtual conference room provided by the online conference server 50 without going through the interview support server 10. However, the main terminal 20 may enter the virtual conference room via the interview support server 10.

[0103] For example, in step S45, the processor 11 of the interview support server 10 outputs a web screen to the main terminal 20 requesting permission to transfer the video from the camera 75 and the audio from the microphone 78 to the online conference server 50. In response to obtaining permission from the main terminal 20, the processor 11 transfers the main video from the camera 75 of the main terminal 20 and the audio from the microphone 78 to the online conference server 50. The conference URL read in step S44 is added to the main video and audio.

[0104] When the processor 51 of the online conference server 50 receives the main video and audio from the interview support server 10, it calls the online conference bot 532. The processor 51 causes the online conference bot 532 to participate in the virtual conference room identified by the conference URL added to the main video. The online conference bot 532 provides the main video and audio from the main terminal 20 to the virtual conference room. Furthermore, the online conference bot 532 transmits all information provided to the virtual conference room (e.g., video and audio of other terminals entering the virtual conference room) to the interview support server 10. The interview support server 10 transfers the information to the main terminal 20. In this way, the main terminal 20 may enter the virtual conference room via the interview support server 10 and the online conference bot 532.

[0105] This allows the interview support server 10 to record the main video from the camera 75 of the main terminal 20 that has entered the virtual conference room via the online conference bot 532 and create a video file. Furthermore, the interview support server 10 can record audio from the microphone 78 and create a recording file. The processor 11 of the interview support server 10 stores the created video file and audio file in the storage 13 or external storage. The processor 11 writes the path to the video file in the field 132i of the record 132a in the management database 132 that corresponds to the session ID associated with the main terminal 20. As a result, after the online interview, the secretariat staff 4 can check the main video from the online interview by playing back the video file and audio file.

[0106] Alternatively, the processor 11 of the interview support server 10 may apply an AI analysis algorithm to the main video received in real time from the main terminal 20 to determine whether or not misconduct is suspected. If misconduct is suspected, the processor 11 adds a message to the main video to call attention to the suspected misconduct. As a result, if misconduct is suspected, the message to call attention to the suspected misconduct is displayed in the area 87 shown in FIG. 12. This allows the interviewer 3 to pay attention to the misconduct at an appropriate time during the online interview.

[0107] (Variation 3) A webcam connected to the main terminal 20 may be used instead of the camera 35 of the sub-terminal 30. In this case, steps S27 to S35 shown in Figures 5 and 6 are omitted, and instead of steps S38 to S41, the main terminal 20 performs a process of transmitting the sub-image from the webcam to the interview support server 10. Then, steps S42 and S43 are performed on the sub-image from the webcam.

[0108] (Variation 4) The first predetermined range is not limited to the above example. For example, the first predetermined range may include the hands or face of the interviewee 2 in addition to or instead of one or more markers 83. If a face is included in the first predetermined range, the processor 11 of the interview support server 10 may determine whether the first predetermined range is included in the video by comparing a face in the video with a face registered in advance.

[0109] Alternatively, the first predetermined range may include the display 76 of the main terminal 20 in addition to or instead of the one or more markers 83. In this case, steps S36 and S37 are omitted.

[0110] (Variation 5) The processor 11 of the interview support server 10 may determine whether a second predetermined range is included in the image captured by the camera 35 of the sub-terminal 30 (hereinafter also referred to as the "sub-image after the start of the interview") after the start of a video call between the main terminal 20 and the terminal 40. The sub-image after the start of the interview is an example of the "third image" of the present disclosure. The second predetermined range includes, for example, the display 76 of the main terminal 20. In this case, the processor 11 may use a known object recognition technique to determine whether the display 76 is included in the sub-image after the start of the interview.

[0111] The processor 11 outputs a notification when the second predetermined range is not included in the sub-video after the start of the interview. The notification is output to the main terminal 20. This allows the interviewee 2 to notice that the position or posture of the sub-terminal 30 has changed unintentionally, for example, and to adjust the position or posture of the sub-terminal 30. Alternatively, the notification may be output to the terminal 40. This allows the interviewer 3 to prompt the interviewee 2 to adjust the position or posture of the sub-terminal 30.

[0112] (Variation 6) The storage 73 of each of the main terminal 20 and the terminal 40 may store an application for the online conference service in addition to the web browser 731. In this case, the terminal 40 may start the application in step S23 shown in Fig. 5 and enter a virtual conference room provided by the online conference service via the application. Similarly, the main terminal 20 may start the application in step S47 shown in Fig. 7 and enter a virtual conference room provided by the online conference service via the application.

[0113] (Variation 7) The interviewer 3 may be an AI interviewer. The AI ​​interviewer is a virtual interviewer generated using AI. The AI ​​interviewer is constructed by the interview support server 10 or an external server. In this case, a virtual terminal constructed by the interview support server 10 or the external server is used instead of the terminal 40. The AI ​​interviewer interacts with the interviewee 2 using AI. The virtual terminal generates video and audio of the AI ​​interviewer and outputs the video and audio to the virtual conference room.

[0114] When the AI ​​interviewer and virtual terminal are constructed by the interview support server 10, the online interview may be conducted in a virtual conference room provided by the interview support server 10, rather than in a virtual conference room provided by the online conference server 50. That is, the processor 11 of the interview support server 10 constructs a virtual conference room and has a virtual terminal (AI interviewer) waiting in that virtual conference room. Thereafter, in response to receiving access to the interview URL from the main terminal 20, the processor 11 guides the main terminal 20 to the virtual conference room based on the sub-image from the camera 35, thereby enabling a video call between the main terminal 20 and the virtual terminal handled by the AI ​​interviewer.

[0115] (Variation 8) The above-described system 1 may be applied to a group interview. In this case, each record 132a of the management database 132 shown in FIG. 3 includes multiple fields 132d in which information identifying multiple interviewees is written, respectively. Steps S21 to S49 shown in FIGS. 5 to 7 are then performed for each of the multiple interviewees. This allows the interviewer 3 to simultaneously evaluate multiple interviewees in a single online interview. Note that the interview support server 10 may notify each interviewee who accesses the interview URL of the conference URL in response to the fact that the sub-image of the sub-terminal 30 used by the interviewee includes the first predetermined range. This allows the main terminal used by the interviewee for whom the answer to step S43 is YES to enter the virtual conference room regardless of the status of the other interviewees.

[0116] Similarly, each record 132a in the management database 132 may include multiple fields 132f in which information identifying multiple interviewers is written, respectively. This allows multiple terminals 40 handled by multiple interviewers to enter the virtual conference room.

[0117] It should be noted that the embodiments disclosed herein are illustrative in all respects and should not be considered limiting. The scope of the present invention is defined by the claims rather than the above description of the embodiments, and further includes all modifications within the meaning and scope of the claims. [Explanation of symbols]

[0118] 1 System, 2 Interviewee, 3 Interviewer, 4 Secretariat staff, 5 Holder, 10 Interview support server, 11, 31, 51, 71 Processor, 12, 32, 52, 72 Memory, 13, 33, 53, 73 Storage, 14, 34, 54, 74 Communication module, 20 Main terminal, 30 Sub-terminal, 35, 75 Camera, 36, 76 Display, 39, 79 Input device, 40, 60 Terminal, 50 Online conference server, 77 Speaker, 78 Microphone, 80, 80A-80C Web screen, 81 Two-dimensional code, 82, 84 Message, 83, 83a-83d Marker, 85, 93 Button, 90 Screen, 131 Support program, 132 Management database, 331, 731 Web browser, 332 Code reader application, 531 Online meeting programs, 532 online meeting bots.

Claims

1. A program for supporting an online interview using a first image of a first camera that captures an interviewee, acquiring a second image of a second camera operated by the interviewee; and enabling a video call between a first terminal operated by the interviewee and a second terminal operated by an interviewer based on the second video.

2. enabling the video call determining whether the second image includes a first predetermined range; The program according to claim 1 , further comprising enabling the video call in response to the second image including the first predetermined range.

3. the first terminal includes a first display; The program further causing the computer to output an image to the first terminal in response to receiving access from the first terminal; The program according to claim 2 , wherein the first predetermined range includes the image displayed on the first display.

4. The program storing a first URL accessed by the interviewee and a second URL accessed by the interviewer, the second URL being different from the first URL, in association with each other; receiving access to the first URL from the first terminal; The program according to claim 1 , wherein enabling the video call includes causing the first terminal that has accessed the first URL to display information about the second URL.

5. The program issuing the interviewee a first access code to a first resource; storing a second access code to a second resource different from the first resource, the second access code being communicated to the interviewer; receiving access to the first resource from the first terminal using the first access code; The program according to claim 1 , wherein enabling the video call includes switching an access destination of the first terminal from the first resource to the second resource.

6. the second camera is mounted on a third terminal; enabling the video call Allowing the first terminal and the second terminal to enter a virtual conference room provided by an online conference service; The program according to claim 1 , further comprising: allowing the third terminal to enter the virtual conference room via an online conference bot.

7. acquiring a third image from the second camera after the video call is started; determining whether the third image includes a second predetermined range; The program according to claim 2 , further causing the computer to execute: outputting a notification in response to the third video not including the second predetermined range.

8. the first terminal includes a first display; the second camera is mounted on a third terminal including a second display; The program In response to receiving access to the first resource from the first terminal, outputting a third access code for a third resource to the first terminal and displaying the third access code on the first display; the second camera reading the third access code to receive access to the third resource from the third terminal; The program according to claim 2, further causing the computer to display on the second display a shooting guide instructing the second camera to shoot the first specified range in response to access to the third resource from the third terminal.

9. A server that supports an online interview using a first image captured by a first camera that captures an interviewee, acquiring a second image from a second camera operated by the interviewee; a server that enables a video call between a first terminal operated by the interviewee and a second terminal operated by an interviewer based on the second video.

10. A method for supporting an online interview using a first image captured by a first camera that captures an interviewee, comprising: a server acquiring a second image of a second camera handled by the interviewee; The method further comprises the step of: the server enabling a video call between a first terminal operated by the interviewee and a second terminal operated by an interviewer based on the second video.

Images