Determination device, determination method, and recording medium

Abstract

A determination device (10) comprises: a first acquisition means (110) that acquires a first captured image which is captured by a first image capturing means (50) having a first display means (55) and which includes second identification information displayed on a second display means (65) and the face of a subject (200); a second acquisition means (120) that acquires a second captured image which is captured by a second image capturing means (60) having the second display means and which includes first identification information displayed on the first display means; a determination means (130) that executes identity determination of the subject on the basis of the first captured image and the second captured image; and an output means (140) that outputs a result of the identity determination. Said determination device makes it possible to perform appropriate identity determination while suppressing load on the subject and the cost.

Description

Determination device, determination method, and recording medium

[0001] The present disclosure relates to the technical fields of a determination device, a determination method, and a recording medium.

[0002] Devices that perform identity verification using images captured by a camera are known. For example, Patent Document 1 discloses verifying the identity of examinees using image data transmitted from a webcam in an online examination system. Patent Document 2 discloses determining whether an examinee is impersonating another using a facial image captured by a webcam in a PC for teleworkers. Patent Document 3 discloses comparing image data captured in a first imaging operation with image data captured in a second imaging operation to determine whether the users match.

[0003] JP 2022-031184 A JP 2016-118977 A JP 2014-119943 A

[0004] This disclosure aims to improve upon the techniques disclosed in the prior art documents.

[0005] One aspect of the disclosed determination device comprises a first acquisition means for acquiring a first captured image, which is captured by a first imaging means having a first display means and includes second identification information displayed on a second display means and the subject's face; a second acquisition means for acquiring a second captured image, which is captured by a second imaging means having the second display means and includes the first identification information displayed on the first display means; a determination means for performing an identity determination of the subject based on the first captured image and the second captured image; and an output means for outputting the result of the identity determination.

[0006] One aspect of the disclosed determination method involves having at least one computer acquire a first captured image, which is captured by a first imaging means having a first display means and includes second identification information displayed on a second display means and the subject's face; acquiring a second captured image, which is captured by a second imaging means having the second display means and includes the first identification information displayed on the first display means; performing an identity determination of the subject based on the first captured image and the second captured image; and outputting the result of the identity determination.

[0007] One aspect of the recording medium of this disclosure is a computer program recorded on at least one computer that causes the computer to execute a determination method, which includes acquiring a first captured image including second identification information displayed on a second display means and the face of a subject, which is captured by a first capturing means having a first display means, acquiring a second captured image including the first identification information displayed on the first display means, which is captured by a second capturing means having the second display means, performing an identity determination of the subject based on the first captured image and the second captured image, and outputting the result of the identity determination.

[0008] 1 is a block diagram showing the hardware configuration of a determination device according to a first embodiment; FIG. 2 is a block diagram showing the functional configuration of the determination device according to the first embodiment; FIG. 3 is a side view showing the operation of capturing an image acquired by the determination device according to the first embodiment; FIG. 4 is a plan view showing an example of a first captured image acquired by the determination device according to the first embodiment; FIG. 5 is a flowchart showing the operation flow of the determination device according to the first embodiment; FIG. 6 is a block diagram showing the functional configuration of a determination device according to a third embodiment; FIG. 7 is a plan view showing an example of a frame displayed in the determination device according to the third embodiment; FIG. 8 is a block diagram showing the functional configuration of a determination device according to a fourth embodiment; FIG. 9 is a flowchart showing the operation flow of the determination device according to the fourth embodiment; FIG. 10 is a plan view showing an example of first identification information and second identification information in a determination device according to a fifth embodiment.

[0009] Hereinafter, embodiments of a determination device, a determination method, and a recording medium will be described with reference to the drawings.

[0010] First Embodiment A determination device according to a first embodiment will be described with reference to FIGS. 1 to 6. FIG.

[0011] (Hardware Configuration) First, the hardware configuration of the determination device according to the first embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the hardware configuration of the determination device according to the first embodiment.

[0012] 1 , a determination device 10 according to the first embodiment includes a processor 11, a RAM (Random Access Memory) 12, and a ROM (Read Only Memory) 13. The determination device 10 may further include a storage device 14, an input device 15, and an output device 16. The processor 11, RAM 12, ROM 13, storage device 14, input device 15, and output device 16 are connected to each other via a data bus 17.

[0013] The processor 11 loads a computer program. For example, the processor 11 is configured to load a computer program stored in at least one of the RAM 12, the ROM 13, and the storage device 14. Alternatively, the processor 11 may load a computer program stored in a computer-readable storage medium using a storage medium reading device (not shown). The processor 11 may acquire (i.e., load) the computer program from a device (not shown) located outside the determination device 10 via a network interface. The processor 11 controls the RAM 12, the storage device 14, the input device 15, and the output device 16 by executing the loaded computer program. In particular, in this embodiment, when the processor 11 executes the loaded computer program, a functional block that performs identity determination of the subject is realized within the processor 11. In other words, the processor 11 may function as a controller that executes each control in the determination device 10.

[0014] The processor 11 may be configured as, for example, a central processing unit (CPU), a graphics processing unit (GPU), a field-programmable gate array (FPGA), a digital signal processor (DSP), an application-specific integrated circuit (ASIC), or a quantum processor. The processor 11 may be configured as one of these, or may be configured to use multiple processors in parallel.

[0015] The RAM 12 temporarily stores computer programs executed by the processor 11. The RAM 12 temporarily stores data that the processor 11 temporarily uses while it is executing the computer programs. The RAM 12 may be, for example, a dynamic random access memory (D-RAM) or a static random access memory (SRAM). Alternatively, other types of volatile memory may be used instead of the RAM 12.

[0016] The ROM 13 stores computer programs executed by the processor 11. The ROM 13 may also store fixed data. The ROM 13 may be, for example, a programmable read-only memory (PROM) or an erasable read-only memory (EPROM). Alternatively, other types of non-volatile memory may be used instead of the ROM 13.

[0017] The storage device 14 stores data that is to be saved long-term by the determination device 10. The storage device 14 may operate as a temporary storage device for the processor 11. The storage device 14 may include, for example, at least one of a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device.

[0018] The input device 15 is a device that receives input instructions from a user of the determination device 10. The input device 15 may include, for example, at least one of a keyboard, a mouse, and a touch panel. The input device 15 may be configured as a mobile terminal such as a smartphone or a tablet. The input device 15 may also be, for example, a device that includes a microphone and is capable of voice input.

[0019] The output device 16 is a device that outputs information related to the determination device 10 to the outside. For example, the output device 16 may be a display device (e.g., a display) that can display information related to the determination device 10. The output device 16 may also be a speaker or the like that can output information related to the determination device 10 as audio.

[0020] 1 may be provided in a device external to the determination device 10. For example, the determination device 10 may be configured to include only the processor 11, RAM 12, and ROM 13 described above, and the other components (i.e., the storage device 14, the input device 15, and the output device 16) may be provided in an external device connected to the determination device 10. Furthermore, some of the calculation functions of the determination device 10 may be realized by an external device (e.g., an external server, a cloud, etc.).

[0021] (Functional Configuration) Next, the functional configuration of the determination device 10 according to the first embodiment will be described with reference to Fig. 2. Fig. 2 is a block diagram showing the functional configuration of the determination device according to the first embodiment.

[0022] 2, the determination device 10 according to the first embodiment is configured to include, as components for realizing its functions, a first acquisition unit 110, a second acquisition unit 120, a determination unit 130, and an output unit 140. Each of the first acquisition unit 110, the second acquisition unit 120, the determination unit 130, and the output unit 140 may be a processing block realized by, for example, the above-described processor 11 (see FIG. 1).

[0023] The first acquisition unit 110 is configured to acquire a first captured image captured by the first image capture unit 50. The first image capture unit 50 is, for example, a terminal (e.g., a personal computer) used by the subject and has a first display unit 55. The first image capture unit 50 is configured to capture a first captured image including second identification information displayed on a second display unit 65 of the second image capture unit 60 and the subject's face. The second identification information is information for verifying that the first captured image has been properly captured by the first image capture unit 50 and may be, for example, a one-time passcode. The first image capture unit 50 is configured to capture the first captured image using, for example, a camera built into the terminal. Alternatively, the first image capture unit 50 may be configured to capture the first captured image using a camera attached to the terminal (e.g., a webcam, etc.). The first acquisition unit 110 is configured to output the acquired first captured image to the determination unit 130.

[0024] The second acquisition unit 120 is configured to acquire a second captured image captured by the second image capture unit 60. The second image capture unit 60 is, for example, a terminal (e.g., a smartphone) used by the subject and has a second display unit 65. The second image capture unit 60 is configured to acquire a second captured image including first identification information displayed on the first display unit 55 of the first image capture unit 50. The first identification information is information for verifying that the second captured image has been properly captured by the second image capture unit 60 and may be, for example, a one-time passcode, similar to the first identification information described above. The second image capture unit 60 is configured to acquire the second captured image using, for example, a camera built into the terminal. Alternatively, the second image capture unit 60 may be configured to acquire the second captured image using a camera (e.g., a webcam) attached to the terminal. The second acquisition unit 120 is configured to output the acquired second captured image to the determination unit 130.

[0025] The determination unit 130 performs identity determination of the subject based on the first captured image acquired by the first acquisition unit 110 and the second captured image acquired by the second acquisition unit 120. Here, "identity determination" refers to a process of determining whether the subject is a registered user who has been registered in advance. In other words, identity determination refers to a process of determining whether impersonation is occurring. Identity determination may be a process of determining whether the subject is a different person. Identity determination may also be a process of determining whether the subject is a living body (e.g., whether the subject is a video, photograph, or the like). The determination unit 130 performs identity determination using the subject's face and second identification information contained in the first captured image and the first identification information contained in the second captured image. For example, the determination unit 130 may determine whether the subject's face matches the face of a registered user. Furthermore, the determination unit 130 may use the first identification information and the second identification information to determine whether the first captured image and the second captured image are currently captured correctly. As for the specific method of identity determination, existing technology can be appropriately adopted, and therefore further detailed explanation will be omitted here.

[0026] An example of a situation in which identity verification is performed is an online exam. In this case, by verifying the identity of the subject examinee, it is possible to determine whether the examinee is actually taking the exam (in other words, whether someone is taking the exam in his / her place). Other examples of situations in which identity verification is performed include online courses, web conferences, and when renewing identification cards, but the application examples of this embodiment are not limited to these.

[0027] The output unit 140 is configured to be able to output the result of the identity determination by the determination unit 130. The output unit 140 may be configured to output the result of the identity determination using, for example, the above-mentioned output device 16 (see FIG. 1). For example, the output unit 140 may output the result of the identity determination as an image on a display provided in the output device 16. Alternatively, the output unit 140 may output the result of the identity determination as audio through a speaker provided in the output device 16. Furthermore, the output unit 140 may be configured to output the result of the identity determination to an external device. For example, the output unit 140 may output the result of the identity determination to an external device that operates according to the result of the identity determination.

[0028] (Image Capturing Method) Next, a method for capturing the first captured image and the second captured image acquired by the determination device 10 according to the first embodiment will be described with reference to Fig. 3. Fig. 3 is a side view showing the operation of capturing images acquired by the determination device according to the first embodiment.

[0029] As shown in Figure 3, the first and second captured images acquired by the determination device 10 according to the first embodiment are captured by a first capturing unit 50 and a second capturing unit 60 arranged to face each other.

[0030] The first image capturing unit 50 is configured, for example, as a monitor of a personal computer having a first display unit 55 and a first camera 56. In this case, the first display unit 55 may be configured as a display portion of the personal computer, and the first camera 56 may be configured as a camera built into the monitor. The first image capturing unit 50 is disposed in a position such that the second display unit 65 of the second image capturing unit 60 and the subject's face 200 are within the imaging range of the first camera 56.

[0031] The second image capturing unit 60 is configured as, for example, a smartphone having a second display unit 65 and a second camera 66. In this case, the second display unit 65 may be configured as a display portion of the smartphone, and the second camera 56 may be configured as a camera built into the smartphone (for example, an in-camera). The second image capturing unit 60 is disposed in a position such that the first display unit 55 of the first image capturing unit 50 is within the imaging range of the second camera 66.

[0032] (Specific Examples of Captured Images) Next, specific examples of the first captured image and the second captured image acquired by the determination device 10 according to the first embodiment will be described with reference to Fig. 4 and Fig. 5. Fig. 4 is a plan view showing an example of the first captured image acquired by the determination device according to the first embodiment. Fig. 5 is a plan view showing an example of the second captured image acquired by the determination device according to the first embodiment. Note that the first captured image and the second captured image will be described here assuming that they are captured in the situation described in Fig. 3.

[0033] 4, the first captured image is captured as an image including the second identification information displayed on the second display unit 65 and the face of the subject 200. Here, the first captured image includes the entire second image capture unit 60 (e.g., a smartphone), but the first captured image may be an image including only a portion of the second image capture unit 60. For example, the first captured image may be an image including only the portion of the second display unit 65 where the second identification information is displayed.

[0034] 5, the second captured image is captured as an image including the first identification information displayed on the first display unit 55. Here, the first captured image includes the entire first image capturing unit 50 (e.g., a personal computer monitor), but the second captured image may be an image including only a portion of the first image capturing unit 50. For example, the second captured image may be an image including only the portion of the first display unit 55 where the first identification information is displayed.

[0035] (Flow of Operation) Next, the flow of operation by the determination device 10 according to the first embodiment will be described with reference to Fig. 6. Fig. 6 is a flowchart showing the flow of operation of the determination device according to the first embodiment.

[0036] 6 , when the operation of the determination device 10 according to the first embodiment is started, the first acquisition unit 110 first acquires a first captured image captured by the first imaging unit 50 (step S101). The second acquisition unit 120 then acquires a second captured image captured by the second imaging unit 60 (step S102). The first acquisition unit 110 and the second acquisition unit 120 output the acquired first and second captured images to the determination unit 130.

[0037] Next, the determination unit 130 performs identity determination of the subject based on the first captured image acquired by the first acquisition unit 110 and the second captured image acquired by the second acquisition unit 120 (step S103). Then, the output unit 140 outputs the result of the identity determination by the determination unit 130 (step S104).

[0038] The above-described series of operations may be repeatedly executed. That is, the identity determination using the first captured image and the second captured image may be repeatedly executed. An example of repeatedly executing the identity determination will be described in detail in another embodiment described later.

[0039] (Technical Effects) Next, technical effects obtained by the determination device 10 according to the first embodiment will be described.

[0040] As described with reference to FIGS. 1 to 6 , the determination device 10 according to the first embodiment performs identity determination of a subject using a first captured image including second identification information and the subject's face, and a second captured image including the first identification information. This allows for highly reliable identity determination without increasing the burden on the subject or the costs required for the determination. For example, remote monitoring by a monitor increases costs and risks oversight. Recording and checking the subject's behavior not only prevents real-time checks and requires post-processing, but also incurs costs for checking the recorded video. Requiring the subject to periodically enter a time-limited password places a heavy burden on the subject. However, the determination device 10 according to the present embodiment can resolve these technical issues while appropriately determining whether the subject is the person in question.

[0041] Second Embodiment A determination device 10 according to a second embodiment will be described with reference to Fig. 7. The second embodiment differs from the first embodiment described above only in some configurations and operations, and other parts may be the same as the first embodiment. Therefore, the following will describe in detail the parts that differ from the first embodiment already described, and will omit a description of other overlapping parts as appropriate.

[0042] (Functional Configuration) First, the functional configuration of the determination device 10 according to the second embodiment will be described with reference to Fig. 7. Fig. 7 is a block diagram showing the functional configuration of the determination device according to the second embodiment. Note that in Fig. 7, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0043] 7, the determination device 10 according to the second embodiment is configured to include, as components for realizing its functions, a first acquisition unit 110, a second acquisition unit 120, a determination unit 130, an output unit 140, and a synchronization unit 150. That is, the determination device 10 according to the second embodiment further includes a synchronization unit 150 in addition to the configuration of the first embodiment (see FIG. 2). The synchronization unit 150 may be a processing block realized by, for example, the above-described processor 11 (see FIG. 1).

[0044] The synchronization unit 150 is configured to be able to synchronize the image capture timing of the first image capture unit 50 and the image capture timing of the second image capture unit 60. For example, the synchronization unit 150 may perform synchronization so that the image capture timing of the first image capture unit 50 and the image capture timing of the second image capture unit 60 coincide with each other. Alternatively, the synchronization unit 150 may perform synchronization so that the difference between the image capture timing of the first image capture unit 50 and the image capture timing of the second image capture unit 60 falls within a predetermined range.

[0045] The synchronization unit 150 may synchronize the timing of image capture by, for example, synchronizing an internal counter of an application of the first image capture unit 50 with an internal counter of an application of the second image capture unit 60. In this case, the synchronization unit 150 may perform image capture when the counters of the first image capture unit 50 and the second image capture unit 60 reach the same count. The synchronization unit 150 may perform image capture when, for example, the subject 200 performs an image capture action (e.g., pressing a capture button) on either the first image capture unit 50 or the second image capture unit 60. For example, when the image capture button on the first image capture unit 50 is pressed on count six, the synchronization unit 150 sends a signal to the second image capture unit 60 to prepare for image capture, and when the count reaches nine, both the first image capture unit 50 and the second image capture unit 60 perform image capture. Alternatively, the synchronization unit 150 may perform the photographing when all of the information to be included in the first photographed image and the second photographed image (i.e., the first identification information, the second identification information, and the subject's face) falls within the photographing range of the first photographing unit 50 and the second photographing unit 60.

[0046] (Technical Effects) Next, technical effects obtained by the determination device 10 according to the second embodiment will be described.

[0047] 7, in the determination device 10 according to the second embodiment, the timing of capturing the first captured image and the timing of capturing the second captured image are synchronized. This makes it possible to prevent mismatch in the timing of capturing the first captured image and the second captured image, thereby enabling identity determination to be performed with higher accuracy.

[0048] Third Embodiment A determination device 10 according to a third embodiment will be described with reference to Figures 8 and 9. Note that the third embodiment differs only in part of the configuration and operation from the first and second embodiments described above, and other parts may be the same as the first and second embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0049] (Functional Configuration) First, the functional configuration of the determination device 10 according to the third embodiment will be described with reference to Fig. 8. Fig. 8 is a block diagram showing the functional configuration of the determination device according to the third embodiment. Note that in Fig. 8, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0050] As shown in Fig. 8, the determination device 10 according to the third embodiment is configured to include, as components for realizing its functions, a first acquisition unit 110, a second acquisition unit 120, a determination unit 130, an output unit 140, and a frame display unit 160. That is, the determination device 10 according to the third embodiment further includes the frame display unit 160 in addition to the configuration of the first embodiment (see Fig. 2). The frame display unit 160 may be a processing block realized by, for example, the above-described processor 11 (see Fig. 1).

[0051] The frame display unit 160 is configured to be able to display an image captured by the first image capture unit 50 (a so-called live view image) on the first display unit 55 of the first image capture unit 50. The frame display unit 160 is also configured to be able to display a first frame for accommodating the face of the subject 200 and a second frame for accommodating the second display unit 65 on the first display unit 55 of the first image capture unit 50. The frame display unit 160 may display the first frame and the second frame superimposed on the image captured by the first image capture unit 50. The first frame is a frame displayed for capturing the face of the subject 200 at an appropriate position and in an appropriate size. The second frame is a frame displayed for capturing the second display unit 65 (in other words, the second identification information) at an appropriate position and in an appropriate size. The sizes and display positions of the first and second frames may be set in advance or may be changed as appropriate depending on the environment (e.g., lighting conditions) during image capture.

[0052] (Display Example) Next, a specific example of frame display in the determination device 10 according to the third embodiment will be described with reference to Fig. 9. Fig. 9 is a plan view showing an example of a frame displayed in the determination device according to the third embodiment.

[0053] As shown in FIG. 9 , in the determination device 10 according to the third embodiment, an image captured by the first image capturing unit 50 (i.e., an image including the subject's face 200 and the second display unit 65) is displayed on the first display unit 55. The first display unit 55 also displays a first frame 310 that contains the subject's face 200 and a second frame 320 that contains the second display unit 65. Furthermore, the first display unit 55 displays first identification information. Note that the positions, sizes, and shapes of the frames shown here are merely examples. The first frame 310 and the second frame 320 may each be displayed in a conspicuous color. In this case, the color of the first frame 310 and the color of the second frame 320 may be different from each other. The first frame 310 and the second frame 320 may also be displayed in a flashing or animated manner.

[0054] In addition to the first frame 310 and the second frame 320, the first display unit 55 may display information for fitting the face of the subject 200 and the second display unit 65 within each frame. For example, messages such as "Please fit your face within the frame" or "Please fit your smartphone within the frame" may be displayed. Furthermore, if the face of the subject 200 and the second display unit 65 do not fit within the frame, guidance information encouraging movement may be displayed. For example, messages such as "Please move a little more to the right" or "Please move your smartphone closer to the camera" may be displayed. These messages may be displayed, for example, using arrows indicating the direction of movement. Alternatively, these messages may be output as audio.

[0055] When the face of the subject 200 is properly fitted within the first frame 310, the frame display unit 160 may change the display mode of the first frame 310. That is, the frame display unit 160 may change the display mode of the first frame 310 to notify the user that the face of the subject 200 is properly fitted within the frame. For example, the frame display unit 160 may change the color of the first frame 310 when the face of the subject 200 is properly fitted within the first frame 310. Similarly, when the second display unit 65 is properly fitted within the second frame 320, the frame display unit 160 may change the display mode of the second frame 320. That is, the frame display unit 160 may change the display mode of the second frame 320 to notify the user that the second display unit 65 is properly fitted within the frame. For example, the frame display unit 160 may change the color of the second frame 320 when the second display unit 65 is properly fitted within the second frame 320.

[0056] (Technical Effects) Next, technical effects obtained by the determination device 10 according to the third embodiment will be described.

[0057] 8 and 9 , in the determination device 10 according to the third embodiment, a frame for accommodating the face of the subject 200 and the second display unit 65 is displayed on the first display unit 55. This facilitates alignment of the face of the subject 200 and the second display unit 65, making it possible to appropriately capture the first captured image including the face of the subject 200 and the second identification information.

[0058] Fourth Embodiment A determination device 10 according to a fourth embodiment will be described with reference to Figures 10 and 11. Note that the fourth embodiment differs from the first to third embodiments described above only in some of its operations, and other parts may be the same as the first to third embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0059] (Functional Configuration) First, the functional configuration of the determination device 10 according to the fourth embodiment will be described with reference to Fig. 10. Fig. 10 is a block diagram showing the functional configuration of the determination device according to the fourth embodiment. Note that in Fig. 10, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0060] 10 , the determination device 10 according to the fourth embodiment is configured to include, as components for realizing its functions, a first acquisition unit 110, a second acquisition unit 120, a determination unit 130, an output unit 140, and a permission unit 170. That is, the determination device 10 according to the fourth embodiment further includes a permission unit 170 in addition to the configuration of the first embodiment (see FIG. 2 ). The permission unit 170 may be a processing block realized by, for example, the above-described processor 11 (see FIG. 1 ).

[0061] The first acquisition unit 110 and the second acquisition unit 120 according to the fourth embodiment are configured to repeatedly acquire the first captured image and the second captured image. In other words, the first imaging unit 50 and the second imaging unit 60 are configured to repeatedly capture the first captured image and the second captured image. The determination unit 130 according to the fourth embodiment is configured to perform identity determination every time the first captured image and the second captured image are acquired. The output unit 140 is configured to output the determination result by the determination unit 130 to the permission unit 170.

[0062] The permission unit 170 is configured to permit the subject 200 to execute a predetermined process during the period when the determination unit 130 outputs a result indicating that the subject's identity has been successfully verified. The "predetermined process" here refers to a process that should be permitted only for the subject 200 and prohibited for others. The predetermined process may be a process that can be executed, for example, on the terminal that is the first image capture unit 50 or the terminal that is the second image capture unit 60. An example of the predetermined process is a process for accessing test content in an online test. In an online test, for example, to prevent proxy taking, only the test taker should be permitted to access the test content, and others different from the test taker should not be permitted to access the test content. The permission unit 170 is configured to permit the execution of such a process depending on the result of the identity verification.

[0063] (Operation Flow) Next, the operation flow of the determination device 10 according to the fourth embodiment will be described with reference to Fig. 11. Fig. 11 is a flowchart showing the operation flow of the determination device according to the fourth embodiment. Note that in Fig. 11, the same processes as those shown in Fig. 6 are denoted by the same reference numerals.

[0064] 11 , when the operation of the determination device 10 according to the fourth embodiment starts, the first acquisition unit 110 first acquires a first captured image captured by the first imaging unit 50 (step S101). The second acquisition unit 120 also acquires a second captured image captured by the second imaging unit 60 (step S102). The first acquisition unit 110 and the second acquisition unit 120 output the acquired first and second captured images to the determination unit 130.

[0065] Next, the determination unit 130 performs identity determination of the subject based on the first captured image acquired by the first acquisition unit 110 and the second captured image acquired by the second acquisition unit 120 (step S103). Then, the output unit 140 outputs the result of the identity determination by the determination unit 130 (step S104).

[0066] Next, the permission unit 170 determines whether the identity determination by the determination unit 130 has been successful (i.e., whether the person has been determined to be the person in question) (step S401). If the identity determination has been successful (step S401: YES), the permission unit 170 permits the subject 200 to execute a predetermined process (step S402). On the other hand, if the identity determination has not been successful (step S401: NO), the permission unit 170 prohibits the subject 200 from executing the predetermined process (step S403). In this case, the permission unit 170 may output an alert.

[0067] Thereafter, the determination device 10 determines whether or not to end the determination operation (step S404). Whether or not to end the determination operation may be determined, for example, based on whether a predetermined period of time has elapsed since the start of the operation. More specifically, the determination device 10 may determine to end the determination operation when, for example, the end time of an online test or online training has arrived. If the determination operation is to be ended (step S404: YES), the series of operations will end. On the other hand, if the determination operation is not to be ended (step S404: NO), the processing will resume from step S101. By repeating such operations, the determination device 10 can permit the execution of a predetermined process during the period in which the identity determination is successful.

[0068] (Technical Effects) Next, technical effects obtained by the determination device 10 according to the fourth embodiment will be described.

[0069] 10 and 11 , the determination device 10 according to the fourth embodiment repeatedly performs identity determination, and allows execution of a predetermined process while identity determination is successful. In this way, it becomes possible to appropriately manage the execution of a predetermined process by a subject by utilizing the result of identity determination.

[0070] Fifth Embodiment A determination device 10 according to a fifth embodiment will be described with reference to Fig. 12. The fifth embodiment differs from the first to fourth embodiments described above only in part of the configuration and operation, and other parts may be the same as the first to fourth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0071] (Identification Information) First, the first identification information and the second identification information in the determination device 10 according to the fifth embodiment will be described with reference to Fig. 12. Fig. 12 is a plan view showing an example of the first identification information and the second identification information in the determination device according to the fifth embodiment.

[0072] 12 , in the determination device 10 according to the fifth embodiment, the first identification information and the second identification information are displayed with different contents. For example, the first identification information may be displayed as a two-dimensional code, and the second identification information may be displayed as a character string.

[0073] Although the first identification information and the second identification information have different display contents, they are linked to each other. Therefore, by comparing the first identification information and the second identification information, it is possible to perform identity determination. The first identification information and the second identification information may be generated as linked information in advance. Alternatively, the first identification information may be converted using a predetermined conversion rule and used as the second identification information. Conversely, the second identification information may be converted using a predetermined conversion rule and used as the first identification information. In this case, when performing identity determination using the first identification information and the second identification information, the determination unit 130 may perform a process of restoring the first or second identification information converted using the predetermined conversion rule to its original state using the predetermined conversion rule.

[0074] (Technical Effects) Next, technical effects obtained by the determination device 10 according to the fifth embodiment will be described.

[0075] As described in FIG. 12 , in the determination device 10 according to the fifth embodiment, the first identification information and the second identification information are displayed as information with different display contents. This makes it possible to achieve more reliable identity determination. For example, if the first identification information and the second identification information have the same display contents, there is a possibility that an attacker can fraudulently bypass identity determination by copying and displaying one of them. However, by displaying the first identification information and the second identification information with different display contents, as in this embodiment, the fraudulent copying described above can be prevented.

[0076] The scope of each embodiment also includes a processing method in which a program that operates the configuration of each embodiment to realize the functions of the above-described embodiments is recorded on a recording medium, the program recorded on the recording medium is read as code, and the program is executed on a computer. In other words, a computer-readable recording medium is also included in the scope of each embodiment. Furthermore, each embodiment includes not only a recording medium on which the above-described program is recorded, but also the program itself.

[0077] Examples of recording media that can be used include floppy disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, magnetic tapes, non-volatile memory cards, and ROMs. Furthermore, the scope of each embodiment is not limited to programs that execute processes by themselves, but also includes programs that execute processes by operating on an OS in conjunction with other software or expansion board functions. Furthermore, the program itself may be stored on a server, and part or all of the program may be downloadable from the server to a user terminal. The program may be provided to the user in, for example, a SaaS (Software as a Service) format.

[0078] <Supplementary Notes> The above-described embodiment may be further described as in the following supplementary notes, but is not limited to the following.

[0079] (Supplementary Note 1) The determination device described in Supplementary Note 1 is a determination device comprising: a first acquisition means for acquiring a first captured image, which is captured by a first imaging means having a first display means and includes second identification information displayed on a second display means and the face of the subject; a second acquisition means for acquiring a second captured image, which is captured by a second imaging means having the second display means and includes the first identification information displayed on the first display means; a determination means for performing identity determination of the subject based on the first captured image and the second captured image; and an output means for outputting the result of the identity determination.

[0080] (Supplementary Note 2) The determination device according to Supplementary Note 2 is the determination device according to Supplementary Note 1, further comprising a synchronization unit that synchronizes the image capturing timing of the first image capturing unit and the second image capturing unit.

[0081] (Appendix 3) The determination device described in Appendix 3 is the determination device described in Appendix 1 or 2, further comprising a frame display means for displaying, on the first display means, an image captured by the first imaging means, a first frame for containing the subject's face, and a second frame for containing the second display means.

[0082] (Appendix 4) The determination device described in Appendix 4 is the determination device described in any one of Appendices 1 to 3, wherein the first acquisition means and the second acquisition means repeatedly acquire the first captured image and the second captured image, the determination means performs the identity determination each time the first captured image and the second captured image are acquired, and the determination device further includes a permission means for permitting the subject to perform a predetermined process during a period in which the output means outputs a result indicating that the identity determination was successful.

[0083] (Supplementary Note 5) The determination device described in Supplementary Note 5 is the determination device described in any one of Supplementary Notes 1 to 4, in which the first identification information and the second identification information are information of different display contents that are linked to each other.

[0084] (Appendix 6) The determination method described in Appendix 6 is a determination method in which, by at least one computer, a first captured image is acquired, which is captured by a first imaging means having a first display means, and includes second identification information displayed on a second display means and the face of the subject; a second captured image is acquired by a second imaging means having the second display means, and includes the first identification information displayed on the first display means; based on the first captured image and the second captured image, a determination is made as to the identity of the subject; and a result of the determination is output.

[0085] (Appendix 7) The recording medium described in Appendix 7 is a recording medium having recorded thereon a computer program for causing at least one computer to execute a determination method, which includes acquiring a first captured image including second identification information displayed on a second display means and the face of a subject, which is captured by a first capturing means having a first display means, acquiring a second captured image including the first identification information displayed on the first display means, which is captured by a second capturing means having the second display means, performing an identity determination of the subject based on the first captured image and the second captured image, and outputting the result of the identity determination.

[0086] (Appendix 8) The computer program described in Appendix 8 is a computer program that causes at least one computer to execute a determination method that acquires a first captured image that is captured by a first capturing means having a first display means and includes second identification information displayed on a second display means and the face of a subject, acquires a second captured image that is captured by a second capturing means having the second display means and includes the first identification information displayed on the first display means, performs identity determination of the subject based on the first captured image and the second captured image, and outputs the result of the identity determination.

[0087] This disclosure may be modified as appropriate within the scope that does not contradict the gist or idea of ​​the invention that can be read from the claims and the entire specification, and determination devices, determination methods, and recording media that involve such modifications are also included in the technical idea of ​​this disclosure.

[0088] REFERENCE SIGNS LIST 10 Determination device 11 Processor 50 First imaging unit 55 Second display unit 56 First camera 60 Second imaging unit 65 Second display unit 66 Second camera 110 First acquisition unit 120 Second acquisition unit 130 Determination unit 140 Output unit 150 Synchronization unit 160 Frame display unit 170 Permission unit 200 Subject 310 First frame 320 Second frame

Claims

1. a first acquisition means for acquiring a first captured image including the second identification information displayed on the second display means and the face of the subject, the first captured image being captured by the first capture means having the first display means; a second acquisition means for acquiring a second captured image including the first identification information displayed on the first display means, the second captured image being captured by a second image capturing means having the second display means; a determination means for determining the identity of the subject based on the first captured image and the second captured image; an output means for outputting the result of the identity determination; A determination device comprising:

2. The camera further includes a synchronization unit that synchronizes the timing of photographing between the first photographing unit and the second photographing unit. The determination device according to claim 1 .

3. The apparatus further includes frame display means for displaying, on the first display means, an image captured by the first image capturing means, a first frame for capturing the face of the subject, and a second frame for capturing the second display means. The determination device according to claim 1 or 2.

4. the first acquisition means and the second acquisition means repeatedly acquire the first captured image and the second captured image, the determination means performs the identity determination each time the first captured image and the second captured image are acquired, The device further includes a permission unit that permits the subject to execute a predetermined process during a period in which the output unit outputs a result indicating that the identity verification has been successful. The determination device according to claim 1 or 2.

5. The first identification information and the second identification information are information of different display contents that are linked to each other. The determination device according to claim 1 or 2.

6. by at least one computer, acquiring a first captured image, which is captured by a first capturing means having a first display means, and which includes the second identification information displayed on a second display means and the face of the subject; acquiring a second captured image including the first identification information displayed on the first display means, the second captured image being captured by a second image capturing means having the second display means; performing an identity determination of the subject based on the first captured image and the second captured image; outputting the result of the identity determination; Judgment method.

7. At least one computer acquiring a first captured image, which is captured by a first capturing means having a first display means, and which includes the second identification information displayed on a second display means and the face of the subject; acquiring a second captured image including the first identification information displayed on the first display means, the second captured image being captured by a second image capturing means having the second display means; performing an identity determination of the subject based on the first captured image and the second captured image; outputting the result of the identity determination; A computer program that executes the determination method.