Determination device, determination method, and recording medium

Abstract

A determination device (10) comprises: a first acquisition means (110) that acquires a first captured image which is captured by a first image capturing means (50) having a first display means (55) and which includes second identification information displayed on a second display means (65) and the face of a subject (200); a second acquisition means (120) that acquires a second captured image which is captured by a second image capturing means (60) having the second display means and which includes first identification information displayed on the first display means; a determination means (130) that executes identity determination of the subject on the basis of the first captured image and the second captured image; and an output means (140) that outputs a result of the identity determination. Said determination device makes it possible to perform appropriate identity determination while suppressing load on the subject and the cost.

Description

Technical Field

[0001] This disclosure relates to the technical field of determination devices, determination methods, and recording media.

Background Art

[0002] Devices that perform identity verification using images captured by a camera are known. For example, Patent Document 1 discloses performing identity verification of examinees using image data transmitted from a web camera in an online test system. Patent Document 2 discloses performing forgery determination using a face image captured by a web camera in a PC for teleworkers. Patent Document 3 discloses comparing image data captured in a first imaging operation with image data captured in a second imaging operation to determine whether the users match.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Patent Document 3

Summary of the Invention

Problems to be Solved by the Invention

[0004] This disclosure aims to improve the technologies disclosed in the prior art documents.

Means for Solving the Problems

[0005] One aspect of the determination device of this disclosure includes: a first acquisition means for acquiring a first captured image taken by a first shooting means having a first display means, which includes a second identification information displayed on a second display means and the face of a subject; a second acquisition means for acquiring a second captured image taken by a second shooting means having the second display means, which includes the first identification information displayed on the first display means; a determination means for performing identity determination of the subject based on the first captured image and the second captured image; and an output means for outputting the result of the identity determination.

[0006] One aspect of the method for determining identity in this disclosure involves, by at least one computer, acquiring a first captured image taken by a first photographic means having a first display means, which includes a second identification information displayed on a second display means and the face of a subject; acquiring a second captured image taken by a second photographic means having the second display means, which includes the first identification information displayed on the first display means; performing identity determination of the subject based on the first captured image and the second captured image; and outputting the result of the identity determination.

[0007] One aspect of the recording medium of this disclosure includes a computer program recorded on at least one computer which records a computer program that causes the computer to execute a determination method which includes acquiring a first captured image taken by a first shooting means having a first display means, including a second identification information displayed on a second display means and the face of a subject; acquiring a second captured image taken by a second shooting means having the second display means, including the first identification information displayed on the first display means; performing identity determination of the subject based on the first captured image and the second captured image; and outputting the result of the identity determination. [Brief explanation of the drawing]

[0008] [Figure 1] This is a block diagram showing the hardware configuration of the determination device according to the first embodiment. [Figure 2] This is a block diagram showing the functional configuration of the determination device according to the first embodiment. [Figure 3]This is a side view showing the image capture operation of the determination device according to the first embodiment. [Figure 4] This is a plan view showing an example of a first captured image acquired by the determination device according to the first embodiment. [Figure 5] This is a plan view showing an example of a second captured image acquired by the determination device according to the first embodiment. [Figure 6] This is a flowchart showing the operation flow of the determination device according to the first embodiment. [Figure 7] This is a block diagram showing the functional configuration of the determination device according to the second embodiment. [Figure 8] This is a block diagram showing the functional configuration of the determination device according to the third embodiment. [Figure 9] This is a plan view showing an example of a frame displayed in the determination device according to the third embodiment. [Figure 10] This is a block diagram showing the functional configuration of the determination device according to the fourth embodiment. [Figure 11] This is a flowchart showing the operation flow of the determination device according to the fourth embodiment. [Figure 12] This is a plan view showing an example of the first identification information and the second identification information in the determination device according to the fifth embodiment. [Modes for carrying out the invention]

[0009] The following describes embodiments of the determination device, determination method, and recording medium with reference to the drawings.

[0010] <First Embodiment> The determination device according to the first embodiment will be described with reference to Figures 1 to 6.

[0011] (Hardware configuration) First, the hardware configuration of the determination device according to the first embodiment will be described with reference to Figure 1. Figure 1 is a block diagram showing the hardware configuration of the determination device according to the first embodiment.

[0012] As shown in FIG. 1, the determination device 10 according to the first embodiment includes a processor 11, a RAM (Random Access Memory) 12, and a ROM (Read Only Memory) 13. The determination device 10 may further include a storage device 14, an input device 15, and an output device 16. The above-described processor 11, RAM 12, ROM 13, storage device 14, input device 15, and output device 16 are connected via a data bus 17.

[0013] The processor 11 reads a computer program. For example, the processor 11 is configured to read a computer program stored in at least one of the RAM 12, ROM 13, and storage device 14. Alternatively, the processor 11 may read a computer program stored in a computer-readable recording medium using a recording medium reading device (not shown). The processor 11 may acquire (i.e., read) a computer program from a device (not shown) disposed outside the determination device 10 via a network interface. By executing the read computer program, the processor 11 controls the RAM 12, storage device 14, input device 15, and output device 16. In particular, in this embodiment, when the processor 11 executes the read computer program, a functional block for performing the determination of the identity of the target person is realized within the processor 11. That is, the processor 11 may function as a controller that executes each control in the determination device 10.

[0014] The processor 11 may be configured as, for example, a CPU (Central Processing Unit), GPU (Graphics Processing Unit), FPGA (field-programmable gate array), DSP (Digital Signal Processor), ASIC (Application Specific Integrated Circuit), or quantum processor. The processor 11 may be constituted by one of these, or may be configured to use a plurality of them in parallel.

[0015] The RAM 12 temporarily stores the computer programs executed by the processor 11. The RAM 12 temporarily stores the data that the processor 11 temporarily uses when the processor 11 is executing a computer program. The RAM 12 may be, for example, a D-RAM (Dynamic Random Access Memory) or an SRAM (Static Random Access Memory). Also, instead of the RAM 12, other types of volatile memory may be used.

[0016] The ROM 13 stores the computer programs executed by the processor 11. The ROM 13 may also store other fixed data. The ROM 13 may be, for example, a P-ROM (Programmable Read Only Memory) or an EPROM (Erasable Read Only Memory). Also, instead of the ROM 13, other types of non-volatile memory may be used.

[0017] The storage device 14 stores the data that the determination device 10 stores in the long term. The storage device 14 may operate as a temporary storage device of the processor 11. The storage device 14 may include, for example, at least one of a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device.

[0018] The input device 15 is a device that receives an input instruction from the user of the determination device 10. The input device 15 may include, for example, at least one of a keyboard, a mouse, and a touch panel. The input device 15 may be configured as a portable terminal such as a smartphone or a tablet. The input device 15 may be a device capable of voice input including, for example, a microphone.

[0019] The output device 16 is a device that outputs information related to the determination device 10 to the outside. For example, the output device 16 may be a display device (e.g., a display) capable of displaying information related to the determination device 10. Alternatively, the output device 16 may be a speaker or the like capable of outputting audio information related to the determination device 10.

[0020] Note that some of the hardware described in Figure 1 may be provided in an external device of the determination device 10. For example, the determination device 10 may be configured with only the processor 11, RAM 12, and ROM 13 described above, and the other components (i.e., storage device 14, input device 15, output device 16) may be provided by an external device connected to the determination device 10. Also, the determination device 10 may implement some of its calculation functions using an external device (for example, an external server or cloud).

[0021] (Functional configuration) Next, the functional configuration of the determination device 10 according to the first embodiment will be described with reference to Figure 2. Figure 2 is a block diagram showing the functional configuration of the determination device according to the first embodiment.

[0022] As shown in Figure 2, the determination device 10 according to the first embodiment is configured to include a first acquisition unit 110, a second acquisition unit 120, a determination unit 130, and an output unit 140 as components for realizing its function. Each of the first acquisition unit 110, the second acquisition unit 120, the determination unit 130, and the output unit 140 may be a processing block realized by, for example, the processor 11 (see Figure 1) described above.

[0023] The first acquisition unit 110 is configured to acquire the first captured image taken by the first shooting unit 50. The first shooting unit 50 is, for example, a terminal used by the subject (e.g., a personal computer) and has a first display unit 55. The first shooting unit 50 is configured to capture the first captured image including the subject's face and second identification information displayed on the second display unit 65 of the second shooting unit 60. The second identification information is information for proving that the first captured image is an image that was successfully captured by the first shooting unit 50, and may be, for example, a one-time passcode. The first shooting unit 50 is configured to capture the first captured image using, for example, a camera built into the terminal. Alternatively, the first shooting unit 50 may be configured to capture the first captured image using a camera attached to the terminal (e.g., a webcam). The first acquisition unit 110 is configured to output the acquired first captured image to the determination unit 130.

[0024] The second acquisition unit 120 is configured to acquire the second captured image taken by the second shooting unit 60. The second shooting unit 60 is, for example, a terminal used by the subject (e.g., a smartphone) and has a second display unit 65. The second shooting unit 60 is configured to capture the second captured image including the first identification information displayed on the first display unit 55 of the first shooting unit 50. The first identification information is information for proving that the second captured image is an image that has been successfully captured by the second shooting unit 60, and, similar to the first identification information described above, may be, for example, a one-time passcode. The second shooting unit 60 is configured to capture the second captured image using, for example, a camera built into the terminal. Alternatively, the second shooting unit 60 may be configured to capture the second captured image using a camera attached to the terminal (e.g., a webcam, etc.). The second acquisition unit 120 is configured to output the acquired second captured image to the determination unit 130.

[0025] The determination unit 130 performs identity determination of the subject based on the first captured image acquired by the first acquisition unit 110 and the second captured image acquired by the second acquisition unit 120. Here, "identity determination" is the process of determining whether the subject is the registered user who has been registered in advance. In other words, identity determination is the process of determining whether impersonation is taking place. Identity determination may be the process of determining that the subject is not another person. Identity determination may also be the process of determining whether the subject is a living being (for example, whether it is a video or a photograph). The determination unit 130 performs identity determination using the subject's face and second identification information contained in the first captured image and the first identification information contained in the second captured image. For example, the determination unit 130 may determine whether the subject's face matches the face of a registered user. The determination unit 130 may also use the first and second identification information to determine whether the first and second captured images are currently images that have been captured normally. Regarding the specific methods for determining identity, existing technologies can be appropriately adopted, so a more detailed explanation will be omitted here.

[0026] One example of a situation in which identity verification is performed is an online examination. In this case, by performing identity verification on the examinee, it is possible to determine whether the examinee is actually taking the exam (in other words, whether someone else is taking the exam in their place). Other examples of situations in which identity verification is performed include online lectures, web conferences, and when renewing identification documents, but the application examples of this embodiment are not limited to these.

[0027] The output unit 140 is configured to output the results of the identity determination performed by the determination unit 130. The output unit 140 may be configured to output the results of the identity determination using, for example, the output device 16 (see Figure 1) described above. For example, the output unit 140 may output the results of the identity determination as an image on the display of the output device 16. Alternatively, the output unit 140 may output the results of the identity determination as an audio through the speaker of the output device 16. Furthermore, the output unit 140 may be configured to output the results of the identity determination to an external device. For example, the output unit 140 may output the results of the identity determination to an external device that operates according to the results of the identity determination.

[0028] (Image acquisition method) Next, with reference to Figure 3, the method for capturing the first and second captured images acquired by the determination device 10 according to the first embodiment will be described. Figure 3 is a side view showing the image capture operation of the determination device according to the first embodiment.

[0029] As shown in Figure 3, the first and second images acquired by the determination device 10 according to the first embodiment are captured by the first imaging unit 50 and the second imaging unit 60, which are arranged to face each other.

[0030] The first imaging unit 50 is configured, for example, as a monitor of a personal computer having a first display unit 55 and a first camera 56. In this case, the first display unit 55 is configured as the display portion of the personal computer, and the first camera 56 may be configured as a camera built into the monitor. The first imaging unit 50 is positioned such that the second display unit 65 of the second imaging unit 60 and the subject's face 200 are within the imaging range of the first camera 56.

[0031] The second imaging unit 60 is configured as a smartphone having, for example, a second display unit 65 and a second camera 66. In this case, the second display unit 65 is configured as the display portion of the smartphone, and the second camera 56 may be configured as a camera built into the smartphone (for example, a front camera). The second imaging unit 60 is positioned such that the first display unit 55 of the first imaging unit 50 is within the imaging range of the second camera 66.

[0032] (Specific examples of captured images) Next, specific examples of the first and second captured images acquired by the determination device 10 according to the first embodiment will be described with reference to Figures 4 and 5. Figure 4 is a plan view showing an example of the first captured image acquired by the determination device according to the first embodiment. Figure 5 is a plan view showing an example of the second captured image acquired by the determination device according to the first embodiment. Here, the first and second captured images will be described assuming they were taken under the conditions described in Figure 3.

[0033] As shown in Figure 4, the first captured image is captured as an image that includes the second identification information displayed on the second display unit 65 and the face of the subject 200. Here, the first captured image includes the entire second shooting unit 60 (for example, a smartphone), but the first captured image may include only a part of the second shooting unit 60. For example, the first captured image may include only the portion of the second display unit 65 where the second identification information is displayed.

[0034] As shown in Figure 5, the second captured image is captured as an image that includes the first identification information displayed on the first display unit 55. Here, the first captured image includes the entire first imaging unit 50 (for example, a computer monitor), but the second captured image may include only a part of the first imaging unit 50. For example, the second captured image may include only the portion of the first display unit 55 where the first identification information is displayed.

[0035] (Flow of operations) Next, the operation flow of the determination device 10 according to the first embodiment will be described with reference to Figure 6. Figure 6 is a flowchart showing the operation flow of the determination device according to the first embodiment.

[0036] As shown in Figure 6, when the determination device 10 according to the first embodiment starts operation, the first acquisition unit 110 first acquires the first captured image taken by the first shooting unit 50 (step S101). Then, the second acquisition unit 120 acquires the second captured image taken by the second shooting unit 60 (step S102). The first acquisition unit 110 and the second acquisition unit 120 output the acquired first and second captured images to the determination unit 130.

[0037] Next, the determination unit 130 performs identity determination of the subject based on the first captured image acquired by the first acquisition unit 110 and the second captured image acquired by the second acquisition unit 120 (step S103). Then, the output unit 140 outputs the result of the identity determination by the determination unit 130 (step S104).

[0038] The series of operations described above may be repeated. That is, the identity determination using the first and second captured images may be repeated. An example of repeatedly performing identity determination will be explained in detail in other embodiments described later.

[0039] (Technical effects) Next, the technical effects obtained by the determination device 10 according to the first embodiment will be described.

[0040] As explained in Figures 1 to 6, the determination device 10 according to the first embodiment performs identity determination of the subject using a first captured image including second identification information and the subject's face, and a second captured image including the first identification information. In this way, it is possible to achieve highly reliable identity determination without increasing the burden on the subject or the cost required for determination. For example, in operations where remote monitoring is performed by a supervisor, there is a risk of increased costs and oversights. In operations where the subject's behavior is recorded and checked, not only is real-time checking not possible and it becomes a post-processing, but there is also the cost of checking the recorded video. In operations where the subject is required to periodically enter a timed password, the burden on the subject becomes large. However, according to the determination device 10 according to this embodiment, it is possible to appropriately determine whether or not the subject is the person in question while resolving these technical problems.

[0041] <Second Embodiment> The determination device 10 according to the second embodiment will be described with reference to Figure 7. Note that the second embodiment differs from the first embodiment described above only in some configurations and operations; other parts may be identical to the first embodiment. Therefore, the following will describe in detail the parts that differ from the first embodiment already described, and will omit explanations of other overlapping parts as appropriate.

[0042] (Functional configuration) First, the functional configuration of the determination device 10 according to the second embodiment will be described with reference to Figure 7. Figure 7 is a block diagram showing the functional configuration of the determination device according to the second embodiment. Note that in Figure 7, the same reference numerals are used for elements similar to those shown in Figure 2.

[0043] As shown in Figure 7, the determination device 10 according to the second embodiment is configured to include a first acquisition unit 110, a second acquisition unit 120, a determination unit 130, an output unit 140, and a synchronization unit 150 as components for realizing its function. That is, the determination device 10 according to the second embodiment further includes a synchronization unit 150 in addition to the configuration of the first embodiment (see Figure 2). The synchronization unit 150 may be, for example, a processing block realized by the processor 11 (see Figure 1) described above.

[0044] The synchronization unit 150 is configured to synchronize the shooting timing of the first shooting unit 50 with the shooting timing of the second shooting unit 60. For example, the synchronization unit 150 may perform synchronization so that the shooting timing of the first shooting unit 50 and the shooting timing of the second shooting unit 60 coincide. Alternatively, the synchronization unit 150 may perform synchronization so that the difference between the shooting timing of the first shooting unit 50 and the shooting timing of the second shooting unit 60 is within a predetermined range.

[0045] The synchronization unit 150 may synchronize the shooting timing by, for example, synchronizing the internal counter of the application of the first shooting unit 50 with the internal counter of the application of the second shooting unit 60. In this case, the synchronization unit 150 should perform shooting when the counter of the first shooting unit 50 and the counter of the second shooting unit 60 reach the same count. The synchronization unit 150 may also perform shooting as a trigger when, for example, a shooting action (for example, pressing the shooting button) is performed by the subject 200 in either the first shooting unit 50 or the second shooting unit 60. For example, if the shooting button on the first shooting unit 50 is pressed at a count of 6, the synchronization unit 150 sends a message to the second shooting unit 60 to prepare for shooting, and when the count reaches 9, both the first shooting unit 50 and the second shooting unit 60 perform shooting. Alternatively, the synchronization unit 150 may trigger the capture when all the information to be included in the first and second captured images (i.e., the first identification information, the second identification information, and the subject's face) is within the imaging range of the first and second imaging units 50 and 60.

[0046] (Technical effects) Next, the technical effects obtained by the determination device 10 according to the second embodiment will be described.

[0047] As explained in Figure 7, in the determination device 10 according to the second embodiment, the timing of capturing the first image and the timing of capturing the second image are synchronized. This prevents a timing discrepancy between the first and second images, making it possible to perform identity determination with higher accuracy.

[0048] <Third Embodiment> The determination device 10 according to the third embodiment will be described with reference to Figures 8 and 9. Note that the third embodiment differs from the first and second embodiments described above only in some configurations and operations; other parts may be identical to those of the first and second embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, while omitting explanations of other overlapping parts as appropriate.

[0049] (Functional configuration) First, the functional configuration of the determination device 10 according to the third embodiment will be described with reference to Figure 8. Figure 8 is a block diagram showing the functional configuration of the determination device according to the third embodiment. Note that in Figure 8, the same reference numerals are used for elements as in the components shown in Figure 2.

[0050] As shown in Figure 8, the determination device 10 according to the third embodiment is configured to include a first acquisition unit 110, a second acquisition unit 120, a determination unit 130, an output unit 140, and a frame display unit 160 as components for realizing its function. That is, the determination device 10 according to the third embodiment further includes a frame display unit 160 in addition to the configuration of the first embodiment (see Figure 2). The frame display unit 160 may be, for example, a processing block realized by the processor 11 (see Figure 1) described above.

[0051] The frame display unit 160 is configured to display the image captured by the first shooting unit 50 (the so-called live view image) on the first display unit 55 of the first shooting unit 50. The frame display unit 160 is also configured to display a first frame for capturing the face of the subject 200 and a second frame for capturing the second display unit 65 on the first display unit 55 of the first shooting unit 50. The frame display unit 160 may display the first frame and the second frame superimposed on the image captured by the first shooting unit 50. The first frame is displayed to capture the face of the subject 200 in an appropriate position and size. The second frame is displayed to capture the second display unit 65 (in other words, the second identification information) in an appropriate position and size. The size and display position of the first frame and the second frame may be set in advance, or they may be changed as appropriate according to the shooting environment (for example, lighting conditions).

[0052] (Example display) Next, with reference to Figure 9, a specific example of the frame display in the determination device 10 according to the third embodiment will be described. Figure 9 is a plan view showing an example of a frame displayed in the determination device according to the third embodiment.

[0053] As shown in Figure 9, in the determination device 10 according to the third embodiment, the first display unit 55 displays the image captured by the first shooting unit 50 (i.e., an image including the subject's face 200 and the second display unit 65). The first display unit 55 also displays a first frame 310 for containing the subject's face 200 and a second frame 320 for containing the second display unit 65. Furthermore, the first display unit 55 displays first identification information. Note that the position, size, and shape of the frames shown here are merely examples. The first frame 310 and the second frame 320 may be displayed in conspicuous colors. In that case, the colors of the first frame 310 and the second frame 320 may be different from each other. The first frame 310 and the second frame 320 may also be displayed in a flashing manner or as an animation.

[0054] In addition to the first frame 310 and the second frame 320, the first display unit 55 may display information to help position the subject's face 200 and the second display unit 65 within the respective frames. For example, messages such as "Put your face within the frame" or "Put your smartphone within the frame" may be displayed. Furthermore, if the subject's face 200 and the second display unit 65 are not within the frame, guidance information to encourage movement may be displayed. For example, messages such as "Move a little further to the right" or "Bring your smartphone closer to the camera" may be displayed. These messages may be displayed, for example, with arrows indicating the direction of movement. Alternatively, these messages may be output as audio.

[0055] When the face of the subject 200 is properly positioned within the first frame 310, the frame display unit 160 may change the display mode of the first frame 310. That is, the frame display unit 160 may change the display mode of the first frame 310 to indicate that the subject's face is positioned within the frame. For example, the frame display unit 160 may change the color of the first frame 310 when the face of the subject 200 is properly positioned within the first frame 310. Similarly, when the second display unit 65 is properly positioned within the second frame 320, the frame display unit 160 may change the display mode of the second frame 320. That is, the frame display unit 160 may change the display mode of the second frame 320 to indicate that the second display unit 65 is positioned within the frame. For example, the frame display unit 160 may change the color of the second frame 320 when the second display unit 65 is properly positioned within the second frame 320.

[0056] (Technical effects) Next, the technical effects obtained by the determination device 10 according to the third embodiment will be described.

[0057] As explained in Figures 8 and 9, in the determination device 10 according to the third embodiment, a frame for accommodating the face of the subject 200 and the second display unit 65 is displayed on the first display unit 55. This makes it easy to align the face of the subject 200 and the second display unit 65, and makes it possible to appropriately capture the first image including the face of the subject 200 and the second identification information.

[0058] <Fourth Embodiment> The determination device 10 according to the fourth embodiment will be described with reference to Figures 10 and 11. Note that the fourth embodiment differs from the first to third embodiments described above only in some operations; other parts may be identical to those of the first to third embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, while other overlapping parts will be omitted as appropriate.

[0059] (Functional configuration) First, the functional configuration of the determination device 10 according to the fourth embodiment will be described with reference to Figure 10. Figure 10 is a block diagram showing the functional configuration of the determination device according to the fourth embodiment. Note that in Figure 10, the same reference numerals are used for elements as in the components shown in Figure 2.

[0060] As shown in Figure 10, the determination device 10 according to the fourth embodiment is configured to include a first acquisition unit 110, a second acquisition unit 120, a determination unit 130, an output unit 140, and an authorization unit 170 as components for realizing its function. That is, the determination device 10 according to the fourth embodiment further includes an authorization unit 170 in addition to the configuration of the first embodiment (see Figure 2). The authorization unit 170 may be, for example, a processing block realized by the processor 11 (see Figure 1) described above.

[0061] In the fourth embodiment, the first acquisition unit 110 and the second acquisition unit 120 are configured to repeatedly acquire the first captured image and the second captured image. In other words, the first imaging unit 50 and the second imaging unit 60 are configured to repeatedly capture the first captured image and the second captured image. The determination unit 130 in the fourth embodiment is configured to perform identity determination each time the first captured image and the second captured image are acquired. The output unit 140 is configured to output the determination result from the determination unit 130 to the permission unit 170.

[0062] The authorization unit 170 is configured to allow the subject 200 to execute a predetermined process during the period in which the determination unit 130 has output a result indicating that the person's identity determination has been successful. Here, "predetermined process" refers to a process that should only be permitted to be executed by the person in question and prohibited from being executed by others. The predetermined process may be, for example, a process that can be executed on the terminal that is the first imaging unit 50 or the terminal that is the second imaging unit 60. An example of a predetermined process is the process of accessing the test content in a web-based test. In a web-based test, for example, to prevent impersonation, access to the test content should only be permitted to the test-taker themselves, and access to the test content should not be permitted to anyone other than the test-taker. The authorization unit 170 is configured to permit the execution of such a process according to the result of the identity determination.

[0063] (Flow of operations) Next, the operation flow of the determination device 10 according to the fourth embodiment will be described with reference to Figure 11. Figure 11 is a flowchart showing the operation flow of the determination device according to the fourth embodiment. Note that in Figure 11, the same reference numerals are used for the same processes as shown in Figure 6.

[0064] As shown in Figure 11, when the determination device 10 according to the fourth embodiment starts operation, the first acquisition unit 110 first acquires the first captured image taken by the first shooting unit 50 (step S101). Then, the second acquisition unit 120 acquires the second captured image taken by the second shooting unit 60 (step S102). The first acquisition unit 110 and the second acquisition unit 120 output the acquired first and second captured images to the determination unit 130.

[0065] Next, the determination unit 130 performs identity determination of the subject based on the first captured image acquired by the first acquisition unit 110 and the second captured image acquired by the second acquisition unit 120 (step S103). Then, the output unit 140 outputs the result of the identity determination by the determination unit 130 (step S104).

[0066] Next, the authorization unit 170 determines whether the identity determination by the judgment unit 130 has been successful (i.e., whether the person has been determined to be the person in question) (step S401). If the identity determination is successful (step S401: YES), the authorization unit 170 permits the person 200 to perform the predetermined process (step S402). On the other hand, if the identity determination is not successful (step S401: NO), the authorization unit 170 prohibits the person 200 from performing the predetermined process (step S403). In this case, the authorization unit 170 may output an alert.

[0067] Subsequently, the determination device 10 determines whether or not to terminate the determination operation (step S404). Whether or not to terminate the determination operation may be determined, for example, by whether or not a predetermined period of time has elapsed since the start of the operation. More specifically, for example, the determination device may determine to terminate the determination operation when the end time of the web test or web training has arrived. If the determination operation is terminated (step S404: YES), the series of operations will end. On the other hand, if the determination operation is not terminated (step S404: NO), processing will resume from step S101. By repeating this operation, the determination device 10 can permit the execution of predetermined processes during the period in which the identity determination is successful.

[0068] (Technical effects) Next, the technical effects obtained by the determination device 10 according to the fourth embodiment will be described.

[0069] As explained in Figures 10 and 11, in the determination device 10 according to the fourth embodiment, identity determination is performed repeatedly, and as long as the identity determination is successful, the execution of a predetermined process is permitted. In this way, it becomes possible to appropriately manage the execution of a predetermined process by the subject using the results of the identity determination.

[0070] <Fifth Embodiment> The determination device 10 according to the fifth embodiment will be described with reference to Figure 12. Note that the fifth embodiment differs from the first to fourth embodiments described above only in some configurations and operations; other parts may be identical to those of the first to fourth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, while other overlapping parts will be omitted as appropriate.

[0071] (Identification information) First, the first identification information and the second identification information in the determination device 10 according to the fifth embodiment will be described with reference to Figure 12. Figure 12 is a plan view showing an example of the first identification information and the second identification information in the determination device according to the fifth embodiment.

[0072] As shown in Figure 12, in the determination device 10 according to the fifth embodiment, the first identification information and the second identification information are displayed with different content. For example, the first identification information may be information displayed as a two-dimensional code. The second identification information may be information displayed as a string of characters.

[0073] The first and second identification information, although their displayed content differs, are linked information. Therefore, by comparing the first and second identification information, it is possible to determine the identity of the person. The first and second identification information may be generated as pre-linked information. Alternatively, the first identification information may be converted using a predetermined conversion rule and used as the second identification information. Conversely, the second identification information may be converted using a predetermined conversion rule and used as the first identification information. In this case, when the determination unit 130 performs identity determination using the first and second identification information, it may perform a process to convert the first or second identification information, which was converted using a predetermined conversion rule, back to its original form using a predetermined conversion rule.

[0074] (Technical effects) Next, the technical effects obtained by the determination device 10 according to the fifth embodiment will be described.

[0075] As explained in Figure 12, in the determination device 10 according to the fifth embodiment, the first identification information and the second identification information are displayed as information with different display content. This makes it possible to achieve more reliable identity determination. For example, if the first identification information and the second identification information have the same display content, it may be possible to fraudulently bypass identity determination by copying and displaying either one of them. However, as in this embodiment, by making the first identification information and the second identification information have different display content, the fraud by copying described above can be prevented.

[0076] The processing method of recording a program that operates the configuration of each embodiment in order to realize the functions of each embodiment described above on a recording medium, reading the program recorded on the recording medium as code, and executing it on a computer is also included in the scope of each embodiment. In other words, a computer-readable recording medium is also included in the scope of each embodiment. Furthermore, not only the recording medium on which the above-mentioned program is recorded, but also the program itself is included in each embodiment.

[0077] As recording media, for example, floppy disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, magnetic tapes, non-volatile memory cards, and ROMs can be used. Furthermore, the scope of each embodiment is not limited to programs that perform processing on the recording media alone, but also includes programs that operate on the OS and perform processing in cooperation with other software and the functions of expansion boards. In addition, the program itself may be stored on a server, and part or all of the program may be made available for download from the server to the user terminal. The program may be provided to the user in, for example, SaaS (Software as a Service) format.

[0078] <Note> The embodiments described above may also be described in the following appendix, but are not limited to these.

[0079] (Note 1) The determination device described in Appendix 1 is a determination device comprising: a first acquisition means for acquiring a first captured image including a second identification information displayed on a second display means and the face of a subject, captured by a first shooting means having a first display means; a second acquisition means for acquiring a second captured image including the first identification information displayed on the first display means, captured by a second shooting means having the second display means; a determination means for performing identity determination of the subject based on the first captured image and the second captured image; and an output means for outputting the result of the identity determination.

[0080] (Note 2) The determination device described in Appendix 2 is the determination device described in Appendix 1, further comprising a synchronization means for synchronizing the shooting timing of the first shooting means and the second shooting means.

[0081] (Note 3) The determination device described in Appendix 3 is the determination device described in Appendix 1 or 2, further comprising a frame display means in the first display means for displaying an image captured by the first shooting means, a first frame for containing the face of the subject, and a second frame for containing the second display means.

[0082] (Note 4) The determination device described in Appendix 4 is the determination device described in any one of Appendix 1 to 3, wherein the first acquisition means and the second acquisition means repeatedly acquire the first captured image and the second captured image, the determination means performs the identity determination each time the first captured image and the second captured image are acquired, and the output means further comprises a permission means that permits the subject to perform a predetermined process during the period in which the result that the identity determination was successful is output.

[0083] (Note 5) The determination device described in Appendix 5 is the determination device described in any one of Appendix 1 to 4, wherein the first identification information and the second identification information are information with different display contents that are linked to each other.

[0084] (Note 6) The determination method described in Appendix 6 is a determination method which, using at least one computer, acquires a first captured image taken by a first shooting means having a first display means, including a second identification information displayed on a second display means and the face of the subject; acquires a second captured image taken by a second shooting means having the second display means, including the first identification information displayed on the first display means; performs identity determination of the subject based on the first captured image and the second captured image; and outputs the result of the identity determination.

[0085] (Note 7) The recording medium described in Appendix 7 is a recording medium on which a computer program is recorded that causes at least one computer to execute a determination method, which includes acquiring a first captured image taken by a first shooting means having a first display means, including a second identification information displayed on a second display means and the face of a subject; acquiring a second captured image taken by a second shooting means having the second display means, including the first identification information displayed on the first display means; performing identity determination of the subject based on the first captured image and the second captured image; and outputting the result of the identity determination.

[0086] (Note 8) The computer program described in Appendix 8 is a computer program that causes at least one computer to execute a determination method which includes: acquiring a first captured image taken by a first shooting means having a first display means, including second identification information displayed on a second display means and the face of a subject; acquiring a second captured image taken by a second shooting means having the second display means, including first identification information displayed on the first display means; performing identity determination of the subject based on the first captured image and the second captured image; and outputting the result of the identity determination.

[0087] This disclosure may be modified as appropriate, insofar as it does not contradict the gist or idea of ​​the invention as can be inferred from the claims and the specification as a whole, and such modified determination devices, determination methods, and recording media are also included in the technical idea of ​​this disclosure. [Explanation of Symbols]

[0088] 10 Judgment device 11 processors 50 First Photography Department 55 2nd display section 56. Camera 1 60 2nd Photography Department 65 2nd display section 66. Second Camera 110 First acquisition part 120 Second acquisition part 130 Judgment section 140 Output section 150 Classmates 160 Frame display section 170 Permit Department 200 target individuals 310 First slot 320 Second slot

Claims

1. A first acquisition means acquires a first captured image, which is captured by a first shooting means having a first display means, and includes second identification information displayed on a second display means and the face of the subject. A second acquisition means for acquiring a second captured image, which is captured by a second shooting means having the second display means and includes the first identification information displayed on the first display means, A determination means that performs identity determination of the subject based on the first captured image and the second captured image, Output means for outputting the results of the aforementioned identity determination, A determination device equipped with the following features.

2. The system further includes a synchronization means for synchronizing the shooting timing of the first shooting means and the second shooting means. The determination device according to claim 1.

3. The first display means further comprises a frame display means for displaying an image captured by the first shooting means, a first frame for containing the face of the subject, and a second frame for containing the second display means. The determination device according to claim 1 or 2.

4. The first acquisition means and the second acquisition means repeatedly acquire the first captured image and the second captured image, The determination means performs the identity determination each time the first captured image and the second captured image are acquired. The output means further includes permission means that permits the subject to perform a predetermined process during the period in which the result that the identity determination was successful is output by the output means. The determination device according to claim 1 or 2.

5. The first identification information and the second identification information are information with different display content that are linked to each other. The determination device according to claim 1 or 2.

6. By at least one computer, A first captured image is obtained, which includes second identification information displayed on a second display means and the face of the subject, captured by a first shooting means having a first display means. A second captured image is obtained, which is captured by the second shooting means having the second display means and includes the first identification information displayed on the first display means. Based on the first and second captured images, the identity of the subject is determined. Output the results of the aforementioned identity determination. Judgment method.

7. On at least one computer, A first captured image is obtained, which includes second identification information displayed on a second display means and the face of the subject, captured by a first shooting means having a first display means. A second captured image is obtained, which is captured by the second shooting means having the second display means and includes the first identification information displayed on the first display means. Based on the first and second captured images, the identity of the subject is determined. Output the results of the aforementioned identity determination. A computer program that executes a judgment method.

Images