Evidence management device, evidence management system, evidence management method and program

Abstract

This trail management device (server device (102)) is provided with: a data acquisition unit (103) that acquires subject image data including a subject image which includes a first region showing the individual, and a second region showing an individual image included in a document; and a trail generation unit (104) that generates trail data based on the subject image if the first region and the second region satisfy a first condition and the sharpness of the subject image satisfies a second condition.

Description

[Technical Field]

[0001] The present invention relates to a trail management device, a trail management system, a trail management method, and program Regarding. [Background technology]

[0002] Various techniques have been proposed for verifying identity using facial images.

[0003] For example, the identity verification and authentication system described in Patent Document 1 calculates a face score value from biometric information generated based on a face image captured by an imaging unit and biometric information generated based on a face image included in an image of an identity document when registering a user. If the face score value is equal to or greater than a first predetermined value, the identity verification and authentication system registers the biometric information generated based on the face image captured by the imaging unit as registered biometric information.

[0004] Patent Document 2 discloses a face recognition device for preventing a decrease in convenience at the beginning of operation. This face recognition device includes a face image acquisition unit, a matching unit, a time measurement unit, and a threshold change unit. The face image acquisition unit acquires a face image of the authentication target. The matching unit performs face recognition on the face image of the authentication target based on a threshold. The time measurement unit measures the elapsed time since the face recognition device started operation. The threshold change unit restricts the threshold from being changed to a value greater than a value determined depending on the measured elapsed time. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Patent Publication No. 2021-125115 [Patent Document 2] Japanese Patent Application Publication No. 2019-125003 Summary of the Invention [Problem to be solved by the invention]

[0006] The identity verification and authentication system described in Patent Document 1 performs identity verification processing using a first predetermined value when registering a user. The identity verification and authentication system registers, as registered biometric information, biometric information generated based on a face image captured by an imaging unit, from among the biometric information used in the identity verification processing at the time of registration.

[0007] Information including a facial image captured by the imaging unit described in Patent Document 1 may be saved as evidence for the identity verification process at the time of registration. However, the facial image captured by the imaging unit may have poor image quality due to reasons such as being slightly out of focus. A facial image with poor image quality may cause problems such as inability to perform sufficient verification when verification using evidence becomes necessary after registration.

[0008] The present invention has been made in view of the above circumstances, and an object of the present invention is to provide an evidence management device and the like that makes it possible to manage evidence with good image quality. [Means for solving the problem]

[0009] In order to achieve the above object, a trail management device according to a first aspect of the present invention comprises: data acquisition means for acquiring target image data including a target image including a first area indicating the person and a second area indicating the person's image included in the document; and a trail generating means for generating trail data based on the target image when the first area and the second area satisfy a first condition and the clarity of the target image satisfies a second condition. 、 the second condition is defined by a relationship between the sharpness and a second reference value, The trail generating means holds candidate data including a plurality of candidate values ​​that are candidates for the second reference value, and repeatedly determines whether or not the clarity of the target image satisfies a second condition by using a candidate value selected from the plurality of candidate values ​​in descending order as the second reference value. do.

[0010] In order to achieve the above object, a trail management system according to a second aspect of the present invention comprises: The above-mentioned trail management device; The device further comprises a terminal device that generates the target image data by photographing the person and the document and transmits the target image data to the trail management device.

[0011] In order to achieve the above object, a trail management method according to a third aspect of the present invention comprises: The computer Acquire target image data including a target image including a first area indicating the person and a second area indicating the person's image included in the document; generating evidence data based on the target image when the first area and the second area satisfy a first condition and the clarity of the target image satisfies a second condition. fruit, the second condition is defined by a relationship between the sharpness and a second reference value, Generating the evidence data includes repeatedly determining whether or not the clarity of the target image satisfies a second condition by using, as the second reference value, a candidate value selected in descending order from the plurality of candidate values ​​based on candidate data including a plurality of candidate values ​​that are candidates for the second reference value. nothing.

[0012] In order to achieve the above object, a program according to a fourth aspect of the present invention comprises: On the computer, Acquire target image data including a target image including a first area indicating the person and a second area indicating the person's image included in the document; generating evidence data based on the target image when the first area and the second area satisfy a first condition and the clarity of the target image satisfies a second condition; 、 the second condition is defined by a relationship between the sharpness and a second reference value, Generating the evidence data includes repeatedly determining whether or not the clarity of the target image satisfies a second condition by using, as the second reference value, a candidate value selected from the plurality of candidate values ​​in descending order based on candidate data including a plurality of candidate values ​​that are candidates for the second reference value. It is a program. [Effects of the Invention]

[0013] The present invention makes it possible to maintain evidence of good image quality. [Brief explanation of the drawings]

[0014] [Figure 1] FIG. 1 illustrates an example of the configuration of a trail management system according to a first embodiment of the present invention. [Figure 2] FIG. 2 is a diagram showing an example of a target image P1. [Figure 3] 1 is a diagram illustrating an example of a physical configuration of a terminal device according to a first embodiment of the present invention. [Figure 4] 1 is a diagram illustrating an example of the physical configuration of a trail management device according to a first embodiment of the present invention. [Figure 5] 5 is a flowchart showing an example of a first terminal process according to the first embodiment of the present invention. [Figure 6] 5 is a flowchart showing an example of a first server process according to the first embodiment of the present invention. [Figure 7] FIG. 10 is a diagram illustrating an example of the configuration of a trail management system according to a second embodiment of the present invention. [Figure 8] FIG. 10 illustrates an example of the functional configuration of a trail generation unit according to a second embodiment. [Figure 9] 10 is a flowchart showing an example of a second terminal process according to the second embodiment of the present invention. [Figure 10] FIG. 10 is a diagram showing an example of a preview image PP. [Figure 11] 10 is a flowchart showing an example of a second server process according to the second embodiment of the present invention. [Figure 12] FIG. 11 is a diagram showing an example of the configuration of trail data according to Modification 2. [Figure 13] FIG. 10 is a diagram illustrating an example of the configuration of a trail management system according to a third embodiment of the present invention. [Figure 14] FIG. 11 illustrates an example of the functional configuration of a trail generation unit according to a third embodiment. [Figure 15] FIG. 10 is a diagram illustrating an example of candidate data. [Figure 16] 11 is a flowchart showing an example of a third server process according to the third embodiment of the present invention. [Figure 17] 13 is a flowchart illustrating an example of a fourth server process according to the third modification. [Figure 18] FIG. 10 is a diagram illustrating an example of the configuration of a trail management system according to a fourth embodiment of the present invention. [Figure 19] FIG. 13 illustrates an example of the functional configuration of a trail generation unit according to a fourth embodiment. [Figure 20]FIG. 10 is a diagram showing another example of candidate data. [Figure 21] 10 is a flowchart showing an example of a fifth server process according to the fourth embodiment of the present invention. [Figure 22] FIG. 10 is a diagram illustrating an example of the configuration of a trail management system according to a fifth embodiment of the present invention. [Figure 23] 13 is a flowchart showing an example of a sixth server process according to the fifth embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0015] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In all the drawings, like components are designated by like reference numerals, and the description thereof will be omitted as appropriate.

[0016] <<Embodiment 1>> The trail management system 100 according to the first embodiment of the present invention is a system for managing trails of identity verification, and includes a terminal device 101 and a server device 102 as a trail management device, as shown in Fig. 1. The trail management device is a device for managing trails of identity verification.

[0017] The terminal device 101 and the server device 102 are connected via a network N, and can transmit and receive data to and from each other via the network N. The network N is a communication network that is wired, wireless, or a combination of these.

[0018] The terminal device 101 is a terminal used by the person to be verified. Functionally, the terminal device 101 generates target image data including a target image P1 by photographing the person and their identification document. The terminal device 101 transmits the generated target image data to the server device 102.

[0019] An identification document is an example of a document used to verify the identity of a person. Examples of identification documents include a driver's license and a My Number card. A My Number card is a card that lists a My Number, a number unique to each resident.

[0020] The identification document includes an image of the person, text, etc.

[0021] The image of the person is an image of the person, for example, an image of the person's face.

[0022] Characters include not only hiragana, katakana, kanji, alphabets, etc., but also numbers, symbols, etc. Characters written on an identity verification document represent the person's name, address, date of birth, ID (Identifier), expiration date of the identity verification document, etc. Here, the ID on the identity verification document is, for example, a number unique to the person shown on the identity verification document.

[0023] FIG. 2 shows an example of a target image P1. The target image P1 is an image to be processed for identity verification. The target image P1 includes the individual and an identification document. Target image data including the target image P1 is typically obtained by simultaneously photographing the individual and the identification document, such as by photographing the individual holding the identification document in their hand as shown in FIG. 2.

[0024] The target image P1 may include both an image of the person and an image of the identification document, and the photographing method for obtaining the target image data including the target image P1 is not limited to this. For example, the identification document may be placed on a desk in front of the person, or may be photographed together with the person.

[0025] As shown in the figure, the target image P1 includes a first area AR1, a second area AR2, and a third area AR3.

[0026] The first area AR1 is an area in the target image P1 that shows the person (for example, the person's face).

[0027] The second area AR2 and the third area AR3 are included in the area of ​​the target image P1 that shows the identification document. The second area AR2 is an area of ​​the target image P1 that shows the image of the person (for example, the person's face image) included in the identification document. The third area AR3 is an area of ​​the target image P1 that shows the characters included in the identification document.

[0028] (Functional configuration of server device 102) Server device 102 is a device that manages the trail of identity verification, and as shown in FIG. 1, includes data acquisition unit 103 and trail generation unit 104.

[0029] The data acquisition unit 103 acquires target image data from the terminal device 101 via the network N.

[0030] The trail generator 104 generates trail data based on the target image P1 when the first area AR1 and the second area AR2 satisfy the first condition and the sharpness of the target image P1 satisfies the second condition.

[0031] (First condition) The first condition is a condition for determining that the images in the first area AR1 and the second area AR2 are of the same person.

[0032] For example, the first condition is defined by the relationship between the degree of coincidence between the first area AR1 and the second area AR2 and a first reference value. The degree of coincidence is a value indicating the degree to which the first area AR1 and the second area AR2 coincide.

[0033] In a case where the degree of match increases as the degree of match between the first region AR1 and the second region AR2 increases, the first condition is, for example, that the degree of match is equal to or greater than a first reference value. In a case where the degree of match decreases as the degree of match between the first region AR1 and the second region AR2 increases, the first condition is, for example, that the degree of match is equal to or less than a first reference value.

[0034] Such a degree of coincidence may be determined by a conventional method, for example, by histogram comparison or feature point matching.

[0035] Alternatively, for example, whether the first area AR1 and the second area AR2 satisfy the first condition may be determined using a trained model trained by machine learning. In this case, the trail generation unit 104 inputs the target image data into the person determination model, and outputs a determination result as to whether the images in the first area AR1 and the second area AR2 represent the same person. This person determination model is a trained machine learning model that has been trained to determine whether the images in the first area AR1 and the second area AR2 represent the same person.

[0036] The determination result may be indicated by an appropriate value, alphabet, symbol, etc. For example, if the images in the first area AR1 and the second area AR2 are of the same person, the determination result is "1," and if the images in the first area AR1 and the second area AR2 are not of the same person, the determination result is "0."

[0037] Input data to the person determination model during learning is data including two person images (preferably, two face images). In machine learning, it is preferable to perform supervised learning using training data including correct determination results regarding whether the person images included in the input data are the same person.

[0038] (Second condition) The second condition is a condition for adopting the target image P1 as evidence. For example, the second condition is defined by the relationship between the sharpness of the target image P1 and a second reference value.

[0039] The sharpness is a value indicating the degree of sharpness of the target image P1. If the sharpness value is greater as the target image P1 is sharper, the second condition is, for example, that the sharpness is equal to or greater than a second reference value. If the sharpness value is smaller as the target image P1 is sharper, the second condition is, for example, that the sharpness is equal to or less than a second reference value.

[0040] The sharpness may be determined by a conventional method.

[0041] For example, the sharpness is obtained by image processing such as edge extraction (also called "edge detection") that calculates changes in brightness, etc. In this case, the trail generation unit 104 obtains the sharpness of the target image P1 using image processing.

[0042] Furthermore, for example, the sharpness may be determined using a learning model trained by machine learning. In this case, the trail generation unit 104 determines the sharpness of the target image P1 by inputting the target image data into a sharpness determination model trained by machine learning for determining the sharpness of the target image P1. The input data to the sharpness determination model during learning is, for example, the target image data. In the machine learning, it is preferable to perform supervised learning using training data including the sharpness of the target image P1.

[0043] (Trail data) The evidence data is data indicating the evidence, and includes an image based on the target image P1. The image based on the target image P1 may be the target image P1 itself, as shown in FIG. 2, or an image that has been processed on the target image P1. The processing on the target image P1 is preferably processing that leaves part or all of the first area AR1, second area AR2, and third area AR3 intact, such as trimming to remove peripheral areas.

[0044] (Physical configuration of the trail management system 100) The trail management system 100 is physically composed of a terminal device 101 and a server device 102 connected via a network N. The terminal device 101 and the server device 102 are each composed of a single, physically separate device.

[0045] The terminal device 101 and the server device 102 may be physically configured as a single device, in which case the terminal device 101 and the server device 102 are connected by an internal bus 1010 (described later) instead of the network N. Either or both of the terminal device 101 and the server device 102 may also be physically configured as multiple devices connected via the network N.

[0046] (Physical configuration of terminal device 101) The terminal device 101 is physically, for example, a tablet PC (Personal Computer), a smartphone, a general-purpose computer, or the like.

[0047] In detail, for example, the terminal device 101 physically includes a bus 1010, a processor 1020, a memory 1030, a storage device 1040, a network interface 1050, an input interface 1060, an output interface 1070, and a camera 1080, as shown in FIG.

[0048] The bus 1010 is a data transmission path for transmitting and receiving data among the processor 1020, memory 1030, storage device 1040, network interface 1050, input interface 1060, output interface 1070, and camera 1080. However, the method for connecting the processor 1020 and other components to each other is not limited to bus connection.

[0049] The processor 1020 is implemented by a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or the like.

[0050] The memory 1030 is a main storage device realized by a RAM (Random Access Memory) or the like.

[0051] The storage device 1040 is an auxiliary storage device realized by a hard disk drive (HDD), a solid state drive (SSD), a memory card, a read only memory (ROM), or the like.

[0052] The storage device 1040 of the terminal device 101 stores program modules for realizing the functions of the terminal device 101. The processor 1020 reads each of these program modules into the memory 1030 and executes them, thereby realizing the function corresponding to that program module.

[0053] The network interface 1050 is an interface for connecting the terminal device 101 to the network N.

[0054] The input interface 1060 is an interface for the user to input information, and is configured from one or more of, for example, a touch panel, a keyboard, a mouse, and the like.

[0055] The output interface 1070 is an interface for presenting information to the user, and is, for example, a liquid crystal panel, an organic EL (Electro-Luminescence) panel, or the like.

[0056] The camera 1080 captures an image of a subject and generates image information representing the image.

[0057] (Physical configuration of server device 102) The server device 102 is physically, for example, a tablet PC (Personal Computer), a smartphone, a general-purpose computer, or the like.

[0058] 4, the server device 102 may be physically configured in the same manner as the terminal device 101. That is, the server device 102 may physically include, for example, a bus 1010, a processor 1020, a memory 1030, a storage device 1040, a network interface 1050, an input interface 1060, and an output interface 1070.

[0059] The storage device 1040 of the server device 102 stores program modules for realizing the functions of the server device 102. The processor 1020 reads each of these program modules into the memory 1030 and executes them, thereby realizing the function corresponding to that program module.

[0060] (Operation of the trail management system 100) The operation of the trail management system 100 will now be described with reference to the drawings.

[0061] The trail management system 100 executes a trail management process. The trail management process is a process for managing the trail of identity verification, and includes a first terminal process executed by the terminal device 101 and a first server process executed by the server device 102.

[0062] (First terminal processing) 5 is a flowchart showing an example of the first terminal processing according to this embodiment. The first terminal processing is started, for example, when the terminal device 101 receives a start instruction based on an input from the principal or a start instruction from a functional unit (not shown) that executes processing before the first terminal processing. At this time, in response to receiving the start instruction from the principal, the terminal device 101 establishes communication with the server device 102 via the network N.

[0063] The terminal device 101 generates target image data including a target image P1 by photographing the person and their identification document (step S101).

[0064] The terminal device 101 transmits the target image data generated in step S101 to the server device 102 (step S102), and the first terminal process ends.

[0065] (First server process) 6 is a flowchart showing an example of the first server process according to the present embodiment. When communication is established between the server device 102 and the terminal device 101 via the network N, the server device 102 starts the first server process.

[0066] The data acquisition unit 103 acquires the target image data transmitted in step S102 from the terminal device 101 via the network N (step S201).

[0067] The trail generator 104 determines whether the first and second conditions are satisfied for the target image P1 included in the target image data acquired in step S210 (step S202).

[0068] If at least one of the first condition and the second condition is not met, the trail generation unit 104 determines that the first condition and the second condition are not met. If it determines that the first condition and the second condition are not met (step S202; No), the trail generation unit 104 notifies the terminal device 101 of an error via network N (step S203) and terminates the first server processing.

[0069] The error notification sent in step S203 is a notification indicating that at least one of the first condition and the second condition is not satisfied, and is acquired by the terminal device 101. In response to acquiring the error notification, the terminal device 101 displays a predetermined message, such as "An appropriate image was not captured" or "Identity verification failed," on the display unit.

[0070] If it is determined that the first and second conditions are met (step S202; Yes), the trail generator 104 generates trail data (step S204) and terminates the first server processing. Since the trail data is generated based on the target image P1 whose clarity satisfies the second condition, it is possible to generate trail data that includes a clear image.

[0071] According to this embodiment, the server device 102 serving as the trail management device comprises a data acquisition unit 103 and a trail generation unit 104 .

[0072] The data acquisition unit 103 acquires target image data including a target image P1. The target image P1 includes a first area AR1 representing the principal and a second area AR2 representing the principal image included in an identification document as a document.

[0073] The trail generator 104 generates trail data based on the target image P1 when the first area AR1 and the second area AR2 satisfy the first condition and the sharpness of the target image P1 satisfies the second condition.

[0074] Therefore, it becomes possible to maintain a good quality of evidence.

[0075] According to this embodiment, the trail management system 100 comprises a server device 102 as a trail management device, and a terminal device 101.

[0076] The terminal device 101 generates target image data by photographing the person and the personal identification document, and transmits the target image data to the server device 102.

[0077] Therefore, it becomes possible to maintain a good quality of evidence.

[0078] (Variation 1) The trail generating unit 104 may calculate the sharpness of the target image P1 based on the third area AR3.

[0079] When image processing such as edge extraction is used to obtain the sharpness, the trail generating unit 104 may obtain the sharpness of the target image P1 by performing image processing on the third area AR3.

[0080] A sharpness determination model trained by machine learning may be used to determine the sharpness. In this case, the trail generation unit 104 may determine the sharpness of the target image P1 by inputting the target image data into a sharpness determination model trained by machine learning for determining the sharpness of the third region AR3. The input data to the sharpness determination model during training may be, for example, the target image data. In the machine learning, supervised learning may be performed using training data including the sharpness of the third region AR3.

[0081] According to this modification, the trail generating unit 104 calculates the sharpness of the target image P1 based on the third area AR3. Generally, an image of text has a larger change in brightness relative to the background than an image such as a photograph.

[0082] Therefore, by calculating the sharpness of the target image P1 based on the third area AR3 that indicates the characters included in the identification document, the sharpness of the target image P1 can be calculated appropriately. Furthermore, evidence data including a clear image can be generated more reliably. Therefore, this modification makes it possible to manage evidence with better image quality.

[0083] <<Embodiment 2>> In the second embodiment, a more detailed example of the trail management system 100 according to the first embodiment will be described. In this embodiment, differences from the first embodiment will be mainly described, and overlapping points will be omitted as appropriate for the sake of simplicity.

[0084] As shown in FIG. 7, a trail management system 200 according to the second embodiment of the present invention includes a terminal device 201 and a server device 202, which replace the terminal device 101 and the server device 102 according to the first embodiment.

[0085] (Functional configuration of terminal device 201) Functionally, the terminal device 201 is similar to the first embodiment in that it generates target image data by photographing the person and their identification document, and transmits the target image data to the server device 202.

[0086] In detail, the terminal device 201 includes an image capturing unit 205 , an input receiving unit 206 , a terminal communication unit 207 , and a display unit 208 .

[0087] The photographing unit 205 photographs the person and the identification document, thereby generating target image data including the target image P1.

[0088] The input receiving unit 206 receives input from the person in question. The terminal communication unit 207 transmits and receives data to and from the server device 102 via the network N. The display unit 208 displays various types of information such as images and text.

[0089] (Functional configuration of server device 202) Server device 202 is a device (trail management device) for managing the trail of identity verification, similar to embodiment 1, and includes a data acquisition unit 103 similar to embodiment 1, and a trail generation unit 204 that replaces the trail generation unit 104 according to embodiment 1. Server device 202 further includes a trail data storage unit 209 and a verification-required data storage unit 210.

[0090] As in the first embodiment, the trail generation unit 204 generates trail data based on the target image P1 when the first area AR1 and the second area AR2 satisfy the first condition and the sharpness of the target image P1 satisfies the second condition.

[0091] In detail, the trail generation unit 204 includes a first determination unit 211, a second determination unit 212, a storage control unit 213, and a notification unit 214, as shown in FIG.

[0092] The first determination unit 211 determines whether or not the first area AR1 and the second area AR2 of the target image P1 included in the target image data acquired by the data acquisition unit 103 satisfy a first condition.

[0093] If the first determination unit 211 determines that the first condition is satisfied, the second determination unit 212 determines whether or not the sharpness of the target image P1 determined to satisfy the first condition satisfies a second condition.

[0094] The storage control unit 213 generates trail data or verification-required data depending on whether it is determined that the second condition is satisfied. If the storage control unit 213 generates trail data, it stores the trail data in the trail data storage unit 209. If the storage control unit 213 generates verification-required data, it stores the verification-required data in the verification-required data storage unit 210.

[0095] The evidence data is data indicating the evidence, as explained in the first embodiment. The confirmation-required data is data indicating the target image P1 that requires visual confirmation.

[0096] The evidence data and the data to be confirmed have in common the fact that they include an image based on the target image P1 that was the subject of determination by the second determination unit 212. As explained in the first embodiment, the image based on the target image P1 may be the target image P1 itself, or may be an image that has been subjected to processing such as trimming of the target image P1.

[0097] The trail data and the data to be verified are stored in different storage units 209, 210. That is, the trail data and the data to be verified are stored in storage areas in the storage device 1040 that belong to different categories, such as different folders.

[0098] The trail data and the verification data may include information for distinguishing them from each other. In this case, the trail data and the verification data may be stored in a common storage unit (i.e., a storage area belonging to a common classification in the storage device 1040).

[0099] The notification unit 214 transmits a notification to the terminal device 201 via the network N.

[0100] Referring again to FIG. The trail data storage unit 209 is a storage unit that stores trail data. The verification data storage unit 210 is a storage unit that stores verification data.

[0101] (Physical configuration of the trail management system 200, terminal device 201, and server device 202) The trail management system 200, terminal device 201, and server device 202 may be physically configured in the same manner as the trail management system 100, terminal device 101, and server device 102 according to the first embodiment.

[0102] (Operation of the trail management system 200) The operation of the trail management system 200 will now be described with reference to the drawings.

[0103] The trail management system 200 executes a trail management process for managing the trail of identity verification, similar to the first embodiment. The trail management process according to this embodiment includes a second terminal process and a second server process that replace the first terminal process and the first server process according to the first embodiment. The second terminal process is executed by the terminal device 201. The second server process is executed by the server device 202.

[0104] (Second terminal processing) 9 is a flowchart showing an example of the second terminal processing according to the present embodiment. The second terminal processing is started, for example, when a start instruction similar to that of the first terminal processing is received. At this time, in response to receiving the start instruction from the user, the terminal device 201 establishes communication with the server device 202 via the network N.

[0105] The image capturing unit 205 displays the preview image PP together with the guides G1 and G2 on the display unit 208 (step S103).

[0106] The preview image PP is an image for confirming the image of the person to be photographed before the target image P1 is photographed by the photographing unit 205. Fig. 10 shows an example of the preview image PP. As shown in the figure, the preview image PP is displayed together with guides G1 and G2.

[0107] Guide G1 indicates the range of the facial image that should be positioned in the preview image PP in order to capture the face image of the principal at a desired size. Guide G2 indicates the range of the image of the identification document that should be positioned in the preview image PP in order to capture the image of the identification document at a desired size.

[0108] The photographing unit 205 determines whether or not a target image P1 including an image of the person's face and identification document of a predetermined size is photographed (step S104).

[0109] If at least one of the person's face and the identification document is not of a predetermined size, the photographing unit 205 determines that the target image P1 including the image of the person's face and the identification document of a predetermined size is not photographed. If it is determined that the target image P1 including the image of the person's face and the identification document of a predetermined size is not photographed (step S104; No), the photographing unit 205 continues to execute the process of step S103.

[0110] While referring to the preview image PP, the person adjusts the position of their face relative to the photographing unit 205 (camera 1080) so that their facial image roughly matches the guide G1. Similarly, for the personal identification document, the person adjusts the position of the personal identification document relative to the photographing unit 205 (camera 1080) so that the image of the personal identification document roughly matches the guide G2.

[0111] When the face image and the image of the identification document in the preview image PP roughly match the guides G1 and G2, respectively, the photographing unit 205 determines that a target image P1 including an image of the person's face and identification document of a predetermined size has been photographed.

[0112] If it is determined that the face of the person and the identification document are to be photographed at a predetermined size (step S104; Yes), the photographing unit 205 executes step S101 similar to that of embodiment 1. As a result, target image data including an image of the face of the person and the identification document at a predetermined size is generated.

[0113] The terminal communication unit 207 executes step S102 similar to that in the first embodiment, and ends the terminal processing.

[0114] (Second server process) 11 is a flowchart showing an example of the second server process according to the present embodiment. As in the first embodiment, the server device 202 starts the second server process when communication with the terminal device 201 via the network N is established.

[0115] The data acquisition unit 103 executes step S201 similar to that in the first embodiment.

[0116] The first determination unit 211 determines whether or not the first area AR1 and the second area AR2 of the target image P1 included in the target image data acquired in step S201 satisfy a first condition (step S205).

[0117] If it is determined that the first condition is satisfied (step S205; Yes), the second determination unit 212 determines whether the sharpness of the target image P1 determined to satisfy the first condition in step S205 satisfies the second condition (step S206).

[0118] If it is determined that the second condition is met (step S206; Yes), the storage control unit 213 executes step S204, which is the same as in embodiment 1. The storage control unit 213 stores the trail data generated in step S204 in the trail data storage unit 209 (step S207).

[0119] The notification unit 214 notifies the terminal device 101 via the network N of the success of the identity verification (step S208), and the second server process ends.

[0120] The success notification sent in step S208 is a notification indicating that the first condition and the second condition have been satisfied, and is acquired by device communication unit 207. In response to acquiring the success notification, device communication unit 207 causes display unit 208 to display a predetermined message such as "Identity verification has been successful."

[0121] If it is determined that the second condition is not satisfied (step S206; No), the storage control unit 213 generates confirmation-required data (step S209). The storage control unit 213 stores the confirmation-required data generated in step S207 in the confirmation-required data storage unit 210 (step S210). The notification unit 214 notifies the terminal device 201 of an error via the network N (step S203), as in the first embodiment, and terminates the second server processing.

[0122] The error notification sent in step S203 is a notification indicating that the second condition is not satisfied, and is acquired by the device communication unit 207. In response to acquiring the error notification, the device communication unit 207 causes the display unit 208 to display a predetermined message such as, for example, "An appropriate image was not captured," or "Personal identification failed."

[0123] If it is determined that the first condition is not satisfied (step S205; No), the notification unit 214 notifies the terminal device 201 of an error via the network N (step S211), and ends the second server processing.

[0124] The error notification sent in step S211 is a notification indicating that the first condition is not satisfied, and is acquired by device communication unit 207. In response to acquiring the error notification, device communication unit 207 displays a predetermined message on display unit 208. The message displayed in response to the error notification sent in step S211 may be the same as or different from the message displayed in response to the error notification sent in step S203.

[0125] (Variation 2) In the first embodiment, an example has been described in which the evidence data includes an image based on the target image P1. The evidence data may include information other than an image based on the target image P1.

[0126] 12 is a diagram showing an example of the configuration of trail data according to Modification 2. The trail data shown in the figure is data in which an image based on target image P1, a trail ID, a time, and text information are associated with each other.

[0127] The trail ID is information for identifying the associated image and is assigned appropriately, for example, when generating the trail data. The time is the time when the trail data including the associated image was generated. Note that, if the trail data is stored in a storage unit, the time may be the time when the trail data was stored in the storage unit.

[0128] The character information is information indicating characters recognized from the image of the third area AR3, and is generated by the trail generation unit 104. In the trail data generation process (step S204), the trail generation unit 104 (storage control unit 213) recognizes the characters displayed in the third area AR3, generates character information including the recognized characters, and generates trail data including the generated character information.

[0129] According to this modification, the evidence data includes text information based on the image of the third area AR3, i.e., information indicating characters recognized from the image of the third area AR3. This allows the user of the server device 102, 202 to easily refer to the characters written on the identification document without viewing the evidence data. This makes it easier to manage the evidence.

[0130] Furthermore, the user of the server device 102, 202 can compare the character information shown in the image of the personal identification document included in the evidence data with the character information included in the evidence data, as needed.

[0131] This makes it easy to determine whether the image of the identification document included in the evidence data is of such good quality that it can be accurately read by character recognition. For example, if there is a misrecognition of character information, measures can be taken, such as improving the process of determining whether the clarity of the target image P1 satisfies the second condition, to obtain evidence data of better quality. Therefore, it becomes possible to manage evidence of good quality.

[0132] <<Embodiment 3>> When the second condition is defined by the relationship between the sharpness of the target image P1 and the second reference value, the second reference value applied to the second condition is not limited to one, but may be appropriately selected from multiple candidate values. In this embodiment, an example will be described in which a candidate value selected from multiple candidate values ​​in descending order of magnitude is adopted as the second reference value. In this embodiment, differences from the second embodiment will be mainly described, and overlapping points will be omitted as appropriate for clarity.

[0133] As shown in FIG. 13, a trail management system 300 according to a third embodiment of the present invention includes a terminal device 201 similar to that of the second embodiment, and a server device 302 that replaces the server device 202 according to the second embodiment.

[0134] (Functional configuration of server device 302) The server device 302 is a device (trail management device) for managing the trail of identity verification, similar to embodiment 2. The server device 302 includes the data acquisition unit 103 similar to embodiment 1, the trail data storage unit 209 and the verification-required data storage unit 210 similar to embodiment 2, and a trail generation unit 304 that replaces the trail generation unit 204 according to embodiment 2.

[0135] As in the first embodiment, the trail generation unit 304 generates trail data based on the target image P1 when the first area AR1 and the second area AR2 satisfy the first condition and the sharpness of the target image P1 satisfies the second condition.

[0136] 14 , the trail generation unit 304 includes a first determination unit 211, a storage control unit 213, and a notification unit 214 similar to those in the second embodiment, and a second determination unit 312 that replaces the second determination unit 212 in the second embodiment. The trail generation unit 304 further includes a candidate storage unit 315.

[0137] The candidate storage unit 315 stores candidate data 316. The candidate data 316 includes a plurality of candidate values. The candidate values ​​are candidates for the second reference value to be applied to the second condition. In this embodiment, the candidate values ​​are set in advance by user input or the like.

[0138] The candidate data 316 according to this embodiment includes three candidate values ​​C1, C2, and C3, as shown in an example in Fig. 15. C1, C2, and C3 have a relationship of C1>C2>C3 in terms of the magnitude of each value.

[0139] The number of candidate values ​​included in the candidate data 316 is not limited to three, but may be any number.

[0140] The second determination unit 312 according to this embodiment repeatedly executes the second determination process by using the candidate value selected from the plurality of candidate values ​​in descending order as the second reference value. The "second determination process" is a process for determining whether the sharpness of the target image P1 satisfies the second condition, and the same applies hereinafter.

[0141] Furthermore, the second determination unit 312 according to this embodiment repeatedly executes the second determination process until the following (A) or (B). (A) Using one of the candidate values ​​as a second reference value, it is determined that the sharpness of the target image P1 satisfies the second condition. (B) Execute the second judgment process for all candidate values.

[0142] Except for these, the second determination unit 312 may be similar to the second determination unit 212 according to the second embodiment.

[0143] (Physical configuration of the trail management system 300 and the server device 302) The trail management system 300 and the server device 302 may be physically configured in the same manner as the trail management system 100 and the server device 102 according to the first embodiment.

[0144] (Operation of the trail management system 300) The operation of the trail management system 300 will now be described with reference to the drawings.

[0145] The trail management system 300 executes a trail management process for managing the trail of identity verification, similar to the first embodiment. The trail management process according to this embodiment includes a second terminal process similar to the second embodiment, and a third server process that replaces the second server process according to the second embodiment. The third server process is executed by the server device 302.

[0146] (Third server processing) 16 is a flowchart showing an example of the third server process according to the present embodiment. When communication is established between server device 302 and terminal device 201 via network N, server device 302 starts the third server process. In the third server process, second determination unit 312 sets counter i, which is updated according to the number of times the second determination process is repeated, to "1" as an initial setting.

[0147] Steps S201 and S205 are executed in the same manner as in the second embodiment.

[0148] If it is determined that the first condition is not satisfied (step S205; No), the notification unit 214 executes step S211 similar to that in the second embodiment, and ends the third server processing.

[0149] If it is determined that the first condition is satisfied (step S205; Yes), the second determination unit 312 selects Ci from the candidate values ​​included in the candidate data 316 as the second reference value (step S212).

[0150] For example, when step S212 is executed for the first time, i has an initial value of "1", so the second determination unit 312 selects C1 as the second reference value.

[0151] The second determination unit 312 executes step S206 similar to that of the second embodiment, using the second reference value selected in step S212.

[0152] If it is determined that the second condition is met (step S206; Yes), the storage control unit 213 executes steps S204 and S207 to S208 similar to those in the second embodiment, and ends the third server processing.

[0153] If it is determined that the second condition is not satisfied (step S206; No), the second determination unit 312 determines whether or not the second determination process (step S206) has been executed for all candidate values ​​(step S213).

[0154] In this embodiment, as described above, there are three candidate values. Therefore, until the second determination process (step S206) is executed for all three candidate values, the second determination unit 312 determines that the second determination process (step S206) has not been executed for all candidate values.

[0155] If it is determined that the second determination process (step S206) has not been executed for all candidate values ​​(step S213; No), the second determination unit 312 adds 1 to i (step S214).

[0156] The second determination unit 312 selects the candidate value Ci corresponding to the i added in step S214 as the second reference value (step S212).

[0157] For example, when i is 2, the second determination unit 312 selects C2 as the second reference value. For example, when i is 3, the second determination unit 312 selects C3 as the second reference value.

[0158] The second determination unit 312 executes step S206 again, similar to the second embodiment, using the second reference value selected in step S212.

[0159] If it is determined that the second condition is met (step S206; Yes), the storage control unit 213 executes steps S204 and S207 to S208 similar to those in the second embodiment, and ends the third server processing.

[0160] If it is determined that the second condition is not satisfied (step S206; No), the second determination unit 312 executes step S213. If it is determined that the second determination process (step S206) has not been executed for all candidate values ​​(step S213; No), the second determination unit 312 adds 1 to i (step S214).

[0161] In this way, if it is determined that the second condition is not satisfied (step S206; No), steps S213 to S214, S212, and S206 are repeated until the second determination process (step S206) is executed for all candidate values ​​C1 to C3. On the other hand, if it is determined that the second condition is satisfied for any of the candidate values ​​C1 to C3 (step S206; Yes), steps S204 and S207 to S208 are executed, and the third server process ends.

[0162] If it is determined that the second determination process has been executed for all candidate values ​​(step S213; Yes), the storage control unit 213 executes steps S209 to S210 and S203, and ends the third server process.

[0163] According to this embodiment, the second condition is defined by the relationship between the sharpness of the target image P1 and the second reference value. The evidence generation unit 304 holds candidate data 316 including multiple candidate values ​​that are candidates for the second reference value. The evidence generation unit 304 repeatedly determines whether the sharpness of the target image P1 satisfies the second condition by using, as the second reference value, a candidate value selected from the multiple candidate values ​​in descending order.

[0164] As a result, the clearer the target image P1 is, the larger the second reference value used in the second determination process to generate evidence data. Therefore, the second reference value used in the second determination process immediately before generating the evidence data serves as an index representing the clarity of the target image P1. For example, by including the second reference value used in the second determination process immediately before generating the evidence data in the evidence data, the clarity of the target image P1 can be easily determined by making the second reference value available for reference. This improves the convenience of managing evidence.

[0165] (Variation 3) There may be multiple pieces of target image data. For example, the terminal device 101, 201 can continuously generate and transmit target image data to the server device 102, 202 by repeatedly executing the first or second terminal process at a predetermined time interval (for example, once to several tens of times per second).

[0166] The server device 102, 202 may repeatedly execute the first or second server process for each of the target image data acquired sequentially until a predetermined time has elapsed or until a predetermined maximum number of executions of the second determination process has been reached.

[0167] 17 is a flowchart showing an example of a fourth server process according to this modification. The fourth server process is a server process in which the second server process according to the second embodiment is repeatedly executed until the predetermined maximum number of executions M of the second determination process is reached.

[0168] As shown in the figure, if it is determined that the second condition is not satisfied (step S206; No), the second determination unit 312 determines whether the second determination process has been executed M times (step S215), where M is a predetermined maximum number of times.

[0169] If it is determined that the second determination process has not been executed M times (step S215; No), the data acquisition unit 103 executes step S201 again. If it is determined that the second determination process has been executed M times (step S215; Yes), the storage control unit 213 executes steps S209 to S210 and S203, and ends the fourth server process. Except for these, the fourth server process may be the same as the second server process.

[0170] According to this modification, there are multiple pieces of target image data. Therefore, it is possible to determine whether the first and second conditions are satisfied for each of the multiple pieces of target image data. This makes it easier to obtain a target image P1 that satisfies the second condition than when determining whether the first and second conditions are satisfied for a single piece of target image data. Therefore, it is possible to manage evidence of good image quality.

[0171] <<Embodiment 4>> In this embodiment, an example will be described in which the third server process according to the third embodiment is repeatedly executed for each of a plurality of target image data until the predetermined maximum number of executions of the second determination process is reached, as in Modification 3. In this embodiment, differences from the third embodiment will be mainly described, and overlapping points will be omitted as appropriate for simplicity of explanation.

[0172] As shown in FIG. 18, a trail management system 400 according to a fourth embodiment of the present invention includes a terminal device 201 similar to that of the second embodiment, and a server device 402 that replaces the server device 302 according to the third embodiment.

[0173] (Functional configuration of server device 402) The server device 402 is a device (trail management device) for managing the trail of identity verification, similar to embodiment 3. The server device 402 includes the data acquisition unit 103 similar to embodiment 1, the trail data storage unit 209 and the verification-required data storage unit 210 similar to embodiment 2, and a trail generation unit 404 that replaces the trail generation unit 304 according to embodiment 3.

[0174] As in the first embodiment, the trail generation unit 404 generates trail data based on the target image P1 when the first area AR1 and the second area AR2 satisfy the first condition and the sharpness of the target image P1 satisfies the second condition.

[0175] Specifically, as shown in FIG. 19, the evidence generation unit 404 includes a first determination unit 211, a memory control unit 213, and a notification unit 214 similar to those in Embodiment 2, and a second determination unit 412 and a candidate holding unit 415 that replace the second determination unit 312 and the candidate holding unit 315 according to Embodiment 3.

[0176] The candidate holding unit 415 holds candidate data 416 including a plurality of candidate values similar to those in Embodiment 3.

[0177] As shown in FIG. 20 as an example, the candidate data 416 according to the present embodiment is data in which the maximum number of executions M1, M2, M3 of the second determination process are associated with each of the three candidate values C1, C2, C3. In the candidate data 416, the maximum number of executions M1 is associated with the candidate value C1, the maximum number of executions M2 is associated with the candidate value C2, and the maximum number of executions M2 is associated with the candidate value C2.

[0178] Similar to Embodiment 3, C1, C2, and C3 are in the relationship of C1 > C2 > C3 in terms of the magnitude of each value. M1, M2, and M3 are in the relationship of M1 < M2 < M3 in terms of the magnitude of each value. That is, in the candidate data 416, the maximum number of executions is larger as the candidate value is smaller.

[0179] Here, setting the maximum number of executions of the second determination process is equivalent to providing a limit time for repeatedly executing the fourth server process. That is, the larger the maximum number of executions, the longer the limit time.

[0180] Note that the number of candidate values included in the candidate data 416 is not limited to three, and may be a plurality.

[0181] Similar to Embodiment 2, when the second determination unit 412 is determined to satisfy the first condition by the first determination unit 211, the second determination process is executed for the target image P1 determined to satisfy the first condition.

[0182] The second determination unit 412 according to the present embodiment repeatedly executes the second determination process up to (A), (B), or the following (C) similar to Embodiment 3. (C) The second determination process is repeated the maximum number of times associated with the candidate value.

[0183] Except for these, the second determination unit 412 may be similar to the second determination unit 312 according to the third embodiment.

[0184] (Physical configuration of the trail management system 400 and the server device 402) The trail management system 400 and the server device 402 may be physically configured in the same manner as the trail management system 100 and the server device 102 according to the first embodiment.

[0185] (Operation of the trail management system 400) The operation of the trail management system 400 will now be described with reference to the drawings.

[0186] The trail management system 400 executes a trail management process for managing the trail of identity verification, similar to the first embodiment. The trail management process according to this embodiment includes a second terminal process similar to the second embodiment, and a fifth server process that replaces the third server process according to the third embodiment. The fifth server process is executed by the server device 402.

[0187] (5th server process) 21 is a flowchart showing an example of the fifth server process according to the present embodiment. As in the first embodiment, the server device 402 starts the fifth server process when communication is established with the terminal device 201 via the network N. In the fifth server process, the second determination unit 412 sets, as an initial setting, "1" to a counter i, which is updated depending on the number of times the second determination process is repeated.

[0188] Steps S201 and S205 are executed in the same manner as in the second embodiment.

[0189] If it is determined that the first condition is not satisfied (step S205; No), the notification unit 214 executes step S211 similar to that in the second embodiment, and ends the fifth server processing.

[0190] If it is determined that the first condition is satisfied (step S205; Yes), the second determination unit 312 executes step S212 similar to that of embodiment 3, and executes step S206 similar to that of embodiment 2 using the second reference value selected in step S212.

[0191] If it is determined that the second condition is met (step S206; Yes), the storage control unit 213 executes steps S204 and S207 to S208 similar to those in the second embodiment, and ends the fifth server process.

[0192] If it is determined that the second condition is not satisfied (step S206; No), the second determination unit 312 executes step S215 similar to the third modification.

[0193] If it is determined that the second determination process has not been executed M times (step S215; No), the data acquisition unit 103 executes step S201 again. If it is determined that the second determination process has been executed M times (step S215; Yes), the second determination unit 312 executes step S213 similar to the third embodiment.

[0194] If it is determined that the second determination process (step S206) has not been executed for all candidate values ​​(step S213; No), the second determination unit 312 executes step S214, and then executes step S212. If it is determined that the second determination process has been executed for all candidate values ​​(step S213; Yes), the storage control unit 213 executes steps S209 to S210 and S203, and ends the fifth server process.

[0195] In this embodiment, the target image P1 to be included in the confirmation-required data in step S209 may be, for example, the target image P1 included in the target image data most recently acquired by the data acquisition unit 103.

[0196] Furthermore, for example, the target image P1 to be included in the confirmation-required data in step S209 may be the target image P1 with the highest definition among the target images P1 included in the plurality of target image data acquired by the data acquisition unit 103. This allows the target image P1 with the highest definition to be included in the confirmation-required data, making visual confirmation easier.

[0197] According to this embodiment, there are multiple sets of target image data. The candidate data 416 is data in which the maximum number of executions of the process (second determination process) for determining whether the sharpness of the target image P1 satisfies the second condition is associated with each of multiple candidate values. In the candidate data 416, the maximum number of executions is larger as the candidate value is smaller. This makes it possible to generate evidence data based on the target image P1 that is as clear as possible. This makes it possible to manage evidence with good image quality.

[0198] (Variation 4) In the fourth embodiment, an example in which the maximum number of executions is changed depending on the second reference value has been described in which a larger maximum number of executions is associated with a smaller candidate value. However, a smaller maximum number of executions may also be associated with a smaller candidate value.

[0199] Generally, the smaller the second reference value, the easier it may be to obtain a target image P1 with a clarity that satisfies the second condition. In such cases, the smaller the candidate value, the smaller the maximum number of executions, thereby shortening the overall time required to obtain evidence data. Therefore, it becomes easier to obtain evidence with good image quality.

[0200] (Variation 5) In the fourth embodiment and the fourth modification, an example was described in which the maximum number of executions differs depending on the second reference value. However, when different values ​​of the second reference value are used, a common maximum number of executions may be applied to all of the second reference values. This corresponds to setting M1, M2, and M3 to the same value in the fourth embodiment.

[0201] This also allows the second determination process to be performed using gradually smaller second reference values, making it possible to generate evidence data based on a target image P1 that is as clear as possible, thereby making it possible to manage evidence with good image quality.

[0202] (Variation 6) In the fourth embodiment, an example has been described in which sequentially acquired target images P1 are used in the second determination process (processing from step S205 onwards) in which each candidate value is used as the second reference value. In the fourth embodiment, a group of target images that do not overlap with each other is used in the second determination process (processing from step S205 onwards) in which each candidate value is used as the second reference value.

[0203] Specifically, for example, a second determination process using C1 as the second reference value, a second determination process using C2 as the second reference value, and a second determination process using C3 as the second reference value will use groups of target images that do not overlap with each other.

[0204] However, for example, the data acquiring unit 103 may hold target image data acquired from the terminal device 201. In the fourth embodiment, in the second determination process (the process from step S205 onwards) in which a certain candidate value is used as the second reference value, some or all of the target image group used in the second determination process (the process from step S205 onwards) in which an earlier candidate value was used as the second reference value may be used.

[0205] Specifically, for example, in the second determination process in which C2 is used as the second reference value, some or all of the target images used in the second determination process in which C1, the previous candidate value, was used as the second reference value may be used.Furthermore, for example, in the second determination process in which C3 is used as the second reference value, some or all of the target images used in the second determination process in which C2, the previous candidate value, was used as the second reference value may be used.

[0206] According to this modification, in the second determination process (the process from step S205 onward), a common target image P1 is used in the second determination process (the process from step S205 onward) in which a different candidate value is used as the second reference value. Therefore, the time required to acquire target image data from the terminal device 201 can be shortened throughout the second determination process (the process from step S205 onward) that is repeatedly executed. Therefore, it is possible to improve the time efficiency for managing evidence of good image quality.

[0207] <<Embodiment 5>> In the third and fourth embodiments, examples have been described in which candidate values ​​for the second reference value are set in advance. However, even if the image capturing unit 205 of the terminal device 201 can capture a clear image, if the second determination process is performed using a relatively small second reference value, there is a risk that evidence data based on a target image P1 that is less clear than would otherwise be obtained will be generated. Therefore, it is desirable to determine the clarity of the target image P1 using a second reference value that corresponds to the performance of the camera of the terminal device 201.

[0208] In this embodiment, an example will be described in which the third embodiment is modified so that candidate values ​​are set according to the performance of the camera included in the terminal device 201.

[0209] As shown in FIG. 22, a trail management system 500 according to a fifth embodiment of the present invention includes a terminal device 201 similar to that of the second embodiment, and a server device 502 that replaces the server device 302 according to the third embodiment.

[0210] (Functional configuration of server device 502) The server device 502 is a device (trail management device) for managing the trail of identity verification, similar to the third embodiment. The server device 502 includes a preparation unit 517 in addition to the functional components 103, 304, 209, and 210 of the server device 302 according to the third embodiment.

[0211] The preparation unit 517 acquires a plurality of pieces of reference data, and determines a plurality of candidate values ​​based on the sharpness of each of the images included in the acquired plurality of pieces of reference data.

[0212] The reference data is data that includes a reference image. In this embodiment, a case will be described where each piece of reference data includes the target image P1 as a reference image. Note that the reference image only needs to include at least a character image.

[0213] In detail, the preparation unit 517 acquires a plurality of pieces of reference data and calculates the sharpness of each of the images included in the acquired plurality of pieces of reference data. Then, the preparation unit 517 calculates a reference value based on the sharpness of the images included in the reference data. The reference value is, for example, an average value of the sharpness of the images included in the reference data. The preparation unit 517 determines each of the plurality of candidate values ​​based on the reference value.

[0214] (Physical configuration of the trail management system 500 and the server device 502) The trail management system 500 and the server device 502 may be physically configured in the same manner as the trail management system 100 and the server device 102 according to the first embodiment.

[0215] (Operation of the trail management system 500) The operation of the trail management system 500 will now be described with reference to the drawings.

[0216] The trail management system 500 executes a trail management process for managing the trail of identity verification, similar to the first embodiment. The trail management process according to this embodiment includes a second terminal process similar to the second embodiment, and a sixth server process that replaces the third server process according to the third embodiment. The sixth server process is executed by the server device 502.

[0217] (6th server process) 23 is a flowchart showing an example of the sixth server process according to the present embodiment. As in the first embodiment, the server device 502 starts the sixth server process when communication with the terminal device 201 via the network N is established.

[0218] In the sixth server process, as shown in the figure, steps S216 to S220 are executed before step S201, which is executed first in the fifth server process. Except for these steps, the sixth server process may be similar to the fifth server process.

[0219] The preparation unit 517 acquires a plurality of pieces of reference data including the target image P1 from the terminal device 201 via the network N (step S216).

[0220] The preparation unit 517 obtains the sharpness of each of the target images P1 included in the reference data acquired in step S216 (step S217).

[0221] In step S217, the preparation unit 517 may calculate the sharpness of each of the target images P1 included in the reference data using the same method as that used to calculate the sharpness of the target images P1 in the second determination process (step S206).

[0222] The preparation unit 517 calculates a reference value based on the multiple sharpness values ​​calculated in step S217 (step S218).

[0223] In step S218, the preparation unit 517, for example, calculates the average value of the multiple sharpness values ​​calculated in step S217, and sets the average value as a reference value.

[0224] The reference value is not limited to the average value of the plurality of sharpness values, but may be any value obtained based on the sharpness values ​​of the image included in the reference data. For example, the reference value may be the maximum or minimum value of the plurality of sharpness values, or a value obtained by performing appropriate statistical processing on the plurality of sharpness values.

[0225] The preparation unit 517 determines a plurality of candidate values ​​based on the reference value obtained in step S218 (step S219).

[0226] In step S219, the preparation unit 517 determines a plurality of candidate values ​​with the reference value as the lower limit. For example, the preparation unit 517 sets the reference value to C3, which is the smallest candidate value among C1, C2, and C3.

[0227] The preparation unit 517 sets the other candidate values ​​C1 and C2 in a predetermined manner. For example, when increasing the value by a predetermined value d, the preparation unit 517 sets C2 to a value obtained by adding d to the reference value, and sets C3 to a value obtained by further adding d to C2.

[0228] The preparation unit 517 may determine at least some of the plurality of candidate values ​​based on the reference value obtained in step S218. When some of the plurality of candidate values ​​are determined based on the reference value, the remaining candidate values ​​may be values ​​based on a user input, predetermined values, etc.

[0229] The preparation unit 517 generates candidate data 316 including the plurality of candidate values ​​determined in step S219, and stores the generated candidate data 316 in the candidate storage unit 315 (step S220). Subsequently, the same processes as those in the third server process from step S201 onward are executed.

[0230] In this embodiment, an example has been described in which a candidate value is determined based on a reference value, but if there is one second reference value, the reference value or a value based on the reference value may be applied to the second reference value.

[0231] According to this embodiment, the preparation unit 517 acquires a plurality of reference data items including at least character images, and determines a plurality of candidate values ​​based on the sharpness of each image included in the acquired plurality of reference data items. This allows the sharpness of the target image P1 to be determined using a second reference value according to the performance of the camera included in the terminal device 201. This makes it possible to manage evidence of better image quality.

[0232] (Variation 7) In the embodiment and the modified examples, the trail management devices are the servers 102, 202, 302, 402, and 502.

[0233] However, the terminal devices 101 and 201 may also include as their trail management devices the data acquisition unit 103 and trail generation units 104, 204, 304, and 404 that are provided in the server devices 102, 202, 302, 402, and 502. The terminal devices 101 and 201 may also include as their trail management device the preparation unit 517 that is provided in the server device 502.

[0234] In this case, for example, the terminal communication unit 207 may transmit the generated trail data to the server device 102, 202 via the network N. Also, for example, the terminal device 101, 201 may include a trail data storage unit 209, and store the trail data in the trail data storage unit 209. Furthermore, for example, the terminal device 101, 201 may include a verification-required data storage unit 210, and store the verification-required data in the verification-required data storage unit 210.

[0235] Also, for example, the candidate values ​​of the candidate data 316 may be set according to instructions from the server device 302 based on user input.

[0236] This also provides the same effects as those of the respective embodiments and modifications.

[0237] Although the embodiments and modifications of the present invention have been described above with reference to the drawings, these are merely examples of the present invention, and various other configurations can also be adopted.

[0238] In addition, although the flowcharts used in the above description show multiple steps (processes) in a sequential order, the order of steps performed in each embodiment is not limited to the order shown. In each embodiment, the order of the steps shown in the drawings can be changed as long as it does not cause any problems in terms of content. Furthermore, the above-described embodiments and variations can be combined as long as the content is not contradictory.

[0239] A part or all of the above-described embodiments can be described as, but not limited to, the following supplementary notes.

[0240] 1. data acquisition means for acquiring target image data including a target image including a first area indicating the person and a second area indicating the person's image included in the document; and a trail generating means for generating trail data based on the target image when the first area and the second area satisfy a first condition and the clarity of the target image satisfies a second condition. Evidence management device. 2. the target image further includes a third region representing characters included in the document; The trail generating means calculates the sharpness based on the third region. The trail management device described in 1 above. 3. The evidence data includes information indicating characters recognized from the image of the third region. The trail management device described in 2. above. 4. When it is determined that the first condition is satisfied, the trail generating means determines whether the clarity satisfies a second condition. The trail management device according to any one of 1. to 3. above. 5. the second condition is defined by a relationship between the sharpness and a second reference value, The trail generation means holds candidate data including a plurality of candidate values ​​that are candidates for the second reference value, and repeatedly determines whether the clarity of the target image satisfies the second condition by using a candidate value selected from the plurality of candidate values ​​in descending order as the second reference value. An evidence management device according to any one of 1. to 4. above. 6. The method further includes a preparation means for acquiring a plurality of reference data including at least an image of a character, and determining the plurality of candidate values ​​based on the sharpness of each of the images included in the acquired plurality of reference data. The trail management device described in 5 above. 7. The target image data is a plurality of The candidate data is data in which the maximum number of times a process for determining whether the sharpness of the target image satisfies a second condition is performed is associated with each of the plurality of candidate values. The trail management device described in 5. or 6. above. 8. The smaller the candidate value, the larger the maximum number of executions. The trail management device described in 7 above. 9. The trail generation means determines that the sharpness is equal to or greater than the second reference value using one of the candidate values ​​as a second reference value, or repeatedly executes the process of determining whether the sharpness is equal to or greater than the second reference value until the second determination process associated with the candidate value has been repeated a maximum number of times. The trail management device described in 7. or 8. above. 10. The target image data includes one or more target images, The evidence generating means generates confirmation-required data based on the one target image or any of the plurality of target images when the clarity of all of the one or plurality of target images does not satisfy the second condition. An evidence management device according to any one of 1. to 9. above. 11. a trail management device according to any one of items 1 to 10 above; a terminal device that takes an image of the person and the document to generate the target image data and transmits the target image data to the trail management device; Evidence management system. 12. The computer Acquire target image data including a target image including a first area indicating the person and a second area indicating the person's image included in the document; generating evidence data based on the target image when the first area and the second area satisfy a first condition and the clarity of the target image satisfies a second condition. Evidence management method. 13. On the computer, Acquire target image data including a target image including a first area indicating the person and a second area indicating the person's image included in the document; A program for causing the computer to execute the steps of generating evidence data based on the target image when the first area and the second area satisfy a first condition and the clarity of the target image satisfies a second condition. 14. On the computer, Acquire target image data including a target image including a first area indicating the person and a second area indicating the person's image included in the document; A recording medium having a program recorded thereon for generating evidence data based on the target image when the first area and the second area satisfy a first condition and the clarity of the target image satisfies a second condition.

[0241] This application claims priority based on Japanese Patent Application No. 2022-017944, filed on February 8, 2022, the disclosure of which is incorporated herein in its entirety. [Explanation of symbols]

[0242] 100,200,300,400,500 Evidence management system 101,201 Terminal equipment 102,202,302,402,502 Server equipment 103 Data Acquisition Unit 104,204,304,404 Trail Generation Unit 205 Photography Department 209 Evidence Data Storage Unit 210 Confirmation Data Storage Unit 211 1st Judgment Department 212,312,412 2nd judgment section 213 Memory control unit 214 Notification Department 315,415 Candidate holding section 316,416 candidate data 517 Preparation Department P1 Target image PP preview image AR1 1st area AR2 2nd area AR3 3rd area G1, G2 Guide

Claims

1. a data acquisition means for acquiring target image data including a target image including a first area indicating the person and a second area indicating the person's image included in the document; a trail generating means for generating trail data based on the target image when the first area and the second area satisfy a first condition and the clarity of the target image satisfies a second condition; the second condition is defined by a relationship between the sharpness and a second reference value, The trail generation means holds candidate data including a plurality of candidate values ​​that are candidates for the second reference value, and repeatedly determines whether the clarity of the target image satisfies the second condition by using a candidate value selected from the plurality of candidate values ​​in descending order as the second reference value. Evidence management device.

2. the target image further includes a third region representing characters included in the document; The trail generating means calculates the sharpness based on the third region. The trail management device according to claim 1 .

3. When it is determined that the first condition is satisfied, the trail generating means determines whether the clarity satisfies a second condition. The trail management device according to claim 1 or 2.

4. The method further includes a preparation means for acquiring a plurality of reference data including at least an image of a character, and determining the plurality of candidate values ​​based on the sharpness of each of the images included in the acquired plurality of reference data. The trail management device according to claim 1 or 2.

5. The target image data is a plurality of The candidate data is data in which the maximum number of times a process for determining whether the sharpness of the target image satisfies a second condition is performed is associated with each of the plurality of candidate values. The trail management device according to claim 1 or 2.

6. The smaller the candidate value, the larger the maximum number of executions. The trail management device according to claim 5 .

7. The trail management device according to claim 1 or 2; a terminal device that takes an image of the person and the document to generate the target image data and transmits the target image data to the trail management device; Evidence management system.

8. The computer Acquire target image data including a target image including a first area indicating the person and a second area indicating the person's image included in the document; generating trail data based on the target image when the first area and the second area satisfy a first condition and the clarity of the target image satisfies a second condition; the second condition is defined by a relationship between the sharpness and a second reference value, Generating the evidence data includes repeatedly determining whether or not the clarity of the target image satisfies a second condition by using, as the second reference value, a candidate value selected from the plurality of candidate values ​​in descending order based on candidate data including a plurality of candidate values ​​that are candidates for the second reference value. Evidence management method.

9. On the computer, Acquire target image data including a target image including a first area indicating the person and a second area indicating the person's image included in the document; generating trail data based on the target image when the first area and the second area satisfy a first condition and the clarity of the target image satisfies a second condition; the second condition is defined by a relationship between the sharpness and a second reference value, The program includes repeatedly determining whether the clarity of the target image satisfies a second condition by using a candidate value selected from the plurality of candidate values ​​in descending order as the second reference value based on candidate data including a plurality of candidate values ​​that are candidates for the second reference value.

Images