Document verification auxiliary system and document verification methods

Abstract

This invention provides a document verification assistance system and method. The document verification assistance system includes a camera, a local document content verification module, a network document content verification module, a facial feature verification module, and a feedback module. The camera is used to scan documents and take photos of passengers; the local document content verification module is used to check the document's feature information; the network document content verification module is used to check the document's content information through a network server; the facial feature verification module is used to check facial feature information based on the passenger's photo and the document holder's photo information on the document; and the feedback module is used to generate a document verification opinion based on the document feature information verification results, document content information verification results, and facial feature information verification results.

Description

Technical Field

[0001] This invention relates to the field of document verification, and in particular to a document verification auxiliary system and a document verification method. Background Technology

[0002] In immigration management and border inspection, it is necessary to strictly verify the identity information of passengers. Currently, the verification of entry and exit documents is mainly done manually. The inspectors manually flip through the documents page by page. The identification and verification of the authenticity of the documents depends on the experience and professional level of the staff. In some cases, this may lead to omissions or misreadings of certain passport information, and it is also impossible to effectively identify the authenticity of the passport, affecting the efficiency and accuracy of the inspection.

[0003] Therefore, this application designs a document verification auxiliary system and document verification method, which can improve the efficiency and accuracy of manual verification. Summary of the Invention

[0004] This invention provides a document verification auxiliary system and method that can improve the verification efficiency and accuracy of document verification personnel, thereby solving the technical problems of low verification efficiency and low verification accuracy of manual verification in existing document verification methods.

[0005] This invention provides a document verification auxiliary system, which includes:

[0006] Cameras are used to scan documents and take photos of passengers;

[0007] The document content local inspection module is used to inspect the document's feature information.

[0008] The document content online inspection module is used to inspect the document content information through a network server;

[0009] The facial feature inspection module is used to inspect facial feature information based on the passenger photo and the holder's photo information on the document; and

[0010] The feedback module is used to generate document verification opinions based on the inspection results of document feature information, document content information, and facial feature information, for reference by document verification staff.

[0011] In the document verification assistance system of the present invention, the local document content inspection module includes:

[0012] The document paper feature inspection unit is used to inspect the document paper feature information of the document;

[0013] A document printing feature inspection unit is used to inspect the document printing feature information of the document; and

[0014] The document binding feature inspection unit is used to inspect the document binding feature information of the document.

[0015] In the document verification auxiliary system described in this invention, the document content network inspection module is specifically used to perform anomaly checks on the document holder information, document validity period, number of valid document uses, accompanying person information, and verification stamp information through a network server.

[0016] In the document verification assistance system of the present invention, the feedback module includes:

[0017] A feedback unit is used to provide feedback on abnormal document information to the inspection staff; and

[0018] The operation prompt unit is used to prompt the inspection staff about the operation procedures.

[0019] This invention also provides a document verification method that uses the above-mentioned document verification assistance system to assist verification personnel in verifying documents, wherein the document verification method includes:

[0020] The camera captures a photograph of the passenger holding the document at the passenger inspection station, and the camera also captures the contents of the document at the document inspection station; wherein the inspection staff member reviews the document at the document inspection station.

[0021] The facial feature inspection module compares the facial feature information in the passenger's photo with the facial feature information in the holder's photo in the document content, and generates a facial feature information inspection result.

[0022] The local document content inspection module inspects the document's paper characteristics, printing characteristics, and binding characteristics, and generates document characteristic information inspection results.

[0023] The document content network inspection module sends the document holder information, document validity period, number of valid document uses, accompanying person information, and verification stamp information in the document content to the network server for inspection, and generates document content information inspection results;

[0024] If the facial feature information check result, the document feature information check result, and the document content information check result are all normal, the feedback module prompts the inspection staff to stamp the document and release it.

[0025] If any of the facial feature information inspection results, the document feature information inspection results, or the document content information inspection results are abnormal, the feedback module will prompt the inspection staff to conduct a manual abnormality check based on the reason for the abnormality.

[0026] In the document verification method of the present invention, the step of the local document content inspection module inspecting the document paper feature information of the document includes:

[0027] The local document content inspection module inspects the document for paper watermarks, paper security lines, and / or paper fluorescent dots.

[0028] The steps of the local document content inspection module in inspecting the document's printing feature information include:

[0029] The local document content inspection module inspects the background printing pattern, intaglio printing pattern, shadow printing pattern, fluorescent printing pattern, micro-letter printing pattern and / or rainbow printing pattern of the document.

[0030] The steps of the local document content inspection module to inspect the document binding feature information include:

[0031] The local document content inspection module checks the document's binding and punching information as well as the encapsulation fluorescent thread information.

[0032] In the document verification method of the present invention, the step of the facial feature inspection module determining and comparing the facial feature information on the passenger's photo with the facial feature information of the document holder's photo in the document content, and generating a facial feature information inspection result includes:

[0033] The facial feature inspection module compares the positional feature information of the relative positions of the facial features in the passenger's photo with the positional feature information of the relative positions of the facial features in the holder's photo in the document content, and generates a first comparison result.

[0034] When the first comparison result meets the preset conditions, the facial feature inspection module compares the shape feature information of the facial features on the passenger photo with the shape feature information of the facial features in the holder photo of the document content to generate a second comparison result.

[0035] The facial feature information inspection result is generated based on the first comparison result and the second comparison result.

[0036] In the document verification method of the present invention, the document verification further includes:

[0037] When the facial feature information check result or the document feature information check result is abnormal, the document content network check module sends the document holder information, document validity period, document validity count, accompanying person information, and verification stamp information in the document content to the network server for check and generates document content information check result.

[0038] In the document verification method of the present invention, the document verification method further includes:

[0039] The local document content checking module checks the matching rationality of the verification stamp information in the document content and generates document content information checking results.

[0040] In the document verification method of the present invention, the step of the feedback module prompting the verification staff to stamp and release the document includes:

[0041] When the holder of the document enters the country, the feedback module prompts the inspection personnel to stamp the blank page of the document and allow passage;

[0042] When the holder leaves the country, the feedback module indicates the location of the entry stamp on the document to the inspector and prompts the inspector to stamp the exit stamp around the entry stamp and then allow the holder to pass.

[0043] Compared to existing technologies, the document verification assistance system and method of this invention utilize machine-assisted inspection of document feature information, document content information, and facial feature information. This enables rapid identification of the document's graphic and textual information, including high-definition, high-fidelity anti-counterfeiting features and entry / exit records. The verification results are then promptly fed back to the verification personnel, facilitating efficient and accurate document verification. This effectively solves the technical problems of low efficiency and accuracy associated with manual verification in existing document verification methods.

[0044] Furthermore, the document verification method of this application prioritizes the use of local content to verify the document holder's documents, thereby improving the speed of document verification while ensuring the accuracy of the verification.

[0045] Furthermore, regardless of whether the inspection is normal or abnormal, the document inspection method in this application can provide inspection prompts to the inspection staff, further improving the efficiency of manual inspection. Attached Figure Description

[0046] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the embodiments are briefly introduced below. The drawings described below are only the corresponding drawings of some embodiments of the present invention.

[0047] Figure 1 This is a schematic diagram of a scenario of an embodiment of the document verification assistance system of the present invention;

[0048] Figure 2 This is a schematic diagram of a structure of an embodiment of the document verification auxiliary system of the present invention;

[0049] Figure 3 This is a schematic diagram of the structure of a local document content checking module according to an embodiment of the document verification auxiliary system of the present invention;

[0050] Figure 4 This is a schematic diagram of the feedback module in one embodiment of the document verification auxiliary system of the present invention;

[0051] Figure 5 This is a flowchart of an embodiment of the document verification method of the present invention. Detailed Implementation

[0052] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by users of the art without creative effort are within the scope of protection of the present invention.

[0053] In the diagram, units with similar structures are represented by the same labels.

[0054] The document verification auxiliary system and document verification method of the present invention can be applied to border inspection personnel to verify the documents of inbound and outbound passengers.

[0055] Please see the usage scenarios for this document verification assistance system. Figure 1 , Figure 1 This is a schematic diagram of a scenario of an embodiment of the document verification assistance system of the present invention. The document verification scenario includes a passenger entrance 11, a passenger exit 12, a document holder 13 entering or leaving the country, border inspection personnel 14, and an inspection counter 15. The document holder 13 enters the verification channel from the passenger entrance 11. The inspection personnel 14 inspects the document of the document holder 13 at the inspection counter 15, located at the passenger inspection station 16. After completing the document verification, the document holder 13 leaves the verification channel from the passenger exit 12. The inspection personnel 14 performs document verification operations at the document verification station 151 of the inspection counter 15. Specifically, the inspection personnel 14 can browse the document at the document verification station 151 so that the camera 21 of the document verification assistance system 20 can capture the content of each page of the document.

[0056] The document verification assistance system 20 of this embodiment can be installed in the scanning area 152 of the verification station 15, or on the upper part of the document verification position 151, or on the body of the verification staff 14. The installation position of the document verification assistance system 20 is such that the camera 21 of the document verification assistance system 20 can simultaneously capture the passenger photo of the document holder 13 at the passenger verification position 16 and the document content at the document verification position 151. Of course, the camera 21 can be integrated into one unit, or it can be designed separately according to the requirements of capturing passenger photos and document content, that is, the camera 21 can be composed of multiple camera modules.

[0057] Since the subsequent camera 21 needs to inspect the paper characteristics, printing characteristics, and binding characteristics of the document, infrared light sources, ultraviolet light sources, or moving light sources should be set around the camera 21 to correspond to different inspection methods or different inspection angles. Because the requirements for taking passenger photos and photographing document content are different, the light sources for taking passenger photos and the light sources for photographing document content should be designed separately.

[0058] The document verification assistance system 20 can assist the verification staff 14 in verifying the documents of the document holder 13 based on the photograph of the passenger and the contents of the document, thereby improving the verification efficiency and accuracy of the verification staff.

[0059] Please refer to Figure 2 , Figure 2 This is a schematic diagram of an embodiment of the document verification assistance system of the present invention. The document verification assistance system 20 of this embodiment includes a camera 21, a local document content inspection module 22, a network document content inspection module 23, a facial feature inspection module 24, and a feedback module 25.

[0060] Camera 21 is used to scan documents and take photos of passengers; local document content inspection module 22 is used to inspect document feature information; online document content inspection module 23 is used to inspect document content information through a network server; facial feature inspection module 24 is used to inspect facial feature information based on passenger photos and document holder photos; feedback module 25 is used to generate document verification opinions based on the results of document feature information inspection, document content information inspection, and facial feature information inspection, for reference by document inspectors.

[0061] Please refer to Figure 3 , Figure 3This is a schematic diagram of the structure of a local document content inspection module according to an embodiment of the document verification auxiliary system of the present invention. The local document content inspection module 22 of this embodiment includes a document paper feature inspection unit 221, a document printing feature inspection unit 222, and a document binding feature inspection unit 223.

[0062] The document paper feature inspection unit 221 is used to inspect the document paper feature information of the document; the document printing feature inspection unit 222 is used to inspect the document printing feature information of the document; and the document binding feature inspection unit 223 is used to inspect the document binding feature information of the document.

[0063] In this embodiment, the document content network inspection module 23 is specifically used to perform anomaly checks on the document holder information, document validity period, number of valid document uses, accompanying person information, and verification stamp information through the network server.

[0064] In this embodiment, the facial feature inspection module 24 is specifically used to perform facial feature information inspection based on the first comparison result generated by the positional feature information of the relative positions of facial features on the passenger's photo and the positional feature information of the relative positions of facial features on the document holder's photo, and the second comparison result generated by the shape feature information of the shape of facial features on the passenger's photo and the shape feature information of the shape of facial features on the document holder's photo.

[0065] Please refer to Figure 4 , Figure 4 This is a schematic diagram of the feedback module in an embodiment of the document verification assistance system of the present invention. The feedback module 25 in this embodiment includes a feedback unit 251 and an operation prompt unit 252. The feedback unit 251 is used to provide feedback on abnormal document information to the verification staff; the operation prompt unit 252 is used to prompt the verification staff with the operation procedures.

[0066] The following is based on Figure 1 The following describes the usage scenario of the document verification assistance system in this embodiment. The process of verification personnel using the document verification assistance system to verify documents includes:

[0067] The holder of the document 13 enters the inspection channel through the passenger entrance 11 and proceeds to the passenger inspection station 16 next to the inspection counter 15. The holder of the document 13 then hands the document to the inspection staff 14 for inspection. The inspection staff 14 performs the document inspection operation at the document inspection station 151 of the inspection counter 15.

[0068] At this time, the camera 20 of the document verification assistance system 20 will simultaneously capture images of the document being reviewed and the document holder 13 located at the passenger verification station 16, thereby obtaining the document content and the passenger photo respectively.

[0069] Subsequently, the facial feature inspection module 24 of the document verification auxiliary system 20 compares the facial feature information in the passenger's photo with the facial feature information in the document holder's photo. Since the relative positions and shapes of the facial features of adult passengers are generally fixed, the facial feature inspection module 24 compares the positional features of the facial features in the passenger's photo with the positional features of the facial features in the document holder's photo, and also compares the shape features of the facial features in the passenger's photo with the shape features of the facial features in the document holder's photo. If the comparison results are consistent, a normal facial feature information inspection result is generated.

[0070] While the facial feature checking module of the document verification auxiliary system 20 compares the facial feature information with that of the document, the local document content checking module 21 of the document verification auxiliary system 20 will check the document paper feature information, document printing feature information and document binding feature information of the document.

[0071] Specifically, the document paper feature inspection unit 221 inspects the document's paper watermark, security thread, and fluorescent dots. The paper watermark is a paper feature created by the mold or printing roller during the document printing process; the security thread is a synthetic magnetic strip added during paper production; and the fluorescent dots are markers that emit strong light under ultraviolet light (the corresponding camera should be surrounded by a fluorescent lamp). Of course, inspection personnel can also use some of the above-mentioned document paper feature information for inspection.

[0072] The document printing feature inspection unit 222 inspects the background printing pattern, intaglio printing pattern, shadow printing pattern, fluorescent printing pattern, micro-letter printing pattern, and rainbow printing pattern of the document. The background printing pattern refers to a continuous pattern on the document's background; if the document holder alters the document, the continuity and consistency of the background printing pattern will be disrupted. The intaglio printing pattern is a raised pattern line formed on the paper surface using intaglio printing technology. The shadow printing pattern is a pattern that only appears when the document is viewed from a specific angle (the camera needs to be set to the appropriate angle to capture this shadow printing pattern). The fluorescent printing pattern is a pattern that emits strong light under ultraviolet light (the corresponding camera should be surrounded by fluorescent lights). The micro-letter printing pattern is a pattern formed by replacing the pattern lines with micro-letters; due to its high production difficulty, it has good anti-counterfeiting performance. The rainbow printing pattern is a background pattern with a color gradient effect; similarly, due to its high production difficulty, it has good anti-counterfeiting performance. Of course, inspection personnel may also select some of the above-mentioned document printing feature information for inspection.

[0073] The document binding feature inspection unit 223 checks the document's binding perforation information and sealing fluorescent thread information. Binding perforation information refers to the perforation details used during document binding, such as the spacing, size, and shape of the perforations. It is difficult for a document holder to simultaneously maintain consistency in these aspects when forging a document. Sealing fluorescent thread information refers to fluorescent threads that emit strong light under ultraviolet light (the corresponding camera should be surrounded by a fluorescent lamp). Of course, inspection personnel may also select some document binding feature information for inspection.

[0074] Subsequently, the local document content inspection module 22 generates document feature information inspection results based on the aforementioned document paper feature information, document printing feature information, and document printing feature information.

[0075] After the camera captures the document content, the document content network inspection module 23 of the document verification assistance system 20 can also send the document holder information, document validity period, number of valid entries, accompanying person information, and verification stamp information from the document content to the network server for anomaly checks. This network server stores the aforementioned document content of the document holder, allowing it to perform anomaly checks on information such as the correctness of the document holder information, document barcode information, whether the document has entry / exit restrictions, whether the document is valid and within a valid route, whether the document's endorsements are valid, and the document holder's accompanying person information, and generate document content information inspection results. Furthermore, the network server can also verify the document paper characteristics, document printing characteristics, and document printing features checked by the local document content inspection module 22.

[0076] Finally, the feedback module 25 checks the results of the document feature information check, the document content information check, and the facial feature information check, and generates a document verification opinion for the document verification staff to refer to. If the facial feature information check, document feature information check, and document content information check are all normal, the operation prompt unit 252 of the feedback module 25 prompts the verification staff to stamp the document and release it; if any of the facial feature information check, document feature information check, and document content information check results are abnormal, the feedback unit 251 of the feedback module 25 prompts the verification staff to conduct a manual abnormality check based on the reason for the abnormality.

[0077] This completes the process of the document verification assistance system in this embodiment assisting verification personnel in verifying documents.

[0078] The document verification assistance system in this embodiment performs machine-assisted checks on document feature information, document content information, and facial feature information, and promptly feeds back the document verification opinions to the verification staff so that the verification staff can perform efficient and accurate document verification operations.

[0079] This invention also provides a document verification method, used to assist verification personnel in verifying documents using the aforementioned document verification auxiliary system. Please refer to... Figure 5 , Figure 5 This is a flowchart illustrating an embodiment of the document verification method of the present invention. The document verification method includes:

[0080] Step S501: The camera takes a photo of the passenger holding the document at the passenger inspection station, and the camera also captures the contents of the document at the document inspection station; the inspection staff flips through the document at the document inspection station so that the camera can obtain the contents of the document.

[0081] In step S502, the facial feature inspection module compares the facial feature information in the passenger's photo with the facial feature information in the document holder's photo to generate a facial feature information inspection result.

[0082] In step S503, the local document content inspection module inspects the document's paper characteristics, printing characteristics, and binding characteristics, and generates document characteristic information inspection results.

[0083] In step S504, the document content network inspection module sends the document holder information, document validity period, number of valid document uses, accompanying person information, and verification stamp information in the document content to the network server for inspection, and generates document content information inspection results.

[0084] In step S505, if the facial feature information check results, document feature information check results, and document content information check results are all normal, the feedback module prompts the inspection staff to stamp the document and release it. If any of the facial feature information check results, document feature information check results, and document content information check results are abnormal, the feedback module prompts the inspection staff to conduct a manual abnormality check based on the reason for the abnormality.

[0085] The document verification process of this embodiment is described in detail below.

[0086] In step S501, the camera of the document verification assistance system will simultaneously capture images of the document being reviewed and the document holder at the passenger verification station, thereby obtaining the document content and the passenger's photo respectively.

[0087] In step S502, the facial feature inspection module compares the facial feature information on the passenger's photo with the facial feature information on the certificate holder's photo in the document content.

[0088] Specifically, the facial feature inspection module compares the positional feature information of the facial features in the passenger's photo with the positional feature information of the facial features in the holder's photo in the document content, and generates a first comparison result; if the first comparison result is consistent, the facial feature inspection module determines that the facial feature information inspection result is normal.

[0089] If the first comparison result shows a large difference, such as the difference between the distance between the eyes and the distance between the eyes and nose in the passenger's photo and the distance between the distance between the eyes and the distance between the eyes and nose in the certificate holder's photo being greater than the first set value (e.g., greater than 0.15), then the difference in the first comparison result is considered large, and the facial feature inspection module determines that the facial feature information inspection result is abnormal.

[0090] If the first comparison result shows a small difference, such as the difference between the distance between the eyes and the distance between the eyes and nose in the passenger's photo and the difference between the distance between the eyes and the distance between the eyes and nose in the document holder's photo being less than a first set value but greater than a second set value (e.g., less than 0.15, greater than 0.05), then the first comparison result is considered questionable. In this case, the facial feature inspection module compares the shape feature information of the facial features in the passenger's photo with the shape feature information of the facial features in the document holder's photo to generate a second comparison result. If the second comparison result is consistent (e.g., the shape ratio difference is less than 0.05), the facial feature inspection module determines that the facial feature information inspection result is normal.

[0091] In step S503, the local document content inspection module inspects the document's paper characteristics, printing characteristics, and binding characteristics, and generates document characteristic information inspection results.

[0092] Specifically, the local document content inspection module checks the document's paper characteristics, such as watermarks, paper security features, and fluorescent dots; it also checks the document's printing characteristics, including background patterns, intaglio printing, shadow printing, fluorescent printing, micro-letter printing, and rainbow printing; and it checks the document's binding characteristics, such as binding perforation and fluorescent binding lines. If all the above checks are normal, the local document content inspection module determines the document's characteristic information check result is normal; if any of the above checks is abnormal, the local document content inspection module determines the document's characteristic information check result is abnormal.

[0093] The paper watermark on the document is a paper feature formed by pressing the paper with a mold or printing roller during the printing process; the paper security thread is a synthetic magnetic tape added during the paper production process that passes through the paper; the paper fluorescent dots are markers that emit strong light under ultraviolet light (the corresponding camera should be surrounded by fluorescent lights).

[0094] Background printing patterns refer to the continuous patterns on the background of the document. If the document holder alters the document, the continuity and consistency of the background printing pattern will be disrupted. Intaglio printing patterns are raised lines created on the paper surface using intaglio printing technology. Shadow printing patterns are patterns that only appear when the document is viewed from a specific angle (the camera needs to be set to the appropriate angle to capture these patterns). Fluorescent printing patterns are patterns that emit strong light under ultraviolet light (the corresponding camera should be equipped with fluorescent lights). Micro-letter printing patterns use micro-letters to replace the lines of the original pattern; due to their high production difficulty, they offer good anti-counterfeiting properties. Rainbow printing patterns are background patterns with a color gradient effect; similarly, due to their high production difficulty, they offer good anti-counterfeiting properties.

[0095] The binding and punching information refers to the punching details used when binding the document, such as the spacing, size, and shape of the binding holes. It is difficult for a document holder to simultaneously maintain consistency in the spacing, size, and shape of these binding holes when forging a document. The encapsulation fluorescent line information refers to the fluorescent line that emits strong light under ultraviolet light (the corresponding camera should be surrounded by fluorescent lights).

[0096] Preferably, the local document content inspection module also checks the matching and reasonableness of the verification stamp information in the document content, that is, it determines whether the entry verification stamp and exit verification stamp appear in the document in pairs, in order to check whether there are any missing pages in the document. For example, the number of entry verification stamps and exit verification stamps in documents prior to the inspection date should be consistent.

[0097] In step S504, the document content network inspection module can also send the document holder information, document validity period, number of valid entries, accompanying person information, and verification stamp information from the document content to the network server for anomaly checking. The network server stores the aforementioned document content of the document holder, allowing it to perform anomaly checks on whether the document holder information is correct, whether the document has any entry / exit restrictions, whether the document is valid, whether the document's endorsements are valid, and the document holder's accompanying person information, and generate document content information inspection results.

[0098] To further improve the efficiency of inspection staff, it can be set here that the document content network inspection module will only generate the document content information inspection result when the facial feature information inspection result or the document feature information inspection result is abnormal.

[0099] In step S505, if the facial feature information check results, document feature information check results, and document content information check results are all normal, the feedback module prompts the inspection personnel to stamp the document and allow passage. Specifically, if the document holder enters the country, the feedback module prompts the inspection personnel to stamp the blank page of the document and allow passage; if the document holder exits the country, the feedback module can provide the inspection personnel with the location of the entry verification stamp on the document and prompt the inspection personnel to stamp the exit verification stamp around the entry verification stamp and allow passage, so as to conduct subsequent checks on the matching and reasonableness of the verification stamp information.

[0100] If any of the above-mentioned facial feature information check results, document feature information check results, or document content information check results are abnormal, the feedback module will prompt the inspection staff to conduct manual abnormality verification based on the reason for the abnormality.

[0101] If the facial feature information check result is abnormal, the feedback module will prompt the verification staff to manually check for abnormal areas in the ID card holder's photo. If the ID card feature information check result is abnormal, the feedback module will prompt the verification staff to manually check for abnormalities in the paper, printing, or binding of a specific page on the ID card. If the ID card content information check result is abnormal, the feedback module will prompt the verification staff to manually check for abnormal content on the ID card, such as by inquiring about the abnormal content from the ID card holder.

[0102] Meanwhile, the camera in the document verification assistance system can also identify the passenger's photo and document content and upload them to the network server for subsequent anomaly verification.

[0103] This completes the document verification process, which uses the aforementioned document verification assistance system to help verification staff verify documents.

[0104] The document verification method in this embodiment uses machine-assisted inspection of document feature information, document content information, and facial feature information to check for anomalies that verification personnel may easily overlook. It also promptly provides verification opinions and prompts to the verification personnel, enabling them to conduct targeted checks. Furthermore, this document verification method prioritizes using local content to verify the document holder's documents, further improving verification speed while ensuring accuracy.

[0105] The document verification auxiliary system and method of the present invention perform machine-assisted inspection of document feature information, document content information and facial feature information, and promptly feed back the document verification opinions to the verification staff so that the verification staff can perform efficient and accurate document verification operations; effectively solving the technical problems of low verification efficiency and low verification accuracy of manual verification in existing document verification methods.

[0106] In summary, although the present invention has been disclosed above with reference to preferred embodiments, the above preferred embodiments are not intended to limit the present invention. Users of ordinary skills in the art can make various modifications and refinements without departing from the spirit and scope of the present invention. Therefore, the scope of protection of the present invention shall be determined by the scope defined in the claims.

Claims

1. A document verification auxiliary system for use by border inspection departments for document verification, characterized in that, include: Cameras are used to scan documents and take photos of passengers; The document content local inspection module is used to inspect the document's feature information. The document content online inspection module is used to inspect the document content information through a network server; The facial feature inspection module is used to inspect facial feature information based on the passenger photo and the holder's photo information on the document; as well as The feedback module is used to generate document verification opinions based on the results of document feature information inspection, document content information inspection, and facial feature information inspection, for reference by document verification staff; The facial feature inspection module compares the positional feature information of the relative facial features in the passenger's photo with the positional feature information of the relative facial features in the holder's photo in the document content to generate a first comparison result. If the first comparison result is consistent, the facial feature inspection module determines that the facial feature information inspection result is normal. If the feature difference value in the first comparison result is greater than a first set value, the facial feature inspection module determines that the facial feature information inspection result is abnormal. When the feature difference value in the first comparison result is less than the first set value and greater than the second set value, the first comparison result is considered to be questionable. The face feature inspection module compares the shape feature information of the facial features on the passenger photo with the shape feature information of the facial features in the holder photo of the document content to generate a second comparison result. If the second comparison result is consistent, the face feature inspection module determines that the face feature information inspection result is normal.

2. The document verification auxiliary system according to claim 1, characterized in that, The local document content checking module includes: The document paper feature inspection unit is used to inspect the document paper feature information of the document; A document printing feature inspection unit is used to inspect the document printing feature information of the document; and The document binding feature inspection unit is used to inspect the document binding feature information of the document.

3. The document verification auxiliary system according to claim 1, characterized in that, The document content network inspection module is specifically used to perform anomaly checks on the document holder information, document validity period, number of valid document uses, accompanying person information, and verification stamp information through a network server.

4. The document verification auxiliary system according to claim 1, characterized in that, The feedback module includes: A feedback unit is used to provide feedback on abnormal document information to the inspection staff; and The operation prompt unit is used to prompt the inspection staff about the operation procedures.

5. A document verification method using the document verification auxiliary system according to claim 1 to assist verification personnel in verifying documents, characterized in that, The document verification methods include: The camera captures a photograph of the passenger holding the document at the passenger inspection station, and the camera also captures the contents of the document at the document inspection station; wherein the inspection staff member reviews the document at the document inspection station. The facial feature inspection module compares the facial feature information in the passenger's photo with the facial feature information in the holder's photo in the document content, and generates a facial feature information inspection result. The local document content inspection module inspects the document's paper characteristics, printing characteristics, and binding characteristics, and generates document characteristic information inspection results. The document content network inspection module sends the document holder information, document validity period, number of valid document uses, accompanying person information, and verification stamp information in the document content to the network server for inspection, and generates document content information inspection results; If the facial feature information check result, the document feature information check result, and the document content information check result are all normal, the feedback module prompts the inspection staff to stamp the document and release it. If any of the facial feature information inspection results, the document feature information inspection results, or the document content information inspection results are abnormal, the feedback module will prompt the inspection staff to conduct a manual abnormality check based on the reason for the abnormality. The facial feature inspection module compares the facial feature information in the passenger photo with the facial feature information in the document holder photo to generate a facial feature information inspection result. The steps include: The facial feature inspection module compares the positional feature information of the relative facial features in the passenger's photo with the positional feature information of the relative facial features in the holder's photo in the document content to generate a first comparison result. If the first comparison result is consistent, the facial feature inspection module determines that the facial feature information inspection result is normal. If the feature difference value in the first comparison result is greater than a first set value, the facial feature inspection module determines that the facial feature information inspection result is abnormal. When the feature difference value in the first comparison result is less than the first set value and greater than the second set value, the first comparison result is considered to be questionable. The face feature inspection module compares the shape feature information of the facial features on the passenger photo with the shape feature information of the facial features in the holder photo of the document content to generate a second comparison result. If the second comparison result is consistent, the face feature inspection module determines that the face feature information inspection result is normal.

6. The document verification method according to claim 5, characterized in that, The steps of the local document content inspection module to inspect the document paper feature information include: The local document content inspection module inspects the document for paper watermarks, paper security lines, and / or paper fluorescent dots. The steps of the local document content inspection module in inspecting the document's printing feature information include: The local document content inspection module inspects the background printing pattern, intaglio printing pattern, shadow printing pattern, fluorescent printing pattern, micro-letter printing pattern and / or rainbow printing pattern of the document. The steps of the local document content inspection module to inspect the document binding feature information include: The local document content inspection module checks the binding and punching information and / or the encapsulation fluorescent line information of the document.

7. The document verification method according to claim 5, characterized in that, The document verification also includes: When the facial feature information check result or the document feature information check result is abnormal, the document content network check module sends the document holder information, document validity period, document validity count, accompanying person information, and verification stamp information in the document content to the network server for check and generates document content information check result.

8. The document verification method according to claim 5, characterized in that, The document verification method also includes: The local document content checking module checks the matching rationality of the verification stamp information in the document content and generates document content information checking results.

9. The document verification method according to claim 5, characterized in that, The feedback module prompts the inspection staff to stamp and release the document, including the following steps: When the holder of the document enters the country, the feedback module prompts the inspection staff to stamp the blank page of the document and allow passage; When the holder leaves the country, the feedback module indicates the location of the entry stamp on the document to the inspection staff and prompts the inspection staff to stamp the exit stamp around the entry stamp and let the holder pass.

Images