A biological information collection system, method and related device for customs passengers

Abstract

This invention discloses a biometric information collection system, method, and related equipment for passengers clearing customs. The biometric information collection system of this invention first collects biometric information using a pre-mounted biometric information collector, then uses a facial recognition server to complete image information matching, and finally binds passport information and biometric information in a main database. Compared to the traditional method of entering biometric information after scanning passport information, this invention separates the entry process into pre-mounted biometric information collection, facial recognition server matching, and main database binding. This can effectively improve the efficiency of biometric information entry for first-time passengers upon entry, reduce passenger queuing time, and alleviate long queues when there are many passengers.

Description

Technical Field

[0001] This application relates to the field of data storage technology, and in particular to a biometric information collection system, method and related equipment for passengers passing through customs. Background Technology

[0002] According to relevant regulations, biometric information, such as fingerprints, voiceprints, palm prints, iris scans, and facial features, must be collected and stored from passengers entering the country for the first time through ports of entry. Because the types of biometric information to be collected are numerous and the collection process is complex, passengers need to enter specific biometric information in a fixed sequence after scanning their passports. For example, when entering fingerprint information, they need to collect fingerprints in the order of four fingers of the left hand, four fingers of the right hand, and both thumbs. In situations with a large number of passengers, this can lead to increased queuing time, seriously affecting the passenger travel experience and the overall efficiency of port clearance. Summary of the Invention

[0003] This invention aims to improve the efficiency of biometric information entry for first-time travelers upon arrival in the country, thereby reducing their waiting time. To this end, this invention proposes a biometric information collection system, method, and related equipment, which can reduce the time required for travelers to enter their information and alleviate queuing issues caused by large numbers of travelers.

[0004] A bioinformatics acquisition system according to a first aspect of the present invention includes:

[0005] The front-mounted biometric data collector is used to collect the passenger's first-person photograph and biometric information; A front-end database, connected to the front-end biometric information collector, is used to receive the first portrait photo and the biometric information, and bind the portrait photo and the biometric information as a front-end data pair, with the first portrait photo serving as the index data of the front-end data pair; The front-end business host is used to read foreign passengers' passports to obtain passport photos and to collect passengers' second-person portrait photos; A facial recognition server is connected to the front-end database and the front-end business host respectively. When the passport photo is received from the front-end business host, the server obtains the front-end data pair from the front-end database, matches the first facial photo and the passport photo through a facial recognition algorithm, determines the front-end data corresponding to the passport photo, and binds the passport photo and the corresponding biometric information as a passport data pair. The main database is connected to both the front-end business host and the facial recognition server. It is used to receive the passport data pairs from the facial recognition server, bind the passport data pairs to the second facial image from the front-end business host as the main data pairs, and store them.

[0006] According to some embodiments of the present invention, the front-facing biometric data collector includes a front-facing camera and at least one biometric data acquisition device; the front-facing camera is used to capture the passenger's image to generate a front-facing photo; the biometric data acquisition device is used to collect at least one biometric feature including fingerprint, iris, voiceprint, palm print, and subcutaneous vein.

[0007] According to some embodiments of the present invention, the prior database is further configured to: delete the prior data pair from the prior database when the portrait photo and the passport photo are successfully matched and the portrait comparison server obtains the prior data pair from the prior database.

[0008] According to some embodiments of the present invention, the master database is further configured to connect to a host device, which is configured to obtain the master data from the master database.

[0009] A bioinformatics acquisition method according to a second aspect of the present invention, the method comprising: Upon completion of the collection of the passenger's first portrait photo and biometric information, in response to the passenger's photo entry instruction, the passenger's passport information is read; Obtain a passport photo from the passport information and take a portrait of the passenger to obtain a second portrait photo; Using the passport photo, find the first portrait photo that matches the passport photo and the biometric information corresponding to the first portrait photo; The biometric information, the passport photo, and the second portrait photo are bound together as a master data pair, and the master data pair is stored.

[0010] According to some embodiments of the present invention, after obtaining the second portrait photograph, the method further includes: If no first portrait photo matching the passport photo is found, the passenger is prompted to re-enter the biometric information.

[0011] According to some embodiments of the present invention, after finding the first portrait photo matching the passport photo and the biometric information corresponding to the first portrait photo, the method further includes: Delete the collected first portrait photo and the biometric information.

[0012] According to some embodiments of the present invention, after storing the master data pair, the method further includes: In response to the host device's instruction to acquire the master data, the master data is uploaded to the host device, and the host device verifies the passenger's identity information based on the master data.

[0013] The embodiments of this application include at least the following beneficial effects: This application provides a biometric information collection system, method, and related equipment. The biometric information collection system in this solution includes a front-end biometric information collector for collecting a passenger's first portrait photo and biometric information; a front-end database connected to the front-end biometric information collector for receiving the first portrait photo and biometric information, and binding the portrait photo and biometric information as a front-end data pair, with the portrait photo serving as the index data of the front-end data pair; a front-end business host for reading the passenger's passport to obtain a passport photo and collecting the passenger's second portrait photo; a face comparison server connected to both the front-end database and the front-end business host for obtaining the front-end data pair from the front-end database when receiving the passport photo from the front-end business host, matching and determining the front-end data corresponding to the passport photo through a face comparison algorithm, and binding the passport photo and the corresponding biometric information as a passport data pair; and a main database connected to both the front-end business host and the face comparison server for receiving passport data pairs from the face comparison server, binding the passport data pairs with the second portrait photo from the front-end business host as the main data pair, and storing them. The biometric information collection system in this embodiment uses a front-end biometric information collector to capture a passenger's first facial image and biometric information. The passenger then scans their passport using a front-end service host to obtain a passport photo and a second facial image. When the first and passport photos are matched, the matching of the passport photo, second facial image, and biometric information is confirmed. The passport photo, second facial image, and biometric information are then bound and stored, completing the acquisition of the passenger's biometric information. In this embodiment, by having the front-end biometric information collector first collect biometric information, followed by image information matching via a facial recognition server, and finally binding passport information and biometric information in the main database, compared to the method of entering biometric information after scanning passport information, this invention separates the entry process into front-end biometric information collection, facial recognition server matching, and main database binding. This reduces the time passengers spend entering information, alleviates queuing issues when there are many passengers, and advances the biometric information collection step before formal border inspection, reducing passenger waiting time for clearance and improving clearance efficiency. Attached Figure Description

[0014] The present invention will be further described below with reference to the accompanying drawings and embodiments, wherein: Figure 1 This is a schematic diagram of the structure of a bioinformatics acquisition system provided in an embodiment of the present invention; Figure 2 A flowchart illustrating the main workflow of the biometric data collection system for passenger clearance provided in this embodiment of the invention; Figure 3 This is a schematic diagram of the structure of the pre-positioned bio-information collector provided in an embodiment of the present invention; Figure 4This is a schematic diagram of the workflow of the pre-positioned bio-information collector provided in an embodiment of the present invention; Figure 5 The control flow diagram of the front-end business host provided in the embodiment of the present invention; Figure 6 A flowchart of a bioinformatics acquisition method provided in an embodiment of the present invention; Figure 7 This is a schematic diagram of the matching failure handling process provided in an embodiment of the present invention. Detailed Implementation

[0015] Embodiments of the present invention are described in detail below. Examples of these embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present invention, and should not be construed as limiting the present invention.

[0016] In the description of this invention, it should be understood that the orientation descriptions, such as up, down, front, back, left, right, etc., are based on the orientation or positional relationship shown in the accompanying drawings. They are only for the convenience of describing this invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limiting this invention.

[0017] In the description of this invention, "several" means one or more, "multiple" means two or more, "greater than," "less than," and "exceeding" are understood to exclude the stated number, while "above," "below," and "within" are understood to include the stated number. The use of "first" and "second" in the description is merely for distinguishing technical features and should not be construed as indicating or implying relative importance, or implicitly indicating the number of indicated technical features, or implicitly indicating the order of the indicated technical features.

[0018] In the description of this invention, unless otherwise explicitly defined, terms such as "set up," "install," and "connect" should be interpreted broadly, and those skilled in the art can reasonably determine the specific meaning of the above terms in this invention in conjunction with the specific content of the technical solution.

[0019] In the description of this invention, the terms "one embodiment," "some embodiments," "illustrative embodiment," "example," "specific example," or "some examples," etc., refer to specific features, structures, materials, or characteristics described in connection with that embodiment or example, which are included in at least one embodiment or example of the invention. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples.

[0020] This embodiment provides a bioinformatics acquisition system, such as Figure 1 As shown, the system mainly includes: a front-end biometric data collector 11, a front-end database 12, a front-end business host 13, a facial recognition server 14, and a main database 15. The specific functions are as follows: Pre-positioned biometric information collector 11: As a front-end data collection node, it directly interacts with passengers passing through the port of entry and exit, completes the on-site collection of passengers' biometric information such as face and fingerprints, and uploads the collected biometric data to the pre-positioned database 12 in real time.

[0021] Front-end database 12: Deployed in the on-site computer room at the import and export port, it runs a dedicated site database and is responsible for receiving and temporarily storing the bioinformatics data uploaded by the front-end bioinformatics collector 11, ensuring the security and real-time nature of local data storage.

[0022] Front-end business host 13: Deployed at the border inspection station, it connects to peripherals such as passport readers and biometric data collection machines. It is responsible for reading passport information, initiating face comparison requests, receiving comparison results, and submitting the final binding data to the back-end server.

[0023] Facial recognition server 14: Deployed in the import and export port data center, equipped with a facial recognition database and high-performance recognition algorithm, it receives biometric information pushed by the front-end database 12 and responds to the recognition request of the front-end business host 13 to complete the 1 to N accurate comparison of "passport photo - on-site face".

[0024] Main database 15: As the core data storage node of the port, it receives and permanently stores passport photos and second-person photos from the front-end business host 13, as well as comparison records from the facial recognition server 14, forming a complete biometric information file for passengers to support subsequent customs clearance business inquiries and traceability.

[0025] Based on the biometric information collection system disclosed in the above embodiments, the main workflow of the biometric collection system during passenger clearance is as follows: Figure 2 As shown, it includes: S201, the first portrait photo and biometric information are collected using the pre-embedded biometric information collector 11. The first portrait photo and biometric information are bound together as a pre-embedded data pair, and the pre-embedded data pair is stored in the pre-embedded database 12. S202, use the front-end business host 13 to scan the passport and obtain the passport photo and the passenger's second portrait photo; S203, using the facial recognition server 14 to match the first facial image and the passport photo, determine the preceding data corresponding to the passport photo, and bind the passport photo and the corresponding biometric information as a passport data pair; S204, use the main database 15 to bind the passport data pair and the second portrait photo from the front-end business host 13 as the main data pair and store them.

[0026] In some embodiments, the pre-positioned biometric data collector 11 adopts an integrated hardware and software design, with a compact hardware structure and convenient operation, and can be directly deployed in the collection area of ​​the port arrival hall, as shown in the schematic diagram. Figure 3 As shown, its hardware components comprise six major functional modules, including: Face camera module 301: It adopts a dual camera system with visible light and infrared light, installed in the center of the top of the terminal. The lens angle can be finely adjusted to adapt to passengers of different heights. The visible light camera is used to capture clear facial images of passengers to meet the accuracy requirements for subsequent comparison. The infrared camera, combined with a liveness detection algorithm, can effectively identify forgery methods such as photos and videos to prevent false identity information.

[0027] Touchscreen module 302: It features an 8-inch capacitive touchscreen that supports multi-touch and provides a graphical user interface. Passengers can select their language and confirm the data collection results via touch, and the font size can be adaptive to suit the needs of passengers with different vision. Speaker and Interface Module 303: The stereo embedded speaker supports multilingual voice broadcasting (Chinese, English, Japanese, Korean, Russian, and Arabic by default, and the language can be expanded through the backend). The broadcast volume is adjustable. The interface includes one Gigabit Ethernet port, two USB 3.0 ports, one HDMI port, and one DC power port. All interfaces are designed with dust covers to adapt to the complex use environment at the port.

[0028] QR code module 304: This is a passive QR code camera, installed below the touchscreen on the front of the terminal. The lens is oriented to match the passenger's operating perspective, allowing passengers to easily scan paper arrival cards or electronic devices by holding them close. After being invoked via system software commands, it can accurately recognize two types of core QR codes: the unique QR code on foreigners' paper or electronic arrival cards, and the electronic arrival declaration QR code generated by passengers through official border inspection mini-programs or apps. During recognition, it supports automatic focus and distortion correction, correctly recognizing QR codes of different materials and sizes. Once a QR code is successfully recognized, the module encrypts and transmits the decoded information to the control motherboard module, which then simultaneously pushes it to the touchscreen display for passenger confirmation of accuracy. Simultaneously, it connects to the site server via a dedicated business network to retrieve the passenger's previously submitted basic entry information and declaration data, achieving pre-association of "QR code information - biometric collection - entry information," reducing repetitive data entry by passengers and further shortening the overall data collection time.

[0029] Ten-finger data acquisition module 305: It is a three-screen ten-fingerprint scanner that supports both dry and wet fingerprint collection. Passengers can place all ten fingers of both hands on the corresponding collection areas at once. The device automatically completes fingerprint image collection, cutting, and quality judgment. The collection time is ≤3 seconds, and the screen displays the fingerprint collection status in real time. A green highlight indicates that the fingerprint has been successfully collected, reducing the passenger's operation error rate.

[0030] Control motherboard module 306: It adopts a 3.5-inch domestic Phytium processor motherboard, pre-installed with the domestic Galaxy Kylin V10 operating system Phytium version, is compatible with domestic encryption algorithms, meets the Level 3 security requirements of the Information Security Protection System, and serves as the core control unit of the terminal. It runs the data acquisition system software, coordinates the collaborative work of various hardware modules, and establishes an encrypted data connection with the site server through the business private network.

[0031] In addition to the aforementioned hardware components, to ensure that the front-end biometric data collector 11 can reliably perform the collection of the passenger's first facial photograph and biometric information, this embodiment further describes the program architecture of the front-end biometric data collector 11, which includes: 1. Main module of the data acquisition program As the core scheduling unit of the software, it is responsible for initializing each sub-module, monitoring the module's running status, and calling sub-modules such as face acquisition, ten-finger acquisition, and data reporting in the order of business process. When a module fails, it automatically pauses the current process and displays fault prompts and contact information for maintenance personnel through the touch screen to ensure a rapid response to problems.

[0032] 2. Facial Image Acquisition Submodule The facial camera module is controlled to complete facial image acquisition, integrating three core algorithms: a liveness detection algorithm that captures facial skin texture and blood flow signals through an infrared camera to reject forged materials such as photos and videos; a mask judgment algorithm that detects whether passengers are wearing masks and prompts "Please remove your mask before acquisition" when wearing them; and a blur judgment algorithm that automatically analyzes the clarity and lighting uniformity of the acquired image and prompts "Please adjust your posture and re-acquire" when the blur exceeds the threshold. After successful acquisition, a facial image data file is generated and a timestamp and terminal number are added for easy traceability.

[0033] 3. Bioinformatics Acquisition Instrument This device is used to collect at least one biometric feature, including fingerprints, irises, voiceprints, palm prints, and subcutaneous veins. The biometric data acquisition unit can be a ten-finger acquisition submodule, used to complete fingerprint acquisition, including fingerprint image preprocessing, fingerprint cutting, and quality assessment. It also displays the progress of ten-finger acquisition in real time via a touchscreen. If the quality of a particular fingerprint is substandard, it will individually prompt that fingerprint to "press again," without requiring the entire fingerprint to be re-acquired.

[0034] 4. Program Interface Submodule It provides a multilingual graphical interface with five core pages: a page displaying six default language icons for passengers to click and enter the language selection page for subsequent processes; a face capture page displaying a real-time preview of the camera image with an overlaid face frame prompting "Place your face within the frame"; a ten-finger capture page displaying a diagram of the ten-finger capture area and marking the corresponding position of each finger; a confirmation submission page displaying the "Face image captured" and "Fingerprint captured" statuses and providing "Confirm Submission" and "Re-capture" buttons; and a result page displaying "Capture complete, proceed to the inspection counter" when capture is successful and "Network error, please try again" when capture fails. It also supports automatic switching between light and dark modes to avoid glare on the interface under strong light.

[0035] 5. Voice Broadcast Submodule Voice prompts are triggered synchronously with various business processes, such as "Please select a language you are familiar with" on the language selection page, "Please face the camera and remove your mask" on the facial recognition page, and "Please place your ten fingers on the corresponding areas" on the ten-finger recognition page. The backend can modify the voice content through configuration files and supports adding port-specific prompts.

[0036] 6. Data Reporting Submodule The collected facial and fingerprint data are packaged in an encrypted format and uploaded to the site server via the business network. The data can be resumed after interruption. After successful upload, the site server will send a "data reception confirmation" and a backup will be stored locally for 3 days.

[0037] When a passenger operates the front-mounted biometric data collector 11 to initiate the collection of the first person's image and biometric information, the main workflow of the front-mounted biometric data collector 11 is as follows: Figure 4 As shown, it includes: Step S401: System Initialization and Language Selection After receiving the passenger's interactive command, the front-end data acquisition terminal is powered on and automatically completes a hardware self-test. After the self-test is passed, it enters the "language selection page". Foreign travelers can click on the corresponding language icon on the touchscreen, and the system will switch to the corresponding language interface and announce, "Welcome to the ID-free data collection service. Please proceed with the face collection."

[0038] Step S402: Facial Image Acquisition and Quality Verification The system enters the "Face Image Acquisition Page", the face camera is activated, and the touch screen displays a real-time preview. Passengers adjust their posture according to the prompts, and the system automatically triggers data collection. If the liveness detection fails, a message will be displayed saying "Please collect the data yourself," and the user will be redirected to preview mode. If the image is blurry, the system will announce "Image is not clear, please adjust the lighting" and re-capture the image. After successful data collection, the system will announce, "Face collection complete. Next step: fingerprint collection."

[0039] Step S403: Ten-finger data collection and progress feedback The system automatically switches to the "Ten-Finger Collection Page," displays a diagram of the ten-finger collection area, and announces, "Please place your ten fingers on the corresponding areas." Passengers place their hands as shown in the diagram, and the system collects all ten fingerprints at once, highlighting the collected fingers in green on the touchscreen in real time. If a fingerprint is blurry, incomplete, or does not meet the quality standards, a message will be displayed for that finger: "Please press again." This process will continue until all fingerprints are successfully collected, at which point the message "Fingerprint collection complete" will be announced.

[0040] Step S404: Second facial re-photographing and consistency comparison The system automatically enters the "second facial re-shoot" process, repeating the acquisition and verification logic of step 2 to obtain a second facial image; The local face comparison algorithm is invoked to perform a one-to-one comparison between the two captured facial images: Verification successful: "Identity consistency verification successful," proceed to the next step; Comparison failed: "The two images are inconsistent, please start again", and return to step 2; Objective: To ensure that fingerprints and facial images come from the same passenger, and to prevent issues such as proxy collection and mixed collection.

[0041] Step S405: Data Confirmation and Submission The system enters the "Confirmation and Submission Page," displaying the statuses "Face has been collected" and "Fingerprint has been collected," and announces "Please confirm the collection results and click Submit." When a passenger clicks the "Confirm Submission" button, the system calls the data reporting submodule to upload the encrypted biometric information to the front-end database 12 via the business private network; If the passenger clicks "Re-collect", the process will return to step 2 and restart.

[0042] Step S406: Feedback on data reporting results If the data upload is successful, the system will enter the "Data Collection Completed" page, display "Data collection successful! Please proceed to the inspection station to pass through customs" and play the corresponding voice message. After 10 seconds, it will automatically return to step 1. If data upload fails, the system will enter the "Network Error Page," displaying "Data upload failed. Please check your network or contact staff," and will play a voice message. The system will provide two buttons, "Retry Upload" and "Re-collect," for passengers to choose from.

[0043] After acquiring the passenger's first facial image and biometric information, the front-end biometric information collector 11 can guide the passenger to the next destination, namely the location of the front-end business host 13. Simultaneously, the front-end biometric information collector 11 can send the collected biometric information and the first facial image to the front-end database 12, which then binds the information of the first facial image and biometric information. The front-end database 12 binds the first facial image and biometric information into a front-end data pair and stores the front-end data pair. Although the passenger's biometric information has been entered at this point, it has not yet been bound to the passenger's complete identity information; therefore, the entered information is incomplete. Entering complete information, i.e., directly entering the passenger's identity information and biometric information at the facial recognition server 13, can easily lead to a long entry time. In situations with a large number of passengers, this could easily cause congestion due to the slow progress of this service. Therefore, in this embodiment, a front-end biometric information collector 11 is set up to quickly input biometric information and the first person's photo information, shortening the biometric information input time. Subsequently, the tourist's identity information is input at the image comparison server 13, and the identity information is bound to the biometric information. When the previous passenger completes biometric information collection and proceeds to the front-end service host 13 for further photo collection, several passengers can utilize the time the previous passenger occupied the front-end service host 13 to conduct self-collection at several front-end collection machines, staggering inspection times and maximizing the use of inspector manpower. Since the number of front-end service hosts 13 and inspectors is limited, setting up independent front-end biometric information collectors 11 can reduce the time each passenger spends on the front-end service host 13 for biometric information collection. Inspectors can also reduce the time spent at the front-end service host 13, allowing them to efficiently complete other important tasks such as verifying document authenticity and purpose of visit within the limited time, rather than wasting time helping passengers collect biometric information. Multiple front-end biometric information collectors 11 can be set up at the exit gate, waiting hall, etc., for convenient self-service use by passengers.

[0044] Because there is a time lag between the entry of identity information and biometric information, other passengers may have already completed their biometric information entry by the time identity information is completed. In this case, the identity information needs to be accurately matched among multiple biometric data to determine if the biometric and identity information of the same passenger matches. To achieve this matching, the front-end biometric data collector 11 also needs to collect first-person image information while collecting biometric information. This information serves as index data for the front-end information pair. After detecting image information from other devices that matches the first-person image, the location of the identity information matching the biometric information can be determined.

[0045] In this embodiment, the pre-construction biometric data collector 11 and the pre-construction database 12 can prioritize the collection of biometric information, reduce the queuing time for subsequent information collection, and reduce the probability of passengers being stranded due to waiting for a longer information entry process, which may cause congestion.

[0046] In some embodiments, the biometric information collection system further includes a front-end service host 13, which is located at the inspection counter at the port of entry / exit, where passengers further verify their identity information. After completing the preliminary data entry and arriving at the inspection counter, passengers need to further enter their identity information at the front-end service host 13. The entered identity information can be completed by the passenger operating the front-end service host 13 to scan their passport. The front-end service host 13 uses a scanning device to read the passenger's identity information recorded in the passport, which includes at least the passport photograph.

[0047] During the process of a passenger moving from the front-end biometric data collector 11 to the front-end business host 13, other passengers may also complete the entry of their biometric information. Therefore, in order to determine the biometric information that matches the identity information, information matching needs to be performed. In order to achieve a new, fast, and accurate matching, information matching needs to be performed based on index data. The index data of the front-end data pair is the portrait photo collected during the passenger's biometric information entry process. Therefore, performing information matching also requires the portrait photo entered by the front-end business host 13. This embodiment emphasizes that the front-end business host 13 needs to enter at least a passport photo and a second portrait photo of the passenger. The passport photo is used to compare the portrait with the first portrait photo to determine whether the passport information and biometric information come from the same person. The second portrait photo is used to store the passenger's real-time portrait.

[0048] In some embodiments, the front-end service host 13 includes: 1. Core Processing Unit: It employs a high-performance, highly stable industrial control computer or ruggedized computer with abundant I / O interfaces (such as USB, serial port, RJ45, Wi-Fi / Bluetooth modules). It runs a customized border inspection business operating system or a security-hardened commercial operating system, carrying the client application of this invention.

[0049] 2. Passport reader: This device typically integrates a contactless chip reader with an optical character recognition module. When a passport is placed in the reading area or inserted into the card slot, the device first uses an optical scanner to read the machine-readable area of ​​the passport's data page, quickly decoding text information such as the passport number, name, and date of birth. Simultaneously, it uses radio frequency technology to read the electronic chip embedded in the passport. The chip stores a digitized, highly secure passport photograph, as well as encrypted personal information. The reader decrypts and verifies the chip data to ensure the authenticity and integrity of the photograph. The device then transmits the decoded text information and the decrypted standard passport digital photograph to the front-end business host application via USB or serial port.

[0050] 3. Dedicated Inspection Camera: Deployed in front of or above the workbench, this camera is specifically designed to capture the real-time facial features of passengers during inspection, i.e., a second portrait photo. To ensure image quality, the camera must have sufficient resolution, autofocus, wide dynamic range to adapt to possible lighting differences within the passageway, and infrared illumination capability for stable imaging in all weather conditions. This camera is directly controlled by an application program on the front-end business host. When data capture is needed, the software triggers the camera to take a single or continuous shot, selecting the clearest and most suitable image.

[0051] 4. Auxiliary interactive devices: Displays: These show operators or passengers operating instructions, passport information, comparison results, and prompts. In self-service channels, touchscreens are the primary human-computer interaction interface.

[0052] Physical / virtual keyboard: Allows operators to input additional information or execute control commands.

[0053] Indicating devices, such as status indicator lights (red / green / yellow) and voice announcements, are used to guide passengers with phrases like "Please approach," "Please look at the camera," "Please retrieve your documents," and "Pass."

[0054] Backup biometric data acquisition device: Used to collect biometric information such as fingerprints on-site when facial recognition fails. It serves as a backup device under the management of the front-end business host.

[0055] In some embodiments, when passengers or staff use the front desk service host, such as Figure 5 As shown, its main usage steps include: Step S501: Initiating the process and reading the passport When a passenger or staff member clicks the "Start Verification" button on the software interface or places their passport into the reader, the software automatically detects the passport using sensors and initiates the passport verification process.

[0056] Step S502: Acquire the second portrait photo After confirming that the passport information has been read correctly, the software automatically proceeds to the next step. The screen will display a clear prompt (such as "Please look directly at the camera ahead") and may be accompanied by an audio announcement. Simultaneously, the auxiliary light on the inspection camera may illuminate to instruct the passenger to adjust their posture. The software performs real-time face detection via video stream. When a face that meets the criteria (size, angle, clarity) is detected in the frame, a high-definition snapshot will be automatically triggered.

[0057] To ensure quality, the software may capture multiple images in quick succession (e.g., 3-5 images) and use a built-in image quality assessment algorithm to automatically select the image with the clearest facial features, most even lighting, open eyes, and most upright posture as the final second portrait photo. A notification sound or interface feedback (such as "Photo taken successfully") is usually provided at the moment of successful capture.

[0058] If a qualified photo cannot be obtained after several attempts (e.g., the passenger is wearing a mask or looking down excessively), the software will prompt staff to intervene manually (e.g., "Please remove the mask" or "Please adjust your posture").

[0059] Step S503: Data Encapsulation and Request Sending The software encapsulates the following key data into a structured comparison request data packet, which may include: Request ID: A unique identifier for this verification transaction; Passport digital photograph: An official photograph of the traveler read from the chip; Second portrait photo: The best photo taken on site; Key passport information: passport number, name, etc. (for final archiving).

[0060] Timestamp and Device ID: Collection time, inspection station number.

[0061] The software sends the request data packet to the facial recognition server 14 via a secure network protocol. At this time, the interface may display "Comparing, please wait...".

[0062] If the front-end business host 13 receives a "match successful" response from the facial recognition server 14, the interface of the front-end business host 13 immediately displays a prominent "pass" message and triggers subsequent actions. These subsequent actions include sending the second facial image to the main database 15 so that it can complete the final binding of the main data pair.

[0063] If the front-end business host 13 receives a matching failure or network timeout error from the facial recognition server 14, the interface displays a clear reason for the failure (such as "No pre-stored information found") and activates the degradation process. The software interface will switch to the on-site biometric information collection interface, guiding the operator or passenger to use the backup biometric data collection device to complete the on-site data entry.

[0064] In this embodiment, the front-end service host 13 is mainly used to collect passenger identity information and a second facial image for identity comparison. In this embodiment, the front-end biometric information collector 11 first collects biometric information, and then the front-end service host 13 collects passenger identity information. This separates the collection of passenger information, reducing the likelihood of a long collection process and congestion caused by collecting biometric and identity information simultaneously.

[0065] In some embodiments, the facial recognition server 14 is connected to the front-end database 12 and the front-end business host 13 respectively. When a passport photo is received from the front-end business host 13, the server obtains the front-end data pair in the front-end database 12, matches the first facial photo and the passport photo through a facial recognition algorithm, determines the front-end data corresponding to the passport photo, and binds the passport photo and the corresponding biometric information as a passport data pair.

[0066] The facial recognition server 14 listens on the port connecting the facial recognition server 14 and the front-end business host 13, and receives request data packets from the front-end business host 13. The request data packet contains information such as the request ID, passport photo, timestamp, and device ID. The facial recognition server 14 decodes the data packet and performs basic verification (such as format verification and source IP whitelist verification). If verification fails, an error response is immediately returned. If the front-end host transmits the original passport photo, the server needs to run a facial feature extraction algorithm, which converts a passport photo into a high-dimensional feature vector. This vector is a unique and efficient mathematical representation of the face in the photo and is the cornerstone of subsequent comparisons.

[0067] The facial recognition server 14 does not request the front-end database 12 to return all data. Instead, it initiates a feature-based similarity search query. The core of the query is: "Find the N records in all stored front-end data pairs where the facial feature vector of the first portrait photo is most similar to the feature vector of the passport photo." The pre-database 12 can establish vector indexes for each first portrait photo. During the query process, the portrait comparison server uses these vector indexes to quickly find several candidate vectors most similar to the passport photo and their associated complete records in the pre-database 12. The pre-database 12 sends pre-data pairs with high matching degrees to the passport photo to the portrait comparison server 14. If there is a first portrait photo with a score higher than a threshold, and its score is significantly higher than other pre-data pairs, then a match is considered successful. The server will determine that this pre-data pair is the pre-data pair corresponding to the passport photo.

[0068] If the facial recognition server 14 confirms that the matching degree between the index data in the front-end database and the passport photo is low, then a matching failure has occurred. The facial recognition server 14 returns a failure response and reason code to the front-end business host 13.

[0069] In some embodiments, when it is confirmed that the first portrait image of the preceding data pair matches the passport photo successfully, and the portrait comparison server retrieves the preceding data pair from the preceding database 12, the preceding data pair is deleted from the preceding database, thereby realizing the rapid release of memory of the preceding database 12.

[0070] In some embodiments, the master database 15 is connected to the front-end business host 13 and the facial recognition server 14 respectively, and is used to receive passport data pairs from the facial recognition server 14, bind the passport data pairs with the second facial photo from the front-end business host 13 as master data pairs and store them.

[0071] The main database 15 receives a second-person photo from the front-end business host and a passport data pair from the facial recognition server, binds these data into a complete passenger biometric profile, and stores it securely and persistently, providing a unique and accurate data foundation for subsequent operations throughout the port.

[0072] In some embodiments, the master database 15 is also connected to a host device, which can extract stored passport data pairs and second facial images from the master database 15. For example, the host device can be a verification device. When a passenger passes through the port for the second time, if the verification device finds that the passenger has already entered biometric information in the master database 15, it can notify the passenger that they do not need to enter biometric information again.

[0073] Please see Figure 6 This application also provides a method for collecting bioinformatics, the method comprising: Step S601: After completing the collection of the passenger's first portrait photo and biometric information, in response to the passenger's photo entry instruction, the passenger's passport information is read.

[0074] The passenger has already completed the initial photo and biometric data entry at the pre-entry biometric data collector 11. At this point, the passenger's initial photo and biometric data are stored as a pre-entry data pair in the pre-entry database 12. The passenger then leaves the pre-entry area and proceeds to the inspection station.

[0075] The input instruction is typically generated by a specific action taken by the passenger on the front-end service host 13. This can take the form of staff inserting the passenger's passport into the passport reader, or in a self-service channel where the passenger inserts their passport into the designated reader slot according to on-screen prompts. The front-end service host 13 responds to the input instruction by activating the passport reader. The reader uses optical scanning and chip reading technology to decrypt and retrieve all the digital information within the passport, the most crucial of which are the standardized passport photograph and text information such as the passport number and name.

[0076] Step S602: Obtain the passport photo from the passport information and take a portrait of the passenger to obtain a second portrait photo.

[0077] The decrypted digital photograph was extracted from the retrieved passport information. This photograph, a high-standard photo issued by the state, serves as the benchmark for subsequent facial recognition.

[0078] The dedicated camera integrated into the front-end business host 13 simultaneously captures a second portrait photo, used to record the passenger's true appearance at the current inspection counter at the specific moment of inspection.

[0079] Step S603: Using the second portrait photo, find the first portrait photo that matches the second portrait photo and the biometric information corresponding to the first portrait photo.

[0080] The front-end business host 13 sends the second portrait photo and passport photo, along with other information, to the facial recognition server 14. The facial recognition server 14 uses the passport photo as the search criterion and performs a massive search in the front-end database. The server extracts the feature vector from the passport photo. It then initiates a 1:N similarity search query in the front-end database 12. Using the vector index of the front-end database 12, it quickly identifies the top few candidate records in the front-end database 12.

[0081] The facial recognition server performs detailed comparisons and scoring on the candidate results. If the similarity score of a candidate record exceeds a preset strict threshold, it is determined that the first facial image in that record belongs to the same person as the current passport photo. Furthermore, the biometric information bound to that record is also determined to belong to the current traveler.

[0082] Facial recognition servers can also use a second facial image to verify the matching results, forming a double layer of protection to ensure the absolute reliability of the identity chain.

[0083] Step S604: Bind the biometric information, passport photo, and second portrait photo as master data pairs and store the master data pairs.

[0084] The facial recognition server 14 sends the successfully matched "passport data pair" (passport photo + corresponding biometric information) to the main database 15. At the same time, the front-end business host 13 also sends the second facial photo and verification context of this verification to the main database 15.

[0085] The main database 15 authoritatively binds three core elements from two independent data streams, including: Passport photo: A traveler's legal identification document.

[0086] Biometric information: A passenger's unique biometric identifier.

[0087] Second portrait photo: Spatiotemporal evidence of the passengers passing through customs this time.

[0088] The master database 15 creates a complete record by binding the passport photo, biometric information, and second portrait photo, which constitutes the master data pair. Each master data pair is assigned a permanently unique ID and accompanied by a precise archiving timestamp. This record is then written to the long-term storage of the master database 15.

[0089] The main database 15 further establishes an index using passport numbers, dates, and other keywords for efficient retrieval during future customs clearance, verification, and tracing.

[0090] In this embodiment, biometric information is first collected by a front-end biometric information collector, then image information matching is completed by a facial recognition server, and finally the passport information and biometric information are bound in the main database. Compared with the method of entering biometric information after scanning passport information, the technical solution of this invention separates the entry process into the collection by the front-end biometric information collector, the comparison by the facial recognition server, and the binding in the main database. This can reduce the time for passengers to enter information and alleviate the queuing phenomenon when there are many passengers.

[0091] In some embodiments, after obtaining the second portrait photograph, the method further includes: If no first-person photo matching the passport photo is found, the traveler will be prompted to re-enter their biometric information.

[0092] In some cases, such as when a passenger has not completed the pre-collection process, or when the appearance of the first portrait photo compared to the passport photo changes due to angle, expression, occlusion, lighting conditions, or time intervals, exceeding the tolerance range of the facial recognition algorithm, or when network issues cause the query to fail and no matching portrait photo can be found, the facial comparison server 14 will return a clear "matching failed" response to the front-end business host 13, along with the reason for the failure. Upon receiving this response, the front-end business host 13 immediately interrupts the normal process and switches to the exception handling module. The front-end business host 13 will activate the connected on-site biometric information collection device (such as a fingerprint scanner or iris camera embedded in the workbench), or remind staff to prepare a handheld collection device. For example, ... Figure 7 As shown, after the facial recognition server 14 determines that the photo matching has failed, the main workflow of the facial recognition server 14 and the front-end business host 13 includes: Step S701: The facial recognition server 14 determines the reason for the matching failure. Step S702, the facial recognition server 14 uploads the reason for failure and the result of the failed match to the front-end business host 13; In step S703, the front-end business host 13 displays the reason for failure and the result of the matching failure, as well as the solution to the reason for failure, and sends the reason for failure and the result of the matching failure to the staff's work terminal. Step S704: The front-end business host 13 initiates the exception handling process based on the displayed failure reason.

[0093] The display interface of the front-end business host 13 will switch to a biometric information collection guidance interface, similar to a front-end data collector, guiding passengers step by step to complete the required biometric data entry. For example, the screen displays an animation of the fingerprint pressing positions, guiding passengers to press all ten fingers in sequence.

[0094] This embodiment can help every passenger complete customs clearance procedures regardless of whether the intelligent matching is successful or not, while ensuring that the national regulations on collecting biometric information of first-time inbound passengers are always met and that no data is missed due to technical reasons.

[0095] In some embodiments, after finding a first portrait photograph that matches the passport photograph and the biometric information corresponding to the first portrait photograph, the method further includes: Delete the first-person portrait photo and biometric information that have been collected.

[0096] After confirming successful reception by the main database 15, the facial recognition server 14 sends a status update command to the preceding database 12, marking the record status of the corresponding preceding data pair as matched or processed. The preceding database 12 periodically (e.g., every 5 minutes) scans the database to find all records with a status of matched or those that have exceeded their time-to-live but are still in a matched state. The preceding database 12 performs a secure deletion operation on these records.

[0097] Front-end database 12 is typically deployed at border crossings, where the physical and network environments are more complex than those of core data centers. Timely deletion of sensitive biometric data can significantly reduce the risk of data leakage when the node is attacked or physically intruded upon. Regularly cleaning up processed data can keep the database lightweight, ensure that the query speed of vector indexes is always at its best, and prevent performance from degrading as data accumulates.

[0098] In some embodiments, after storing the master data pair, the method further includes: In response to the host device's instruction to acquire the master data pair, the master data pair is uploaded to the host device, and the host device verifies the passenger's identity information based on the master data pair.

[0099] The final collected master data pairs can be used by the host device to verify the identity information of passengers passing through customs this time and in subsequent passages. Once the passenger master data pair is collected, it is not necessary to collect the master data pair again if the passenger passes through customs again in the future.

[0100] The embodiments of the present invention have been described in detail above with reference to the accompanying drawings. However, the present invention is not limited to the above embodiments, and various changes can be made within the scope of knowledge possessed by those skilled in the art without departing from the spirit of the present invention. Furthermore, the embodiments of the present invention and the features thereof can be combined with each other unless otherwise specified.

[0101] This application also provides an electronic device, which includes a memory and a processor. The memory stores a computer program, and the processor executes the computer program to implement the above-described method. This electronic device can be any smart terminal, including tablet computers, in-vehicle computers, etc.

[0102] It is understood that the content of the above method embodiments is applicable to this device embodiment. The specific functions implemented by this device embodiment are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.

[0103] This application also provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the above-described method.

[0104] It is understood that the content of the above method embodiments is applicable to this storage medium embodiment. The specific functions implemented in this storage medium embodiment are the same as those in the above method embodiments, and the beneficial effects achieved are also the same as those achieved in the above method embodiments.

[0105] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the above-described method.

[0106] It is understood that the content of the above method embodiments is applicable to the embodiments of this program product. The specific functions implemented by the embodiments of this program product are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.

[0107] Memory, as a non-transitory computer-readable storage medium, can be used to store non-transitory software programs and non-transitory computer-executable programs. Furthermore, memory may include high-speed random access memory, and may also include non-transitory memory, such as at least one disk storage device, flash memory device, or other non-transitory solid-state storage device. In some embodiments, memory may optionally include memory remotely located relative to the processor, and these remote memories can be connected to the processor via a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

[0108] The biometric information collection system, method, and related equipment for first-time customs clearance provided in this application embodiment include: a front-end biometric information collector for collecting a passenger's first facial image and biometric information; a front-end database connected to the front-end biometric information collector for receiving the facial image and biometric information, and binding the first facial image and biometric information as a front-end data pair, with the facial image serving as index data for the front-end data pair; a front-end business host for reading the passenger's passport to obtain a passport photo and collecting the passenger's second facial image; a facial recognition server connected to both the front-end database and the front-end business host for obtaining the front-end data pair from the front-end database when receiving the passport photo from the front-end business host, matching and determining the front-end data corresponding to the passport photo through a facial recognition algorithm, and binding the passport photo and corresponding biometric information as a passport data pair; and a main database connected to both the front-end business host and the facial recognition server for receiving passport data pairs from the facial recognition server, binding the passport data pairs with the second facial image from the front-end business host as the main data pair, and storing them. The biometric information collection system in this embodiment uses a front-end biometric information collector to capture a passenger's first facial image and biometric information. The passenger then scans their passport using a front-end service host to obtain a passport photo and a second facial image. When the first facial image and passport photo are matched, the matching of the passport photo, second facial image, and biometric information is confirmed. The passport photo, second facial image, and biometric information are then bound and stored, completing the acquisition of the passenger's biometric information. In this embodiment, by having the front-end biometric information collector first collect biometric information, followed by image information matching via a facial recognition server, and finally binding passport information and biometric information in the main database, compared to the method of entering biometric information after scanning passport information, this invention separates the entry process into front-end biometric information collection, facial recognition server matching, and main database binding. This reduces the time passengers spend entering information and alleviates queuing issues when there are many passengers.

[0109] The embodiments described in this application are for the purpose of more clearly illustrating the technical solutions of the embodiments of this application, and do not constitute a limitation on the technical solutions provided by the embodiments of this application. As those skilled in the art will know, with the evolution of technology and the emergence of new application scenarios, the technical solutions provided by the embodiments of this application are also applicable to similar technical problems.

[0110] Those skilled in the art will understand that the technical solutions shown in the figures do not constitute a limitation on the embodiments of this application, and may include more or fewer steps than shown, or combine certain steps, or different steps.

[0111] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs.

[0112] Those skilled in the art will understand that all or some of the steps in the methods disclosed above, as well as the functional modules / units in the systems and devices, can be implemented as software, firmware, hardware, or suitable combinations thereof.

[0113] The terms “first,” “second,” “third,” “fourth,” etc. (if present) in the specification and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms “comprising” and “having,” and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0114] It should be understood that in this application, "at least one (item)" means one or more, and "more than" means two or more. "And / or" is used to describe the relationship between related objects, indicating that three relationships can exist. For example, "A and / or B" can represent three cases: only A exists, only B exists, and both A and B exist simultaneously, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one (item) of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one (item) of a, b, or c can represent: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, and c can be single or multiple.

[0115] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of the units described above is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0116] The units described above as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0117] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0118] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes multiple instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned storage medium includes various media capable of storing programs, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0119] The preferred embodiments of the present application have been described above with reference to the accompanying drawings, but this does not limit the scope of the claims of the present application. Any modifications, equivalent substitutions, and improvements made by those skilled in the art without departing from the scope and substance of the embodiments of the present application shall be within the scope of the claims of the present application.

Claims

1. A bioinformatics acquisition system, characterized in that, The system includes: The front-mounted biometric data collector is used to collect the passenger's first-person photograph and biometric information; A front-end database, connected to the front-end biometric information collector, is used to receive the first portrait photo and the biometric information, and bind the first portrait photo and the biometric information as a front-end data pair, with the first portrait photo serving as the index data of the front-end data pair; The front-end business host is used to read passengers' passports to obtain passport photos and to collect passengers' second-person portrait photos; A facial recognition server is connected to the front-end database and the front-end business host respectively. When the passport photo is received from the front-end business host, the server obtains the front-end data pair from the front-end database, matches the first facial photo and the passport photo through a facial recognition algorithm, determines the front-end data corresponding to the passport photo, and binds the passport photo and the corresponding biometric information as a passport data pair. The main database is connected to both the front-end business host and the facial recognition server. It is used to receive the passport data pairs from the facial recognition server, bind the passport data pairs to the second facial image from the front-end business host as the main data pairs, and store them.

2. The system according to claim 1, characterized in that, The front-facing biometric data acquisition device includes a front-facing camera and at least one biometric data acquisition instrument; the front-facing camera is used to capture the passenger's image to generate a front-facing photo; the biometric data acquisition instrument is used to collect at least one biometric feature including fingerprint, iris, voiceprint, palm print, and subcutaneous vein.

3. The system according to claim 1, characterized in that, The preceding database is also used to: delete the preceding data pair from the preceding database when the portrait photo and the passport photo are successfully matched and the portrait comparison server obtains the preceding data pair from the preceding database.

4. The system according to claim 1, characterized in that, The master database is also used to connect to a host device, which is used to obtain the master data from the master database.

5. A method for collecting biometric information from passengers clearing customs, characterized in that, The method includes: After completing the collection of the passenger's first portrait photo and biometric information, in response to the passenger's photo entry instruction, the passenger's passport information is read; Obtain a passport photo from the passport information and take a portrait of the passenger to obtain a second portrait photo; Using the passport photo, find the first portrait photo that matches the passport photo and the biometric information corresponding to the first portrait photo; The biometric information, the passport photo, and the second portrait photo are bound together as a master data pair, and the master data pair is stored.

6. The method according to claim 5, characterized in that, After obtaining the second portrait photograph, the method further includes: If no first portrait photo matching the passport photo is found, the passenger is prompted to re-enter the biometric information.

7. The method according to claim 5, characterized in that, After finding the first portrait photo matching the passport photo and the biometric information corresponding to the first portrait photo, the method further includes: Delete the collected first portrait photo and the biometric information.

8. The method according to claim 5, characterized in that, After storing the master data pair, the method further includes: In response to the host device's instruction to acquire the master data pair, the master data pair is uploaded to the host device, and the host device verifies the passenger's identity information based on the master data pair.

9. An electronic device, characterized in that, The electronic device includes a memory and a processor, the memory storing a computer program, and the processor executing the computer program to implement the method of any one of claims 6 to 8.

10. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by a processor, it implements the method of any one of claims 6 to 8.

Images