Access control management method and system with express delivery function

Abstract

The invention discloses an access control management method and system with an express delivery function. The system is composed of an access control machine, an access controller, an access control platform and an express delivery platform, and is also provided with a mobile terminal application to cope with a special access control machine. The method comprises the steps of express waybill scanning, OCR recognition, information extraction, address matching, express state query, elevator calling, model fine adjustment and the like. Express bill information is extracted through an OCR and an entity recognition model, an address is matched through a semantic similarity model, and whether a door is opened or not is determined after an express state is verified. The model can be finely adjusted according to matching failure data to improve the recognition effect. The system improves the delivery efficiency of couriers, reduces the waiting time of recipients, improves the user experience, also has the functions of image enhancement, log recording, exception handling and the like, and is high in practicability.

Description

Technical Field

[0001] The present invention relates to the technical field of access control management, and in particular to an access control management method and system with express delivery function. Background Art

[0002] In the current booming modern express delivery and logistics industry, the efficiency and experience of the "last one hundred meters" of express delivery have increasingly become the focus of attention. Especially when couriers face buildings equipped with access control systems, the existing access procedures expose many drawbacks.

[0003] Currently, when couriers deliver goods to such buildings, they usually rely on the building intercom system to call the recipients, and the recipients remotely control the unlocking before the couriers can enter. If the recipients are out and not at home, the couriers still need to communicate with the recipients repeatedly by phone to reconfirm the delivery time and specific handover location.

[0004] This access procedure not only greatly consumes the time and energy of couriers, with frequent waiting for recipient responses and secondary delivery arrangements, significantly reducing the overall efficiency of express delivery and increasing logistics costs; for recipients, they may be disturbed at busy or inconvenient times, and if they miss the communication, it will cause the package to be delayed, affecting the normal life and work rhythm.

[0005] Therefore, it is urgent to develop a management method and system that can optimize the access procedure of couriers in access-controlled buildings, which can not only improve the timeliness and convenience of express delivery, but also create a better service experience for both couriers and recipients. Summary of the Invention

[0006] The purpose of the present invention is to provide an access control management method and system with express delivery function. By integrating advanced identification and communication technologies, the process for couriers to enter access-controlled buildings is simplified, thereby greatly improving the efficiency of express delivery, reducing the time consumption of recipients, and comprehensively enhancing the overall user experience of express delivery services.

[0007] To achieve the above purpose, the present invention is implemented through the following technical solutions: An access control management system with express delivery function, comprising:

[0008] Access control machine: used to identify user identities, scan and identify express delivery forms using an OCR model, and capture the express delivery forms;

[0009] Access control controller: receives the door opening instruction sent by the access control platform or the access control machine, and controls the opening of the door lock of the gate;

[0010] Access control platform: connects the access control machine and the access control controller, deploys a semantic similarity model, a named entity recognition model, and an OCR model, and processes, analyzes, and matches the information uploaded by the access control machine;

[0011] Express delivery platform: used to query the delivery status of express deliveries, interact with the access control platform, and provide real-time logistics information of express deliveries.

[0012] Furthermore, as an improvement to the technical solution of the present invention, the system further includes a mobile application:

[0013] For some old or third-party access control machines, a QR code with a unique identifier is assigned to each gate. The courier scans the QR code to open the mobile application, and the application reads the unique identifier in the QR code and matches the detailed address information of the gate in the access control platform;

[0014] The mobile application reads the geographical location information of the courier's mobile phone and compares it with the preset geographical location distance of the QR code. If it exceeds the set range, the door opening function is not allowed to be used;

[0015] The courier opens the express delivery order scanning function module in the mobile application to take a photo and identify the express delivery order. The access control platform performs OCR recognition, information extraction, address matching, and express delivery status query on the express delivery order. After successful processing, the platform issues door opening and elevator calling instructions to the local access control controller;

[0016] When the access control machine or the access control controller cannot connect to the platform due to a network failure, the mobile application connects to the Bluetooth of the access control machine or the access control controller and sends the door opening and elevator calling instructions through Bluetooth.

[0017] Furthermore, as an improvement to the technical solution of the present invention, the access control machine is equipped with an image enhancement module. When scanning the express delivery order, it can automatically adjust the image quality according to the brightness and contrast parameters of the express delivery order image, improving the accuracy of OCR recognition.

[0018] Furthermore, as an improvement to the technical solution of the present invention, the access control platform is provided with a log recording module, which details the time, results, and relevant data of each express delivery order scanning, information processing, address matching, express delivery status query, and door opening and elevator calling operations, for subsequent system analysis and fault troubleshooting.

[0019] Furthermore, as an improvement to the technical solution of the present invention, the mobile application is provided with a user feedback interface. Couriers and users can submit problems, suggestions, and abnormal situations encountered during use in the interface. The system background receives and processes the feedback information in real time to continuously optimize the system function.

[0020] Furthermore, as an improvement to the technical solution of the present invention, the system has a docking interface with the property management system, and can synchronize express delivery-related information, including the courier's entry time, departure time, and the number of delivered packages, to the property management system for the property to conduct unified management and data analysis.

[0021] As a further improvement of the technical solution of the present invention, an access control management method with express delivery function includes the following steps:

[0022] Step S1, express bill scanning: When the courier delivers goods to the residential building, scan the express bill at the camera of the access control machine, and the access control machine captures the express bill.

[0023] Express bill OCR recognition:

[0024] Perform image preprocessing on the captured express bill picture, including distortion correction and edge cropping, to improve the accuracy of OCR recognition.

[0025] Send the preprocessed express bill picture to the OCR model for text recognition to recognize the text and numbers on the express bill.

[0026] Step S2, information extraction: Filter out irrelevant information from the text extracted by OCR, and send the useful information to the address named entity recognition model for entity recognition of the express bill number and address. The extracted content includes the express bill number, province, city, administrative region, road, village, community, building, and room number.

[0027] Step S3, address matching: Use the semantic similarity model to perform hierarchical matching on the obtained address and the preset address of the access control machine. Set a passing threshold, and only perform the next-level matching when the similarity is greater than the threshold.

[0028] Allow users to add similar addresses to improve the matching success rate.

[0029] Process the missing address fields. For example, if some fields fail to match but the key information of the community matches successfully, send a text message or APP message to the administrator or user to confirm whether to allow the express to enter; if the matching fails, the access control machine prompts the matching failure and refuses the courier to enter, ending this round of authentication process.

[0030] Step S4, express status query: After the address matching is successful, send a request to the express platform using the obtained express bill number to query the logistics status of the express. If the status is "delivering", the access control machine prompts the matching success and opens the gate; if the status is other statuses, the access control machine prompts the matching failure and refuses the courier to enter.

[0031] Step S5, summon elevator: If the room number is extracted and the building is equipped with an elevator IC card system, the access control machine sends the elevator floor unlocking instruction of the room to the elevator. The elevator automatically arrives at the floor where the access control machine is located and opens the elevator button for the courier to register for taking the elevator.

[0032] As a further improvement of the technical solution of the present invention, an access control management method with express delivery function further includes a model fine-tuning step:

[0033] OCR model: For courier order images that fail to match, the system sends them to the building administrator. The administrator maintains the access control machine address library and adds similar addresses. The administrator can choose to send the image to the platform for retraining and cover sensitive information before sending. The platform receives the image and manually annotates it and maintains it in the OCR model dataset. The platform fine-tunes the OCR model based on the latest dataset and updates it to the access control machine and platform.

[0034] Address named entity recognition model: collects records where address matching fails, uses the name entity recognition model to extract and delete the names in the records, manually labels the order numbers and addresses, and maintains them in the address dataset. The platform uses the dataset for fine-tuning.

[0035] Semantic similarity model: Similar addresses added by users are regularly collected and maintained into a semantic similarity dataset, which the platform uses for fine-tuning.

[0036] As a further improvement of the technical solution of the present invention, in the express status query step, if the express platform cannot return the logistics status information in time, the system automatically enters a waiting state and initiates a query request again after a set time of 30 seconds. If the query fails for three consecutive times, an abnormal prompt message is sent to the courier and the administrator at the same time.

[0037] As a further improvement of the technical solution of the present invention, in the address matching step, when encountering a fuzzy address or an ambiguous address expression, the system automatically calls the big data analysis module, combines historical delivery data and surrounding address information, performs intelligent inference and matching, and improves the success rate and accuracy of matching.

[0038] The present invention has the following beneficial effects:

[0039] Efficient delivery: With advanced OCR recognition, intelligent matching and status query technologies, couriers can quickly enter access control buildings without waiting for the recipient's response, greatly reducing delivery time. At the same time, the system's automatic elevator call function further improves the courier's efficiency in the building, significantly improving overall delivery efficiency and reducing logistics costs.

[0040] Convenient experience: Recipients no longer need to be frequently disturbed by building intercoms or phone calls, nor do they need to take time out of their busy schedule to deal with door opening matters. This truly realizes the "seamless" reception of express delivery, saving recipients a lot of time and energy, allowing them to arrange work and life more calmly.

[0041] Accurate and reliable: Through continuous fine-tuning and optimization of the OCR model, address named entity recognition model and semantic similarity model, the system's recognition and processing of express delivery order information has become more and more accurate. Whether facing complex addresses or special situations, it can respond efficiently, ensuring the accuracy of address matching and express status query, and ensuring the reliable operation of the access control system.

[0042] Security protection: Multiple security mechanisms such as geographical location restrictions and express delivery status verification effectively prevent the abuse of express delivery forms and the risk of illegal door opening. At the same time, the strict handling of sensitive information also fully protects user privacy, building a solid security line for access control management and express delivery.

[0043] Flexible compatibility: For different types of access control machines, the system provides diversified solutions. For example, the mobile application combined with QR code recognition technology can meet the usage requirements of old or third-party access control machines. In addition, the Bluetooth door opening and elevator calling functions in the offline state further enhance the environmental adaptability and stability of the system, ensuring the smooth progress of express delivery work.

[0044] The access control management method of the present invention is driven by technological innovation, deeply integrating express delivery and access control management. It not only improves the service quality and operation efficiency of the express delivery industry, but also provides strong support for the construction of smart communities, with extremely high practical value and broad market application prospects. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] By reading the detailed description of the non-limiting embodiments with reference to the following drawings, other features, objectives and advantages of the present invention will become more apparent:

[0046] Figure 1 It is a schematic diagram of the architecture of an access control management system with express delivery function of the present invention;

[0047] Figure 2 It is a flowchart of an access control management method with express delivery function of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0048] The present invention will be described in detail below in conjunction with the drawings and specific embodiments. Here, the schematic embodiments and descriptions of the present invention are used to explain the present invention, but not to limit the present invention.

[0049] It should be noted that all directional indications (such as up, down, left, right, front, back, upper end, lower end, top, bottom...) in the embodiments of the present invention are only used to explain the relative position relationship and movement conditions between components in a specific posture (as shown in the drawings). If the specific posture changes, the directional indications will also change accordingly.

[0050] In the present invention, unless otherwise clearly defined and limited, the term "connection" shall be understood in a broad sense. For example, "connection" can be a fixed connection, a detachable connection, or an integral one; it can be a mechanical connection or an electrical connection; it can be directly connected or indirectly connected through an intermediate medium, and it can be the communication inside two components or the interaction relationship between two components, unless otherwise clearly limited. For those of ordinary skill in the art, the specific meaning of the above terms in the present invention can be understood according to specific circumstances.

[0051] In addition, in the present invention, descriptions such as "first", "second", etc. are only for descriptive purposes and cannot be understood as indicating or implying their relative importance or implicitly indicating the quantity of the indicated technical features. Thus, features defined with "first" and "second" may explicitly or implicitly include at least one such feature. In addition, the technical solutions between various embodiments can be combined with each other, but it must be based on the fact that those of ordinary skill in the art can implement them. When the combination of technical solutions is contradictory or cannot be implemented, it should be considered that such a combination of technical solutions does not exist and is not within the scope of protection required by the present invention.

[0052] The present invention will be further described in detail below with reference to the accompanying drawings.

[0053] Refer to Figure 1 , an access control management system with express delivery function, including:

[0054] Access control machine: used to identify the user's identity, scan and identify the express waybill using the OCR model, and capture the express waybill;

[0055] Access control controller: receive the door opening instruction sent by the access control platform or the access control machine, and control the opening of the door electric lock;

[0056] Access control platform: connect the access control machine and the access control controller, deploy the semantic similarity model, named entity recognition model, and OCR model, and process, analyze, and match the information uploaded by the access control machine;

[0057] Express delivery platform: used to query the express delivery status, interact with the access control platform, and provide real-time express delivery logistics information.

[0058] It should be noted that as a front-end interaction device, the access control machine can not only accurately identify the user's identity, but also be equipped with an advanced OCR model, which can efficiently scan and identify the express delivery note, providing basic information for subsequent data processing. The access control controller is used to receive the door opening instruction from the access control platform or the access control machine, and through the precise control of the door electric lock, it realizes the opening and closing of the access control, ensuring the security and controllability of the building access. The access control platform, as the core hub of the system, connects the access control machine and the access control controller, and deploys semantic similarity models, named entity recognition models, and OCR models. Through the collaborative work of these models, in-depth processing and analysis of the express delivery note information are realized. The express delivery platform, by docking with major express delivery companies, can query the delivery status of the express delivery in real time, providing accurate logistics information reference for the access control system to ensure that only couriers in the "delivering" state can obtain the access control permission.

[0059] Specifically, in the solution of this embodiment, the system further includes a mobile application:

[0060] For some old or third-party access control machines, a QR code with a unique identifier is assigned to each door. The courier scans the QR code to open the mobile application, and the application reads the unique identifier in the QR code and matches the detailed address information of the door on the access control platform;

[0061] The mobile application reads the geographical location information of the courier's mobile phone and compares it with the preset geographical location distance of the QR code. If it exceeds the set range, the door opening function is not allowed to be used;

[0062] The courier opens the express delivery note scanning function module in the mobile application to take pictures and identify the express delivery note. The access control platform performs OCR recognition, information extraction, address matching, and express delivery status query on the express delivery note. After successful processing, the platform issues door opening and elevator calling instructions to the local access control controller;

[0063] When the access control machine or the access control controller cannot connect to the platform due to a network failure, the mobile application connects to the Bluetooth of the access control machine or the access control controller and sends the door opening and elevator calling instructions through Bluetooth.

[0064] Specifically, in the solution of this embodiment, the access control machine is equipped with an image enhancement module, which can automatically adjust the image quality according to the brightness and contrast parameters of the express delivery note image when scanning the express delivery note, improving the accuracy of OCR recognition.

[0065] Specifically, in the solution of this embodiment, the access control platform is provided with a log recording module, which details the time, results, and relevant data of each express delivery note scanning, information processing, address matching, express delivery status query, and door opening and elevator calling operations, for subsequent system analysis and fault troubleshooting.

[0066] Specifically, in the solution of this embodiment, the mobile application is provided with a user feedback interface, where couriers and users can submit problems, suggestions, and abnormal situations encountered during use. The system background receives and processes the feedback information in real time to continuously optimize the system functions.

[0067] Specifically, in the solution of this embodiment, the system has a docking interface with the property management system, and can synchronize the information related to express delivery, including the entry time, departure time of the courier, and the number of parcels delivered, to the property management system for the property to conduct unified management and data analysis.

[0068] Refer to Figure 2 , specifically, in the solution of this embodiment, an access control management method with express delivery function includes the following steps:

[0069] Step S1, express bill scanning: When the courier delivers goods to the residential building, scan the express bill at the camera of the access control machine, and the access control machine captures the express bill;

[0070] Express bill OCR recognition:

[0071] Perform image preprocessing on the captured express bill picture, including distortion correction and edge cropping, to improve the OCR recognition accuracy;

[0072] Send the preprocessed express bill picture to the OCR model for text recognition to recognize the text and numbers on the express bill;

[0073] Step S2, information extraction: Filter out irrelevant information from the text extracted by OCR, and send the useful information to the address named entity recognition model for entity recognition of the express bill number and address. The extracted content includes the express bill number, province, city, administrative region, road, village, community, building, and room number;

[0074] Step S3, address matching: Use the semantic similarity model to perform hierarchical matching on the obtained address and the preset address of the access control machine, set a passing threshold, and only perform the next-level matching when the similarity is greater than the threshold;

[0075] Allow users to add similar addresses to improve the matching success rate;

[0076] Process the missing address fields. For example, if some fields fail to match but the key information of the community matches successfully, send a text message or APP message to the administrator or user to confirm whether to allow the express to enter; if the match fails, the access control machine prompts a match failure and refuses the courier to enter, ending this round of authentication process;

[0077] Step S4, courier status query: After the address is matched successfully, use the obtained courier number to send a request to the courier platform to query the logistics status of the courier. If the status is "delivery", the access control machine prompts that the match is successful and opens the door; if the status is other states, the access control machine prompts that the match fails and refuses the courier to enter;

[0078] Step S5, calling the elevator: If the room number is extracted and the building has an elevator IC card system installed, the access control machine sends the elevator floor unlocking command of the room to the elevator, and the elevator automatically reaches the floor where the access control machine is located, and opens the elevator button to allow the courier to register to take the elevator.

[0079] Specifically, in this embodiment, a door access management method with express delivery function also includes a model fine-tuning step:

[0080] OCR model: For courier order images that fail to match, the system sends them to the building administrator. The administrator maintains the access control machine address library and adds similar addresses. The administrator can choose to send the image to the platform for retraining and cover sensitive information before sending. The platform receives the image and manually annotates it and maintains it in the OCR model dataset. The platform fine-tunes the OCR model based on the latest dataset and updates it to the access control machine and platform.

[0081] Address named entity recognition model: collects records where address matching fails, uses the name entity recognition model to extract and delete the names in the records, manually labels the order numbers and addresses, and maintains them in the address dataset. The platform uses the dataset for fine-tuning.

[0082] Semantic similarity model: Similar addresses added by users are regularly collected and maintained into a semantic similarity dataset, which the platform uses for fine-tuning.

[0083] It should be noted that in a door access management method with express delivery function of the present invention:

[0084] Express delivery note scanning: When the courier arrives at the resident's building, he only needs to easily scan the express delivery note in front of the access control camera. The access control machine can quickly complete the capture and obtain the express delivery note image information. The operation is convenient and efficient.

[0085] Express delivery order OCR recognition:

[0086] Image preprocessing: Intelligent distortion correction and precise edge cropping are performed on the captured express delivery image, effectively eliminating interference factors in the image acquisition process and significantly improving the accuracy of subsequent OCR recognition.

[0087] Text recognition: The pre-processed high-quality images are sent to the advanced OCR model to quickly and accurately identify the text and digital information on the express delivery slip, laying a solid foundation for subsequent data extraction and analysis.

[0088] Information extraction: Since the OCR recognition result contains all the text on the express bill, including information unrelated to access control. Therefore, the system will intelligently filter the text extracted by OCR, remove irrelevant content such as promotional information and manufacturer information, and use an address named entity recognition model (based on the BERT pre-trained model and fine-tuned specifically using a Chinese address element parsing dataset containing express bill numbers) to structurally extract useful information and accurately obtain key data such as the express bill number, detailed address (including province, city, administrative region, road, village or community, building, room number, etc.).

[0089] Address matching:

[0090] Hierarchical matching: Using a semantic similarity model (also based on the BERT pre-trained model and fine-tuned using a dataset of similar sentences), the extracted address information is compared and matched hierarchically with the addresses preset in the access control machine. A reasonable passing threshold is set, and only when the similarity is greater than the threshold can it enter the next level of matching to ensure the accuracy and reliability of address matching. For example, first perform province similarity matching, and after passing, perform more detailed level matching such as city and administrative region in turn until all address fields are successfully matched.

[0091] Maintenance of similar address information: Considering that human differences in address input may lead to matching failures, the system allows users to flexibly add similar addresses. For example, when the actual name of the community is "Jinxiu Garden", users can add similar expressions such as "Jinxiu Community" and "Jinxiu Park", effectively improving the success rate of address matching and enhancing the adaptability and practicality of the system.

[0092] Processing of missing address fields: For the common problem of missing address fields on the express bill, the system has an intelligent processing mechanism. If some fields fail to match, but the key information of the community can be successfully matched, the system will promptly send a text message or APP notification to the administrator or user, requesting the user to confirm whether to allow the courier to enter. On the premise of ensuring safety, the flexibility of express delivery is maximized. If all matching steps fail, the access control machine will clearly prompt the matching failure and reject the courier from entering, ending this round of authentication process to ensure the security of the access control system.

[0093] Express status query: To prevent the illegal reuse of express delivery slips, after the address matching is successful, the system will immediately conduct a strict verification of the logistics status of the express delivery. Using the express delivery number obtained in step 4, a request is sent to the express delivery platform to query the real-time logistics status of the express delivery. If the status shows "out for delivery", it is determined that the matching is successful, and the access control machine will automatically open the door to allow the courier to enter; if it shows other statuses such as "signed for", it is determined that the matching fails, and the access control machine will prompt to refuse entry, effectively ensuring the security and reliability of the access control system. At the same time, the express delivery platform can flexibly choose to connect to the express delivery aggregation query platform, which has docked the express delivery query API interfaces of most express delivery companies and provides a unified API query interface for third parties to achieve efficient data acquisition. For express deliveries not included in the aggregation platform, the system supports configuring the regular expressions of such express delivery numbers internally. After successful regular expression matching, the corresponding express delivery platform API interface is automatically called to ensure comprehensive support for various express deliveries.

[0094] Summon the elevator (if any): If the room number is successfully obtained in the information extraction in step 4 and the building is equipped with an elevator IC card system, the access control machine will automatically send an elevator floor unlocking instruction to the elevator control system. After receiving the instruction, the elevator will automatically arrive at the floor where the access control machine is located and open the elevator button permission, facilitating the courier to register and take the elevator, further enhancing the convenience and smoothness of express delivery.

[0095] Mobile application (WeChat mini-program or APP):

[0096] QR code recognition and address matching: For some old or third-party access control machines that cannot run the OCR model and install the access control machine application of this system due to hardware or software limitations, the system assigns a unique identifier QR code to each door. The courier only needs to scan this QR code to quickly open the mobile application of this system. The application will automatically read the unique identifier in the QR code and accurately match the detailed address information of the door at the access control platform to achieve convenient identity verification and address association.

[0097] Geographical location restriction: To effectively prevent the QR code from being remotely maliciously scanned to open the door and ensure the security of the access control system, when the mobile application scans the QR code to open, it will read the geographical location information of the courier's mobile phone in real time and accurately compare it with the geographical location preset in the QR code. If the distance between the two exceeds the set range, the system will automatically prohibit the use of the door opening function, eliminating potential safety hazards from the source.

[0098] Courier Waybill Recognition and Operation Instruction Issuance: The courier opens the courier waybill scanning function module in the mobile application and takes a photo of the courier waybill for recognition. The access control platform will perform a series of processes on the courier waybill, such as OCR recognition, information extraction, address matching, and courier status query, according to the established process. If all steps are processed successfully, the platform will promptly issue the door opening and elevator calling instructions to the local access control controller, and the access control controller will precisely control the door opening and call the elevator to open the floor permission, realizing the full-process automated operation.

[0099] Offline Emergency Handling: Considering the possible impact of network failures on the access control system, when the access control machine or access control controller cannot connect to the platform due to network problems, the mobile application can send the door opening and elevator calling instructions to the relevant devices via Bluetooth by connecting to the Bluetooth of the access control machine or access control controller, ensuring that the door opening and elevator calling functions can be normally realized in a network-free environment and guaranteeing the continuity and stability of courier delivery.

[0100] Model Fine-tuning:

[0101] OCR Model: For the courier waybill pictures that fail to match, the system will promptly send them to the building administrator. The administrator can update and maintain the address database of the access control machine according to the accurate address information on the courier waybill, add similar addresses, and improve the system data. At the same time, the administrator can independently choose whether to send the pictures that fail to match to the platform for retraining. Before sending, the system supports intelligent smearing of sensitive information in the pictures to protect user privacy. After receiving the pictures, the platform will perform manual annotation and integrate the annotated information into the OCR model dataset. Based on the latest dataset, the platform performs targeted fine-tuning on the OCR model and promptly synchronizes the updated model to the access control machine and the platform, continuously improving the accuracy and precision of OCR recognition.

[0102] Address Named Entity Recognition Model: The system will regularly collect records of failed address matches. To prevent the leakage of privacy information, the name entity recognition model is used to automatically extract and delete the names in the records. Subsequently, the order numbers and address information in the records after deleting the names are manually annotated, and the annotated data is maintained in the address dataset. The platform uses this dataset to fine-tune and optimize the address named entity recognition model, continuously improving the recognition effect and accuracy of the model for address information.

[0103] Semantic Similarity Model: The system will regularly collect the similar address information added by users, organize and maintain it in the semantic similarity dataset. The platform fine-tunes the semantic similarity model based on this dataset, continuously enhancing the model's recognition ability and matching precision for similar addresses, and further enhancing the intelligence and adaptability of the system.

[0104] Specifically, in the present embodiment, in the express status query step, if the express platform cannot return the logistics status information in time, the system automatically enters a waiting state and initiates a query request again after a set time of 30 seconds. If the query fails for three consecutive times, an abnormal prompt message is sent to the courier and the administrator at the same time.

[0105] Specifically, in the present embodiment, in the address matching step, when encountering a fuzzy address or an ambiguous address expression, the system automatically calls the big data analysis module, combines historical delivery data and surrounding address information, performs intelligent inference and matching, and improves the success rate and accuracy of the matching.

[0106] Daily express delivery scenarios:

[0107] Courier scanning: When the courier arrives at the building where the access control machine of this system is installed, he will place the courier in the designated scanning area of ​​the access control machine camera. The access control machine will quickly capture the courier, and the whole process is fast and convenient, usually completed within 1-2 seconds.

[0108] Express delivery slip OCR recognition: After the capture is completed, the access control machine immediately pre-processes the acquired express delivery slip image. Through advanced distortion correction algorithms, image deformation caused by shooting angles or wrinkles on the express delivery slip itself is eliminated; at the same time, precise edge cropping technology removes excess background, retains the effective information area of ​​the express delivery slip, and greatly improves image quality. The pre-processed image is then sent to the built-in OCR model, which can quickly and accurately recognize the text and digital information on the express delivery slip within 3-5 seconds, with a recognition accuracy of more than 95%.

[0109] Information extraction: The large amount of text information recognized by OCR contains a lot of content that is not related to access control. At this time, the access control machine uses the built-in filtering algorithm to automatically remove redundant data such as discount information and manufacturer information. Subsequently, the filtered text information is sent to the access control platform. The access control platform uses the address named entity recognition model based on the BERT pre-training model and fine-tuned in a targeted manner to deeply extract key information. It can accurately obtain core data such as express delivery numbers, detailed addresses (including provinces, cities, administrative regions, roads, villages or communities, buildings, room numbers, etc.) within 2-3 seconds, providing accurate information support for subsequent processes.

[0110] Address Matching: After the access control platform obtains the extracted address information, it uses a semantic similarity model based on the BERT pre-trained model and fine-tuned with a similar sentence dataset to perform hierarchical matching with the preset addresses of the access control machines. Taking province matching as an example, the model will quickly calculate the semantic similarity score between the two. If the score is higher than the set threshold (such as 0.8), it will continue to perform matching at the city level, and so on. The entire matching process can be completed within 5 - 8 seconds. During the matching process, if a matching failure occurs due to differences in address expressions, the system allows administrators or authorized users to add similar addresses through the background management interface. For example, for the community name "Sunshine Home", similar expressions such as "Sunshine Home Community" and "Sunshine Home Neighborhood" can be added to effectively improve the matching success rate. If some fields of the address on the express delivery note are missing, but the key information of the community can be successfully matched, the system will send a text message or an APP notification to the administrator's or user's mobile phone within 1 - 2 seconds, requesting the user to confirm whether to allow the courier to enter, ensuring the flexibility of delivery. If all matching steps fail, the access control machine will immediately prompt a matching failure and reject the courier from entering.

[0111] Express Delivery Status Query: After the address matching is successful, the access control platform will immediately use the extracted express delivery number to send a query request to the express delivery platform. The express delivery platform can choose to connect to the express delivery aggregation query platform, which integrates the query interfaces of many express delivery companies and can quickly return the real-time logistics status of the express delivery within 3 - 5 seconds. If the status shows "Out for Delivery", the access control machine will emit a prompt sound and automatically open the door within 1 - 2 seconds; if it shows other statuses, such as "Signed for", the access control machine will prompt a matching failure and reject the courier from entering, effectively preventing the illegal use of express delivery notes.

[0112] Summon the Elevator (if any): If the room number is successfully obtained in the information extraction step and the building is equipped with an elevator IC card system, the access control platform will immediately send a floor unlocking command to the elevator control system after confirming that the express delivery status is "Out for Delivery". The elevator will automatically reach the floor where the access control machine is located within 3 - 5 seconds after receiving the command and open the elevator button permission, facilitating the courier to take the elevator to the recipient's floor without the need for the courier to manually operate the elevator.

[0113] Response Scenarios for Special Access Control Machines

[0114] For some old or third-party access control machines, due to hardware performance limitations or software compatibility issues, they cannot directly run the OCR model and install the access control machine application of this system. At this time:

[0115] QR Code Recognition and Address Matching: The system assigns a QR code with a unique identifier to each gate and posts it in a prominent position on the gate. When the courier arrives at the gate, they can use their mobile phone to scan the QR code to open the mobile application (WeChat Mini Program or APP) of this system. The application reads the unique identifier in the QR code within 1 - 2 seconds and sends it to the access control platform via the network. The access control platform accurately matches the detailed address information of this gate within 2 - 3 seconds after receiving the identifier, preparing for subsequent operations.

[0116] Geographical Location Restriction: To prevent the QR code from being maliciously scanned remotely to open the door, when the mobile application is opened, it will immediately read the geographical location information of the courier's mobile phone and compare it with the preset geographical location of the QR code in real time. If the distance between the two exceeds the set range (such as 50 meters), the application will pop up a prompt box within 1 - 2 seconds to prohibit the use of the door opening function, ensuring the security of the access control system.

[0117] Courier Waybill Recognition and Operation Instruction Issuance: After confirming that the geographical location meets the requirements, the courier opens the courier waybill scanning function module in the mobile application and takes a photo of the courier waybill. The application sends the taken photo to the access control platform, and the access control platform performs OCR recognition, information extraction, address matching, and courier status query on the courier waybill according to the same process as a conventional access control machine. If all steps are processed successfully, the platform will issue the door opening and elevator calling instructions to the local access control controller within 3 - 5 seconds. After receiving the instructions, the access control controller immediately controls the opening of the door and the calling of the elevator, making the whole process smooth and efficient.

[0118] Response Scenarios in a Network - Free Environment:

[0119] When the access control machine or access control controller cannot connect to the platform due to a network failure:

[0120] Bluetooth Connection and Instruction Transmission: The courier opens the mobile application and clicks the "Open Door without Network" function button. The application will automatically search for the Bluetooth signal of the nearby access control machine or access control controller and complete the connection within 1 - 2 seconds. After successful connection, the courier enters necessary information such as the courier waybill number in the application. The application encrypts the door opening and elevator calling instructions and sends them to the access control machine or access control controller via Bluetooth within 2 - 3 seconds.

[0121] Local Processing and Operation Execution: After receiving the instructions, the access control machine or access control controller performs information verification and processing locally. If the instructions are legal and valid, the access control controller will immediately control the opening of the door and the calling of the elevator, ensuring that the courier can enter and use the elevator normally, realizing access control and courier delivery in a network - free environment.

[0122] Model Fine - Tuning and Optimization Scenarios

[0123] OCR Model: When the express delivery note matching fails, the access control machine automatically sends the captured express delivery note picture to the management terminal of the building administrator. After the administrator views the picture, if it is found that there are differences in the address information, the administrator can update and maintain the address library of the access control machine in the management interface and add similar addresses. At the same time, the administrator can choose to send the pictures with matching failures to the platform for retraining. Before sending, the system will automatically smear sensitive information in the pictures (such as the recipient's name, phone number, etc.). After the platform receives the pictures, professionals will manually label the information on the pictures within 24 hours and integrate the labeled information into the OCR model dataset. The platform will regularly (such as once a week) fine-tune the OCR model according to the latest dataset and update the latest model to the access control machine and the platform within 1 hour after the fine-tuning is completed, continuously improving the OCR recognition accuracy so that it can better handle various complex express delivery note styles and text contents.

[0124] Address Named Entity Recognition Model: The system background will collect the records of address matching failures in real time and automatically use the name entity recognition model to extract and delete the names in the records to protect user privacy. Subsequently, professionals will manually label the order numbers and address information in the records after deleting the names, and maintain them in the address dataset after the labeling is completed. The platform will fine-tune and optimize the address named entity recognition model once a month according to the updated dataset, continuously improving the recognition accuracy and integrity of the model for address information, so that it can more accurately extract address information in various formats and expressions.

[0125] Semantic Similarity Model: The system will regularly (such as once a week) collect the similar address information added by users during the address matching process, organize and summarize it, and maintain it in the semantic similarity dataset. The platform will fine-tune the semantic similarity model once a quarter according to the latest dataset to further improve the model's recognition ability and matching accuracy for similar addresses, ensuring that the address matching process is more accurate and efficient, and reducing the matching failure cases caused by address expression differences.

[0126] In summary, through the above innovative system composition and method steps, the present invention effectively solves the problems of couriers in accessing buildings with access control. It not only significantly improves the delivery efficiency of couriers, reduces the delivery time and costs, but also realizes the convenient experience that the recipient can complete the delivery of the express without manual handling, greatly reducing the recipient's waiting time. At the same time, through the advanced model fine-tuning mechanism and security protection measures, the accuracy, security and stability of the system are guaranteed, comprehensively improving the overall user experience of the express delivery service, and having broad application prospects and significant social and economic benefits.

[0127] The above has introduced in detail the technical solutions provided by the embodiments of the present invention. Specific examples are used herein to elaborate on the principles and implementation manners of the embodiments of the present invention. The description of the above embodiments is only applicable to helping understand the principles of the embodiments of the present invention. At the same time, for those of ordinary skill in the art, according to the embodiments of the present invention, there will be changes in the specific implementation manners and application scopes. In summary, the content of this specification should not be construed as a limitation to the present invention.

Claims

1. A door access management system with express delivery function, characterized in that: include: Access control machine: used to identify the user, scan and identify the express delivery slip using the OCR model, and take a photo of the express delivery slip; Access controller: receives the door opening command sent by the access control platform or access control machine, and controls the door electric lock to open; Access control platform: connects the access control machine and the access controller, deploys the semantic similarity model, named entity recognition model, and OCR model, and processes, analyzes, and matches the information uploaded by the access control machine; Express delivery platform: used to query the express delivery status, interact with the access control platform, and provide real-time express logistics information.

2. According to claim 1, a door access control management system with express delivery function is characterized in that: The system also includes a mobile application: For some old or third-party access control machines, a QR code with a unique identifier is assigned to each gate. The courier scans the QR code to open the mobile application. The application reads the unique identifier in the QR code and matches the detailed address information of the gate on the access control platform. The mobile application reads the courier's mobile phone geographic location information and compares it with the preset geographic location distance of the QR code. If it exceeds the set range, the door opening function is not allowed; The courier opens the express order scanning function module on the mobile application to take a photo of the express order for identification. The access control platform performs OCR recognition, information extraction, address matching, and express status query on the express order. After successful processing, the platform sends door opening and elevator calling commands to the local access control controller. When the access control machine or access controller cannot connect to the platform due to network failure, the mobile application connects to the Bluetooth of the access control machine or access controller and sends the door opening and elevator calling command via Bluetooth.

3. According to claim 1, a door access control management system with express delivery function is characterized in that: The access control machine is equipped with an image enhancement module. When scanning a courier order, it can automatically adjust the image quality according to the brightness and contrast parameters of the courier order image to improve the accuracy of OCR recognition.

4. The access control management system with express delivery function according to claim 1, characterized in that: The access control platform is provided with a log recording module, which records in detail the time, results and related data of each express delivery order scanning, information processing, address matching, express delivery status query and door opening and elevator calling operation for subsequent system analysis and troubleshooting.

5. The access control management system with express delivery function according to claim 1, characterized in that: The mobile application is provided with a user feedback interface, in which couriers and users can submit problems, suggestions and abnormal situations encountered during use. The system background receives and processes the feedback information in real time to continuously optimize the system functions.

6. The access control management system with express delivery function according to claim 1, characterized in that: The system has an interface with the property management system, which can synchronize express delivery related information, including the courier's entry time, departure time, and number of delivered packages, to the property management system to facilitate unified property management and data analysis.

7. A management method based on the system according to any one of claims 1 to 6, characterized in that: The following steps are involved: Step S1, express delivery order scanning: When the courier delivers the goods to the resident's building, the courier scans the express delivery order at the access control camera, and the access control machine captures the express delivery order; Express delivery order OCR recognition: Perform image preprocessing such as distortion correction and edge cropping on captured express delivery order images to improve OCR recognition accuracy; The pre-processed express delivery slip image is sent to the OCR model for text recognition to identify the text and numbers on the express delivery slip; Step S2, information extraction: Filter irrelevant information from the text extracted by OCR, and send useful information to the address named entity recognition model for entity recognition of the express number and the address. The extracted content includes the express number, province, city, administrative district, road, town, community, building, and room number; Step S3, address matching: Use the semantic similarity model to match the acquired address with the address preset by the access control machine step by step, set a passing threshold, and only proceed to the next level of matching when the similarity is greater than the threshold; Allow users to add similar addresses to improve matching success rate; Processing of missing address fields, such as failure to match some fields but successful matching of key community information, sends a text message or APP message to the administrator or user to confirm whether to allow the courier to enter; if the match fails, the access control machine prompts the match failure, refuses the courier to enter, and ends this round of authentication process; Step S4, courier status query: After the address is successfully matched, use the obtained courier number to send a request to the courier platform to query the logistics status of the courier. If the status is "delivery", the access control machine prompts that the match is successful and opens the door; if the status is other states, the access control machine prompts that the match fails and refuses the courier to enter; Step S5, calling the elevator: If the room number is extracted and the building has an elevator IC card system installed, the access control machine sends the elevator floor unlocking command of the room to the elevator, and the elevator automatically reaches the floor where the access control machine is located, and opens the elevator button to allow the courier to register to take the elevator.

8. A door access management method with express delivery function according to claim 7, characterized in that: It also includes the model fine-tuning steps: OCR model: For courier order images that fail to match, the system sends them to the building administrator. The administrator maintains the access control machine address library and adds similar addresses. The administrator can choose to send the image to the platform for retraining and cover sensitive information before sending. The platform receives the image and manually annotates it and maintains it in the OCR model dataset. The platform fine-tunes the OCR model based on the latest dataset and updates it to the access control machine and platform. Address named entity recognition model: collects records where address matching fails, uses the name entity recognition model to extract and delete the names in the records, manually labels the order numbers and addresses, and maintains them in the address dataset. The platform uses the dataset for fine-tuning. Semantic similarity model: Similar addresses added by users are regularly collected and maintained into a semantic similarity dataset, which the platform uses for fine-tuning.

9. The access control management method with express delivery function according to claim 7, characterized in that: In the express status query step, if the express platform cannot return the logistics status information in time, the system will automatically enter the waiting state and initiate the query request again after the set time of 30 seconds. If the query fails for three consecutive times, an abnormal prompt message will be sent to the courier and the administrator at the same time.

10. The access control management method with express delivery function according to claim 7, characterized in that: In the address matching step, when encountering ambiguous addresses or ambiguous address expressions, the system automatically calls the big data analysis module, combines historical delivery data and surrounding address information, and performs intelligent inference and matching to improve the success rate and accuracy of matching.

Images