Non-inductive warehouse management system and method based on multi-modal authentication fusion

Abstract

The invention relates to a non-inductive warehouse management system and method based on multi-modal authentication fusion, and the system comprises front-end equipment which comprises a face recognition camera, RFID recognition equipment, a voiceprint collector, a gait recognition camera, AR equipment and access control equipment; the back-end server is used for data storage and authority management of employees and warehouse materials; the multi-modal biological recognition fusion module is used for fusing the multi-modal biological characteristics to perform employee identity authentication; the dynamic authority intelligent adaptation module is internally provided with an authority management engine and automatically adjusts the access authority to the warehouse and the material operation range according to the state of the employee; the AR auxiliary sorting module is used for synchronizing the pre-receiving bill of materials of the employees to AR equipment, and the AR equipment provides material position navigation and an optimal sorting path in real time; and the non-inductive warehouse full-process management module is used for realizing automatic warehouse-in and warehouse-out management of material receiving and returning and warehouse access control.

Description

Technical Field

[0001] This invention relates to the field of warehouse management technology, and mainly to a seamless warehouse management system and method based on multimodal authentication fusion. Background Technology

[0002] In traditional warehouse management, a dedicated warehouse manager is typically responsible for comprehensive management. When employees requisition or return materials, they need to manually input or record the data for material entry and exit, apply for separate permissions, and locate the materials, making the process cumbersome. This method not only consumes a lot of time and reduces work efficiency, but is also highly susceptible to errors caused by human error, which in turn affects the accuracy of inventory data.

[0003] For example, in the warehouses of some large manufacturing companies, a large amount of materials enter and leave every day. Warehouse managers need to record information such as the name, specifications, quantity, recipient, and return time of each material. Employees also need to repeatedly check documents and confirm permissions. Even slight negligence can lead to data discrepancies, causing many inconveniences for subsequent production planning, cost accounting, and other processes. In addition, manual management means that companies need to invest more manpower to maintain the normal operation of the warehouse, increasing the company's operational burden.

[0004] Therefore, there is an urgent need for a warehouse management method that is efficient, accurate, intelligent, and enables seamless operation. Summary of the Invention

[0005] To address the problems existing in the prior art, this invention proposes a seamless warehouse management system and method based on multimodal authentication fusion.

[0006] The technical solution of the present invention is as follows: On one hand, this invention proposes a seamless warehouse management system based on multimodal authentication fusion, the system comprising: Front-end equipment includes facial recognition cameras, RFID identification devices, voiceprint collectors, gait recognition cameras, AR devices, and access control devices; The backend server is used for data storage and access control of employee and warehouse materials; A multimodal biometric fusion module is used to fuse multimodal biometric features for employee identity authentication. The dynamic permission intelligent adaptation module has a built-in permission management engine that automatically adjusts employees' access permissions to the warehouse and the scope of material operations based on their status. The AR-assisted picking module is used to synchronize the employee's pre-requisition material list to the AR device, which provides real-time material location navigation and optimal picking path. The seamless warehouse end-to-end management module is used to realize automatic inbound and outbound management of material requisition and return, as well as warehouse access control.

[0007] Preferably, the multimodal biometrics include: The facial images captured by the facial recognition camera are used as the primary recognition method; RFID identification equipment reads employee RFID card information; Voiceprint collectors gather employee voiceprint information; Gait recognition cameras collect employee gait information; The preset feature extraction algorithm is used to extract features from face images, employee RFID card information, voiceprint information and gait information to obtain multimodal biometrics; All multimodal biometric features are encrypted and stored on the backend server, and transmitted encrypted using the SSL / TLS 1.3 protocol.

[0008] Preferably, the dynamic permission intelligent adaptation module automatically adjusts its access permissions to the warehouse, specifically as follows: Ordinary employees can only use materials commonly used in their own positions. The quantity that can be used at one time is limited by the system's preset upper limit, and they cannot view the inventory of high-value materials. Managers can view the entire inventory and requisition records, and there are no quantity restrictions on the requisition of high-value materials; Employees in special positions are automatically assigned material operation permissions based on their current tasks, and these permissions are automatically revoked upon completion of the task. The temporary authorization is valid for 24 hours, after which the original permissions will be automatically restored.

[0009] Preferably, the seamless warehouse end-to-end management module includes: The pre-operation preparation unit is used to automatically read the pre-requisition material list and download offline data when an employee who has completed identity authentication approaches the access control. The inbound management unit is used to identify whether the materials carried by an employee who has completed identity authentication have been used by the current employee when they bring them into the warehouse. If so, it is determined to be a return operation and the return process is completed; otherwise, it is determined to be an abnormal situation and an alarm is triggered. The outbound management unit is used to automatically generate an outbound order and update the inventory when a user leaves the warehouse. Outbound operations are not triggered when no materials are carried. The warehouse access control unit is used to automatically open and close the access control system based on the status of the personnel inside the warehouse.

[0010] Preferably, the system further includes: RFID identification devices are evenly distributed in key locations within the warehouse to achieve full-range coverage identification of materials. Every item in the warehouse is affixed with a uniquely coded RFID tag.

[0011] On the other hand, the present invention also provides a contactless warehouse management method based on RFID and facial recognition, which employs a contactless warehouse management system based on multimodal authentication fusion as described in any embodiment of this application for contactless warehouse management, the method comprising: Obtain employees' biometric information, identity information, and pre-requisition material lists; Utilize a multimodal biometric fusion module to authenticate employees' biometric information; Once an employee is authenticated, the dynamic permission intelligent adaptation module configures the current employee's material operation permissions based on the employee's identity information. The AR-assisted picking module identifies the location of materials to be picked in the pre-requisition material list and plans the optimal picking path. The current employee completes the material picking based on the optimal picking path. RFID identification equipment matches each picked material with the pre-requisition material list based on RFID tags; When employees leave the warehouse, the seamless warehouse management module automatically manages the outbound or return of picked materials and updates the warehouse's material inventory.

[0012] Preferably, the outbound management specifically includes: When an employee leaves the warehouse, the seamless warehouse management module automatically generates an outbound slip for the materials currently used by the employee based on the pre-requisitioned material list and the employee's identity information, and simultaneously reduces the inventory of the used materials. If an employee leaves the warehouse without taking any materials with them, the outbound operation will not be triggered. The aforementioned return management specifically includes: When an employee enters the warehouse with materials after being certified, the seamless warehouse full-process management module determines it as a return operation. The RFID identification device scans the RFID tag of the materials in real time and compares it with the employee's historical requisition records. If the material carried is material that the person has received, the return process will be completed automatically and the warehouse material inventory will be updated. If the carried materials are not materials that were not received by the person in charge, an audible and visual alarm will be triggered to alert the management personnel.

[0013] Preferably, the method further includes warehouse access control, specifically: The system monitors the status of personnel in the warehouse in real time. When an employee is already in the warehouse, the access control is automatically closed to prevent other users from entering. When no one is in the warehouse, the access control is immediately reopened, eliminating the need for manual supervision.

[0014] In another aspect, the present invention also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the method described in the present invention.

[0015] In another aspect, the present invention also provides a computer-readable storage medium having a computer program stored thereon that, when executed by a processor, implements the method described in the present invention.

[0016] The present invention has the following beneficial effects: 1. This invention provides a seamless warehouse management system and method based on multimodal authentication fusion. The entire process eliminates the need for manual registration, document verification, and permission application. Identity recognition is completed automatically, material positioning and navigation are completed automatically, and inbound and outbound data are processed automatically. Employees only need to complete three steps: "approach the access control - pick according to AR navigation - leave the warehouse" to realize the material requisition or return, completely eliminating the cumbersome steps of traditional processes and achieving a seamless experience. 2. This invention provides a contactless warehouse management system and method based on multimodal authentication fusion, which integrates multimodal biometric features such as face, RFID card, voiceprint, and gait. By integrating information through feature extraction algorithms, it solves the problems of error-proneness and insecurity of single authentication methods, achieves accurate identity verification, improves the accuracy and reliability of identity authentication, and enhances the security of transmission and storage of employee information and warehouse data. 3. This invention provides a seamless warehouse management system and method based on multimodal authentication fusion. It has a built-in permission management engine that automatically adjusts permissions based on employee identity (ordinary employee, manager, special position), task status, and temporary authorization duration. Permission changes are fully traceable, preventing unauthorized operations and enabling on-demand allocation and automatic revocation of permissions. This improves the flexibility and accuracy of permission management, enhances the compliance and traceability of warehouse material usage, and reduces the cost of manual permission control. 4. This invention provides a contactless warehouse management system and method based on multimodal authentication fusion. It utilizes AR devices for assisted picking, synchronizes pre-requisition material lists, locates material positions, plans the optimal picking path, and highlights shelf numbers and layers to indicate the location. This solves the problems of difficult material retrieval and chaotic paths in traditional picking, improves material picking efficiency, enhances operational convenience, and reduces picking error rates. Attached Figure Description

[0017] Figure 1 This is a system flowchart of an embodiment of the present invention. Detailed Implementation

[0018] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0019] It should be understood that the step numbers used in the text are for ease of description only and are not intended to limit the order in which the steps are performed.

[0020] It should be understood that the terminology used in this specification is for the purpose of describing particular embodiments only and is not intended to limit the invention. As used in this specification and the appended claims, the singular forms “a,” “an,” and “the” are intended to include the plural forms unless the context clearly indicates otherwise.

[0021] The terms “comprising” and “including” indicate the presence of the described feature, whole, step, operation, element and / or component, but do not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or collections thereof.

[0022] The term “and / or” refers to any combination of one or more of the associated listed items, as well as all possible combinations, and includes these combinations.

[0023] See Figure 1 This invention provides a seamless warehouse management system based on multimodal authentication fusion, the system comprising: Front-end equipment includes facial recognition cameras, RFID identification devices, voiceprint collectors, gait recognition cameras, AR devices, and access control devices; The backend server is used for data storage and access control of employee and warehouse materials; A multimodal biometric fusion module is used to fuse multimodal biometric features for employee identity authentication. The dynamic permission intelligent adaptation module has a built-in permission management engine that automatically adjusts employees' access permissions to the warehouse and the scope of material operations based on their status. The AR-assisted picking module is used to synchronize the employee's pre-requisition material list to the AR device, which provides real-time material location navigation and optimal picking path; the AR interface displays the shelf number and layer of the material with highlighted marks. The seamless warehouse end-to-end management module is used to realize automatic inbound and outbound management of material requisition and return, as well as warehouse access control.

[0024] In some embodiments, the multimodal biometrics include: The facial images captured by the facial recognition camera are used as the primary recognition method; RFID identification equipment reads employee RFID card information; Voiceprint collectors gather employee voiceprint information; Gait recognition cameras collect employee gait information; The preset feature extraction algorithm is used to extract features from face images, employee RFID card information, voiceprint information and gait information to obtain multimodal biometrics; All multimodal biometric features are encrypted and stored on the backend server, and transmitted encrypted using the SSL / TLS 1.3 protocol.

[0025] In some embodiments, the dynamic permission intelligent adaptation module automatically adjusts its access permissions to the warehouse, specifically as follows: Ordinary employees can only use materials commonly used in their own positions. The quantity that can be used at one time is limited by the system's preset upper limit, and they cannot view the inventory of high-value materials. Managers can view the entire inventory and requisition records, and there are no quantity restrictions on the requisition of high-value materials; in addition, they also have the right to approve requisition applications from subordinates. For employees in special positions (such as maintenance and procurement), material operation permissions are automatically assigned based on the current task, and the permissions are automatically revoked after the task is completed. Temporary authorizations (such as granting permissions beyond one's authorized capacity for an emergency task) are valid for 24 hours, after which the original permissions are automatically restored. All permission changes are recorded in the backend server logs for traceability.

[0026] In some embodiments, the seamless warehouse end-to-end management module includes: The pre-operation preparation unit is used to automatically read the pre-requisition material list and download offline data when an employee who has completed identity authentication approaches the access control. If no list has been compiled, the warehouse material catalog is cached, and the AR device automatically downloads offline data packages (such as material location and inventory) for subsequent operations. The inbound management unit is used to scan the material tags in real time when an employee who has completed identity verification brings materials into the warehouse. The RFID identification device identifies whether the materials carried are for the current employee. If so, it is determined to be a return operation and the return process is completed; otherwise, it is determined to be an abnormal situation and an alarm is triggered. The outbound management unit is used to automatically generate an outbound order and update the inventory when a user leaves the warehouse. Outbound operations are not triggered when no materials are carried. The warehouse access control unit is used to automatically open and close the access control system based on the status of the personnel inside the warehouse.

[0027] In some embodiments, the system further includes: RFID identification devices are evenly distributed in key locations within the warehouse (such as next to shelves and at aisle entrances) to achieve full-range coverage identification of materials; Every item in the warehouse is affixed with a uniquely coded RFID tag.

[0028] In one specific embodiment, a contactless warehouse management method based on RFID and facial recognition is also provided, the contactless warehouse management including the following steps: Obtain employees' biometric information, identity information, and pre-requisition material lists; Utilize a multimodal biometric fusion module to authenticate employees' biometric information; Once an employee is authenticated, the dynamic permission intelligent adaptation module configures the current employee's material operation permissions based on the employee's identity information. The AR-assisted picking module identifies the location of materials to be picked in the pre-requisition material list and plans the optimal picking path. The current employee completes the material picking based on the optimal picking path. RFID identification equipment matches each picked material with the pre-requisition material list based on RFID tags; When employees leave the warehouse, the seamless warehouse management module automatically manages the outbound or return of picked materials and updates the warehouse's material inventory.

[0029] In some embodiments, the outbound management specifically includes: When an employee leaves the warehouse, the seamless warehouse management module automatically generates an outbound slip for the materials currently used by the employee based on the pre-requisitioned material list and the employee's identity information, and simultaneously reduces the inventory of the used materials. If an employee leaves the warehouse without taking any materials with them, the outbound operation will not be triggered. The aforementioned return management specifically includes: When an employee enters the warehouse with materials after being certified, the seamless warehouse full-process management module determines it as a return operation. The RFID identification device scans the RFID tag of the materials in real time and compares it with the employee's historical requisition records. If the material carried is material that the person has received, the return process will be completed automatically and the warehouse material inventory will be updated. If the carried materials are not materials that were not received by the person in charge, an audible and visual alarm will be triggered to alert the management personnel.

[0030] In some embodiments, the method further includes warehouse access control, specifically: The system monitors the status of personnel in the warehouse in real time. When an employee is already in the warehouse, the access control is automatically closed to prevent other users from entering. When no one is in the warehouse, the access control is immediately reopened, eliminating the need for manual supervision.

[0031] In some embodiments, an electronic device is provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement a seamless warehouse management system based on multimodal authentication fusion as described in any embodiment.

[0032] In some embodiments, a computer-readable storage medium is provided having a computer program stored thereon that, when executed by a processor, implements a seamless warehouse management system based on multimodal authentication fusion as described in any embodiment.

[0033] In this application embodiment, "at least one" refers to one or more, and "more than one" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent the existence of A alone, A and B simultaneously, or B alone. A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" and similar expressions refer to any combination of these items, including any combination of singular or plural items. For example, at least one of a, b, and c can represent: a, b, c, a and b, a and c, b and c, or a and b and c, where a, b, and c can be single or multiple.

[0034] Those skilled in the art will recognize that the units and algorithm steps described in the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of electronic hardware and software. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0035] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0036] In the several embodiments provided in this application, any function, if implemented as a software functional unit and sold or used as an independent product, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0037] The above description is merely an embodiment of the present invention and does not limit the patent scope of the present invention. Any equivalent structural or procedural transformations made based on the content of the present invention's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of the present invention.

Claims

1. A seamless warehouse management system based on multimodal authentication fusion, characterized in that, The system includes: Front-end equipment includes facial recognition cameras, RFID identification devices, voiceprint collectors, gait recognition cameras, AR devices, and access control devices; The backend server is used for data storage and access control of employee and warehouse materials; A multimodal biometric fusion module is used to fuse multimodal biometric features for employee identity authentication. The dynamic permission intelligent adaptation module has a built-in permission management engine that automatically adjusts employees' access permissions to the warehouse and the scope of material operations based on their status. The AR-assisted picking module is used to synchronize the employee's pre-requisition material list to the AR device, which provides real-time material location navigation and optimal picking path. The seamless warehouse end-to-end management module is used to realize automatic inbound and outbound management of material requisition and return, as well as warehouse access control.

2. The seamless warehouse management system based on multimodal authentication fusion according to claim 1, characterized in that, The multimodal biometrics include: The facial images captured by the facial recognition camera are used as the primary recognition method; RFID identification equipment reads employee RFID card information; Voiceprint collectors gather employee voiceprint information; Gait recognition cameras collect employee gait information; The preset feature extraction algorithm is used to extract features from face images, employee RFID card information, voiceprint information and gait information to obtain multimodal biometrics; All multimodal biometric features are encrypted and stored on the backend server, and transmitted encrypted using the SSL / TLS 1.3 protocol.

3. The seamless warehouse management system based on multimodal authentication fusion according to claim 1, characterized in that, The dynamic permission intelligent adaptation module automatically adjusts its access permissions to the warehouse, specifically as follows: Ordinary employees can only use materials commonly used in their own positions. The quantity that can be used at one time is limited by the system's preset upper limit, and they cannot view the inventory of high-value materials. Managers can view the entire inventory and requisition records, and there are no quantity restrictions on the requisition of high-value materials; Employees in special positions are automatically assigned material operation permissions based on their current tasks, and these permissions are automatically revoked upon completion of the task. The temporary authorization is valid for 24 hours, after which the original permissions will be automatically restored.

4. The seamless warehouse management system based on multimodal authentication fusion according to claim 1, characterized in that, The seamless warehouse end-to-end management module includes: The pre-operation preparation unit is used to automatically read the pre-requisition material list and download offline data when an employee who has completed identity authentication approaches the access control. The inbound management unit is used to identify whether the materials carried by an employee who has completed identity authentication have been used by the current employee when they bring them into the warehouse. If so, it is determined to be a return operation and the return process is completed; otherwise, it is determined to be an abnormal situation and an alarm is triggered. The outbound management unit is used to automatically generate an outbound order and update the inventory when a user leaves the warehouse. Outbound operations are not triggered when no materials are carried. The warehouse access control unit is used to automatically open and close the access control system based on the status of the personnel inside the warehouse.

5. The seamless warehouse management system based on multimodal authentication fusion according to claim 1, characterized in that, The system also includes: RFID identification devices are evenly distributed in key locations within the warehouse to achieve full-range coverage identification of materials. Every item in the warehouse is affixed with a uniquely coded RFID tag.

6. A contactless warehouse management method based on RFID and facial recognition, characterized in that, Seamless warehouse management is performed using a seamless warehouse management system based on multimodal authentication fusion as described in any one of claims 1 to 5, the method comprising: Obtain employees' biometric information, identity information, and pre-requisition material lists; Utilize a multimodal biometric fusion module to authenticate employees' biometric information; Once an employee is authenticated, the dynamic permission intelligent adaptation module configures the current employee's material operation permissions based on the employee's identity information. The AR-assisted picking module identifies the location of materials to be picked in the pre-requisition material list and plans the optimal picking path. The current employee completes the material picking based on the optimal picking path. RFID identification equipment matches each picked material with the pre-requisition material list based on RFID tags; When employees leave the warehouse, the seamless warehouse management module automatically manages the outbound or return of picked materials and updates the warehouse's material inventory.

7. The seamless warehouse management method based on multimodal authentication fusion according to claim 6, characterized in that, The outbound management specifically includes: When an employee leaves the warehouse, the seamless warehouse management module automatically generates an outbound slip for the materials currently used by the employee based on the pre-requisitioned material list and the employee's identity information, and simultaneously reduces the inventory of the used materials. If an employee leaves the warehouse without taking any materials with them, the outbound operation will not be triggered. The aforementioned return management specifically includes: When an employee enters the warehouse with materials after being certified, the seamless warehouse full-process management module determines it as a return operation. The RFID identification device scans the RFID tag of the materials in real time and compares it with the employee's historical requisition records. If the material carried is material that the person has received, the return process will be completed automatically and the warehouse material inventory will be updated. If the carried materials are not materials that were not received by the person in charge, an audible and visual alarm will be triggered to alert the management personnel.

8. The seamless warehouse management method based on multimodal authentication fusion according to claim 6, characterized in that, The method also includes warehouse access control, specifically: The system monitors the status of personnel in the warehouse in real time. When an employee is already in the warehouse, the access control is automatically closed to prevent other users from entering. When no one is in the warehouse, the access control is immediately reopened, eliminating the need for manual supervision.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the program, it implements the method as described in any one of claims 6 to 8.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the method as described in any one of claims 6 to 8.

Images