Virtual warehouse management method and device, storage medium and equipment

Abstract

This invention provides a virtual warehouse management method, apparatus, storage medium, and equipment, including: determining a designated area for the virtual warehouse based on electronic fence marking signals; obtaining initial material storage information for the virtual warehouse based on image information sent by an image acquisition device and radio frequency signals sent by a radio frequency signal acquisition device; if any user appears in the designated area of ​​the virtual warehouse, retrieving warehouse item storage and retrieval work orders based on the user's identity information, and determining whether the item storage and retrieval is compliant by combining the warehouse item storage and retrieval work orders, real-time image information, and real-time radio frequency signals; if the item storage and retrieval is compliant, determining the actual items stored and retrieved in the virtual warehouse based on the warehouse item storage and retrieval work orders, real-time image information, and real-time radio frequency signals, and updating the inventory information of the virtual warehouse. This application flexibly constructs a virtual warehouse and accurately identifies item storage through image acquisition devices, radio frequency signal acquisition devices, and warehouse item storage and retrieval work orders, improving the flexibility and efficiency of virtual warehouse management.

Description

Technical Field

[0001] This invention relates to the field of virtual warehouses, and more specifically to virtual warehouse management methods, apparatus, storage media and equipment. Background Technology

[0002] Existing laboratory storage methods mostly involve storing items in fixed locations within a warehouse, such as designated shelf areas or designated zones. The number of items in each zone or shelf within the warehouse is fixed, as are the types of items stored there. This results in a lack of flexibility in adjusting the warehouse to the environment, leading to low utilization of unused areas (such as unused shelf space).

[0003] Meanwhile, the existing management of goods entering and leaving the warehouse is mostly reflected in the registration of goods entering and leaving the warehouse. It can only identify the type and quantity of goods entering / leaving the warehouse, but cannot know the specific status of the goods in the warehouse (such as whether there are problems such as damaged packaging, tilted placement, or missing labels), which is prone to errors in the warehouse inventory management stage. Summary of the Invention

[0004] Based on this, the present invention provides a virtual warehouse management method, apparatus, storage medium and equipment, which combines camera monitoring area to delineate the area of ​​the virtual warehouse, and uses monitoring screen to identify the specific status of items in the virtual warehouse, and combines electronic tags and specific work orders in the system to manage the entry and exit of items, thereby improving the flexibility and efficiency of virtual warehouse management.

[0005] In a first aspect, the present invention provides a virtual warehouse management method, which is applied to a virtual warehouse system. The virtual warehouse system includes an image acquisition device, a radio frequency signal acquisition device, a user mobile terminal, and a central processing unit. The image acquisition device, the radio frequency signal acquisition device, and the user mobile terminal are all communicatively connected to the central processing unit. The virtual warehouse management method includes the following steps:

[0006] Acquire electronic fence marking signals and combine them to determine the designated area of ​​the virtual warehouse;

[0007] Based on the image information sent by all image acquisition devices and the radio frequency signals sent by all radio frequency signal acquisition devices within the designated area of ​​the virtual warehouse, the initial material storage information of the virtual warehouse is obtained and recorded as the inventory information of the virtual warehouse.

[0008] If any user appears in the designated area of ​​the virtual warehouse, the warehouse item storage and retrieval work order will be retrieved based on the user's identity information, and the compliance of the item storage and retrieval will be determined by combining the warehouse item storage and retrieval work order, real-time image information and real-time radio frequency signal.

[0009] If the storage and retrieval of the items are compliant, the actual items stored and retrieved in the virtual warehouse are determined based on the warehouse item storage and retrieval work order, real-time image information, and real-time radio frequency signals, and the inventory information of the virtual warehouse is updated in conjunction with the initial material storage information of the virtual warehouse.

[0010] Furthermore, the virtual warehouse management method also includes:

[0011] If the storage or retrieval of items is not compliant, an illegal storage or retrieval signal in the virtual warehouse is generated and sent to the administrator.

[0012] Furthermore, the electronic fence marking signal includes electronic fence markings delineated by the user terminal in conjunction with received graphic information, or electronic fence markings placed on-site.

[0013] Furthermore, the virtual warehouse management method also includes:

[0014] If there is a monitoring blind spot formed by preset obstacles within the designated area of ​​the virtual warehouse, identify the edge of the monitoring blind spot formed by the preset obstacles;

[0015] If the edge of the monitoring blind zone formed by the preset obstacles coincides with the edge of the virtual warehouse area, the monitoring blind zone is removed from the virtual warehouse area based on the edge of the monitoring blind zone to obtain the updated virtual warehouse area.

[0016] If the edge of the monitoring blind zone formed by the preset obstacles does not coincide with the edge of the virtual warehouse area, a prompt message indicating that the virtual warehouse monitoring blind zone cannot be eliminated will be generated and sent to the administrator.

[0017] Furthermore, the initial material storage information of the virtual warehouse is obtained based on the image information sent by all image acquisition devices and the radio frequency signals sent by all radio frequency signal acquisition devices within the defined area of ​​the virtual warehouse, and is recorded as the inventory information of the virtual warehouse. Specifically:

[0018] The first material storage information is obtained based on the image information sent by all image acquisition devices within the designated area of ​​the virtual warehouse. The material information items of the first material storage information include the type, quantity, and status of the stored materials.

[0019] The second material storage information is obtained based on the radio frequency signals sent by all radio frequency signal acquisition devices within the designated area of ​​the virtual warehouse. The material information items of the second material storage information include the quantity, location, and code of the stored materials.

[0020] Extract the material information items from the first material storage information and the second material storage information;

[0021] For the same stored material information item in the first and second stored material information, if the content of the same stored material information item is consistent, the content of the stored material information item shall be retained.

[0022] If the contents of the same stored material information items are inconsistent, a material information identification inconsistency prompt message is generated and sent to the user's mobile terminal;

[0023] For different storage material information items in the first and second material storage information, retain the content of all different storage material information items.

[0024] By integrating all the retained identical and different stored material information items, the initial material storage information of the virtual warehouse is obtained.

[0025] Furthermore, if any user appears in the designated area of ​​the virtual warehouse, the warehouse item storage and retrieval work order is retrieved based on the user's identity information. The compliance of the item storage and retrieval is then determined by combining the warehouse item storage and retrieval work order, real-time image information, and real-time radio frequency signals. Specifically:

[0026] Determine whether a user has entered the virtual warehouse based on real-time image information of the virtual warehouse;

[0027] If a user enters the virtual warehouse, the user's identity information and actions are determined based on real-time image information and real-time radio frequency signals.

[0028] If the user's action is to store or retrieve an item, capture the first image information of the stored item and input the first image information into the improved YOLOv8 model to obtain the moved item information;

[0029] Combine the user's identity information to retrieve the warehouse item storage and retrieval work order. If the moving item information is consistent with the category of the item to be stored or retrieved in the warehouse item storage and retrieval work order, obtain the first radio frequency signal for user positioning based on the user's identity information, obtain the code information of the item to be stored or retrieved based on the warehouse item storage and retrieval work order, and obtain the second radio frequency signal for positioning the item to be stored or retrieved based on the code information of the item to be stored or retrieved.

[0030] If the user location obtained from the first radio frequency signal coincides with the location of the item to be accessed obtained from the second radio frequency signal, the access to the item is deemed compliant.

[0031] If the distance between the user location obtained from the first radio frequency signal and the location of the item to be stored obtained from the second radio frequency signal exceeds the maximum distance threshold, then the storage of the item is non-compliant.

[0032] Furthermore, the virtual warehouse management method also includes:

[0033] The user's location information is determined based on real-time image information and real-time radio frequency signals;

[0034] The virtual warehouse operated by the user is determined based on the user's location information and actions;

[0035] The user's permission level in the virtual warehouse is determined based on the user's identity information;

[0036] If a user's actions are inconsistent with their permission level, a permission alert message will be issued.

[0037] Secondly, the present invention also provides a virtual warehouse management device, which is applied to a virtual warehouse system. The virtual warehouse system includes an image acquisition device, a radio frequency signal acquisition device, a user mobile terminal, and a central processing unit. The image acquisition device, the radio frequency signal acquisition device, and the user mobile terminal are respectively communicatively connected to the central processing unit. The virtual warehouse management device includes the following modules:

[0038] The fence marking module is used to acquire electronic fence marking signals and combine them to determine the designated area of ​​the virtual warehouse.

[0039] The inventory scanning module is used to obtain the initial material storage information of the virtual warehouse based on the image information sent by all image acquisition devices and the radio frequency signals sent by all radio frequency signal acquisition devices within the defined area of ​​the virtual warehouse, and record it as the inventory information of the virtual warehouse.

[0040] The storage and retrieval compliance judgment module is used to retrieve the warehouse item storage and retrieval work order based on the user's identity information if any user appears in the designated area of ​​the virtual warehouse, and to judge whether the storage and retrieval of items is compliant by combining the warehouse item storage and retrieval work order, real-time image information and real-time radio frequency signal.

[0041] The inventory update module is used to determine the actual stored or retrieved items in the virtual warehouse based on the warehouse item storage and retrieval work order, real-time image information, and real-time radio frequency signal, if the item storage and retrieval is compliant, and to update the inventory information of the virtual warehouse in conjunction with the initial material storage information of the virtual warehouse.

[0042] Thirdly, the present invention also provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the steps of any of the virtual warehouse management methods in the first aspect.

[0043] Fourthly, the present invention also provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to perform any one of the virtual warehouse management methods in the first aspect.

[0044] The beneficial effects of adopting the above technical solution are as follows: The virtual warehouse management method provided in this embodiment differs from existing virtual warehouses with fixed areas. It can delineate specific virtual warehouse areas in non-standard warehouse areas, such as office areas containing other items or blank areas within the warehouse, by combining the user's electronic fence marking information (such as the user drawing an electronic fence by hand using a terminal device or placing markers on-site). This allows for flexible construction of virtual warehouses and improves the scenario adaptability of virtual warehouses. Furthermore, this embodiment uses monitoring image recognition and radio frequency signal collection to acquire information on the storage of items within the virtual warehouse, overcoming the limitations of existing technologies that only "identify type and quantity." It adds features such as item status detection (e.g., damage, tilting, label detachment, etc.), reducing inventory management errors within the virtual warehouse and improving the safety of item storage. Furthermore, this embodiment sets up a multi-dimensional verification system of "image-radio frequency-work order" for the item storage and retrieval process, establishing a closed loop of "work order triggering-image / radio frequency bidirectional verification-result feedback." This solves the problems of misjudgment and difficulty in traceability in existing technologies for non-contact warehouses, ensuring compliance of the item storage process. In addition, the virtual warehouse management in this embodiment divides user permissions to accurately determine whether a user's storage and retrieval actions on items comply with their permissions, thereby reducing the storage security risks of virtual warehouse management. Attached Figure Description

[0045] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the accompanying drawings used in the description of the embodiments or the prior art will be briefly introduced below.

[0046] Figure 1 This is a schematic diagram of a virtual warehouse management method in one embodiment of this application;

[0047] Figure 2 This is a schematic diagram of a virtual warehouse management device in one embodiment of this application. Detailed Implementation

[0048] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention. To describe the present invention in more detail, the virtual warehouse management method, apparatus, storage medium, and device provided by the present invention will be specifically described below with reference to the accompanying drawings.

[0049] Unless otherwise defined, the technical or scientific terms used in this application shall have the ordinary meaning understood by one of ordinary skill in the art to which this invention pertains. The terms "first," "second," and similar terms used in this invention do not indicate any order, quantity, or importance, but are merely used to distinguish different components. Similarly, the terms "an," "a," or "the" do not indicate a quantity limitation, but rather indicate the presence of at least one. The terms "comprising" or "including" mean that the preceding element or object encompasses the elements or objects listed after the word and their equivalents, without excluding other elements or objects. The terms "connected" or "linked" are not limited to physical or mechanical connections, but can include electrical connections, whether direct or indirect. "Up," "down," "left," "right," etc., are used only to indicate relative positional relationships; when the absolute position of the described object changes, the relative positional relationship may also change accordingly.

[0050] Existing laboratory storage relies heavily on pre-defined, fixed areas within warehouses, such as designated shelving areas or fixed-size electronic fences. This prevents the utilization or dynamic adjustment of unused areas, resulting in low warehouse space utilization and flexibility. Furthermore, existing warehouses can only identify the type and quantity of items, failing to simultaneously monitor their status, leading to errors in warehouse management.

[0051] Based on this, this invention proposes a virtual warehouse management method. This virtual warehouse management method is applied to a virtual warehouse system, which includes at least one image acquisition device, one radio frequency signal acquisition device, a user mobile terminal, and a central processing unit (CPU). The image acquisition device is used to acquire image information within the virtual warehouse in real time and send the acquired image information to the CPU. The radio frequency signal acquisition device is used to acquire radio frequency signals from electronic tags carried on items in the virtual warehouse in real time and send the acquired radio frequency signals to the CPU. The user mobile terminal is used to generate a warehouse item storage / retrieval work order based on the user's specific outbound / inbound request and send the warehouse item storage / retrieval work order to the CPU. The CPU manages the storage status of items in the virtual warehouse based on the received image information, radio frequency signals, and warehouse item storage / retrieval work orders. The aforementioned CPU and user mobile terminal include, but are not limited to, smartphones and computer devices, wherein the computer device can be at least one of desktop computers, portable computers, laptop computers, mainframe computers, tablet computers, etc. (See attached figure.) Figure 1 The diagram illustrates a virtual warehouse management method, with the central processing unit as the execution entity. The specific execution steps of an embodiment of the virtual warehouse management method are explained.

[0052] Step S100: Obtain the electronic fence marker signal and determine the virtual warehouse area based on the electronic fence marker signal.

[0053] Specifically, in this embodiment, the electronic fence marking signal can be divided into two types: electronic fence markings defined by combining image information on the user's mobile terminal, and electronic fence markings placed by the user on the ground.

[0054] When the electronic fence marking signal is an electronic fence mark defined by the user on the mobile terminal in combination with image information, the central processing unit, upon receiving image information from the image acquisition device within the area, sends the image information to the user's mobile terminal. The user then draws the electronic fence mark on the specific image information using the mobile terminal (e.g., drawing a closed line in the image displayed on the user's mobile terminal; this line can be recorded as an electronic fence mark), and maps the electronic fence mark onto the actual area to obtain the virtual warehouse demarcation area. For example, monitoring cameras A and D are set up in the storage area, and each monitoring camera captures a different area. When the user marks the electronic fence on the image of the area fed back by monitoring camera A with a closed shape (such as a rectangle, circle, triangle, etc.) using a drawing pen, the closed shape drawn by the user is the electronic fence marking signal.

[0055] When a user places electronic fence markers (such as special icons on the ground) in the field, the designated area of ​​the virtual warehouse is determined by the closed shape formed by connecting the lines of these markers. For example, if surveillance cameras A and D are installed within the storage area, each camera capturing a different area, and a user places non-overlapping reflective cones or non-overlapping red dots on the ground within area two captured by camera B, the designated area of ​​the virtual warehouse can be determined based on the closed shape formed by connecting the lines between the placed reflective cones or red dots.

[0056] It should be noted that whether users draw electronic fence markers on specific image information using their mobile terminals or place electronic fence tags in the field, they need to bind their identity information to the specific electronic fence markers. Once bound, the user is equivalent to the administrator of the designated area of ​​the virtual warehouse.

[0057] In addition, if the area where the user places the electronic fence tag exceeds the area captured by a single surveillance camera, the capture areas of adjacent surveillance cameras with the same electronic fence tag will be merged based on the physical location of each surveillance camera to obtain a complete virtual warehouse delineation area.

[0058] Furthermore, the aforementioned virtual warehouse delineation area is for the case of a single user marking a virtual warehouse area. Considering that in the actual virtual warehouse delineation process, multiple users' virtual warehouse locations may overlap, this embodiment also includes: obtaining the user identity information corresponding to the user sending the electronic fence marking signal; and binding the user identity information with the corresponding virtual warehouse delineation area. By binding the user identity information with the virtual warehouse delineation area, the bound user becomes the administrator of that virtual warehouse. Even if the virtual warehouse delineation areas overlap, different items within the actual delineation area correspond to different virtual warehouse delineation areas, and the corresponding virtual warehouse management methods are different, enabling flexible management of different items within the same placement area.

[0059] In addition, when the designated areas of the virtual warehouses corresponding to different users do not overlap, if there is a material allocation between different users, the user information bound to the designated sub-area of ​​the material to be allocated and the user information of both parties to the allocation can be changed by combining the designated sub-area of ​​the material to be allocated and the user information of both parties. In this way, the material allocation can be completed without changing the actual storage area of ​​the material to be allocated.

[0060] Furthermore, considering that there may be blind spots in monitoring, such as pillars or desks, during the process of defining virtual warehouses within the office area, this embodiment specifically includes the following steps for handling monitoring blind spots within the defined virtual warehouse area:

[0061] If there is a monitoring blind spot formed by preset obstacles within the designated area of ​​the virtual warehouse, identify the edge of the monitoring blind spot formed by the preset obstacles;

[0062] If the edge of the monitoring blind zone formed by the preset obstacles coincides with the edge of the designated area of ​​the virtual warehouse, the monitoring blind zone is removed from the designated area of ​​the virtual warehouse based on the edge of the monitoring blind zone, resulting in an updated designated area of ​​the virtual warehouse.

[0063] If the edge of the monitoring blind zone formed by the preset obstacles does not coincide with the edge of the designated area of ​​the virtual warehouse, a prompt message indicating that the monitoring blind zone of the virtual warehouse cannot be eliminated will be generated and sent to the mobile terminal of the corresponding user.

[0064] It should be noted that the preset obstacles in this embodiment include desks, large furniture, pillars, large equipment, etc. These preset obstacles will create blind spots in the monitoring process during image acquisition, making it impossible to observe whether items are placed in that area. This is detrimental to the management of the virtual warehouse, so it is necessary to remove these blind spots. The defined area of ​​the virtual warehouse obtained after removing the blind spots can be smoothed by combining it with the edges of the updated defined area of ​​the virtual warehouse.

[0065] Step S200: Based on the image information sent by all image acquisition devices and the radio frequency signals sent by all radio frequency signal acquisition devices within the designated area of ​​the virtual warehouse, the initial material storage information in the virtual warehouse is obtained and recorded as the inventory information of the virtual warehouse.

[0066] Specifically, in the initialization phase of the virtual warehouse, this embodiment determines the initial material storage information of the virtual warehouse by combining the item information collected by the image acquisition device and the radio frequency signal acquisition device, thereby establishing the inventory information of the virtual warehouse.

[0067] Among them, the image information sent by the image acquisition device is combined with the trained image recognition model (such as the improved YOLOv8 model) to obtain the first material storage information. The material information items of the first material storage information include the type, quantity and status of the stored materials (such as whether the items are damaged, whether the items are placed at an angle, whether the item labels are detached, etc.).

[0068] The radio frequency (RF) signal transmitted by the RF signal acquisition device is combined with the RF signal demodulation model to obtain the second material storage information. The material information items of the second material storage information include the quantity, location, and code of the stored materials. It should be noted that the RF signal in this embodiment includes, but is not limited to, Wi-Fi signals, RFID signals, and UWB signals.

[0069] To improve the accuracy of material management in virtual warehouses, the initial material storage information of the virtual warehouse is obtained by combining the first and second material storage information within the same virtual warehouse's defined area. This includes:

[0070] Step S201: Extract the material information items from the first material storage information and the second material storage information;

[0071] Step S202: For the same storage material information item in the first material storage information and the second material storage information, if the content of the same storage material information item is consistent, the content of the storage material information item is retained.

[0072] Step S203: If the contents of the same stored material information items are inconsistent, generate a prompt message indicating inconsistent material information identification and send the prompt message to the user's mobile terminal to remind the user to check and calibrate the image acquisition device or radio frequency signal acquisition device.

[0073] Step S204: For different storage material information items in the first material storage information and the second material storage information, retain the content of all different storage material information items;

[0074] Step S205: Integrate all retained identical and different stored material information items to obtain the initial material storage information of the virtual warehouse.

[0075] For example, during the initialization phase of virtual warehouse S, the designated area of ​​virtual warehouse S corresponds to the area captured by two adjacent surveillance cameras (surveillance camera A and surveillance camera B). After the images captured by the two adjacent surveillance cameras are recognized by the improved YOLOv8 model, the first material storage information of virtual warehouse S is obtained, including: "Virtual warehouse S contains laptops and printing paper, including 10 laptops and 5 boxes of printing paper. The 10 laptops are neatly arranged within the designated area of ​​virtual warehouse S, and their appearance is intact and without stains. The 5 boxes of printing paper are stacked within the designated area of ​​virtual warehouse S, with the top box of printing paper having some open sections." The radio frequency signal collected by the radio frequency signal acquisition device is processed by the radio frequency signal demodulation model to obtain the second material storage information of the virtual warehouse S, including "the laptops and printers placed in the virtual warehouse S, of which 10 laptops are arranged in a queue in the left area of ​​the virtual warehouse S, and the laptops are coded as Lap001-Lap010; 5 boxes of printing paper are stacked in the right area of ​​the virtual warehouse S, and 1 box is placed in the left area of ​​the virtual warehouse S, and the stacked printing paper is coded as Paper001-Paper005; the separately placed printing paper is coded as Paper006". For identical storage information items in the first and second storage information (virtual warehouse S stores laptops and printer paper, the number of laptops, and the number of printer papers), the identical parts are merged, such as virtual warehouse S storing laptops and printer paper, and there are 10 laptops; for inconsistent parts, a message indicating inconsistent material information is issued, such as the number of printer papers being inconsistent, reminding the user to check whether the printer paper that should be placed separately is in the blind spot of the surveillance camera; for different storage information items in the first and second storage information (the appearance of laptops and printer paper in virtual warehouse S, the location information of laptops and printer paper, and the specific codes), the content of all different storage information items is retained. Finally, all the retained identical and different stored material information items are integrated to obtain the initial material storage information of the virtual warehouse. For example, "Virtual warehouse S contains laptops and printing paper. There are 10 laptops. The laptops are intact and free of stains. The top stack of printing paper has open boxes. The 10 laptops are arranged in a queue on the left side of virtual warehouse S. The laptop codes are Lap001-Lap010. There are 5 boxes of printing paper stacked on the right side of virtual warehouse S. The stacked printing paper codes are Paper001-Paper005." At the same time, if the content of the identical stored material information items is inconsistent, a prompt message "The quantity of printing paper is inconsistent" is issued.

[0076] Step S300: If any user appears in the designated area of ​​the virtual warehouse, retrieve the warehouse item storage and retrieval work order based on the user's identity information, and determine whether the item storage and retrieval is compliant by combining the warehouse item storage and retrieval work order, real-time image information and real-time radio frequency signal.

[0077] Specifically, in this embodiment, the mobile terminal carried by the user also has positioning capabilities, and the user can also carry a UWB positioning tag to determine the user's specific location. When any user appears in the designated area of ​​the virtual warehouse, it means that the user's location is within the designated area of ​​the virtual warehouse. Considering that different users have different permissions in each virtual warehouse, during the process of the user storing and retrieving items in the virtual warehouse, it is also necessary to combine the specific warehouse item storage and retrieval work order sent by the user, real-time image information, and real-time radio frequency signals to determine whether the storage and retrieval of items is compliant, including the following steps:

[0078] Step S301: Determine whether the user has entered the virtual warehouse based on the real-time image information of the virtual warehouse.

[0079] Specifically, by combining the trained image recognition model, the system uses real-time image information from the virtual warehouse to determine whether a user has entered the designated area of ​​the virtual warehouse. When the virtual image information of the virtual warehouse detects that a person has entered the designated area of ​​the virtual warehouse, it can be determined that the user has entered the virtual warehouse.

[0080] Step S302: If a user enters the virtual warehouse, the user's identity information, location information, and actions are determined based on real-time image information and real-time radio frequency signals.

[0081] Specifically, after confirming the presence of personnel entering a designated area of ​​the virtual warehouse using real-time image information, the system further combines real-time image information and real-time radio frequency (RF) information to determine the user's specific information (such as user identity, location, and actions). First, the system identifies the approximate outline of the person through image recognition, accurately identifying entry without requiring overly detailed processing of the real-time image, reducing unnecessary image processing calculations and avoiding errors in determining user location using RF signals. Then, the system precisely identifies the user's identity, location, and actions using real-time image and RF information. The user's identity and location information determine whether they have permission to access items in the virtual warehouse, and the user's actions determine whether they have performed the actions of storing or retrieving items.

[0082] It should be noted that, in the technical solution of the embodiment, the user's identity information can also be determined using an image acquisition device and a radio frequency signal acquisition device. The image acquisition device can determine in real time whether a person has entered the designated area of ​​the virtual warehouse and the specific location of the person in the designated area of ​​the virtual warehouse through personnel contour recognition. The image acquisition device can also determine the identity information of the specific person entering the virtual warehouse and whether the person has performed a specific item storage or item retrieval action through face recognition, action recognition, etc. The radio frequency signal acquisition device, combined with the electronic tags worn by the person (such as UWB tags, RFID tags, WI-FI tags, etc.), can identify the specific person's identity information and the specific location of the person in the designated area of ​​the virtual warehouse.

[0083] Furthermore, considering that different users have different permissions in different virtual warehouses after determining the user's identity information, location information, and actions, this embodiment also sets up the following to prevent users from exceeding the permission settings of a specific virtual warehouse during the storage of items:

[0084] Step S3021: Determine the virtual warehouse operated by the user based on the user's location information and actions.

[0085] Specifically, considering that the actual designated areas of virtual warehouses may overlap or be adjacent, relying solely on user location information to determine the virtual warehouse a user is operating on might result in a user corresponding to two or more virtual warehouses. To quickly determine the virtual warehouse a user is operating on, user actions are considered, i.e., which item the user needs to operate on. By determining the item the user needs to operate on through their actions, the virtual warehouse the user is operating on can be determined based on that item.

[0086] For example, if the actual defined areas of virtual warehouse X and virtual warehouse Y partially overlap, with some items belonging to virtual warehouse X and some items belonging to virtual warehouse Y, and a user is located within this overlapping area, the location information only indicates that the user is in the overlapping area of ​​virtual warehouse X and virtual warehouse Y. However, it cannot be determined which virtual warehouse the user needs to store or retrieve items from, making it impossible to verify whether the user has operation permissions for the items in that virtual warehouse. Therefore, the user's actions are combined to determine which item the user needs to operate on. For example, if the user's action indicates that the user needs to operate on item 'a' and retrieve the virtual warehouse to which the item belongs, then that virtual warehouse can be identified as the virtual warehouse operated on by the user. That is, virtual warehouse X, to which item 'a' belongs, is the virtual warehouse operated on by the user.

[0087] Step S3022: Determine the user's permission level in the virtual warehouse based on the user's identity information.

[0088] Specifically, each virtual warehouse has three access levels: a first level, a second level, and a third level. The first level corresponds to the virtual warehouse administrator, who can modify the electronic fence markings of the virtual warehouse, such as expanding or shrinking the designated area, as well as modifying the virtual warehouse's inventory database and managing user permissions for access. The second level corresponds to the virtual warehouse operator, who can retrieve or store items by submitting work orders and view the inventory information of the virtual warehouses belonging to their department. The third level corresponds to the virtual warehouse visitor, who can only view the inventory information of a designated virtual warehouse with authorization from the virtual warehouse administrator and cannot store or retrieve items within the virtual warehouse.

[0089] It's important to note that the same user may have different permissions in different virtual repositories. For example, User A might be an administrator in virtual repository X (Level 1 permission), but a visitor in virtual repository Y (Level 3 permission). Furthermore, when users with different permission levels operate simultaneously in the same virtual repository, the information in the virtual repository is synchronized during the operation. For instance, if User A stores 10 printer ink cartridges in virtual repository X, the inventory information in virtual repository X, which is being viewed by User B simultaneously, is updated in real time after User A completes the storage action, improving information synchronization. However, if more than one user with Level 1 permission modifies the geofence marker of the virtual repository, a geofence modification conflict warning message is issued.

[0090] Step S3023: If the user's action is inconsistent with the permission level, issue a permission alarm message.

[0091] Specifically, when a user's action is to store or retrieve an item, if the user's permission level is level three, a permission alert message will be issued. For example, if user C's action in the designated area of ​​virtual warehouse X is to store a printer, but user C's permission level in virtual warehouse X is level three, it means that user C cannot perform the action of storing or retrieving items in virtual warehouse X. In this case, the user's action is inconsistent with their permission level, and a permission alert message will be issued, such as "Items cannot be stored in virtual warehouse X".

[0092] Step S303: If the user's action is an item storage action or an item retrieval action, capture the first image information of the user storing the item, and input the first image information into the improved YOLOv8 model to obtain the moving item information.

[0093] Specifically, when a user's action is to store or retrieve an item, the system first captures the first image information of the item. Based on this first image information and the improved YOLOv8 model, the system can quickly determine the category of the moving item. For example, the system can identify the moving item as a laptop, printer, or computer based on the first image.

[0094] Step S304: Retrieve the warehouse item storage and retrieval work order based on the user's identity information. If the moving item information is consistent with the category of the item to be stored or retrieved in the warehouse item storage and retrieval work order, obtain the code information of the item to be stored or retrieved based on the warehouse item storage and retrieval work order, obtain the first radio frequency signal for user positioning based on the user's identity information, and obtain the second radio frequency signal for positioning the item to be stored or retrieved based on the code information of the item to be stored or retrieved. If the user positioning obtained from the first radio frequency signal and the positioning of the item to be stored or retrieved obtained from the second radio frequency signal overlap, the item storage and retrieval is deemed compliant.

[0095] Specifically, after the first image information identifies the type of item the user is storing or retrieving, the user's item storage / retrieval work order is retrieved. If the type of item the user is storing or retrieving matches the category on the item storage / retrieval work order, the specific item location is determined by combining the item's code information on the storage / retrieval work order. This helps determine whether the user has correctly stored or retrieved the item according to the work order. For example, if the laptop computer retrieved by the user on the item storage / retrieval work order is coded Lap005, the specific location is determined based on the radio frequency signal corresponding to Lap005. For example, the location of the electronic tag carried by the laptop computer coded Lap005 can be obtained from an RFID base station, Wi-Fi base station, or UWB base station. At the same time, the user's location is obtained from the electronic tag carried by the user. If the two locations match, it means that the user is performing the operation of retrieving the laptop computer coded Lap005, and the item storage / retrieval is compliant. It should be noted that, considering the issue of positioning deviation, if the object positioning and the user positioning overlap, the distance between the two positioning can be less than the maximum distance threshold. This maximum distance threshold can be set according to the specific scenario, and in this embodiment, it can be set to 0.5 meters.

[0096] It should be noted that in this embodiment, users need to submit an application through an item storage / retrieval work order before they can perform specific item retrieval or item storage operations to retrieve or store items in the virtual warehouse. If the retrieved item storage work order is empty, the item storage work order is inconsistent with the type of item that the user is storing or retrieving, or the item storage work order is inconsistent with the virtual warehouse, it means that the user does not have the authority to store or retrieve the item. In this case, an illegal access signal for the virtual warehouse needs to be issued.

[0097] Step S400: If the item storage and retrieval are compliant, determine the actual items stored and retrieved in the virtual warehouse based on the warehouse item storage and retrieval work order, real-time image information and real-time radio frequency signal, and update the virtual warehouse inventory information in conjunction with the initial material storage information of the virtual warehouse.

[0098] Specifically, once the compliance of item storage and retrieval is determined, the actual items stored and retrieved in the virtual warehouse (such as a laptop computer with the serial number Lap005) can be accurately obtained through real-time image information triggering, real-time radio frequency signals, and mutual verification with the warehouse item storage and retrieval work order. At this time, combined with the initial material storage information of the virtual warehouse, the inventory information of the virtual warehouse is updated, thereby realizing the real-time update of inventory information in the virtual warehouse based on the user's compliant item storage and retrieval actions, improving the item management efficiency of the virtual warehouse.

[0099] Step S500: If the storage or retrieval of items is not compliant, a virtual warehouse illegal storage or retrieval signal is generated and sent to the administrator.

[0100] Specifically, if the distance between the user location obtained from the first radio frequency signal and the location of the item to be stored / retrieved from the second radio frequency signal exceeds the maximum distance threshold, the item storage is non-compliant, generating a virtual warehouse illegal storage / retrieval signal, such as issuing a "retrieval abnormality" virtual warehouse illegal storage / retrieval signal, locking the item's outbound access permission, and pushing the virtual warehouse illegal storage / retrieval signal to the administrator of the virtual warehouse.

[0101] Based on the above description, the virtual warehouse management method provided in this embodiment is not limited to a fixed area and can create virtual warehouses in any space, which is especially suitable for temporary storage scenarios such as offices and workshops. Furthermore, by detecting the status of goods in the virtual warehouse, inventory statistics deviations caused by damage or misplacement can be avoided. Moreover, in this embodiment, the virtual warehouse is verified through multiple dimensions such as vision, radio frequency, and work orders, which eliminates the problems of unreported pickup and misidentification of pickup personnel, and realizes full-process traceability of items in the virtual warehouse.

[0102] It should be understood that, although attached Figure 1 The steps in the flowchart are shown sequentially according to the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified in this document, there is no strict order requirement for the execution of these steps, and they can be executed in other orders. Furthermore, [the following is a list of steps]. Figure 1 At least some of the steps in the process may include multiple sub-steps or sub-stages. These sub-steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed in turn or alternately with other steps or at least some of the sub-steps or stages of other steps.

[0103] The virtual warehouse management method is described in detail in the embodiments disclosed above. Since the above-disclosed method can be implemented using various types of devices, this invention also discloses a virtual warehouse management device, in conjunction with the appendix. Figure 2 The following are specific embodiments for detailed explanation.

[0104] The fence marking module 601 is used to acquire electronic fence marking signals and combine them with the electronic fence marking signals to determine the designated area of ​​the virtual warehouse.

[0105] The inventory scanning module 602 is used to obtain the initial material storage information of the virtual warehouse based on the image information sent by all image acquisition devices and the radio frequency signals sent by all radio frequency signal acquisition devices within the designated area of ​​the virtual warehouse, and record it as the inventory information of the virtual warehouse.

[0106] The storage and retrieval compliance judgment module 603 is used to retrieve the warehouse item storage and retrieval work order based on the user's identity information if any user appears in the designated area of ​​the virtual warehouse, and to judge whether the item storage and retrieval is compliant by combining the warehouse item storage and retrieval work order, real-time image information and real-time radio frequency signal.

[0107] The inventory update module 604 is used to determine the actual stored or retrieved items in the virtual warehouse based on the warehouse item storage and retrieval work order, real-time image information and real-time radio frequency signal if the item storage and retrieval is compliant, and update the inventory information of the virtual warehouse in combination with the initial material storage information of the virtual warehouse.

[0108] For details regarding the virtual warehouse management device, please refer to the above description of the method; further elaboration will not be repeated here. Each module in the aforementioned device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in the processor of the terminal device in hardware form or independent of it, or stored in the memory of the terminal device in software form, so that the processor can call and execute the corresponding operations of each module.

[0109] In one embodiment, the present invention also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the virtual warehouse management method described above.

[0110] The computer-readable storage medium may be an electronic storage device such as flash memory, EEPROM (Electrically Erasable Programmable Read-Only Memory), EPROM (Erasable Programmable Read-Only Memory), hard disk, or ROM. Optionally, the computer-readable storage medium includes a non-transitory computer-readable storage medium. The computer-readable storage medium has storage space for program code that performs any of the method steps described above. This program code can be read from or written to one or more computer program products, and the program code may be compressed in an appropriate form.

[0111] In one embodiment, the present invention provides a computer device including a memory and a processor, wherein the memory stores a computer program, and the processor executes the above-described virtual warehouse management method when executing the computer program.

[0112] The computer device includes a memory, a processor, and one or more computer programs, wherein the one or more computer programs may be stored in the memory and configured to be executed by one or more processors, and one or more application programs are configured to perform the virtual warehouse management method described above.

[0113] A processor may include one or more processing cores. The processor connects to various parts of the computer device using various interfaces and lines, and performs various functions and processes data by running or executing instructions, programs, code sets, or instruction sets stored in memory, and by calling data stored in memory. Optionally, the processor may be implemented using at least one hardware form of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), or Programmable Logic Array (PLA). The processor may integrate one or a combination of several of the following: Central Processing Unit (CPU), Graphics Processing Unit (GPU), and modem. The CPU primarily handles the operating system, user interface, and applications; the GPU is responsible for rendering and drawing the displayed content; and the modem handles wireless communication. It is understood that the modem may also be implemented separately as a communication chip, without being integrated into the processor.

[0114] The memory may include random access memory (RAM) or read-only memory (ROM). The memory can be used to store instructions, programs, code, code sets, or instruction sets. The memory may include a program storage area and a data storage area. The program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as touch functionality, sound playback functionality, image playback functionality, etc.), and instructions for implementing the various method embodiments described above. The data storage area may also store data created by the terminal device during use.

[0115] The above embodiments are only used to illustrate the technical solutions of the present invention, and are not intended to limit it. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A virtual warehouse management method, characterized in that, The virtual warehouse management method is applied to a virtual warehouse system, which includes an image acquisition device, a radio frequency signal acquisition device, a user mobile terminal, and a central processing unit. The image acquisition device, the radio frequency signal acquisition device, and the user mobile terminal are all communicatively connected to the central processing unit. The virtual warehouse management method includes the following steps: Acquire electronic fence marking signals and combine them to determine the designated area of ​​the virtual warehouse; Based on the image information sent by all image acquisition devices and the radio frequency signals sent by all radio frequency signal acquisition devices within the designated area of ​​the virtual warehouse, the initial material storage information of the virtual warehouse is obtained and recorded as the inventory information of the virtual warehouse. If any user appears in the designated area of ​​the virtual warehouse, the warehouse item storage and retrieval work order will be retrieved based on the user's identity information, and the compliance of the item storage and retrieval will be determined by combining the warehouse item storage and retrieval work order, real-time image information and real-time radio frequency signal. If the storage and retrieval of the items are compliant, the actual items stored and retrieved in the virtual warehouse are determined based on the warehouse item storage and retrieval work order, real-time image information and real-time radio frequency signal, and the inventory information of the virtual warehouse is updated in combination with the initial material storage information of the virtual warehouse. Obtain the user identity information corresponding to the sent electronic fence marker signal; bind the user identity information to the designated area of ​​the corresponding virtual warehouse; When the designated areas of the virtual warehouses corresponding to different users do not overlap, if there is a material allocation between different users, the user information bound to the designated sub-area of ​​the material to be allocated will be changed by combining the designated sub-area of ​​the material to be allocated and the user information of both parties involved in the allocation.

2. The virtual warehouse management method as described in claim 1, characterized in that, Also includes: If the storage or retrieval of items is not compliant, an illegal storage or retrieval signal in the virtual warehouse is generated and sent to the administrator.

3. The virtual warehouse management method as described in any one of claims 1-2, characterized in that, The electronic fence marking signal includes electronic fence markings delineated by the user terminal in conjunction with received graphic information, or electronic fence markings placed on-site.

4. The virtual warehouse management method as described in claim 3, characterized in that, Also includes: If there is a monitoring blind spot formed by preset obstacles within the designated area of ​​the virtual warehouse, identify the edge of the monitoring blind spot formed by the preset obstacles; If the edge of the monitoring blind zone formed by the preset obstacles coincides with the edge of the virtual warehouse area, the monitoring blind zone is removed from the virtual warehouse area based on the edge of the monitoring blind zone to obtain the updated virtual warehouse area. If the edge of the monitoring blind zone formed by the preset obstacles does not coincide with the edge of the virtual warehouse area, a prompt message indicating that the virtual warehouse monitoring blind zone cannot be eliminated will be generated and sent to the administrator.

5. The virtual warehouse management method as described in claim 4, characterized in that, The initial material storage information of the virtual warehouse is obtained based on the image information sent by all image acquisition devices and the radio frequency signals sent by all radio frequency signal acquisition devices within the defined area of ​​the virtual warehouse. This information is recorded as the inventory information of the virtual warehouse. Specifically: The first material storage information is obtained based on the image information sent by all image acquisition devices within the designated area of ​​the virtual warehouse. The material information items of the first material storage information include the type, quantity, and status of the stored materials. The second material storage information is obtained based on the radio frequency signals sent by all radio frequency signal acquisition devices within the designated area of ​​the virtual warehouse. The material information items of the second material storage information include the quantity, location, and code of the stored materials. Extract the material information items from the first material storage information and the second material storage information; For the same stored material information item in the first and second stored material information, if the content of the same stored material information item is consistent, the content of the stored material information item shall be retained. If the contents of the same stored material information items are inconsistent, a material information identification inconsistency prompt message is generated and sent to the user's mobile terminal; For different storage material information items in the first and second material storage information, retain the content of all different storage material information items. By integrating all the retained identical and different stored material information items, the initial material storage information of the virtual warehouse is obtained.

6. The virtual warehouse management method as described in claim 5, characterized in that, If any user appears in the designated area of ​​the virtual warehouse, the warehouse item storage and retrieval work order is retrieved based on the user's identity information. The compliance of the item storage and retrieval is then determined by combining the warehouse item storage and retrieval work order, real-time image information, and real-time radio frequency signals. Specifically: Determine whether a user has entered the virtual warehouse based on real-time image information of the virtual warehouse; If a user enters the virtual warehouse, the user's identity information and actions are determined based on real-time image information and real-time radio frequency signals. If the user's action is to store or retrieve an item, capture the first image information of the stored item and input the first image information into the improved YOLOv8 model to obtain the moved item information; Combine the user's identity information to retrieve the warehouse item storage and retrieval work order. If the moving item information is consistent with the category of the item to be stored or retrieved in the warehouse item storage and retrieval work order, obtain the first radio frequency signal for user positioning based on the user's identity information, obtain the code information of the item to be stored or retrieved based on the warehouse item storage and retrieval work order, and obtain the second radio frequency signal for positioning the item to be stored or retrieved based on the code information of the item to be stored or retrieved. If the user location obtained from the first radio frequency signal coincides with the location of the item to be accessed obtained from the second radio frequency signal, the access to the item is deemed compliant. If the distance between the user location obtained from the first radio frequency signal and the location of the item to be stored obtained from the second radio frequency signal exceeds the maximum distance threshold, then the storage of the item is non-compliant.

7. The virtual warehouse management method as described in claim 6, characterized in that, Also includes: The user's location information is determined based on real-time image information and real-time radio frequency signals; The virtual warehouse operated by the user is determined based on the user's location information and actions; The user's permission level in the virtual warehouse is determined based on the user's identity information; If a user's actions are inconsistent with their permission level, a permission alert message will be issued.

8. A virtual warehouse management device, characterized in that, The virtual warehouse management device is applied to a virtual warehouse system, which includes an image acquisition device, a radio frequency signal acquisition device, a user mobile terminal, and a central processing unit. The image acquisition device, radio frequency signal acquisition device, and user mobile terminal are all communicatively connected to the central processing unit. The virtual warehouse management device includes the following modules: The fence marking module is used to acquire electronic fence marking signals and combine them to determine the designated area of ​​the virtual warehouse. The inventory scanning module is used to obtain the initial material storage information of the virtual warehouse based on the image information sent by all image acquisition devices and the radio frequency signals sent by all radio frequency signal acquisition devices within the defined area of ​​the virtual warehouse, and record it as the inventory information of the virtual warehouse. The storage and retrieval compliance judgment module is used to retrieve the warehouse item storage and retrieval work order based on the user's identity information if any user appears in the designated area of ​​the virtual warehouse, and to judge whether the storage and retrieval of items is compliant by combining the warehouse item storage and retrieval work order, real-time image information and real-time radio frequency signal. The inventory update module is used to determine the actual stored and retrieved items in the virtual warehouse based on the warehouse item storage and retrieval work order, real-time image information and real-time radio frequency signal if the item storage and retrieval is compliant, and update the inventory information of the virtual warehouse in combination with the initial material storage information of the virtual warehouse. Obtain the user identity information corresponding to the sent electronic fence marker signal; Bind user identity information to the designated area of ​​the corresponding virtual warehouse; When the designated areas of the virtual warehouses corresponding to different users do not overlap, if there is a material allocation between different users, the user information bound to the designated sub-area of ​​the material to be allocated will be changed by combining the designated sub-area of ​​the material to be allocated and the user information of both parties involved in the allocation.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the virtual warehouse management method according to any one of claims 1-7.

10. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it performs the virtual warehouse management method according to any one of claims 1-7.

Images