Storage and distribution management system and method based on augmented reality technology

Abstract

The invention discloses a storage distribution management system and method based on an augmented reality technology, and belongs to the technical field of storage management, and the method comprises the following steps: setting a cloud server and an AR end, and enabling the AR end to collect and display image information; the cloud server pre-stores a storage three-dimensional diagram; the AR end obtains current position information; the cloud server determines a current point location of the AR end in the storage three-dimensional diagram according to the position information and marks the current point location; the AR end receives cargo warehousing information, the AR end receives an instruction and selects a cargo storage area on a warehousing three-dimensional diagram according to the instruction, the cloud server modifies the cargo storage information according to the cargo warehousing information, the AR end receives shipment information, and the AR end selects the cargo storage area on the warehousing three-dimensional diagram according to the shipment instruction after receiving the shipment instruction. And the cloud server deletes the goods storage area corresponding to the highlight area in the stored warehouse three-dimensional diagram. The warehouse management system and method have the effects of effectively improving the warehouse management efficiency and reducing the workload of workers.

Description

Technical Field

[0001] The present invention relates to the field of warehouse management, and in particular to a warehouse distribution management system and method based on augmented reality technology. Background Art

[0002] At present, warehousing and distribution management is a comprehensive management field involving multiple links and aspects, which covers the core functions of storage, transportation and distribution of goods. According to the characteristics and storage requirements of the goods, the layout of the warehouse is reasonably planned, including the area of ​​the warehouse, the division of storage areas, the setting of channels, etc., to optimize the storage and access efficiency and space utilization of the goods. Receive customer order information, and perform data entry, coordination of delivery dates, etc. Ensure that the order information is accurate and communicated to the relevant departments in a timely manner for execution. Users need to manage the storage and transportation of warehoused goods at the same time.

[0003] The above-mentioned existing technical solutions have the following defects: users usually use office software in digital devices such as computers to manage storage, but for large-scale storage systems, the amount of storage information is huge, and it is inconvenient for users to manage it through commonly used office software. Summary of the invention

[0004] In order to simplify the warehouse management work of the staff, the present application provides a warehouse distribution management system and method based on augmented reality technology.

[0005] On the one hand, the present application provides a warehouse distribution management method based on augmented reality technology, which adopts the following technical solutions: A warehouse distribution management method based on augmented reality technology includes the following steps: Set up a cloud server and AR end, and the AR end collects image information and displays it; The cloud server pre-stores a 3D warehouse map, which is generated according to the size and location information of the warehouse; The AR end obtains the current location information and uploads the location information to the cloud server; After obtaining the location information, the cloud server determines the current location of the AR terminal in the warehouse 3D map based on the location information and marks it, and sends the marked warehouse 3D map to the AR terminal; The AR terminal displays a three-dimensional image of the warehouse; The AR end receives the cargo entry information, which includes cargo information and entry requirements; The AR end receives the instruction and selects the cargo storage area on the warehouse 3D map according to the instruction, uploads the warehouse 3D map and cargo warehousing information to the cloud server, and draws a route map on the warehouse 3D map with the current location as the starting point and the cargo storage area as the end point, and displays the moving direction according to the route map on the warehouse 3D map; The cloud server modifies the cargo storage information according to the cargo warehousing information, and overwrites the original warehouse 3D map with the received warehouse 3D map; The AR end receives the shipping information, which includes the cargo information and the destination information. The AR end searches for the cargo information on the three-dimensional warehouse map, and highlights the cargo storage area with the corresponding cargo information on the three-dimensional warehouse map; After receiving the shipping instruction, the AR end selects the cargo storage area on the warehouse 3D map according to the shipping instruction, retains the highlight mark of the selected area in the warehouse 3D map, and uploads the modified warehouse 3D map and shipping information to the cloud server. The AR end draws a route map with the current position as the starting point and the highlighted area as the end point, and displays the moving direction according to the route map on the warehouse 3D map. When the AR end reaches the highlighted area, the cargo is highlighted in the collected image information; The cloud server deletes the cargo storage area corresponding to the highlighted area in the stored three-dimensional warehouse image according to the received three-dimensional warehouse image, and modifies the cargo storage information according to the shipping information.

[0006] By adopting the above solution, the staff can load the AR end by wearing the AR device. When receiving the information of goods entering the warehouse, the AR end and the cloud server will work together to automatically find a suitable location for storing the goods. After the staff selects the storage location, the AR end will also show the staff the arrival route and guidance icons to facilitate the staff to enter the warehouse. When receiving the information of goods leaving the warehouse, the AR end and the cloud server will work together to automatically find the location of the goods to be shipped out. The AR end will show the staff the arrival route and guidance icons, and when approaching the goods to be shipped out, the AR end will also highlight the goods to be shipped out. The staff can intuitively understand the goods that need to be shipped out and carry out the shipment, which effectively improves the work efficiency of the staff and reduces the workload of the staff.

[0007] Preferably, the step of "the cloud server obtains the location information and determines and marks the current position of the AR terminal in the three-dimensional warehouse map according to the location information" also includes: Set the cargo storage space occupancy level, and generate a three-dimensional cargo space occupancy model for each level of cargo storage space; Divide the storage area of ​​each level of cargo storage space on the three-dimensional warehouse map; The step of "the AR end receives the instruction and selects the cargo storage area on the warehouse three-dimensional map according to the instruction" also includes: According to the cargo information, the corresponding cargo storage space level and cargo space occupancy three-dimensional model are called, and the storage area corresponding to the cargo storage space level is highlighted on the warehouse three-dimensional map according to the cargo storage space level; The AR end receives the instruction and selects the cargo storage area on the warehouse three-dimensional map according to the instruction, and adds a three-dimensional model of the cargo occupied space in the selected cargo storage area.

[0008] By adopting the above solution, the clear storable area on the warehouse three-dimensional map allows the AR end to accurately find the location where the goods can be stored. When the goods are put into the warehouse, the three-dimensional model of the space occupied by the goods can also be used to accurately determine the storage location of the goods.

[0009] Preferably, the step of "dividing the storable area of ​​each level of cargo storage space on the three-dimensional warehouse map" further includes: Selecting a three-dimensional model of cargo space occupation according to the cargo storage space occupation level corresponding to the storable area, filling the storable area with the selected three-dimensional model of cargo space occupation, and virtualizing the three-dimensional model of cargo space occupation in the storable area into a non-substantial cell; The step of "the AR end receives the instruction and selects the cargo storage area on the warehouse three-dimensional map according to the instruction, and adds a three-dimensional model of the cargo occupied space in the selected cargo storage area" also includes: When adding a 3D model of cargo space, fill the 3D model of cargo space into unoccupied non-entity cells and flash it; When the AR end receives the confirmation command, it cancels the flashing of the three-dimensional model of the cargo space and uploads the three-dimensional warehouse map to the cloud server; When the AR end receives the modification instruction, it moves the flashing three-dimensional model of the space occupied by the cargo according to the modification instruction.

[0010] By adopting the above solution, when the goods are put into the warehouse, the AR side will first show the recommended storage location to the staff. The staff can determine the storage location or change it at will. The absence of physical cells can prevent the staff from putting the goods in the wrong place.

[0011] Preferably, the step of "the AR terminal receives the instruction and selects the cargo storage area on the warehouse three-dimensional map according to the instruction" further includes: The AR terminal detects the remaining space in the selected cargo storage area in the warehouse 3D map, excluding the 3D model of the space occupied by the added cargo; If the remaining space is smaller than the model volume of the three-dimensional model of the cargo space occupation, a warning is displayed and the storable area corresponding to the remaining cargo storage space occupation level is highlighted.

[0012] By adopting the above solution, when the staff selects the storage area for the goods, if the space in the selected area is not sufficient to store the goods, the AR side will prompt the staff.

[0013] Preferably, the step of "highlighting the goods in the collected image information after the AR terminal reaches the highlighted area" further includes: Cargo information includes cargo entry code and cargo appearance diagram; When the AR terminal reaches the highlighted area, it scans the QR code in the collected image information. When the cargo entry code of the goods to be picked up is scanned, it searches for the contour that is most similar to the cargo appearance with the scanned cargo entry code as the center, and highlights the area within the contour; If the goods entry code is not scanned, when the AR end receives the approximate search instruction, it uses the marked point in the warehouse three-dimensional map as the viewing point according to the current position information, determines the field of view direction according to the gyroscope on the AR end, and then substitutes the currently collected image information into the warehouse three-dimensional map, selects the highlighted area in the current display screen, and then searches for the contour most similar to the goods appearance in the selected area, and highlights the area within the contour.

[0014] By adopting the above solution, when the goods are shipped out of the warehouse, the AR end can accurately mark the location of the goods by scanning the QR code on the goods. If the QR code cannot be scanned, the location of the goods can also be marked by the location and appearance of the goods.

[0015] On the other hand, the present application provides a warehouse distribution management system based on augmented reality technology, which adopts the following technical solutions: A warehouse distribution management system based on augmented reality technology, comprising a cloud server and an AR terminal, wherein the cloud server comprises a data storage module, an image sending module, a goods warehousing module, and a goods outbound module; The data storage module pre-stores a three-dimensional warehouse map and cargo storage information, and the three-dimensional warehouse map is generated according to the size and location information of the warehouse; The image sending module calls the three-dimensional warehouse map stored in the data storage module and receives the position information, determines the current point of the AR terminal in the three-dimensional warehouse map according to the position information and marks it, and sends the marked three-dimensional warehouse map to the AR terminal; The cargo entry module receives cargo entry information, calls the three-dimensional storage map and cargo storage information stored in the data storage module, modifies the cargo storage information according to the cargo entry information, and covers the original three-dimensional storage map with the received three-dimensional storage map; The cargo outbound module receives the three-dimensional warehouse map and the shipping information, deletes the cargo storage area corresponding to the highlighted area in the stored three-dimensional warehouse map according to the received three-dimensional warehouse map, and modifies the cargo storage information according to the shipping information; The AR terminal includes an image acquisition module, an image processing module, a location upload module, an inbound processing module, an outbound processing module, and a shipping marking module; The image acquisition module acquires image information and transmits it to the image processing module; The image processing module receives image information for display. When receiving the three-dimensional warehouse map from the image sending module, the three-dimensional warehouse map is added to the image information for display. When receiving the route map, the position is determined according to the marking points in the three-dimensional warehouse map, the gyroscope determines the direction, and a moving direction mark is generated according to the route map. The route map is added to the three-dimensional warehouse map, and the three-dimensional warehouse map and the moving direction mark are added to the image information for display. The position uploading module obtains the current position information and sends the position information to the image sending module; The warehousing processing module receives the goods warehousing information, which includes the goods information and warehousing requirements. After receiving the warehousing instruction, the warehousing processing module selects the goods storage area on the 3D warehouse map according to the instruction, sends the 3D warehouse map and the goods warehousing information to the goods warehousing module, draws a route map on the 3D warehouse map with the current position as the starting point and the goods storage area as the end point, and sends the route map to the image processing module. The outbound processing module receives the shipping information, which includes the cargo information and the destination information. The outbound processing module searches for the cargo information on the three-dimensional warehouse map, highlights the cargo storage area with the corresponding cargo information on the three-dimensional warehouse map, selects the cargo storage area on the three-dimensional warehouse map according to the shipping instruction after receiving the shipping instruction, retains the highlight mark of the selected area in the three-dimensional warehouse map, sends the modified three-dimensional warehouse map and the shipping information to the cargo outbound module, draws a route map with the current position as the starting point and the highlighted area as the end point, and sends the route map to the image processing module; The shipment marking module calls the warehouse three-dimensional map of the image processing module. When the marking point in the warehouse three-dimensional map reaches the end point of the route map, the goods are highlighted in the image information and the marked warehouse three-dimensional map is sent to the image processing module.

[0016] By adopting the above solution, the staff can load the AR end by wearing the AR device. When receiving the information of goods entering the warehouse, the AR end and the cloud server will work together to automatically find a suitable location for storing the goods. After the staff selects the storage location, the AR end will also show the staff the arrival route and guidance icons to facilitate the staff to enter the warehouse. When receiving the information of goods leaving the warehouse, the AR end and the cloud server will work together to automatically find the location of the goods to be shipped out. The AR end will show the staff the arrival route and guidance icons, and when approaching the goods to be shipped out, the AR end will also highlight the goods to be shipped out. The staff can intuitively understand the goods that need to be shipped out and carry out the shipment, which effectively improves the work efficiency of the staff and reduces the workload of the staff.

[0017] Preferably, the cloud server further comprises an image segmentation module, the image segmentation module calls the three-dimensional warehouse map stored in the data storage module, the image segmentation module receives external input instructions and sets the cargo storage space classification according to the instructions, generates a three-dimensional model of cargo space for each level of cargo storage space, divides the storable area of ​​each level of cargo storage space on the three-dimensional warehouse map, and sends the cargo storage space classification, the cargo space three-dimensional model and the three-dimensional warehouse map to the data storage module for storage; The image sending module calls the storage space classification and cargo space occupancy three-dimensional model of the data storage module, and sends the storage space classification and cargo space occupancy three-dimensional model to the AR terminal; The warehousing processing module calls the corresponding cargo storage space occupation level and the cargo occupation space three-dimensional model according to the cargo information, and highlights the storable area corresponding to the cargo storage space occupation level on the warehouse three-dimensional map according to the cargo storage space occupation level. After receiving the warehousing instruction, the warehousing processing module selects the cargo storage area on the warehouse three-dimensional map according to the instruction, and adds the cargo occupation space three-dimensional model in the selected cargo storage area.

[0018] By adopting the above solution, the clear storable area on the warehouse three-dimensional map allows the AR end to accurately find the location where the goods can be stored. When the goods are put into the warehouse, the three-dimensional model of the space occupied by the goods can also be used to accurately determine the storage location of the goods.

[0019] Preferably, the image division module selects a three-dimensional model of the cargo space occupied according to the cargo storage space occupied level corresponding to the storable area, fills the storable area with the selected three-dimensional model of the cargo space occupied, and virtualizes the three-dimensional model of the cargo space occupied in the storable area into a non-substantial cell; When adding the three-dimensional model of the space occupied by goods, the warehousing processing module fills the three-dimensional model of the space occupied by goods into the unoccupied entity-free cell and makes it flash. When the warehousing processing module receives a modification instruction, it moves the flashing three-dimensional model of the space occupied by goods according to the modification instruction. When the warehousing processing module receives a confirmation instruction, it cancels the flashing of the three-dimensional model of the space occupied by goods and transmits the three-dimensional warehouse map to the goods warehousing module.

[0020] By adopting the above solution, when the goods are put into the warehouse, the AR side will first show the recommended storage location to the staff. The staff can determine the storage location or change it at will. The absence of physical cells can prevent the staff from putting the goods in the wrong place.

[0021] Preferably, the warehousing processing module detects the remaining space in the cargo storage area selected in the warehouse three-dimensional map, excluding the three-dimensional model of the space occupied by the added cargo. If the remaining space is smaller than the model volume of the three-dimensional model of the space occupied by the cargo, a warning is displayed and the storable area corresponding to the remaining cargo storage space occupation level is highlighted.

[0022] By adopting the above solution, when the staff selects the storage area for the goods, if the space in the selected area is not sufficient to store the goods, the AR side will prompt the staff.

[0023] Preferably, the cargo information includes a cargo entry code and a cargo appearance diagram. The shipping marking module scans the QR code in the image information. When the cargo entry code of the cargo to be picked up is scanned, the scanned cargo entry code is used as the center to search for the contour most similar to the cargo appearance diagram, and the area within the contour is highlighted. If the cargo entry code is not scanned, the shipping marking module receives an approximate search instruction, uses the marked point in the warehouse three-dimensional map as a viewing point according to the current position information, determines the field of view direction according to the gyroscope on the AR end, and then substitutes the currently collected image information into the warehouse three-dimensional map, selects the highlighted area in the current display screen, and then searches for the contour most similar to the cargo appearance diagram in the selected area, and highlights the area within the contour.

[0024] By adopting the above solution, when the goods are shipped out of the warehouse, the AR end can accurately mark the location of the goods by scanning the QR code on the goods. If the QR code cannot be scanned, the location of the goods can also be marked by the location and appearance of the goods.

[0025] In summary, the present invention has the following beneficial effects: 1. When goods are put into storage, the AR end and the cloud server will automatically find a suitable location for storing the goods. After the staff selects the storage location, the AR end will also show the staff the route and guidance icons to facilitate the staff to put the goods into storage.

[0026] 2. When the goods are shipped out, the AR end and the cloud server will work together to automatically find the location of the goods that need to be shipped out. The AR end will show the staff the route to the goods and guidance icons, and when approaching the goods that need to be shipped out, the AR end will also highlight the goods that need to be shipped out, so that the staff can intuitively understand the goods that need to be shipped out. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 It is an overall system block diagram of the second embodiment of the present application.

[0028] Figure 2 This is a module block diagram of the cloud server and AR terminal in Example 2 of the present application.

[0029] Description of reference numerals: 1. Cloud server; 11. Data storage module; 12. Image sending module; 13. Goods warehousing module; 14. Goods outbound module; 15. Image segmentation module; 2. AR terminal; 21. Image acquisition module; 22. Image processing module; 23. Location upload module; 24. Warehouse entry processing module; 25. Outbound processing module; 26. Shipping marking module. DETAILED DESCRIPTION

[0030] The present application embodiment discloses a warehouse distribution management method based on augmented reality technology, and the specific steps are as follows: A cloud server 1 and an AR terminal 2 are set up, and the AR terminal 2 collects image information and displays it. The cloud server 1 is set in the server host and communicates with other devices through the Internet of Things. The AR terminal 2 is set in the smart AR glasses and the mobile device, and the smart AR glasses are used to shoot the same picture as the user's human eye field of view, and the smart AR glasses can display the received picture.

[0031] The cloud server 1 pre-stores a three-dimensional warehouse map, which is generated according to the size and location information of the warehouse. The three-dimensional warehouse map is manually generated by a three-dimensional map creation software, which can use SOLIDWORKS.

[0032] AR terminal 2 obtains the current location information and uploads the location information to cloud server 1. AR terminal 2 obtains the location through the positioning system of the mobile device or smart AR glasses. The positioning system can use the GPS positioning system or the Beidou positioning system, or can use radio frequency identification (RFID) positioning.

[0033] The cloud server 1 sets the cargo storage space occupancy classification and generates a cargo space occupancy three-dimensional model for each cargo storage space occupancy classification. The cargo space occupancy three-dimensional model is a three-dimensional model established in a three-dimensional software according to the shape and size of the cargo corresponding to each cargo storage space occupancy classification, and its size standard is the same as the three-dimensional warehouse map.

[0034] Divide the storage area of ​​each level of cargo storage space on the three-dimensional warehouse diagram.

[0035] Select the cargo space 3D model according to the cargo storage space level corresponding to the storable area, fill the storable area with the selected cargo space 3D model, and virtualize the cargo space 3D model in the storable area into non-entity cells. Generate the cargo space 3D model in the storable area in an array in the 3D software until the cargo space 3D model fills the storable area.

[0036] After obtaining the location information, the cloud server 1 determines the current position of the AR terminal 2 in the three-dimensional warehouse map according to the location information and marks it, and sends the marked three-dimensional warehouse map to the AR terminal 2.

[0037] AR terminal 2 displays a three-dimensional image of the warehouse.

[0038] AR terminal 2 receives cargo entry information, which includes cargo information and entry requirements. The cargo information includes cargo entry code and cargo appearance drawing.

[0039] The corresponding cargo storage space occupation level and cargo occupation space three-dimensional model are called according to the cargo information, and the storable area corresponding to the cargo storage space occupation level is highlighted on the warehouse three-dimensional map according to the cargo storage space occupation level.

[0040] AR terminal 2 detects the remaining space in the selected cargo storage area in the warehouse 3D map, excluding the added cargo space occupancy 3D model. The selected cargo storage area is the area where the current cargo should be stored, and there is an added cargo space occupancy 3D model inside it. The current incoming cargo can only be placed in the remaining space excluding the stored cargo, and the remaining space is screened out to prepare for the subsequent steps.

[0041] If the remaining space is smaller than the model volume of the three-dimensional model of the cargo space, a warning is displayed and the storage area corresponding to the remaining cargo storage space level is highlighted. When the staff selects the storage area for the cargo on the AR terminal 2, if the selected area is not large enough to store the cargo, the AR terminal 2 will prompt the staff. If the remaining space is smaller than the model volume of the three-dimensional model of the cargo space, it means that the remaining space is not large enough to store the cargo to be stored.

[0042] AR terminal 2 receives the instruction and selects the cargo storage area on the warehouse three-dimensional map according to the instruction, and adds the three-dimensional model of the cargo space occupied in the selected cargo storage area. The clear storage area on the warehouse three-dimensional map allows AR terminal 2 to accurately find the location where the cargo can be stored, and can also accurately determine the cargo storage location through the three-dimensional model of the cargo space occupied when the cargo is put into storage. Selecting an area on the warehouse three-dimensional map means manually establishing a non-entity three-dimensional model. The space within the three-dimensional model is the selected area. The three-dimensional model of the cargo space occupied can be added by dragging the three-dimensional model of the cargo space occupied in the three-dimensional software interface.

[0043] When adding a 3D model of cargo space, the 3D model of cargo space is filled into the unoccupied non-entity cells and flashes. After dragging a model of a fixed shape and size into the stored 3D map, the 3D software can automatically adsorb the dragged model into a non-entity cell of the same size. After a solid model exists in the non-entity cell, its status changes to occupied.

[0044] When the AR terminal 2 receives the confirmation instruction, it cancels the flashing of the three-dimensional model of the cargo-occupied space and uploads the three-dimensional warehouse map to the cloud server 1.

[0045] When AR terminal 2 receives the modification instruction, it moves the flashing three-dimensional model of the space occupied by the goods according to the modification instruction. When the goods are put into the warehouse, AR terminal 2 will first show the recommended storage location to the staff. The staff can determine the storage location or change it at will. The absence of physical cells can prevent the staff from misplacing the goods. The modification instruction means that the staff manually drags the flashing three-dimensional model of the space occupied by the goods on the smart AR glasses interface.

[0046] The warehouse 3D map and the goods warehousing information are uploaded to the cloud server 1. The AR terminal 2 draws a route map on the warehouse 3D map with the current location as the starting point and the goods storage area as the end point, and displays the moving direction according to the route map on the warehouse 3D map. The route map can be automatically generated using route map generation software such as ProductPlan and PingCode.

[0047] The cloud server 1 modifies the cargo storage information according to the cargo warehousing information, and covers the original warehouse three-dimensional map with the received warehouse three-dimensional map.

[0048] AR terminal 2 receives the shipping information, which includes cargo information and destination information. AR terminal 2 searches for cargo information on the three-dimensional warehouse map, and highlights the cargo storage area with corresponding cargo information on the three-dimensional warehouse map.

[0049] After receiving the shipping instruction, AR terminal 2 selects the cargo storage area on the warehouse three-dimensional map according to the shipping instruction, retains the highlighted mark of the selected area in the warehouse three-dimensional map, and uploads the modified warehouse three-dimensional map and shipping information to cloud server 1. AR terminal 2 draws a route map with the current position as the starting point and the highlighted area as the end point, and displays the moving direction according to the route map on the warehouse three-dimensional map.

[0050] When the AR terminal 2 reaches the highlighted area, it scans the QR code in the collected image information. When the cargo entry code of the goods to be picked up is scanned, the scanned cargo entry code is used as the center to search for the contour most similar to the cargo outline, and the area within the contour is highlighted.

[0051] If the goods entry code is not scanned, when AR terminal 2 receives the approximate search instruction, it uses the marked point in the warehouse 3D map as the view acquisition point according to the current position information, determines the field of view direction according to the gyroscope of AR terminal 2, and then substitutes the currently acquired image information into the warehouse 3D map, selects the highlighted area in the current display screen, and then searches for the outline that is most similar to the goods appearance in the selected area, and highlights the area within the outline. When the goods are out of the warehouse, AR terminal 2 can accurately mark the location of the goods by scanning the QR code on the goods. If the QR code cannot be scanned, the location of the goods can also be marked by the location and appearance of the goods.

[0052] The cloud server 1 deletes the cargo storage area corresponding to the highlighted area in the stored three-dimensional warehouse map according to the received three-dimensional warehouse map, and modifies the cargo storage information according to the shipping information.

[0053] The implementation principle of a warehouse distribution management system and method based on augmented reality technology in an embodiment of the present application is as follows: the staff can load the AR terminal 2 by wearing an AR device. When receiving the information of goods entering the warehouse, the AR terminal 2 and the cloud server 1 will cooperate to automatically find a suitable location for storing the goods. After the staff selects the storage location, the AR terminal 2 will also show the staff the arrival route and guidance icons to facilitate the staff to enter the warehouse. When receiving the information of goods leaving the warehouse, the AR terminal 2 and the cloud server 1 will cooperate to automatically find the location of the goods to be shipped out. The AR terminal 2 will show the staff the arrival route and guidance icons, and when approaching the goods to be shipped out, the AR terminal 2 will also highlight the goods to be shipped out. The staff can intuitively understand the goods that need to be shipped out and carry out the shipment, which effectively improves the work efficiency of the staff and reduces the workload of the staff.

[0054] The present application embodiment discloses a warehouse distribution management system based on augmented reality technology, such as Figure 1 and Figure 2 As shown, it includes a cloud server 1 and an AR terminal 2. The cloud server 1 is set in the server host, and the AR terminal 2 is set in the AR device of the staff. The AR device can be AR glasses or a mobile phone with AR function. The AR device has a photo taking function and a gyroscope positioning function. The cloud server 1 includes a data storage module 11, an image sending module 12, a goods warehousing module 13, a goods outgoing module 14, and an image segmentation module 15. The AR terminal 2 includes an image acquisition module 21, an image processing module 22, a location upload module 23, an incoming processing module 24, an outgoing processing module 25, and a shipping marking module 26.

[0055] like Figure 2 As shown, the data storage module 11 pre-stores a three-dimensional warehouse map and cargo storage information, and the three-dimensional warehouse map is generated according to the size and location information of the warehouse.

[0056] like Figure 2As shown, the image segmentation module 15 calls the three-dimensional warehouse map stored in the data storage module 11. The image segmentation module 15 receives external input instructions and sets the cargo storage space classification according to the instructions, and generates a cargo space classification model for each level of cargo storage space, and divides the storage area of ​​each level of cargo storage space on the three-dimensional warehouse map. The image segmentation module 15 selects the cargo space classification model according to the cargo storage space classification corresponding to the storage area, fills the storage area with the selected cargo space classification model, and virtualizes the cargo space classification model in the storage area into a non-physical cell. The cargo storage space classification, cargo space classification model and the three-dimensional warehouse map are sent to the data storage module 11 for storage.

[0057] like Figure 2 As shown, the image sending module 12 calls the three-dimensional warehouse map stored in the data storage module 11 and receives the location information, determines the current point of the AR terminal 2 in the three-dimensional warehouse map according to the location information and marks it. The image sending module 12 calls the storage occupied space classification and the three-dimensional model of the cargo occupied space of the data storage module 11, and sends the three-dimensional warehouse map, the storage occupied space classification and the three-dimensional model of the cargo occupied space to the AR terminal 2.

[0058] like Figure 2 As shown, the goods warehousing module 13 receives the goods warehousing information, calls the warehousing three-dimensional map and goods storage information stored in the data storage module 11, modifies the goods storage information according to the goods warehousing information, and covers the original warehousing three-dimensional map with the received warehousing three-dimensional map.

[0059] like Figure 2 As shown, the cargo outbound module 14 receives the 3D warehouse map and the shipping information, deletes the cargo storage area corresponding to the highlighted area in the stored 3D warehouse map according to the received 3D warehouse map, and modifies the cargo storage information according to the shipping information.

[0060] like Figure 2 As shown, the image acquisition module 21 acquires image information and transmits it to the image processing module 22. The image processing module 22 receives the image information for display. When receiving the three-dimensional warehouse map from the image sending module 12, the three-dimensional warehouse map is added to the image information for display. When receiving the route map, the position is determined according to the marking points in the three-dimensional warehouse map, the gyroscope determines the direction, and a moving direction mark is generated according to the route map, and the route map is added to the three-dimensional warehouse map. The three-dimensional warehouse map and the moving direction mark are added to the image information for display.

[0061] like Figure 2 As shown, the position uploading module 23 obtains the current position information and sends the position information to the image sending module 12 .

[0062] like Figure 2As shown, the warehousing processing module 24 receives the goods warehousing information, which includes the goods information and warehousing requirements, and the goods information includes the goods warehousing code and the goods appearance diagram. After receiving the warehousing instruction, the goods storage area is selected on the warehouse three-dimensional map according to the instruction, and the warehouse three-dimensional map and the goods warehousing information are sent to the goods warehousing module 13. The warehousing processing module 24 calls the corresponding goods storage space occupation level and the goods occupancy space three-dimensional model according to the goods information, and highlights the storage area corresponding to the goods storage space occupation level on the warehouse three-dimensional map according to the goods storage space occupation level. After receiving the warehousing instruction, the warehousing processing module 24 selects the goods storage area on the warehouse three-dimensional map according to the instruction, and adds the goods occupancy space three-dimensional model in the selected goods storage area. Draw a route map on the warehouse three-dimensional map with the current position as the starting point and the goods storage area as the end point, and send the route map to the image processing module 22. When adding the three-dimensional model of the cargo space occupied, the warehouse entry processing module 24 fills the three-dimensional model of the cargo space occupied into the unoccupied non-entity cell and flashes it. When the warehouse entry processing module 24 receives the modification instruction, it moves the flashing three-dimensional model of the cargo space occupied according to the modification instruction. When the warehouse entry processing module 24 receives the confirmation instruction, it cancels the flashing of the three-dimensional model of the cargo space occupied and transmits the three-dimensional storage map to the cargo warehouse entry module 13. The warehouse entry processing module 24 detects the remaining space in the cargo storage area selected in the three-dimensional storage map except for the added three-dimensional model of the cargo space occupied. If the remaining space is less than the model volume of the three-dimensional model of the cargo space occupied, a warning is displayed and the storage area corresponding to the remaining cargo storage space level is highlighted.

[0063] like Figure 2 As shown, the outbound processing module 25 receives the shipping information, which includes the cargo information and the destination information. The outbound processing module 25 searches for the cargo information on the warehouse three-dimensional map, highlights the cargo storage area with the corresponding cargo information on the warehouse three-dimensional map, and after receiving the shipping instruction, selects the cargo storage area on the warehouse three-dimensional map according to the shipping instruction, retains the highlight mark of the selected area in the warehouse three-dimensional map, sends the modified warehouse three-dimensional map and the shipping information to the cargo outbound module 14, draws a route map with the current position as the starting point and the highlighted area as the end point, and sends the route map to the image processing module 22.

[0064] like Figure 2As shown, the shipment marking module 26 calls the storage three-dimensional map of the image processing module 22. When the marking point in the storage three-dimensional map reaches the end of the route map, the goods are highlighted in the image information, and the marked storage three-dimensional map is sent to the image processing module 22. The shipment marking module 26 scans the QR code in the image information. When the goods entry code of the goods to be picked up is scanned, the scanned goods entry code is used as the center to search for the contour most similar to the goods appearance map, and the area inside the contour is highlighted. If the goods entry code is not scanned, the shipment marking module 26 receives the approximate search instruction, uses the marking point in the storage three-dimensional map as the view acquisition point according to the current position information, determines the field of view direction according to the gyroscope of the AR terminal 2, and then substitutes the currently collected image information into the storage three-dimensional map, selects the highlighted area in the current display screen, and then searches for the contour most similar to the goods appearance map in the selected area, and highlights the area inside the contour.

[0065] The embodiments of this specific implementation method are all preferred embodiments of the present invention, and are not intended to limit the protection scope of the present invention. Therefore, any equivalent changes made based on the structure, shape, and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A warehouse distribution management method based on augmented reality technology, characterized in that: The following steps are involved: A cloud server (1) and an AR terminal (2) are provided, and the AR terminal (2) collects image information and displays it; The cloud server (1) pre-stores a three-dimensional warehouse map, and the three-dimensional warehouse map is generated according to the size and location information of the warehouse; The AR terminal (2) obtains the current location information and uploads the location information to the cloud server (1); After obtaining the location information, the cloud server (1) determines the current location of the AR terminal (2) in the three-dimensional warehouse map according to the location information and marks it, and sends the marked three-dimensional warehouse map to the AR terminal (2); The AR end (2) displays a three-dimensional image of the warehouse; The AR end (2) receives the cargo entry information, which includes cargo information and entry requirements; The AR end (2) receives the instruction and selects a cargo storage area on the three-dimensional warehouse map according to the instruction, and uploads the three-dimensional warehouse map and cargo storage information to the cloud server (1). The AR end (2) draws a route map on the three-dimensional warehouse map with the current position as the starting point and the cargo storage area as the end point, and displays the moving direction according to the route map on the three-dimensional warehouse map; The cloud server (1) modifies the cargo storage information according to the cargo warehousing information, and covers the original warehouse three-dimensional map with the received warehouse three-dimensional map; The AR end (2) receives the shipping information, which includes cargo information and destination information. The AR end (2) searches for the cargo information on the three-dimensional warehouse map, and highlights the cargo storage area where the corresponding cargo information exists on the three-dimensional warehouse map; After receiving the shipping instruction, the AR end (2) selects a cargo storage area on the warehouse three-dimensional map according to the shipping instruction, retains the highlight mark of the selected area in the warehouse three-dimensional map, and uploads the modified warehouse three-dimensional map and shipping information to the cloud server (1). The AR end (2) draws a route map with the current position as the starting point and the highlighted area as the end point, and displays the moving direction according to the route map on the warehouse three-dimensional map. When the AR end (2) reaches the highlighted area, the cargo is highlighted in the collected image information; The cloud server (1) deletes the cargo storage area corresponding to the highlighted area in the stored three-dimensional warehouse image according to the received three-dimensional warehouse image, and modifies the cargo storage information according to the shipping information.

2. The warehouse distribution management method based on augmented reality technology according to claim 1 is characterized in that: The step of "the cloud server (1) obtains the location information and determines the current point of the AR terminal (2) in the three-dimensional warehouse map according to the location information and marks it" also includes: Set the cargo storage space occupancy level, and generate a three-dimensional cargo space occupancy model for each level of cargo storage space; Divide the storage area of ​​each level of cargo storage space on the three-dimensional warehouse map; The step of "the AR end (2) receives the instruction and selects the cargo storage area on the three-dimensional warehouse map according to the instruction" also includes: According to the cargo information, the corresponding cargo storage space level and cargo space occupancy three-dimensional model are called, and the storage area corresponding to the cargo storage space level is highlighted on the warehouse three-dimensional map according to the cargo storage space level; The AR end (2) receives the instruction and selects a cargo storage area on the warehouse three-dimensional map according to the instruction, and adds a three-dimensional model of the cargo occupied space in the selected cargo storage area.

3. The warehouse distribution management method based on augmented reality technology according to claim 2 is characterized in that: The step of "dividing the storage area of ​​each level of cargo storage space on the three-dimensional warehouse map" also includes: Selecting a three-dimensional model of cargo space occupation according to the cargo storage space occupation level corresponding to the storable area, filling the storable area with the selected three-dimensional model of cargo space occupation, and virtualizing the three-dimensional model of cargo space occupation in the storable area into a non-substantial cell; The step "the AR end (2) receives the instruction and selects a cargo storage area on the warehouse three-dimensional map according to the instruction, and adds a three-dimensional model of the cargo occupied space in the selected cargo storage area" also includes: When adding a 3D model of cargo space, fill the 3D model of cargo space into unoccupied non-entity cells and flash it; When the AR end (2) receives the confirmation command, it cancels the flashing of the three-dimensional model of the cargo-occupied space and uploads the three-dimensional warehouse map to the cloud server (1); The AR end (2) receives the modification instruction and moves the flashing three-dimensional model of the cargo occupied space according to the modification instruction.

4. The warehouse distribution management method based on augmented reality technology according to claim 2 is characterized in that: The step of "the AR end (2) receives the instruction and selects the cargo storage area on the three-dimensional warehouse map according to the instruction" also includes: The AR end (2) detects the remaining space in the cargo storage area selected in the warehouse three-dimensional image, excluding the three-dimensional model of the space occupied by the added cargo; If the remaining space is smaller than the model volume of the three-dimensional model of the cargo space occupation, a warning is displayed and the storable area corresponding to the remaining cargo storage space occupation level is highlighted.

5. The warehouse distribution management method based on augmented reality technology according to claim 1 is characterized in that: The step of "when the AR terminal (2) reaches the highlighted area, highlighting the goods in the collected image information" also includes: Cargo information includes cargo entry code and cargo appearance diagram; When the AR terminal (2) reaches the highlighted area, it scans the QR code in the collected image information. When the cargo entry code of the cargo to be picked up is scanned, it searches for the contour most similar to the cargo appearance with the scanned cargo entry code as the center, and highlights the area within the contour; If the goods entry code is not scanned, when the AR end (2) receives the approximate search instruction, it uses the marked point in the warehouse three-dimensional map as the viewing point according to the current position information, determines the field of view direction according to the gyroscope of the AR end (2), and then substitutes the currently collected image information into the warehouse three-dimensional map, selects the highlighted area in the current display screen, and then searches for the outline that is most similar to the goods appearance in the selected area, and highlights the area within the outline.

6. A warehouse distribution management system based on augmented reality technology, characterized in that: It comprises a cloud server (1) and an AR terminal (2), wherein the cloud server (1) comprises a data storage module (11), an image sending module (12), a goods warehousing module (13), and a goods warehousing out module (14); The data storage module (11) pre-stores a three-dimensional warehouse map and cargo storage information, and the three-dimensional warehouse map is generated according to the size and location information of the warehouse; The image sending module (12) calls the three-dimensional warehouse map stored in the data storage module (11) and receives the position information, determines the current point of the AR terminal (2) in the three-dimensional warehouse map according to the position information and marks it, and sends the marked three-dimensional warehouse map to the AR terminal (2); The cargo entry module (13) receives cargo entry information, calls the three-dimensional warehouse map and cargo storage information stored in the data storage module (11), modifies the cargo storage information according to the cargo entry information, and covers the original three-dimensional warehouse map with the received three-dimensional warehouse map; The cargo outbound module (14) receives the three-dimensional warehouse map and the shipping information, deletes the cargo storage area corresponding to the highlighted area in the stored three-dimensional warehouse map according to the received three-dimensional warehouse map, and modifies the cargo storage information according to the shipping information; The AR terminal (2) comprises an image acquisition module (21), an image processing module (22), a location upload module (23), a warehousing processing module (24), a shipping processing module (25), and a shipping marking module (26); The image acquisition module (21) acquires image information and transmits it to the image processing module (22); The image processing module (22) receives image information for display. When receiving the three-dimensional warehouse map from the image sending module (12), the three-dimensional warehouse map is added to the image information for display. When receiving the route map, the position is determined according to the marking points in the three-dimensional warehouse map, the gyroscope determines the direction, and a moving direction mark is generated according to the route map. The route map is added to the three-dimensional warehouse map, and the three-dimensional warehouse map and the moving direction mark are added to the image information for display. The position uploading module (23) acquires current position information and sends the position information to the image sending module (12); The warehousing processing module (24) receives goods warehousing information, which includes goods information and warehousing requirements. After receiving the warehousing instruction, the warehousing processing module (24) selects the goods storage area on the three-dimensional warehouse map according to the instruction, sends the three-dimensional warehouse map and the goods warehousing information to the goods warehousing module (13), draws a route map on the three-dimensional warehouse map with the current position as the starting point and the goods storage area as the end point, and sends the route map to the image processing module (22); The outbound processing module (25) receives the shipping information, which includes the cargo information and the destination information. The outbound processing module (25) searches for the cargo information on the three-dimensional warehouse map, highlights the cargo storage area with the corresponding cargo information on the three-dimensional warehouse map, selects the cargo storage area on the three-dimensional warehouse map according to the shipping instruction after receiving the shipping instruction, retains the highlight mark of the selected area in the three-dimensional warehouse map, sends the modified three-dimensional warehouse map and the shipping information to the cargo outbound module (14), draws a route map with the current position as the starting point and the highlighted area as the end point, and sends the route map to the image processing module (22); The shipment marking module (26) calls the three-dimensional warehouse map of the image processing module (22). When the marking point in the three-dimensional warehouse map reaches the end point of the route map, the goods are highlighted in the image information and the marked three-dimensional warehouse map is sent to the image processing module (22).

7. The warehouse distribution management system based on augmented reality technology according to claim 6, characterized in that: The cloud server (1) further comprises an image segmentation module (15), wherein the image segmentation module (15) calls the three-dimensional warehouse map stored in the data storage module (11), the image segmentation module (15) receives external input instructions and sets the cargo storage space classification according to the instructions, generates a three-dimensional cargo space classification model for each level of cargo storage space, divides the storage area of ​​each level of cargo storage space on the three-dimensional warehouse map, and sends the cargo storage space classification, the cargo space classification model and the three-dimensional warehouse map to the data storage module (11) for storage; The image sending module (12) calls the storage space classification and cargo space three-dimensional model of the data storage module (11), and sends the storage space classification and cargo space three-dimensional model to the AR terminal (2); The warehousing processing module (24) calls the corresponding cargo storage space occupation level and cargo occupation space three-dimensional model according to the cargo information, and highlights the storable area corresponding to the cargo storage space occupation level on the warehouse three-dimensional map according to the cargo storage space occupation level. After receiving the warehousing instruction, the warehousing processing module (24) selects the cargo storage area on the warehouse three-dimensional map according to the instruction, and adds the cargo occupation space three-dimensional model in the selected cargo storage area.

8. The warehouse distribution management system based on augmented reality technology according to claim 7, characterized in that: The image division module (15) selects a three-dimensional model of the cargo space occupied according to the cargo storage space occupied level corresponding to the storable area, fills the storable area with the selected three-dimensional model of the cargo space occupied, and virtualizes the three-dimensional model of the cargo space occupied in the storable area into a non-substantial cell; When adding the three-dimensional model of the cargo occupied space, the warehousing processing module (24) fills the three-dimensional model of the cargo occupied space into an unoccupied entity-free cell and makes it flash. When the warehousing processing module (24) receives a modification instruction, the flashing three-dimensional model of the cargo occupied space is moved according to the modification instruction. When the warehousing processing module (24) receives a confirmation instruction, the flashing of the three-dimensional model of the cargo occupied space is cancelled and the three-dimensional warehouse map is transmitted to the cargo warehousing module (13).

9. The warehouse distribution management system based on augmented reality technology according to claim 7, characterized in that: The warehousing processing module (24) detects the remaining space in the cargo storage area selected in the three-dimensional warehouse map, excluding the three-dimensional model of the cargo space occupied by the added cargo. If the remaining space is smaller than the model volume of the three-dimensional model of the cargo space occupied, a warning is displayed and the storage area corresponding to the remaining cargo storage space level is highlighted.

10. The warehouse distribution management system based on augmented reality technology according to claim 6, characterized in that: The cargo information includes a cargo entry code and a cargo appearance diagram. The shipping marking module (26) scans the two-dimensional code in the image information. When the cargo entry code of the cargo to be picked up is scanned, the scanned cargo entry code is used as the center to search for the contour most similar to the cargo appearance diagram, and the area within the contour is highlighted. If the cargo entry code is not scanned, the shipping marking module (26) receives an approximate search instruction, uses the marked point in the warehouse three-dimensional map as a viewing point according to the current position information, determines the field of view direction according to the gyroscope of the AR end (2), and then substitutes the currently collected image information into the warehouse three-dimensional map, selects the highlighted area in the current display screen, and then searches for the contour most similar to the cargo appearance diagram in the selected area, and highlights the area within the contour.

Images