Unmanned aerial vehicle intelligent inspection system and method based on management system

Abstract

The invention discloses an unmanned aerial vehicle intelligent inspection system and method based on a management system. The system comprises an unmanned aerial vehicle unit, a stereoscopic warehouse unit, a fusion navigation unit, a data processing unit, an environment regulation and control unit, a single-station automatic charging unit and a warehouse management access unit. The UWB and vision fusion navigation technology is adopted, the navigation precision and reliability of the unmanned aerial vehicle in the complex environment of the stereoscopic warehouse are improved, it is ensured that the unmanned aerial vehicle can accurately and rapidly complete the cargo inspection task, the inspection efficiency is improved, and therefore the high-precision navigation and college inspection effects are achieved; real-time synchronization with WMS data is realized through the WMS access unit, so that warehouse management personnel can master information such as positions and states of goods in time, more accurate reference is provided for inspection tasks of unmanned aerial vehicles, and informatization and intelligence levels of warehouse management are improved; and according to the collected temperature and humidity data and the optimal cargo storage condition, accurate regulation and control of the warehouse environment are realized.

Description

Technical Field

[0001] The present invention relates to the field of warehouse logistics automation technology, and in particular to a management system-based unmanned aerial vehicle intelligent inspection system and method. Background Art

[0002] In modern warehousing and logistics management, the efficient operation of high-bay warehouses is crucial. Although some technologies have attempted to use drones for warehouse inspections, there are many shortcomings. On the one hand, the navigation accuracy of drones is limited by a single navigation method, making it difficult to complete tasks accurately and efficiently in complex high-bay warehouse environments. On the other hand, the data interaction between the warehouse management system (WMS) and inspection equipment is not perfect, and it is impossible to synchronize the location of goods, image information, and empty shelf information in real time, resulting in a low level of informatization and intelligence in warehouse management. In addition, the battery life of drones is also a key factor restricting their continued operation. The existing charging methods lack automation and intelligence, which affects the overall operational efficiency of the warehouse. Summary of the Invention

[0003] The purpose of the present invention is to provide a drone intelligent inspection system and method based on a management system, combining UWB and visual fusion navigation technology, accessing the warehouse management system, and realizing the system and method of drone intelligent inspection, environmental control, single-station automatic charging and data synchronization with the warehouse management system in the three-dimensional warehouse, so as to solve the problems raised in the above background technology.

[0004] To achieve the above object, the present invention provides the following technical solutions:

[0005] The UAV intelligent inspection system based on the management system includes a UAV unit, a three-dimensional warehouse unit, a fusion navigation unit, a data processing unit, an environmental control unit, a single-station automatic charging unit, and a warehouse management access unit;

[0006] Drone unit: Equipped with a UWB positioning module, visual sensor, RFID reading module, zoom camera, active electronic tag gateway, temperature and humidity probe, power monitoring module, and charging port; the UWB positioning module obtains the drone's approximate position within the warehouse; the visual sensor identifies the warehouse's visual features and corrects positioning errors; the RFID reading module reads the cargo's RFID tag information; the zoom camera scans the cargo's QR code and captures an image; the active electronic tag gateway obtains real-time cargo status data; the temperature and humidity probe collects warehouse temperature and humidity data; the power monitoring module monitors power in real time; and the charging port is used to connect to a single-station automatic charging unit.

[0007] Stereoscopic warehouse unit: used to store goods. The shelves are equipped with visual identification and UWB positioning base stations. The goods are affixed with RFID tags, QR codes or installed with active electronic tags.

[0008] Fusion Navigation Unit: Receives data from the UWB positioning module and visual sensors, uses data fusion algorithms to generate precise navigation instructions, and guides the drone to fly along a preset route. When the power monitoring module detects that the drone's battery level is below a set threshold, it plans a charging route to the charging station.

[0009] Data processing unit: Receives various data transmitted by the drone unit, integrates and analyzes cargo information to establish a database; processes image data to identify cargo status; creates a 3D visual map of temperature and humidity based on temperature and humidity data, compares the optimal storage temperature and humidity for cargo, and determines the environmental control area; and simultaneously interacts with the warehouse management access unit after processing data to achieve data synchronization;

[0010] Environmental control unit: connected to the data processing unit, accurately adjusts the temperature and humidity of the corresponding area in the warehouse according to the control instructions issued by the data processing unit;

[0011] Single-station automatic charging unit: This is the charging station for the drone, consisting of a charging control module, charging contacts, a communication module, and visual guidance signs. The charging control module manages the drone's charging process; the charging contacts connect to the drone's charging port to enable charging; the communication module communicates with the drone, receiving charging requests and location information and sending guidance instructions; and the visual guidance signs assist the drone in precise docking.

[0012] Warehouse management access unit: responsible for data interaction with the external WMS, synchronizing the cargo location, image information, empty shelf information, etc. processed by the data processing unit to the WMS, and obtaining relevant warehouse management data from the WMS to provide reference for the drone's inspection mission. WMS is a warehouse management system, which is a real-time computer software system.

[0013] Preferably, a charging station corresponding to the drone is set at a specific location in the warehouse of the three-dimensional warehouse unit.

[0014] Preferably, the environmental control unit includes a plurality of temperature and humidity control devices distributed in different locations of the warehouse, such as air conditioners, humidifiers, dehumidifiers, etc.

[0015] The intelligent inspection method of drones based on the management system includes the following steps:

[0016] Step 1: Warehouse managers enter the drone's inspection mission into the fusion navigation unit and simultaneously obtain the latest warehouse cargo layout and mission information from the WMS through the WMS access unit. The drone takes off from the charging station, the UWB positioning module quickly obtains its approximate location, and the visual sensor identifies visual features within the warehouse. The fusion navigation unit then fuses the two data and guides the drone to the target shelf.

[0017] Step 2: After arriving at the target shelf, the drone's various functional modules start collecting data, which is then transmitted to the data processing unit for processing and analysis. The processed cargo location, image information, empty shelf information, etc. are synchronized to the WMS through the WMS access unit, allowing warehouse managers to grasp the warehouse situation in real time.

[0018] Step 3: If the data processing unit finds that the temperature and humidity in a certain area of the warehouse do not meet the storage requirements for goods, it will send a control instruction to the environmental control unit to adjust the temperature and humidity in that area;

[0019] Step 4: During the inspection process, the power monitoring module monitors the power level in real time. When the power level falls below the threshold, the drone requests charging. The integrated navigation unit plans the charging route, and the drone flies to the charging station. It docks accurately through the communication module and visual guidance signs, and the charging control module starts the charging process.

[0020] Step 5: After being fully charged, the drone continues to perform inspection tasks, and this cycle continues to achieve efficient management of the three-dimensional warehouse.

[0021] Including the following technical content:

[0022] Mission planning and initial navigation: The drone's inspection route and mission are set in the fusion navigation unit, while the data processing unit stores optimal storage temperature and humidity data for various types of goods. The latest warehouse cargo layout and mission information is obtained from the WMS through the WMS access unit. The drone takes off from the charging station, and the UWB positioning module and visual sensor work together. The fusion navigation unit integrates the data from these two modules to guide the drone along the planned route to the target shelf.

[0023] Cargo information collection and environmental monitoring: After the drone reaches the target shelf, the RFID reader module reads the RFID tag information of the goods, the zoom camera scans the QR code of the goods and takes an image of the goods, the active electronic tag gateway obtains the real-time status data of the goods, and the temperature and humidity probe collects the temperature and humidity data of the current location. All collected data is transmitted to the data processing unit in real time;

[0024] Data processing and WMS synchronization: The data processing unit receives data transmitted by drones, integrates cargo information, and updates the cargo information database. It processes image data to identify any abnormalities such as damage or deformation on the cargo's exterior, and reads detailed information from QR codes. It creates a 3D visual image of temperature and humidity based on the temperature and humidity data and compares it with the cargo's optimal storage temperature and humidity data to identify areas within the warehouse where temperature and humidity do not meet requirements. The processed cargo location, image information, and empty shelf information are synchronized to the WMS via the WMS access unit.

[0025] Environmental control: The data processing unit sends control instructions to the environmental control unit, specifying the area to be adjusted and the target temperature and humidity. The environmental control unit controls the temperature and humidity control equipment in the corresponding area to operate, achieving precise zoning adjustment of warehouse temperature and humidity;

[0026] Power Monitoring and Charging Decision-Making: The power monitoring module monitors the drone's power level in real time. When the power level falls below a set threshold, the drone sends a charging request to the fusion navigation unit. The fusion navigation unit then plans a charging route to the charging station based on the drone's current location and the location of the charging station.

[0027] Automatic charging docking and charging process: The drone flies to the charging station according to the charging route. When approaching the charging station, the communication module communicates with the drone to provide more accurate guidance information. At the same time, the drone's visual sensor recognizes the visual guidance signs of the charging station to assist the drone in precise docking. When the drone's charging port is accurately docked with the charging contact of the charging station, the charging control module starts the charging process to charge the drone.

[0028] Circular inspection and continuous operation: After the drone is fully charged, the integrated navigation unit plans to return to the original inspection route or continue to perform a new inspection task. The drone continues to carry out cargo inspection, data collection and environmental monitoring. This cycle realizes the continuous intelligent management of the three-dimensional warehouse.

[0029] Compared with the prior art, the present invention has the following beneficial effects:

[0030] The management system-based intelligent inspection system and method of drones involved in the present invention adopts UWB and vision fusion navigation technology to improve the navigation accuracy and reliability of drones in the complex environment of stereoscopic warehouses, ensuring that drones can accurately and quickly complete cargo inspection tasks, improving inspection efficiency, and thus achieving high-precision navigation and high-quality inspection results.

[0031] The WMS access unit enables real-time data synchronization with the WMS, enabling warehouse managers to promptly grasp information such as the location and status of goods. This also provides a more accurate reference for drone inspections, improving the informatization and intelligence of warehouse management.

[0032] Based on the collected temperature and humidity data and the optimal storage conditions for goods, the warehouse environment can be precisely controlled to ensure the storage quality of goods;

[0033] The single-station automatic charging unit solves the problem of drone battery life, realizes automatic charging of drones, and improves the continuity and efficiency of inspection work. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] Figure 1This is a schematic diagram of the structure of the UAV intelligent inspection system of the present invention;

[0035] Figure 2 This is a schematic diagram of the intelligent inspection process of the UAV of the present invention;

[0036] Figure 3 Schematic diagram of the UAV intelligent inspection method of the present invention. DETAILED DESCRIPTION

[0037] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of the present invention.

[0038] See also Figure 1-3 , the present invention provides a UAV intelligent inspection system based on a management system, including a UAV unit, a stereoscopic warehouse unit, a fusion navigation unit, a data processing unit, an environmental control unit, a single-station automatic charging unit, and a warehouse management access unit;

[0039] Drone unit: Equipped with a UWB positioning module, visual sensor, RFID reading module, zoom camera, active electronic tag gateway, temperature and humidity probe, power monitoring module, and charging port; the UWB positioning module obtains the drone's approximate position within the warehouse; the visual sensor identifies the warehouse's visual features and corrects positioning errors; the RFID reading module reads the cargo's RFID tag information; the zoom camera scans the cargo's QR code and captures an image; the active electronic tag gateway obtains real-time cargo status data; the temperature and humidity probe collects warehouse temperature and humidity data; the power monitoring module monitors power in real time; and the charging port is used to connect to a single-station automatic charging unit.

[0040] Stereoscopic warehouse unit: used to store goods. The shelves are equipped with visual identification and UWB positioning base stations. The goods are affixed with RFID tags, QR codes or installed with active electronic tags. A charging station corresponding to the drone is set up at a specific location in the warehouse of the stereoscopic warehouse unit.

[0041] Fusion Navigation Unit: Receives data from the UWB positioning module and visual sensors, uses data fusion algorithms to generate precise navigation instructions, and guides the drone to fly along a preset route. When the power monitoring module detects that the drone's battery level is below a set threshold, it plans a charging route to the charging station.

[0042] Data processing unit: Receives various data transmitted by the drone unit, integrates and analyzes cargo information to establish a database; processes image data to identify cargo status; creates a 3D visual map of temperature and humidity based on temperature and humidity data, compares the optimal storage temperature and humidity for cargo, and determines the environmental control area; and simultaneously interacts with the warehouse management access unit after processing data to achieve data synchronization;

[0043] Environmental control unit: connected to the data processing unit, it accurately adjusts the temperature and humidity of the corresponding area in the warehouse according to the control instructions issued by the data processing unit; the environmental control unit includes multiple temperature and humidity control devices distributed in different locations in the warehouse, such as air conditioners, humidifiers, dehumidifiers, etc.

[0044] Single-station automatic charging unit: This is the charging station for the drone, consisting of a charging control module, charging contacts, a communication module, and visual guidance signs. The charging control module manages the drone's charging process; the charging contacts connect to the drone's charging port to enable charging; the communication module communicates with the drone, receiving charging requests and location information and sending guidance instructions; and the visual guidance signs assist the drone in precise docking.

[0045] Warehouse management access unit: responsible for data interaction with the external WMS, synchronizing the cargo location, image information, empty shelf information, etc. processed by the data processing unit to the WMS, and obtaining relevant warehouse management data from the WMS to provide reference for the drone's inspection mission. WMS is a warehouse management system, which is a real-time computer software system.

[0046] The intelligent inspection method of drones based on the management system includes the following steps:

[0047] Step 1: Warehouse managers enter the drone's inspection mission into the fusion navigation unit and simultaneously obtain the latest warehouse cargo layout and mission information from the WMS through the WMS access unit. The drone takes off from the charging station, the UWB positioning module quickly obtains its approximate location, and the visual sensor identifies visual features within the warehouse. The fusion navigation unit then fuses the two data and guides the drone to the target shelf.

[0048] Step 2: After arriving at the target shelf, the drone's various functional modules start collecting data, which is then transmitted to the data processing unit for processing and analysis. The processed cargo location, image information, empty shelf information, etc. are synchronized to the WMS through the WMS access unit, allowing warehouse managers to grasp the warehouse situation in real time.

[0049] Step 3: If the data processing unit finds that the temperature and humidity in a certain area of the warehouse do not meet the storage requirements for goods, it will send a control instruction to the environmental control unit to adjust the temperature and humidity in that area;

[0050] Step 4: During the inspection process, the power monitoring module monitors the power level in real time. When the power level falls below the threshold, the drone requests charging. The integrated navigation unit plans the charging route, and the drone flies to the charging station. It docks accurately through the communication module and visual guidance signs, and the charging control module starts the charging process.

[0051] Step 5: After being fully charged, the drone continues to perform inspection tasks, and this cycle continues to achieve efficient management of the three-dimensional warehouse.

[0052] Mission planning and initial navigation: The drone's inspection route and mission are set in the fusion navigation unit, while the data processing unit stores optimal storage temperature and humidity data for various types of goods. The latest warehouse cargo layout and mission information is obtained from the WMS through the WMS access unit. The drone takes off from the charging station, and the UWB positioning module and visual sensor work together. The fusion navigation unit integrates the data from these two modules to guide the drone along the planned route to the target shelf.

[0053] Cargo information collection and environmental monitoring: After the drone reaches the target shelf, the RFID reader module reads the RFID tag information of the goods, the zoom camera scans the QR code of the goods and takes an image of the goods, the active electronic tag gateway obtains the real-time status data of the goods, and the temperature and humidity probe collects the temperature and humidity data of the current location. All collected data is transmitted to the data processing unit in real time;

[0054] Data processing and WMS synchronization: The data processing unit receives data transmitted by drones, integrates cargo information, and updates the cargo information database. It processes image data to identify any abnormalities such as damage or deformation on the cargo's exterior, and reads detailed information from QR codes. It creates a 3D visual image of temperature and humidity based on the temperature and humidity data and compares it with the cargo's optimal storage temperature and humidity data to identify areas within the warehouse where temperature and humidity do not meet requirements. The processed cargo location, image information, and empty shelf information are synchronized to the WMS via the WMS access unit.

[0055] Environmental control: The data processing unit sends control instructions to the environmental control unit, specifying the area to be adjusted and the target temperature and humidity. The environmental control unit controls the temperature and humidity control equipment in the corresponding area to operate, achieving precise zoning adjustment of warehouse temperature and humidity;

[0056] Power Monitoring and Charging Decision-Making: The power monitoring module monitors the drone's power level in real time. When the power level falls below a set threshold, the drone sends a charging request to the fusion navigation unit. The fusion navigation unit then plans a charging route to the charging station based on the drone's current location and the location of the charging station.

[0057] Automatic charging docking and charging process: The drone flies to the charging station according to the charging route. When approaching the charging station, the communication module communicates with the drone to provide more accurate guidance information. At the same time, the drone's visual sensor recognizes the visual guidance signs of the charging station to assist the drone in precise docking. When the drone's charging port is accurately docked with the charging contact of the charging station, the charging control module starts the charging process to charge the drone.

[0058] Circular inspection and continuous operation: After the drone is fully charged, the integrated navigation unit plans to return to the original inspection route or continue to perform a new inspection task. The drone continues to carry out cargo inspection, data collection and environmental monitoring. This cycle realizes the continuous intelligent management of the three-dimensional warehouse.

[0059] While embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions, and variations may be made to these embodiments without departing from the principles and spirit of the invention, and that the scope of the invention is defined by the appended claims and their equivalents.

Claims

1. The intelligent inspection system of UAV based on management system is characterized by: It includes drone unit, stereoscopic warehouse unit, integrated navigation unit, data processing unit, environmental control unit, single-station automatic charging unit and warehouse management access unit; Drone unit: Equipped with a UWB positioning module, visual sensor, RFID reading module, zoom camera, active electronic tag gateway, temperature and humidity probe, power monitoring module, and charging port; the UWB positioning module obtains the drone's approximate position within the warehouse; the visual sensor identifies the warehouse's visual features and corrects positioning errors; the RFID reading module reads the cargo's RFID tag information; the zoom camera scans the cargo's QR code and captures an image; the active electronic tag gateway obtains real-time cargo status data; the temperature and humidity probe collects warehouse temperature and humidity data; the power monitoring module monitors power in real time; and the charging port is used to connect to a single-station automatic charging unit. Stereoscopic warehouse unit: used to store goods. The shelves are equipped with visual identification and UWB positioning base stations. The goods are affixed with RFID tags, QR codes or installed with active electronic tags. Fusion Navigation Unit: Receives data from the UWB positioning module and visual sensors, uses data fusion algorithms to generate precise navigation instructions, and guides the drone to fly along a preset route. When the power monitoring module detects that the drone's battery level is below a set threshold, it plans a charging route to the charging station. Data processing unit: Receives various data transmitted by the drone unit, integrates and analyzes cargo information to establish a database; processes image data to identify cargo status; Based on the temperature and humidity data, a 3D visual map of temperature and humidity is drawn to compare the optimal storage temperature and humidity for the goods and determine the environmental control area. The processed data is then interacted with the warehouse management access unit to achieve data synchronization. Environmental control unit: connected to the data processing unit, accurately adjusts the temperature and humidity of the corresponding area in the warehouse according to the control instructions issued by the data processing unit; Single-station automatic charging unit: This is the charging station for the drone, consisting of a charging control module, charging contacts, a communication module, and visual guidance signs. The charging control module manages the drone's charging process; the charging contacts connect to the drone's charging port to enable charging; the communication module communicates with the drone, receiving charging requests and location information and sending guidance instructions; and the visual guidance signs assist the drone in precise docking. Warehouse management access unit: responsible for data interaction with the external WMS, synchronizing the cargo location, image information, empty shelf information, etc. processed by the data processing unit to the WMS, and obtaining relevant warehouse management data from the WMS to provide reference for the drone's inspection mission. WMS is a warehouse management system, which is a real-time computer software system.

2. The intelligent inspection system for drones based on a management system according to claim 1 is characterized by: A charging station corresponding to the drone is set at a specific location of the warehouse in the three-dimensional warehouse unit.

3. The intelligent inspection system for drones based on a management system according to claim 1 is characterized by: The environmental control unit includes multiple temperature and humidity control devices distributed in different locations of the warehouse, such as air conditioners, humidifiers, dehumidifiers, etc.

4. The intelligent inspection method of UAV based on management system is characterized by: The following steps are included: Step 1: Warehouse managers enter the drone's inspection mission into the fusion navigation unit and simultaneously obtain the latest warehouse cargo layout and mission information from the WMS through the WMS access unit. The drone takes off from the charging station, the UWB positioning module quickly obtains its approximate location, and the visual sensor identifies visual features within the warehouse. The fusion navigation unit then fuses the two data and guides the drone to the target shelf. Step 2: After arriving at the target shelf, the drone's various functional modules start collecting data, which is then transmitted to the data processing unit for processing and analysis. The processed cargo location, image information, empty shelf information, etc. are synchronized to the WMS through the WMS access unit, allowing warehouse managers to grasp the warehouse situation in real time. Step 3: If the data processing unit finds that the temperature and humidity in a certain area of the warehouse do not meet the storage requirements for goods, it will send a control instruction to the environmental control unit to adjust the temperature and humidity in that area; Step 4: During the inspection process, the power monitoring module monitors the power level in real time. When the power level falls below the threshold, the drone requests charging. The integrated navigation unit plans the charging route, and the drone flies to the charging station. It docks accurately through the communication module and visual guidance signs, and the charging control module starts the charging process. Step 5: After being fully charged, the drone continues to perform inspection tasks, and this cycle continues to achieve efficient management of the three-dimensional warehouse.

5. The intelligent inspection method for drones based on a management system according to claim 4 is characterized in that: Including the following technical content: Mission planning and initial navigation: The drone's inspection route and mission are set in the fusion navigation unit, while the data processing unit stores optimal storage temperature and humidity data for various types of goods. The latest warehouse cargo layout and mission information is obtained from the WMS through the WMS access unit. The drone takes off from the charging station, and the UWB positioning module and visual sensor work together. The fusion navigation unit integrates the data from these two modules to guide the drone along the planned route to the target shelf. Cargo information collection and environmental monitoring: After the drone reaches the target shelf, the RFID reader module reads the RFID tag information of the goods, the zoom camera scans the QR code of the goods and takes an image of the goods, the active electronic tag gateway obtains the real-time status data of the goods, and the temperature and humidity probe collects the temperature and humidity data of the current location. All collected data is transmitted to the data processing unit in real time; Data processing and WMS synchronization: The data processing unit receives data transmitted by drones, integrates cargo information, and updates the cargo information database. It processes image data to identify any abnormalities such as damage or deformation on the cargo's exterior, and reads detailed information from QR codes. It creates a 3D visual image of temperature and humidity based on the temperature and humidity data and compares it with the cargo's optimal storage temperature and humidity data to identify areas within the warehouse where temperature and humidity do not meet requirements. The processed cargo location, image information, and empty shelf information are synchronized to the WMS via the WMS access unit. Environmental control: The data processing unit sends control instructions to the environmental control unit, specifying the area to be adjusted and the target temperature and humidity. The environmental control unit controls the temperature and humidity control equipment in the corresponding area to operate, achieving precise zoning adjustment of warehouse temperature and humidity; Power monitoring and charging decision: The power monitoring module monitors the UAV's power in real time. When the power falls below the set threshold, the UAV sends a charging request to the fusion navigation unit; The fusion navigation unit plans a charging route to the charging station based on the current location of the drone and the location of the charging station; Automatic charging docking and charging process: The drone flies to the charging station according to the charging route. When approaching the charging station, the communication module communicates with the drone to provide it with more accurate guidance information. At the same time, the drone's visual sensor recognizes the visual guidance signs of the charging station to assist the drone in docking accurately. When the charging port of the drone is accurately connected to the charging contact of the charging station, the charging control module starts the charging process to charge the drone; Circular inspection and continuous operation: After the drone is fully charged, the integrated navigation unit plans to return to the original inspection route or continue to perform a new inspection task. The drone continues to carry out cargo inspection, data collection and environmental monitoring. This cycle realizes the continuous intelligent management of the three-dimensional warehouse.

Images