A drone inventory system

By using the drone inventory system in the warehouse, combining color identification and multiple positioning technologies, automatic identification and inventory are achieved, solving the problems of low inventory efficiency and high error rate in the existing technology, and improving warehouse management efficiency.

CN115063696BActive Publication Date: 2024-12-03QINGDAO RIRISHUN LOGISTICS CO LTD
View PDF 0 Cites 4 Cited by

Patent Information

Application Number
CN202210344350.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-03-31
Publication Date
2024-12-03
Estimated Expiration
2042-03-31

AI Technical Summary

Technical Problem

The inventory method of existing warehouse goods is inefficient and has high error rate, which affects warehouse management.

Method used

The drone inventory system is adopted, and the first and second color marks are set in front of the shelf, combined with the UWB positioning module, IMU module and visual ranging module, and the cargo information code is identified by scanning cameras to realize automatic inventory.

Benefits of technology

It improves inventory efficiency, reduces error rate, reduces labor costs, and improves warehouse management efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115063696B_ABST
    Figure CN115063696B_ABST
Patent Text Reader

Abstract

The present invention discloses a drone inventory counting system, comprising: a shelf, the front ground of one end of which has a first color mark, and the front ground of the other end of the shelf has a second color mark; a shelf information code is arranged on the front ground of the shelf near the first color mark; a drone, which starts to identify the goods information code of the goods on the shelf after identifying the first color mark and the shelf information code; and ends the identification of the goods on the shelf after identifying the second color mark. In the drone inventory counting system of the present invention, the drone learns to enter or leave the identification area of ​​the shelf through the first color mark and the second color mark, starts to identify the goods information code after entering the shelf identification area and identifying the shelf information code; ends the identification after leaving the shelf identification area, thereby realizing automatic inventory counting of goods, with high identification accuracy, improved inventory counting efficiency, reduced inventory counting error rate, reduced labor costs, and improved warehouse management efficiency.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the technical field of inventory counting, and in particular, relates to an unmanned aerial vehicle inventory counting system. Background Art

[0002] With the continuous development of society, warehouse storage has become an important part of social and economic development. As warehouses become larger and larger, and more and more goods are stored, inventory counting has become a very important task in warehouse management.

[0003] The current method of counting goods is to put labels on the goods and have the staff use handheld card readers to count them manually. This method of counting is not only labor-intensive and inefficient, but also prone to counting errors, affecting the normal management of the warehouse. Summary of the invention

[0004] The present invention provides an unmanned aerial vehicle inventory counting system, which solves the problems of low inventory counting efficiency and high error rate in the prior art.

[0005] In order to solve the above technical problems, the present invention adopts the following technical solutions to achieve the above problems:

[0006] A drone inventory system, comprising:

[0007] A shelf for storing goods, the goods having a goods information code; the ground in front of one end of the shelf has a first color mark, and the ground in front of the other end of the shelf has a second color mark; the ground in front of the shelf is provided with a shelf information code near the first color mark;

[0008] The drone, after identifying the first color identification and the shelf information code, starts to identify the goods information code of the goods on the shelf; after identifying the second color identification, it ends the identification of the goods on the shelf.

[0009] In some embodiments of the present application, the first color identification and the second color identification are both color bars, and the two color bars have different colors;

[0010] The two color strips are arranged in parallel, and both color strips are perpendicular to the front surface of the shelf.

[0011] In some embodiments of the present application, the shelf has multiple layers and multiple rows of cargo spaces, and there is a partition between two adjacent layers of cargo spaces, and the front end of each layer of partition has a different color;

[0012] After the drone recognizes the first color identification and the shelf information code, it scans the cargo information code of each column of cargo up and down, recognizes the cargo information contained in the cargo information code, and saves the recognized cargo information in correspondence with the color of the partition under the cargo.

[0013] In some embodiments of the present application, the drone includes:

[0014] A scanning camera, which is used to scan the shelf information code, the cargo information code, the first color mark, the second color mark, and the color of the front end of the partition;

[0015] The controller is used to identify the first color identification and the shelf information code after receiving the first color identification and the shelf information code sent by the scanning camera, and then control the scanning camera to scan the cargo information code of each column of cargo up and down, identify the cargo information contained in the cargo information code, and save the identified cargo information in correspondence with the color of the partition below the cargo.

[0016] In some embodiments of the present application, the drone inventory system further includes a UWB positioning module; the UWB positioning module includes:

[0017] at least three base stations, which are arranged in the warehouse;

[0018] A UWB positioning tag is installed on the drone to detect the distance to each base station and send the detected distance to the drone controller;

[0019] The controller takes each base station as the center of the circle and draws a circle according to the distance between each base station and the UWB positioning tag as the radius, determines the position of the UWB positioning tag through the intersection of the circles, and obtains the absolute position of the drone.

[0020] In some embodiments of the present application, the drone further includes an IMU module for acquiring acceleration information and sending it to the controller;

[0021] The controller processes the received acceleration information to obtain the relative position of the drone;

[0022] The controller fuses the absolute position of the drone obtained by the UWB positioning module and the relative position of the drone obtained by the IMU module through a Kalman filter algorithm to obtain the absolute position of the drone after fusion.

[0023] In some embodiments of the present application, the drone further includes a visual ranging module for measuring the relative position of the drone;

[0024] The controller fuses the absolute position of the drone obtained by the UWB positioning module and the relative position of the drone obtained by the visual ranging module through a Kalman filter algorithm to obtain the absolute position of the drone after fusion.

[0025] In some embodiments of the present application, the drone further includes:

[0026] IMU module, used to obtain acceleration information and send it to the controller;

[0027] Visual ranging module, used to measure the relative position of the drone;

[0028] The controller processes the received acceleration information to obtain the relative position of the drone;

[0029] The controller fuses the relative position of the drone obtained based on the IMU module and the relative position of the drone obtained based on the visual ranging module through the Kalman filtering algorithm to obtain the fused relative position; then fuses the fused relative position and the absolute position of the drone obtained based on the UWB positioning module through the Kalman filtering algorithm to obtain the fused absolute position of the drone.

[0030] In some embodiments of the present application, the visual ranging module includes:

[0031] A visual camera is installed on the drone to capture images of the warehouse floor and send them to the controller; wherein a color-coded area is set on the warehouse floor;

[0032] A laser ranging sensor is installed on the drone to detect the distance h between the visual camera and the ground and send it to the controller;

[0033] The controller performs edge detection on the color identification area in a frame image captured by the visual camera and records the edge position, performs edge detection on the color identification area in the next frame image received and records the edge position, and subtracts the same edge position of the color identification area in the two frames of images to obtain the pixel displacement d of the color identification area; the actual displacement of the drone D = h × d / f, where f is the focal length of the visual camera.

[0034] In some embodiments of the present application, the drone inventory system further includes:

[0035] A control terminal communicates with the controller of the drone and displays the operating parameters of the drone.

[0036] Compared with the prior art, the advantages and positive effects of the present invention are: the drone inventory counting system of the present invention sets a first color mark on the ground in front of one end of the shelf and a second color mark on the ground in front of the other end of the shelf; a shelf information code is set on the ground in front of the shelf near the first color mark; after the drone identifies the first color mark on the ground and the shelf information code, it starts to identify the goods information code of the goods on the shelf; after the drone identifies the second color mark on the ground, it ends the identification of the goods on the shelf; therefore, in the drone inventory counting system of the present invention, the drone knows to enter or leave the identification area of ​​the shelf through the first color mark and the second color mark, and starts to identify the goods information code after entering the shelf identification area and identifying the shelf information code; after leaving the shelf identification area, the identification is ended, thereby realizing automatic inventory counting of goods, with high identification accuracy, improving inventory counting efficiency, reducing inventory counting error rate, reducing labor costs, and improving warehouse management efficiency.

[0037] Other features and advantages of the present invention will become more apparent after reading the detailed description of the embodiments of the present invention in conjunction with the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] Figure 1 It is a principle block diagram of an embodiment of the drone inventory system proposed by the present invention;

[0039] Figure 2 It is a structural schematic diagram of an embodiment of a shelf;

[0040] Figure 3 This is a schematic diagram of the UWB positioning principle;

[0041] Figure 4 It is a schematic diagram of the principle of visual ranging;

[0042] Figure 5 It is a schematic diagram of the color-coded areas on the warehouse floor;

[0043] Figure 6 It is the data processing flow chart of IMU module, visual ranging module and UWB positioning module.

[0044] Reference numerals:

[0045] 10. Shelves; 11. Partitions;

[0046] 20. Cargo information code;

[0047] 30. First color identification;

[0048] 40. Second color identification;

[0049] 50. Drones;

[0050] 60. Color identification area. DETAILED DESCRIPTION

[0051] In order to make the purpose, technical solutions and advantages of the present invention more clearly understood, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments.

[0052] It should be noted that in the description of the present invention, the terms "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer" and the like indicating directions or positional relationships are based on the directions or positional relationships shown in the drawings, which are only for the convenience of description, and do not indicate or imply that the device or element must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as limiting the present invention. In addition, the terms "first" and "second" are used for descriptive purposes only, and cannot be understood as indicating or implying relative importance.

[0053] In addition, it should be noted that in the description of the present invention, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For those skilled in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0054] In view of the current technical problems of low inventory efficiency and high error rate in warehouses, the present invention proposes a drone inventory system, which improves inventory efficiency and reduces inventory error rate. The drone inventory system of the present invention is described in detail below in conjunction with the accompanying drawings.

[0055] The drone inventory counting system of this embodiment mainly includes a shelf 10 and a drone 50 .

[0056] The shelf 10 is used to store goods. Each of the goods has a goods information code 20, and the goods information code is pasted outwards to facilitate the identification of the drone. The goods information code contains the goods information. Figure 2 As shown, the ground in front of one end of the shelf 10 has a first color mark 30, and the ground in front of the other end of the shelf 10 has a second color mark 40; the colors of the first color mark 30 and the second color mark 40 are different. A shelf information code is set on the ground in front of the shelf 10 near the first color mark 30, and the shelf information code includes the location information of the shelf.

[0057] The shelf information code and the goods information code may be in the form of a barcode or a QR code. In this embodiment, the information code is in the form of a barcode, that is, the shelf information code is a shelf barcode, and the goods information code is a goods barcode.

[0058] In some embodiments of the present application, the first color identification 30 and the second color identification 40 are both color strips, and the two color strips have different colors; the two color strips are arranged in parallel, and the two color strips are perpendicular to the front face of the shelf, and the distance between the two color strips is equal to the length of the shelf. The area between the two color strips is the identification area of ​​the shelf. Setting the first color identification 30 and the second color identification 40 as two color strips of different colors and parallel is not only convenient for layout and implementation, but also can accurately identify the identification area of ​​the shelf.

[0059] For example, the first color identification 30 is a yellow bar, indicating a signal that the drone enters the shelf identification area; the second color identification 40 is a brown bar, indicating a signal that the drone leaves the shelf identification area.

[0060] The drone 50 starts to identify the cargo information code of the cargo on the shelf 10 after identifying the first color mark 30 on the ground and the shelf information code; and ends the identification of the cargo on the shelf 10 after identifying the second color mark 40 on the ground.

[0061] The drone 50 flies along a planned path and at a certain altitude. After recognizing the first color mark 30, it knows that it has entered the recognition area of ​​the shelf and is ready to start recognizing the goods on the shelf. Then, after recognizing the shelf information code, it starts to recognize the cargo information code of the goods on the shelf and obtains the cargo information contained in the cargo information code. After recognizing the second color mark 40 on the ground, it means that it has left the recognition area of ​​the shelf, and the recognition of the goods on the shelf ends.

[0062] The drone inventory counting system of the present embodiment sets a first color mark 30 on the ground in front of one end of the shelf 10, and sets a second color mark 40 on the ground in front of the other end of the shelf 10; a shelf information code is set on the ground in front of the shelf 10 near the first color mark; after the drone identifies the first color mark 30 on the ground and the shelf information code, it starts to identify the goods information code of the goods on the shelf; after the drone identifies the second color mark on the ground, it ends the identification of the goods on the shelf; therefore, in the drone inventory counting system of the present embodiment, the drone knows to enter or leave the identification area of ​​the shelf through the first color mark and the second color mark, and starts to identify the goods information code after entering the shelf identification area and identifying the shelf information code; after leaving the shelf identification area, the identification is ended, thereby realizing automatic inventory counting of goods, with high identification accuracy, improving inventory counting efficiency, reducing inventory counting error rate, reducing labor costs, and improving warehouse management efficiency.

[0063] In some embodiments of the present application, the shelf 10 has a plurality of partitions 11 arranged at intervals from top to bottom. The plurality of partitions 11 divide the shelf 10 into multiple layers of cargo spaces, each layer of cargo spaces including multiple rows of cargo spaces. That is, the entire shelf has multiple layers of cargo spaces and multiple rows of cargo spaces, and there are partitions between two adjacent layers of cargo spaces. The front end of each layer of partitions has a different color, and the different colors indicate that the partitions are located at different layers on the shelf. One color corresponds to one layer of partitions. For example, Figure 2 As shown in the figure, there are three layers of partitions on the shelf. The front end of the bottom partition is painted red, indicating that the partition is the first layer of the shelf; the front end of the middle partition is painted green, indicating that the partition is the second layer of the shelf; the front end of the top partition is painted purple, indicating that the partition is the third layer of the shelf. The color of the front end of the partition can be used to know which layer the partition is located on. The color of the front end of the partition indicates the position of the partition on the shelf.

[0064] After the drone recognizes the first color mark 30 and the shelf information code on the ground, it scans the cargo information code of each column of cargo up and down in the process of flying from the first color mark 30 to the second color mark 40, recognizes the cargo information contained in the cargo information code, and saves the recognized cargo information in correspondence with the color of the partition under the cargo. After each cargo information of a cargo information code is recognized, the cargo information is saved in correspondence with the color information of the partition under the cargo, so that the layer of the shelf where the cargo is located can be known, that is, the specific location of the cargo can be obtained while the cargo inventory is completed.

[0065] Therefore, when taking inventory, the drone not only obtains the shelf location and cargo information, but also the number of layers of the shelf where the cargo is located, thus achieving accurate inventory.

[0066] In some embodiments of the present application, the drone includes a scanning camera and a controller, see Figure 1 shown.

[0067] The scanning camera has a scanning function and is used to scan the shelf information code, the cargo information code, the first color mark, the second color mark, and the color of the front end of the partition, and send the scanned information to the controller.

[0068] The controller is the control center of the drone and controls the operation of the entire drone. The controller controls the scanning camera to rotate up and down through the servo. After receiving the first color identification and shelf information code sent by the scanning camera, the controller identifies the first color identification and shelf information code and obtains the location information contained in the shelf information code; then controls the scanning camera to scan the cargo information code of each column of cargo up and down, and the controller identifies the cargo information contained in the cargo information code, and saves the identified cargo information in correspondence with the color of the partition below the cargo to obtain the location of the cargo on the shelf.

[0069] The scanning camera is easy to install and easy to control. By installing a scanning camera on the drone, the scanning function can be simply and conveniently realized so that it can be sent to the controller for identification and identify the information contained in the shelf information code and the cargo information code.

[0070] The scanning camera will capture the real-time image and transmit it to the controller, and use OpenCV to identify the information code in the image to obtain the information contained in the information code. When the drone is in working state, it flies according to the planned path and a certain height, and the scanning camera keeps facing downward; when the scanning camera scans the yellow bar on the ground, it means that it is ready to start identifying the cargo information code, and the drone reduces the flight speed and moves slowly; the scanning camera continues to face downward to wait for scanning the shelf information code on the ground. When the shelf information code is identified, the servo will control the scanning camera to start rotating up and down to complete the scanning and identification of the information code on the cargo. After each cargo information code is identified, the cargo information is matched with the color information of the partition under the cargo, that is, the specific location of the cargo can be obtained while completing the inventory of the cargo; the drone flies slowly, and the scanning camera rotates up and down to complete the scanning of each column of cargo on the shelf. When the scanning camera recognizes the brown bar on the ground during the up and down rotation, it means that the cargo on the shelf has been counted; at this time, the drone resumes normal flight state and prepares to perform inventory operations on the next shelf.

[0071] If a drone wants to be able to fly fully autonomously indoors and complete more complex tasks, it needs high-precision positioning. Indoor GPS signals of drones are weak and positioning errors are large, so they cannot fly stably. Therefore, in this application, UWB positioning technology is used to achieve drone positioning.

[0072] In some embodiments of the present application, the drone inventory system also includes a UWB positioning module for realizing the positioning of the drone.

[0073] The UWB positioning module includes a UWB positioning tag and at least three base stations.

[0074] at least three base stations, which are arranged in the warehouse;

[0075] The UWB positioning tag is set on the drone to detect the distance to each base station and send the detected distance to the controller.

[0076] The controller uses each base station as the center and the distance between each base station and the UWB positioning tag as the radius to draw a circle, and determines the position of the UWB positioning tag through the intersection of the circle to obtain the absolute position of the drone. The position of the UWB positioning tag is the absolute position coordinate information of the drone.

[0077] The UWB positioning tag is connected to the controller on the drone. Based on the TOA distance measurement method, the distance is calculated by the time it takes for the pulse signal sent by the UWB positioning tag to reach each base station, and then sent to the controller. The controller draws a circle with the distance between each base station and the UWB positioning tag as the radius, and determines the position of the UWB positioning tag through the intersection of the circle, so at least three base stations are required.

[0078] The UWB positioning module includes a UWB positioning tag and three base stations. Figure 3 As shown in the figure, three base stations are deployed in the warehouse. The coordinates of base station 1 are (x1, y1), and the distance from the UWB positioning tag is R1; the coordinates of base station 2 are (x2, y2), and the distance from the UWB positioning tag is R2; the coordinates of base station 3 are (x3, y3), and the distance from the UWB positioning tag is R3. Draw a circle with the measured distance between the UWB positioning tag and the three base stations as the radius. The three circles will have a common intersection. The common intersection of the three circles is the location of the UWB positioning tag, that is, the absolute position of the drone, to achieve the positioning of the drone.

[0079] This embodiment uses the UWB positioning module to achieve accurate positioning of the drone.

[0080] In some embodiments of the present application, in order to further improve the positioning accuracy of the drone, the drone also includes an IMU module for acquiring acceleration information and sending it to the controller. The controller processes the received acceleration information to obtain the relative position of the drone.

[0081] The drone is equipped with an IMU (Inertial Measurement Unit) module, which is connected to the controller. The IMU module can measure its own acceleration and angle in three axes. The relative displacement of the IMU module can be obtained by double integration of the acceleration value over time. The relative displacement of the IMU module is also the displacement of the drone, that is, the relative position coordinate information of the drone is obtained.

[0082] The controller uses the Kalman filter algorithm to fuse the absolute position of the drone obtained by the UWB positioning module and the relative position of the drone obtained by the IMU module to obtain the absolute position of the drone after fusion. The absolute position of the drone after fusion is more accurate, and the drone can be positioned more accurately. The UWB positioning module is combined with the IMU module to achieve accurate positioning of the drone.

[0083] In some other embodiments of the present application, in order to further improve the positioning accuracy of the drone, the drone also includes a visual ranging module for measuring the relative position of the drone.

[0084] The controller uses the Kalman filter algorithm to fuse the absolute position of the drone obtained by the UWB positioning module and the relative position of the drone obtained by the visual ranging module to obtain the absolute position of the drone after fusion. The absolute position of the drone after fusion is more accurate, and the drone can be positioned more accurately. The UWB positioning module is combined with the visual ranging module to achieve accurate positioning of the drone.

[0085] In some embodiments of the present application, the visual ranging module includes a visual camera and a laser ranging sensor.

[0086] The visual camera is installed on the drone and fixed at the bottom of the drone, facing the ground, and is used to capture the warehouse floor image and send the captured image to the controller. A color identification area is set on the warehouse floor to assist the drone visual positioning. The color identification area is a square block with color, such as a red rectangular block.

[0087] The laser ranging sensor is installed on the drone and fixed at the bottom of the drone, facing the ground. It is used to detect the distance h between the visual camera and the ground and send it to the controller.

[0088] The controller performs edge detection on the color-marked area in a frame of image captured by the visual camera and records the edge position, and performs edge detection on the color-marked area in the next frame of image received and records the edge position, and subtracts the same edge position of the color-marked area in the two frames of image to obtain the pixel displacement d of the color-marked area; the actual displacement of the drone D = h × d / f, where f is the focal length of the visual camera, see Figure 4 As shown in the figure, the actual displacement D of the drone is the relative position coordinate information of the drone.

[0089] Through the above-mentioned visual camera, laser ranging sensor, and combined with image processing technology, a relatively accurate relative position of the drone can be obtained.

[0090] Figure 4 The three planes in the figure are, from top to bottom, the imaging plane, the optical center plane, and the ground plane. The rectangular color block on the ground plane is the color identification area; h is the object distance, which is the distance from the optical center plane to the ground plane; the optical center plane is equivalent to the position of the camera lens; that is, h is the distance between the visual camera and the ground; and f is the focal length of the camera.

[0091] Using visual recognition technology to measure the moving distance of the drone, there are usually multiple color-coded areas on the warehouse floor, such as Figure 5 As shown, a plurality of color identification areas 60 are arranged around each shelf. When edge detection is performed, edge detection is performed on the same color identification area in two frames of images.

[0092] A visual camera and a laser ranging module facing the ground are installed at the bottom of the drone. The visual camera will capture ground images at a certain period of time and transmit them to the controller for image processing. Figure 5 The color identification area shown is edge detected and its edge position is recorded. In the next frame image, the color identification area of ​​the previous frame image is tracked and detected, and the edge detection is continued and its position is recorded. The same edge position of the color identification area in the two frames of images is subtracted to obtain the pixel displacement d of the detected color identification area. The distance h from the camera to the ground can be measured by the laser ranging module. According to the camera imaging principle, its actual displacement D=h×d / f can be obtained. The displacement is the displacement of the UAV, and the relative position coordinate information of the UAV can be obtained.

[0093] In some other embodiments of the present application, in order to further improve the positioning accuracy of the drone, the drone also includes an IMU module and a visual ranging module.

[0094] The IMU module is used to obtain acceleration information and send it to the controller.

[0095] Visual ranging module, used to measure the relative position of the drone.

[0096] The controller processes the received acceleration information to obtain the relative position of the drone.

[0097] The controller uses the Kalman filter algorithm to fuse the relative position of the drone obtained by the IMU module and the relative position of the drone obtained by the visual ranging module to obtain the fused relative position; then the fused relative position and the absolute position of the drone obtained by the UWB positioning module are fused by the Kalman filter algorithm to obtain the fused absolute position of the drone, see Figure 6 As shown in the figure, the absolute position of the drone after fusion is more accurate, and the drone can be positioned more accurately. The UWB positioning module is combined with the IMU module and the visual ranging module to achieve accurate positioning of the drone.

[0098] Therefore, in order to further improve the positioning accuracy of the UAV and avoid non-line-of-sight errors, the data obtained by the visual ranging module and the IMU module are first fused through the Kalman filter algorithm to obtain more accurate relative position information, and then the relative position information is fused with the absolute position information obtained by the UWB positioning module through the Kalman filter algorithm to enable the UAV to obtain accurate absolute position information. With the support of relative position information, the continuity and robustness of the positioning of the UAV during autonomous flight are guaranteed.

[0099] In this embodiment, the positioning method of the drone uses UWB positioning technology, inertial navigation technology, and visual ranging technology, and uses the Kalman filter algorithm to highly couple and fuse the data obtained by the three technologies to enable the drone to obtain high-precision positioning information. Under the fusion positioning of multiple positioning technologies, the drone can fly autonomously.

[0100] In some embodiments of the present application, the drone is a quad-rotor drone. The drone hardware mainly includes a controller, a communication module, a scanning camera, a visual camera, a laser ranging sensor, an IMU module, a UWB positioning tag, etc. Figure 1 shown.

[0101] In some embodiments of the present application, in order to facilitate the control of the drone and timely obtain various operating parameters of the drone, the drone inventory system also includes a control terminal, see Figure 1 shown.

[0102] The control terminal communicates with the drone controller and displays the operating parameters of the drone. The control terminal establishes a communication connection with the communication module on the drone through the local area network, and communicates with the drone controller through the communication module.

[0103] The control terminal is PC, PAD, smart phone, etc.

[0104] The control terminal is installed with interactive software, which is displayed to users in the form of an APP. The interactive software is used to perform operations such as flight path planning, remote control, and flight parameter setting for the drone. At the same time, the software can display the warehouse floor plan, the dynamic location information of the drone, and the real-time images detected by the onboard camera.

[0105] The drone inventory system of this embodiment plans the working path of the drone on the interactive software platform of the control terminal. Under the fusion positioning of multiple positioning technologies, the drone can fly autonomously and use the camera to scan each cargo information code to automatically count the warehouse cargo. The cargo information identified by the drone through the camera scan is transmitted to the interactive software on the control terminal through the communication module for display.

[0106] Of course, the above description is not a limitation of the present invention, and the present invention is not limited to the above examples. Changes, modifications, additions or substitutions made by ordinary technicians in this technical field within the essential scope of the present invention should also fall within the protection scope of the present invention.

Claims

1. A drone inventory system, characterized by: include: A shelf for storing goods, the goods having a goods information code; the ground in front of one end of the shelf has a first color mark, and the ground in front of the other end of the shelf has a second color mark; the ground in front of the shelf is provided with a shelf information code near the first color mark; The drone, after identifying the first color identification and the shelf information code, starts to identify the cargo information code of the cargo on the shelf; After identifying the second color mark, it ends the identification of the goods on the shelf; The drone includes a visual ranging module for measuring the relative position of the drone; The visual ranging module comprises: A visual camera is mounted on the drone and is used to capture images of the warehouse floor and send them to the drone controller; wherein a color-coded area is set on the warehouse floor; A laser ranging sensor is installed on the drone to detect the distance h between the visual camera and the ground and send it to the controller; The controller performs edge detection on the color identification area in a frame image captured by the visual camera and records the edge position, performs edge detection on the color identification area in the next frame image received and records the edge position, and subtracts the same edge position of the color identification area in the two frames of images to obtain the pixel displacement d of the color identification area; the actual displacement of the drone D=h×d / f, where f is the focal length of the visual camera.

2. The drone inventory system according to claim 1, characterized in that: The first color mark and the second color mark are both color bars, and the two color bars have different colors; The two color strips are arranged in parallel, and both color strips are perpendicular to the front surface of the shelf.

3. The drone inventory system according to claim 1, characterized in that: The shelf has multiple layers and multiple rows of cargo spaces, and there is a partition between two adjacent layers of cargo spaces, and the front end of each layer of partition has a different color; After the drone recognizes the first color identification and the shelf information code, it scans the cargo information code of each column of cargo up and down, recognizes the cargo information contained in the cargo information code, and saves the recognized cargo information in correspondence with the color of the partition under the cargo.

4. The drone inventory system according to claim 3, characterized in that: The drone comprises: A scanning camera, which is used to scan the shelf information code, the cargo information code, the first color mark, the second color mark, and the color of the front end of the partition; The controller is used to identify the first color identification and the shelf information code after receiving the first color identification and the shelf information code sent by the scanning camera, and then control the scanning camera to scan the cargo information code of each column of cargo up and down, identify the cargo information contained in the cargo information code, and save the identified cargo information in correspondence with the color of the partition below the cargo.

5. The drone inventory system according to claim 4, characterized in that: The UAV inventory system also includes a UWB positioning module; the UWB positioning module includes: at least three base stations, which are arranged in the warehouse; A UWB positioning tag is installed on the drone to detect the distance to each base station and send the detected distance to the drone controller; The controller takes each base station as the center of the circle and draws a circle according to the distance between each base station and the UWB positioning tag as the radius, determines the position of the UWB positioning tag through the intersection of the circles, and obtains the absolute position of the drone.

6. The drone inventory system according to claim 5, characterized in that: The drone also includes an IMU module for acquiring acceleration information and sending it to the controller; The controller processes the received acceleration information to obtain the relative position of the drone; The controller fuses the absolute position of the drone obtained by the UWB positioning module and the relative position of the drone obtained by the IMU module through a Kalman filter algorithm to obtain the absolute position of the drone after fusion.

7. The drone inventory system according to claim 5, characterized in that: The controller fuses the absolute position of the drone obtained by the UWB positioning module and the relative position of the drone obtained by the visual ranging module through a Kalman filter algorithm to obtain the absolute position of the drone after fusion.

8. The drone inventory system according to claim 5, characterized in that: The drone also includes: IMU module, used to obtain acceleration information and send it to the controller; Visual ranging module, used to measure the relative position of the drone; The controller processes the received acceleration information to obtain the relative position of the drone; The controller fuses the relative position of the drone obtained based on the IMU module and the relative position of the drone obtained based on the visual ranging module through the Kalman filtering algorithm to obtain the fused relative position; then fuses the fused relative position and the absolute position of the drone obtained based on the UWB positioning module through the Kalman filtering algorithm to obtain the fused absolute position of the drone.

9. The drone inventory counting system according to any one of claims 1 to 8, characterized in that: The drone inventory system also includes: A control terminal communicates with the controller of the drone and displays the operating parameters of the drone.

Citation Information

Cited By

  • Rotor unmanned aerial vehicle inventory taking method and device based on digital twinning and storage medium

    CN116339389A

  • Indoor storage unmanned aerial vehicle positioning and navigation method

    CN120668142A

  • Unmanned aerial vehicle positioning method and system

    CN121634169A

  • Digital twin-based rotor unmanned aerial vehicle inventory counting method and apparatus, and storage medium

    WO2024244579A1