Method for navigation and positioning of battery-swapping AGV using multiple navigation devices

Through the combination of multiple navigation devices, including lidar, depth camera and inertial sensor, the problem of poor positioning accuracy and environmental adaptability during battery swap is solved, and accurate battery swap operation in open areas is achieved, which improves the degree of intelligence.

CN115342798BActive Publication Date: 2024-11-15ANHUI GREEN BOAT TECH CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202210967493.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-08-12
Publication Date
2024-11-15
Estimated Expiration
2042-08-12

AI Technical Summary

Technical Problem

The prior art has problems such as low positioning accuracy and poor environmental adaptability during battery swap process, especially in the open area, it is difficult to achieve stability and expansion.

Method used

Multi-navigation equipment is used to combine lidar, depth camera, inertial sensor and QR code navigation, and through point cloud matching, visual recognition and error correction, the precise navigation and positioning of battery-swap AGV trolleys in narrow areas is achieved.

Benefits of technology

It realizes accurate battery swap operations in different environments, improves the navigation and positioning accuracy of battery swap AGV trolleys, simplifies the operation process, and improves the degree of intelligence.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115342798B_ABST
    Figure CN115342798B_ABST
Patent Text Reader

Abstract

The present invention provides a method for a battery-swapping AGV to use multiple navigation devices for navigation and positioning, including the following steps: the battery-swapping AGV obtains information about the surrounding environment through a laser radar sensor; matches and splices the newly collected point cloud from the laser radar into the original map to complete the map update; uses a depth camera, through the visual sensor thereon, to identify the drivable area in the surrounding environment and plan the path; combines with an inertial sensor to obtain accurate self-position. The present invention uses a device to scan the physical position of a closed space, draw an electronic map, and mark the starting point to achieve route planning based on the electronic map. Through the synergistic effect of multiple navigation devices, refined navigation and positioning are achieved, which is convenient for battery-swapping operations in different environments, simple to operate, and highly intelligent.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of battery replacement technology, and in particular to a method for a battery replacement AGV vehicle to perform navigation and positioning using multiple navigation devices. Background Art

[0002] Laser navigation is widely used in practice due to its high precision, but it is expensive and prone to positioning loss in environments without rich feature objects; QR code navigation is low-cost but requires long-term maintenance; inertial navigation is a natural navigation method, but the accumulated error of the sensor will cause drift; vision-based detection can identify rich features, but the error is large, and the current battery replacement method is limited to being carried out in built battery replacement stations and is difficult to expand to more areas. In order to facilitate the battery replacement operation of electric vehicles in more open areas, a device that can move freely in space (such as underground or above-ground parking lots) is designed to automatically replace the battery of the vehicle through intelligent technologies such as navigation, positioning and recognition.

[0003] Therefore, a method for a battery-swapping AGV to use multiple navigation devices for navigation and positioning is needed to achieve stable navigation, positioning, and battery-swapping operations in a small area. Summary of the invention

[0004] The present invention aims to provide a method for a battery-swapping AGV to use multiple navigation devices for navigation and positioning to overcome the above-mentioned problems or at least partially solve the above-mentioned problems.

[0005] To achieve the above object, the technical solution of the present invention is specifically implemented as follows:

[0006] The present invention provides a method for navigation and positioning of a battery-swapping AGV using multiple navigation devices, comprising the following steps:

[0007] Step 1: The battery-swapping AGV obtains information about the surrounding environment through a laser radar sensor;

[0008] Step 2: Match and stitch the newly collected point cloud from the LiDAR into the original map to complete the map update;

[0009] Step 3: Use the depth camera and its visual sensor to identify the drivable area in the surrounding environment and plan the path;

[0010] Step 4: Combine inertial sensors to obtain accurate self-position;

[0011] Step 5: After the battery-swapping AGV finds the target vehicle according to the navigation, it uses the 3D vision camera mounted on the battery-swapping AGV to collect image data in front of the vehicle, and performs posture recognition and positioning of the target object based on the features of the license plate and vehicle logo. It makes preliminary adjustments to the battery-swapping AGV based on the detection result information, and realizes the centering positioning of the battery-swapping AGV and the vehicle.

[0012] Step 6: Using the laser SLAM and QR code navigation of the battery swap AGV, the battery swap AGV navigates to the lifting position of the vehicle to be swapped, uses the QR code as an auxiliary feature, and corrects the accumulated error;

[0013] Step 7: Start the two 3D vision cameras on the battery-swapping AGV again to start taking pictures and collecting image data, detect the tire position and the distance between the camera and the tire, and adjust the posture of the battery-swapping AGV so that the distance between the 3D vision camera and the tire is appropriate;

[0014] Step eight, use a laser scanner to scan the directions of both ends of the vehicle bottom beam, detect the position of the lifting point, and confirm the position information twice. After meeting the established conditions, the battery-swapping AGV starts working.

[0015] As a further solution of the present invention, the depth camera recognizes and locates the front of the vehicle and recognizes and locates the license plate respectively.

[0016] As a further solution of the present invention, the laser scanner identifies and locates the wheels, and integrates the algorithm to accurately locate the posture of the vehicle body.

[0017] As a further solution of the present invention, in step three and step four, during the driving process of the battery-swapping AGV, due to changes in light and obstructions by external objects, the features of the laser radar scan will be fewer and its own position information cannot be calculated. At this time, a QR code reader is needed to read the QR code information on the path, that is, the QR code navigation method, to assist the battery-swapping AGV in finding its own position information.

[0018] As a further solution of the present invention, in step nine, a laser scanner is also used to identify and locate the screw features on the battery to achieve disassembly and grasping of the battery.

[0019] The present invention provides a method for a battery-swapping AGV to use multiple navigation devices for navigation and positioning, and the beneficial effects are: by scanning the physical position of a closed space through the device, an electronic map is drawn, and the route planning based on the electronic map is realized by marking the starting point; by scanning the feature points of the relative objects through the laser device, the relative position deviation is calculated, and the device is driven to move and correct the position to achieve relative position symmetry, and at the same time, the scanning head device is allowed to identify and control the refined movement of the device to achieve non-contact precise positioning in a small space and realize the docking of two devices; and by synergizing through multiple navigation devices, refined navigation and positioning are realized, which is convenient for battery-swapping operations in different environments, simple to operate, and highly intelligent. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative work.

[0021] Figure 1 It is a schematic diagram of the workflow of the present invention.

[0022] Figure 2 This is a partial flow chart of the posture adjustment during navigation of the battery-swapping AGV in the present invention.

[0023] Figure 3 This is a partial flow chart of the posture adjustment of the battery-swapping AGV during lifting in the present invention.

[0024] Figure 4 This is a schematic diagram of tire laser positioning in the present invention.

[0025] Figure 5 This is a schematic diagram of the position between the battery-swapping AGV and the battery-swapping vehicle in the present invention. DETAILED DESCRIPTION

[0026] The exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0027] See also Figure 1-5 The method for navigation and positioning of a battery-swapping AGV using multiple navigation devices provided by an embodiment of the present invention includes the following steps:

[0028] Step 1: The battery-swapping AGV obtains information about the surrounding environment through the laser radar sensor, optimizes the original data, and removes or filters some problematic data;

[0029] Step 2: Match and stitch the newly collected point cloud from the LiDAR into the original map to complete the map update;

[0030] Step 3: Use the depth camera and the visual sensor on it to identify the drivable area in the surrounding environment and plan the path;

[0031] Step 4: Combine inertial sensors to obtain the precise position and posture of the battery-swapping AGV.

[0032] Step 5: After the battery-swapping AGV finds the target vehicle according to the navigation, it uses the 3D vision camera mounted on the battery-swapping AGV to collect image data in front of the vehicle, and performs posture recognition and positioning of the target object based on the features of the license plate and vehicle logo. It makes preliminary adjustments to the battery-swapping AGV based on the detection result information, and realizes the centering positioning of the battery-swapping AGV and the vehicle.

[0033] Step 6: Using the laser SLAM and QR code navigation of the battery swap AGV, the battery swap AGV navigates to the lifting position of the vehicle to be swapped, uses the QR code as an auxiliary feature, and corrects the accumulated error;

[0034] Step 7: Start the two 3D vision cameras on the battery-swapping AGV again to start taking pictures and collecting image data, detect the tire position and the distance between the camera and the tire, and adjust the posture of the battery-swapping AGV so that the distance between the 3D vision camera and the tire is appropriate;

[0035] Step eight, use a laser scanner to scan the directions of both ends of the vehicle bottom beam, detect the position of the lifting point, and confirm the position information twice. After meeting the established conditions, the battery-swapping AGV starts working.

[0036] In steps three and four, during the driving process of the battery-swapping AGV, due to changes in light and obstructions from external objects, the features scanned by the laser radar are fewer and its own position information cannot be calculated. At this time, a QR code reader is needed to read the QR code information on the path, that is, the QR code navigation method, to assist the battery-swapping AGV in finding its own position information.

[0037] In step nine, a laser scanner is also used to identify and locate the screw features on the battery to enable disassembly and grasping of the battery.

[0038] During use of the present invention, the laser radar sensor obtains information about the surrounding environment, optimizes the original data, eliminates or filters some problematic data, and transmits it to an external processing terminal. The external processing terminal matches and splices the newly collected point cloud from the laser radar into the original map to complete the map update, uses a depth camera and the visual sensor thereon to identify the drivable area in the surrounding environment, plans a path, and combines with inertial sensors to obtain the precise position and posture of the battery-swapping AGV vehicle itself, transmits the planned path and the battery-swapping AGV vehicle's own position and posture to the electronic map, and simultaneously transmits this information to the battery-swapping AGV vehicle, and controls the battery-swapping AGV vehicle to move according to the planned path.

[0039] The battery-swapping AGV moves according to the plan, and after finding the target vehicle through navigation, the 3D vision camera mounted on the battery-swapping AGV collects image data in front of the vehicle, and recognizes and locates the target object based on features such as the license plate and logo. The battery-swapping AGV is initially adjusted based on the detection result information to align the battery-swapping AGV with the vehicle. After adjusting the posture of the battery-swapping assembly through the 3D vision camera, the battery-swapping AGV is in the center of the front of the vehicle. At the same time, the battery-swapping AGV is equipped with a laser radar. The laser radar is placed directly in front of the vehicle, directly below the vehicle front, and the four wheels are scanned to obtain the parking position of the vehicle body and adjust the position of the battery swap assembly. At this time, the four tires are scanned to obtain the laser point cloud map, and the outline of the wheel is identified on the point cloud image. The outline of the wheel is used to determine the body posture, and the position of the battery swap assembly is fine-tuned to complete the vehicle centering positioning. The battery swap AGV relies on navigation to drive to the front of the vehicle to be parked. The battery swap AGV is required to be parallel to the front of the vehicle, and the distance from the front of the vehicle is set to ≥1500mm, with an error of ≤50mm.

[0040] Two 3D cameras are installed at both ends of the battery-swapping AGV to detect the position and distance of the tires. When the two 3D vision cameras are at the same distance from the corresponding tires, laser is used to confirm again. Once the conditions are met, the battery-swapping AGV is successfully positioned.

[0041] The above are only embodiments of the present application and are not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included within the scope of the claims of the present application.

Claims

1. A method for navigation and positioning of a battery-swapping AGV using multiple navigation devices, characterized in that: The following steps are involved: Step 1: The battery-swapping AGV obtains information about the surrounding environment through a laser radar sensor; Step 2: Match and stitch the newly collected point cloud from the LiDAR into the original map to complete the map update; Step 3: Use the depth camera and its visual sensor to identify the drivable area in the surrounding environment and plan the path; Step 4: Combine inertial sensors to obtain accurate self-position; Step 5: After the battery-swapping AGV finds the target vehicle according to the navigation, it uses the 3D vision camera mounted on the battery-swapping AGV to collect image data in front of the vehicle, and performs posture recognition and positioning of the target object based on the features of the license plate and vehicle logo. It makes preliminary adjustments to the battery-swapping AGV based on the detection result information, and realizes the centering positioning of the battery-swapping AGV and the vehicle. Step 6: Using the laser SLAM and QR code navigation of the battery swap AGV, the battery swap AGV navigates to the lifting position of the vehicle to be swapped, uses the QR code as an auxiliary feature, and corrects the accumulated error; Step 7: Start the two 3D vision cameras on the battery-swapping AGV again to start taking pictures and collecting image data, detect the tire position and the distance between the camera and the tire, and adjust the posture of the battery-swapping AGV so that the distance between the 3D vision camera and the tire is appropriate; Step 8: Use a laser scanner to scan the two ends of the vehicle bottom beam, detect the position of the lifting point, and confirm the position information twice. After meeting the established conditions, the battery-swapping AGV starts working.

2. The method for navigation and positioning of a battery-swapping AGV using multiple navigation devices according to claim 1 is characterized in that: The depth camera recognizes and locates the front of the vehicle and recognizes and locates the license plate respectively.

3. The method for navigation and positioning of a battery-swapping AGV using multiple navigation devices according to claim 1 is characterized in that: The laser scanner identifies and locates the wheels, and integrates the algorithm to accurately locate the body position.

4. The method for navigation and positioning of a battery-swapping AGV using multiple navigation devices according to claim 1 is characterized in that: In step three and step four, during the driving process of the battery-swapping AGV, due to changes in light and obstructions from external objects, the features scanned by the laser radar are fewer and its own position information cannot be calculated. At this time, a QR code reader is needed to read the QR code information on the path, that is, the QR code navigation method, to assist the battery-swapping AGV in finding its own position information.

5. The method for navigation and positioning of a battery-swapping AGV using multiple navigation devices according to claim 1 is characterized in that: In step nine, a laser scanner is also used to identify and locate the screw features on the battery to enable disassembly and grasping of the battery.

Citation Information

Patent Citations

  • AGV with multiple sensors and high-accuracy positioning method thereof

    CN110514210A

  • Battery replacement method and device, computer equipment and storage medium

    CN111231731A

  • Vehicle for handling truck batteries and positioning system thereof

    CN112611370A

  • procedure for removing feed from clamp silos

    DE102014116882A1

  • Autonomous traveling apparatus, autonomous traveling system, and program

    JP2019067215A