An AGV obstacle avoidance method based on lidar and depth camera data fusion

A lidar and depth camera technology, applied in motor vehicles, transportation and packaging, two-dimensional position/channel control, etc., can solve the problem that robots cannot cope with complex environments well, the obstacle avoidance scheme is single, and there is no avoidance. It can improve the ability of identification and avoidance, ensure safety, and reduce hardware costs.

Active Publication Date: 2022-04-08
泗阳县人民医院
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, the existing obstacle avoidance schemes of intelligent robots have the defect of singleness, which makes the robot unable to cope with the complex environment well, and the collected data does not have enough information to deal with the obstacle avoidance operation
If you consider using multi-line laser radar, although the data contains multi-dimensional information, it will help improve the adaptability of the robot, but the hardware cost will be greatly increased.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An AGV obstacle avoidance method based on lidar and depth camera data fusion
  • An AGV obstacle avoidance method based on lidar and depth camera data fusion
  • An AGV obstacle avoidance method based on lidar and depth camera data fusion

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0044] Such as Figure 1-3 As shown, an AGV obstacle avoidance method based on lidar and depth camera data fusion, including a controller installed on the AGV for data processing, the controller uses the NVIDIA Jetson TX2 control board, and the controller is equipped with data processing unit, decision-making unit and control unit; the modeling platform of NVIDIA Jetson TX2 control board is Ubuntu operating system.

[0045] It also includes the lidar installed on the AGV to monitor the surrounding environment and the hardware equipment that can obtain depth images and point cloud images. The hardware equipment for depth images and point cloud images includes scanning and tracking obstacles in the direction of AGV travel installed on the front of the AGV The depth camera, and the ordinary camera installed on the AGV to collect house number images; the laser radar, depth camera and ordinary camera are respectively connected to the controller signal for signal transmission;

[0...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an AGV obstacle avoidance method based on lidar and depth camera data fusion, comprising: a controller; a data processing unit, a decision-making unit and a control unit are arranged in the controller; and a laser installed at the front end of the AGV Radar and depth cameras, and ordinary cameras installed on the AGV; the lidar, depth cameras, and ordinary cameras are respectively connected to the controller signal for signal transmission. In the present invention, the combination of laser radar data and depth camera data is used to scan and track obstacles in the direction of AGV travel. By preprocessing the sensor data, a corresponding data node is established in the system for data transmission. The controller and Nodes communicate to obtain different data. The data processing unit is used to process sensor data and run algorithms for data processing. The processing results are determined by the decision-making unit to determine how the AGV avoids the current situation, and the avoidance method is transmitted to the underlying motion control unit for Complete evasive maneuvers.

Description

technical field [0001] The invention relates to an automatic drug distribution system, in particular to an AGV obstacle avoidance method based on laser radar and depth camera data fusion. Background technique [0002] As an emerging technology that has emerged in recent decades, intelligent robots and their automation technology have continued to grow and enter people's lives. In order to make robots better serve human life, the development of robots is slowly moving from the workshop assembly line From assembly robots to indoor sweeping robots, ordering robots in restaurants, etc. Robotics is increasingly becoming an integral part of human life. [0003] However, the existing obstacle avoidance solutions for intelligent robots have the defect of singleness, which makes the robot unable to cope with complex environments well, and the collected data does not have enough information to deal with obstacle avoidance operations. If multi-line laser radar is considered, although...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G05D1/02
CPCG05D1/024G05D1/0246G05D1/0214G05D1/0221G05D1/0276G05D2201/02
Inventor 李勇
Owner 泗阳县人民医院
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products