DeeplabV3 +-based instant positioning and mapping method for obstacles in unfamiliar sea area

A technology of map construction and obstacles, applied in the field of unmanned boats, can solve the problems of high false alarm rate, long baseline stability, poor matching accuracy, etc., and achieve the effect of optimizing training results, enriching diversity, and quickly separating and positioning

Pending Publication Date: 2022-05-06
航天时代(青岛)海洋装备科技发展有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, the detection of marine obstacles generally adopts the YOLO series network model, which has good detection results for predictable obstacles, but cannot identify unpredictable obstacles; the positioning method of marine obstacles mostly uses laser radar or Binocular camera positioning method
The laser clustering met

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • DeeplabV3 +-based instant positioning and mapping method for obstacles in unfamiliar sea area
  • DeeplabV3 +-based instant positioning and mapping method for obstacles in unfamiliar sea area
  • DeeplabV3 +-based instant positioning and mapping method for obstacles in unfamiliar sea area

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0080] Example 1:

[0081] as Figure 1 As shown in, the implementation steps of an obstacle real-time location and map construction method in unfamiliar sea areas based on deeplabv3 + are as follows:

[0082] A. Through the joint calibration of lidar and visible camera, the transformation relationship between lidar coordinate system and visible camera coordinate system is obtained, that is, the rotation matrix and translation vector from lidar coordinate system to visible camera coordinate system;

[0083] The parameters of the camera are calibrated by using the white checkerboard; Prepare the checkerboard calibration board with no white edge on the edge, set the acquisition frequency of lidar and visible camera to 10Hz, and use the rosbag command in ROS to synchronously collect the checkerboard data of visible camera and lidar; The corner extraction algorithm is used to extract the coordinates of the checkerboard corner in the visible image; The laser point cloud processing soft...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a DeeplabV3 +-based instant positioning and mapping method for obstacles in an unfamiliar sea area, and the method comprises the steps: firstly, projecting a laser point cloud to an image based on a conversion relation between a laser radar coordinate system and a visible light camera coordinate system, and obtaining a laser point cloud projection coordinate in an image coordinate system; performing segmentation prediction on the image based on a Deeplabv3 + semantic segmentation network model to obtain a segmented category image, making an obstacle mask by using an obstacle category to obtain a laser point cloud corresponding to an obstacle, and finally, according to a conversion relation between a laser radar coordinate system and an IMU coordinate system, obtaining a laser point cloud corresponding to the obstacle. And constructing a surrounding obstacle map taking the unmanned ship as the center of the map according to the coordinates of the laser point cloud corresponding to the obstacle in the laser radar coordinate system and the attitude information of the unmanned ship acquired by the IMU. According to the invention, accurate extraction of predictable and unpredictable obstacle contour information is realized by using a Deeplabv3 + semantic segmentation network model, and accurate detection and positioning of offshore predictable and unpredictable obstacles are realized in combination with a visible light camera and a laser radar.

Description

technical field [0001] The invention belongs to the technical field of unmanned boats, and in particular relates to a DeeplabV3+-based real-time obstacle positioning and map construction method in unfamiliar sea areas. Background technique [0002] Unmanned boats have been used more and more widely in recent years. For example, in the military field, unmanned boats can be widely used in ship protection, anti-submarine warfare, logistics supplies, information investigation and other fields. In the civilian field, unmanned boats can be widely used in Marine environmental monitoring, seabed surveying and mapping, emergency response and sea area search and rescue work and other fields. Since the unmanned boat and its equipment are often expensive, if it collides with objects in the ocean during navigation, it will seriously damage the unmanned boat and equipment. If it collides with a ship, the consequences of injuring people may be even more unimaginable. At present, technical...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T17/05G06T7/73G06T7/90
CPCG06T17/05G06T7/73G06T7/90G06T2207/30244
Inventor 杨长坤刘柳王潇文龙贻彬胡常青李清洲
Owner 航天时代(青岛)海洋装备科技发展有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products